Development and Validation of a Questionnaire to Measure Social Competencies for Undergraduate Students
DOI:
https://doi.org/10.15503/10.15503.jecs2025.2.535.553Keywords:
social competency, social skills, social functioning, skills development, confirmatory factor analysisAbstract
Aim. This study aimed to develop and validate a social competencies scale (SOCS) for undergraduate students and examine the mean differences in SOCS across gender and family income.
Methods. This cross-sectional study comprised six stages. Stage I: Items Generation and Selection, the initial SOCS was constructed through literature reviews. Stage II: Expert Reviewing, the items were further reviewed by experts to ensure content validity, clarity, and alignment with theoretical constructs. Stage III: Pilot Study, a pilot study was conducted with 20 undergraduate students. Feedback from this study was used to refine the wording and structure of the items. Stage IV: Construction of SOCS, this survey was administered to students from 15 universities in Thailand using a 5-point Likert scale. Exploratory Factor Analysis (EFA) was performed on responses from 955 students to identify the structure of SOCS. Stage V: Scale Validation, the SOCS measurement model was tested for reliability and construct validity using Confirmatory Factor Analysis (CFA). Stage VI: Comparison of Means Difference, independent t-test and ANOVA were conducted to compare mean differences in SOCS.
Results. The final SOCS model included six latent factors: self-responsibility (SRS), social relationships (REL), self-awareness (AWR), teamwork-building (TWB), social networking (NET), and communication (COM). The second-order CFA of SOCS fits the data adequately. Female students scored higher on SRS, REL, TWB, and COM, indicating significant gender differences but there was not significantly impacted by family income.
Conclusions. The results of this study demonstrated the basic psychometric properties of a new questionnaire to measure social competencies for undergraduate students that can be applied in similar contexts.
Downloads
References
Alban Conto, C., Akseer, S., Dreesen, T., Kamei, A., Mizunoya, S., & Rigole, A. (2021). Potential effects of COVID-19 school closures on foundational skills and Country responses for mitigating learning loss. International Journal of Educational Development, 87, Article 102434. https://doi.org/10.1016/j.ijedudev.2021.102434
Anggraeni, T., & Tarmidi, D. T. (2021). Analysis of intrapersonal skills and interpersonal skills on the welfare of micro entrepreneurs in the COVID-19 era. International Journal of Economics, Business and Accounting Research (IJEBAR), 5(4). https://doi.org/10.29040/ijebar.v5i4.3274
Ashiq, M., Jabeen, F., & Mahmood, K. (2023). Workplace creativity and job satisfaction of academic librarians: A perspective of distributed leadership theory. Information Development, 39(3), 500-511. https://doi.org/10.1177/02666669221136864
Atabey, N., & TopÇU, M. S. (2021). The Relationship between Turkish Middle School Students’ 21st Century Skills and STEM Career Interest: Gender Effect. Journal of Education in Science Environment and Health, 7(2), 86-103. https://doi.org/10.21891/jeseh.739586
Ayaz, A., & Yanartaş, M. (2020). An analysis on the unified theory of acceptance and use of technology theory (UTAUT): Acceptance of electronic document management system (EDMS). Computers in Human Behavior Reports, 2, Article 100032. https://doi.org/10.1016/j.chbr.2020.100032
Baird, A. M., & Parayitam, S. (2019). Employers’ ratings of importance of skills and competencies college graduates need to get hired: Evidence from the New England region of USA. Education + Training, 61(5), 622-634. https://doi.org/10.1108/ET-12-2018-0250
Bandura, A. (1971). Social learning theory. General Learning Press.
Baumeister, R. F., & Sommer, K. L. (1997). What do men want? Gender differences and two spheres of belongingness: Comment on Cross and Madson (1997). Psychological Bulletin, 122(1), 38-44. https://doi.org/10.1037/0033-2909.122.1.38
Bollen, K. A. (1989). A new incremental fit index for general structural equation models. Sociological Methods & Research, 17(3), 303-316. https://doi.org/10.1177/0049124189017003004
Bolsoni-Silv, A. T., Marturano, E. M., & Loureiro, S. R. (2011). Estudos de confiabilidade e validade do questionário de respostas socialmente habilidosas versão para pais - QRSH-Pais [Studies in reliability and validation of the Social Skills Questionnaire-Parents Version (SSQ-P).]. Psicologia: Reflexão e Crítica, 24(2), 227-235. https://doi.org/10.1590/S0102-79722011000200003
Borbely, M., & Némethi-Takács, M. (2023). Digital competence landscape in public libraries: Examining the role of age and gender in the development of digital skills. Performance Measurement and Metrics, 24(3/4), 155-175. https://doi.org/10.1108/PMM-03-2022-0012
Cebollero-Salinas, A., Cano-Escoriaza, J., & Orejudo, S. (2022). Social networks, emotions, and education: Design and validation of e-COM, a scale of socio-emotional interaction competencies among adolescents. Sustainability, 14(5), Article 2566. https://doi.org/10.3390/su14052566
Chitralada, C., & Ahmad, M. M. (2021). Success or failure of the thai higher education development—critical factors in the policy process of quality assurance. Sustainability, 13(17), Article 9486. https://doi.org/10.3390/su13179486
Chonsalasin, D., & Khampirat, B. (2022). The impact of achievement goal orientation, learning strategies, and digital skill on engineering skill self-efficacy in Thailand. IEEE Access, 10, 11858-11870. https://doi.org/10.1109/ACCESS.2022.3146128
Chyung, S. Y., Barkin, J. R., & Shamsy, J. A. (2018). Evidence-based survey design: The use of negatively worded items in surveys. Performance Improvement, 57(3), 16-25. https://doi.org/10.1002/pfi.21749
Cooper, K., & Stewart, K. (2021). Does household income affect children’s outcomes? A systematic review of the evidence. Child Indicators Research, 14(3), 981-1005. https://doi.org/10.1007/s12187-020-09782-0
Cordier, R., Speyer, R., Chen, Y. W., Wilkes-Gillan, S., Brown, T., Bourke-Taylor, H., Doma, K., & Leicht, A. (2015). Evaluating the psychometric quality of social skills measures: A systematic review. PLoS One, 10(7), Article e0132299. https://doi.org/10.1371/journal.pone.0132299
Ćurlin, T., Pejic Bach, M., & Miloloža, I. (2020). Presentation skills of business and economics students: Cluster analysis. Croatian Review of Economic, Business and Social Statistics, 6, 27-42. https://doi.org/10.2478/crebss-2020-0009
Daines, C. L., Hansen, D., Novilla, M. L. B., & Crandall, A. (2021). Effects of positive and negative childhood experiences on adult family health. BMC Public Health, 21(1), Article 651. https://doi.org/10.1186/s12889-021-10732-w
Damang, T., Thammasit, P., & Rujimatapas, S. (2021). Karn Phatthana Tua Bongchi Thaksa Tang Sangkhom Khong Phu Borihan Sathan Sueksa Sangkat Samnakngan Khet Phuentee Kansueksa Matthayomsueksa Khet 38 [Development indicators of leadership soft skills of the administrators under the secondary educational service area office 38]. Journal of Roi Kaensarn Academi, 6(6), 258-270. https://so02.tci-thaijo.org/index.php/JRKSA/article/view/249306
Dziuban, C. D., & Shirkey, E. C. (1974). When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin, 81(6), 358-361. https://doi.org/10.1037/h0036316
Flinkenflogel, N., Novin, S., Huizinga, M., & Krabbendam, L. (2017). Gender moderates the influence of self-construal priming on fairness considerations. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00503
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312
Fundinho, J. F., Ferreira-Alves, J., Braz, A. C., Del Prette, Z. A. P., & Del Prette, A. (2021). Measuring social skills: Cultural adaptation and validation of the SSI-Del Prette. The Journal of Adult Protection, 23(5), 337-350. https://doi.org/10.1108/JAP-03-2021-0012
García-Álvarez, J., Vázquez-Rodríguez, A., Quiroga-Carrillo, A., & Priegue Caamaño, D. (2022). Transversal competencies for employability in university graduates: A systematic review from the employers’ perspective. Education Sciences, 12(3), Article 204. https://doi.org/10.3390/educsci12030204
Garrote, H. A., & Moser, O. E. (2021). The social relationships of students with intellectual disabilities in inclusive classrooms. Empirische Sonderpädagogik 13(3), 201-215. https://doi.org/10.5167/uzh-209713
González-Pérez, L. I., & Ramírez-Montoya, M. S. (2022). Components of education 4.0 in 21st century skills frameworks: systematic review. Sustainability, 14(3), Article 1493. https://doi.org/10.3390/su14031493
Griffiths, A. J., Hurley-Hanson, A. E., Giannantonio, C. M., Nash, A. M., Walrod, W., Walrod, P., Torres, R., & Delgado, R. (2024). Identifying critical employability skills for employment success of autistic individuals: A content analysis of job postings. Journal of Research in Special Educational Needs, 24(3), 566-577. https://doi.org/10.1111/1471-3802.12651
Hair Jr, J. F., Babin, B. J., & Krey, N. (2017). Covariance-based structural equation modeling in the Journal of Advertising: Review and recommendations. Journal of Advertising, 46(1), 163-177. https://doi.org/10.1080/00913367.2017.1281777
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis: A global perspective. Pearson.
Han, H. S., & Kemple, K. M. (2006). Components of social competence and strategies of support: Considering what to teach and how. Early Childhood Education Journal, 34, 241-246. https://doi.org/10.1007/s10643-006-0139-2
Hoffman, A. J., McGuire, L., Rutland, A., Hartstone-Rose, A., Irvin, M. J., Winterbottom, M., Balkwill, F., Fields, G. E., & Mulvey, K. L. (2021). The relations and role of social competencies and belonging with math and science interest and efficacy for adolescents in informal STEM programs. Journal of Youth and Adolescence, 50(2), 314-323. https://doi.org/10.1007/s10964-020-01302-1
IMD. (2020, June). IMD world competitiveness ranking 2020: One year change. International Institute for Management Development (IMD). https://www.imd.org/news/competitiveness/updates-imd-2020-world-competitiveness-ranking-revealed/
John, E., Mwakalobo, B. S., & Bengesi, K. (2023). Influence of social competence on performance of small and medium enterprises (SMES): Empirical evidence from Tanzania’s manufacturing SMES. Journal of Co-operative and Business Studies (JCBS), 6(1). https://doi.org/10.2023/jcbs.v6i1.71
Junge, C., Valkenburg, P. M., Deković, M., & Branje, S. (2020). The building blocks of social competence: Contributions of the consortium of individual development. Developmental Cognitive Neuroscience, 45, Article 100861. https://doi.org/10.1016/j.dcn.2020.100861
Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141-151. https://doi.org/10.1177/001316446002000116
Khampirat, B. (2020). The relationship between paternal education, self-esteem, resilience, future orientation, and career aspirations. PLoS One, 15(12), Article e0243283. https://doi.org/10.1371/journal.pone.0243283
Khampirat, B. (2021a). The impact of work-integrated learning and learning strategies on engineering students’ learning outcomes in Thailand: A multiple mediation model of learning experiences and psychological factors. IEEE Access, 9, 111390-111406. https://doi.org/10.1109/ACCESS.2021.3055620
Khampirat, B. (2021b). Relationships between ICT competencies related to work, self-esteem, and self-regulated learning with engineering competencies. PLoS One, 16(12), Article e0260659. https://doi.org/10.1371/journal.pone.0260659
Khampirat, B. (2024). Psychometric characteristics of the career adapt-abilities scale in Thai undergraduate students: A multiple indicators multiple causes model. Frontiers in Psychology, 15, Article 1338401. https://doi.org/10.3389/fpsyg.2024.1338401
Khampirat, B., & Pop, C. (2017). Labour market needs and graduate competence: An examination of the gap between employer expectations and new engineering graduate performance in Thailand. In K. E. Zegwaard & M. Ford (Eds.), Refereed Proceedings of the 20 th WACE World Conference on Cooperative and Work-Integrated Education, 2017, Chiang Mai, Thailand (pp. 147-154)
Kim, Y. K., Yu, M., Moon, S. S., Maleku, A., Um, M. Y., & Tefera, G. M. (2022). Sociodemographic characteristics, preventive behaviors, and the mental health status of social work students in the US during the COVID-19 pandemic. Social Work in Mental Health, 20(5), 578-603. https://doi.org/10.1080/15332985.2022.2047870
Koszałka-Silska, A., Korcz, A., & Wiza, A. (2021). The impact of physical education based on the adventure education programme on self-esteem and social competences of adolescent boys. International Journal of Environmental Research and Public Health, 18(6), Article 3021. https://doi.org/10.3390/ijerph18063021
Kunchai, J., Chonsalasin, D., & Khampirat, B. (2021). Psychometric properties and a multiple indicators multiple cause model of the career aspiration scale with college students of rural Thailand. Sustainability, 13(18), Article 10377. https://doi.org/10.3390/su131810377
Leganés-Lavall, E. N., & Pérez-Aldeguer, S. (2016). Social competence in higher education questionnaire (CCSES): Revision and psychometric analysis. Frontiers in Psychology, 7, Article 1484. https://doi.org/10.3389/fpsyg.2016.01484
Lertdechapata, K., & Pimthong, P. (2021). A comparison of students’ competencies of Thai and international documents. Kasetsart Journal of Social Sciences, 42(4), 904–913. https://doi.org/10.34044/j.kjss.2021.42.4.26
Liang, S., Dong, M., Zhao, H., Song, Y., & Yang, A. (2022). Mindfulness and life satisfaction: The moderating effect of self-control and the moderated moderating effect of resilience. Personality and Individual Differences, 185, Article 111241.
Llorent, V. J., González-Gómez, A. L., Farrington, D. P., & Zych, I. (2020). Social and emotional competencies and empathy as predictors of literacy competence. Psicothema, 32(1), 47-53. https://doi.org/10.7334/psicothema2019.106
Major, S. O., Seabra-Santos, M. J., Martin, R. P., & Ventura, M. F. (2023). Preschoolers’ social skills and behavior problems: A cross-cultural exploratory study of Angolan and Portuguese teachers’ perceptions. Current Psychology, 42(2), 932-945. https://doi.org/10.1007/s12144-021-01375-6
Mallinckrodt, B. (2000). Attachment, social competencies, social support, and interpersonal process in psychotherapy. Psychotherapy Research, 10(3), 239-266. http://dx.doi.org/10.1093/ptr/10.3.239
Marín-López, I., Zych, I., Ortega-Ruiz, R., Hunter, S. C., & Llorent, V. J. (2020). Relations among online emotional content use, social and emotional competencies and cyberbullying. Children and Youth Services Review, 108, Article 104647. https://doi.org/10.1016/j.childyouth.2019.104647
Matczak, A. (2001). KKS Kwestionariusz kompetencji społecznych [KKS Social competence questionnaire]. Pracownia Testów Psychologicznych Polskiego Towarzystwa Psychologicznego.
McTaggart, V., McGill, R., & Stephens, S. (2022). Gender differences in the development of children's social and emotional competencies during the pre-school year. Early Child Development and Care, 192(12), 1952-1966. https://doi.org/10.1080/03004430.2021.1957859
Ministry of Higher Education, Science, Research and Innovation (MHESI). (2023). The graduate employment. . https://employ.mhesi.go.th/index.php/MTJ8fG1haW4vZGV0YWlsc3ViMmxldmVsMi8yNTYxLzI1NjU
MOE. (2019). Prakat Krasuang Sueksathikan Rueang Mattrathan Khunnawut Radap Parinyatri Sakha Kharusart Lae Saka Sueksasart (Laksoot See Pi) Ph. S. 2562 [Announcement of Thai Qualification Framework (TQF): A bachelor's degree in education (four-year programs) B.E. 2562]. Ministry of Education (MOE), Thailand.
MOE. (2022). Raingan Prajam Pi 2565: Krasuang Sueksathikarn [Anual report 2022: Ministry of education]. Ministry of Education (MOE), Thailand.
Mwita, K., Kinunda, S., Obwolo, S., & Mwilongo, N. (2023). Soft skills development in higher education institutions: Students’ perceived role of universities and students’ self-initiatives in bridging the soft skills gap. International Journal of Research in Business and Social Science (2147- 4478). 12(3), 505-513. https://doi.org/10.20525/ijrbs.v12i3.2435
Naukkarinen, J., & Bairoh, S. (2022). Gender differences in professional identities and development of engineering skills among early career engineers in Finland. European Journal of Engineering Education, 47(1), 85-101. https://doi.org/10.1080/03043797.2021.1929851
Negoescu, A. G., Boştină-Bratu, S., & Morar, L.-L. (2019). Strategic and social competences in the foreign language class. Scientific Bulletin, 24(1), 61-66. https://doi.org/10.2478/bsaft-2019-0007
Saphaphatthanakansetthakit Lae Sangkhom Haengchat (NESDC). (2023). Phaen Phatthana Setthakit Lae Sangkhom Haeng Chat Chabap Thi 13 Ph.S. 2566-2570 [The thirteenth national economic and social development plan 2023-2027]. Office of the National Economic and Social Development Council (ONESDC), Thailand.
Netemeyer, R. G., Bearden, W. O., & Sharma, S. (2003). Scaling procedures: Issues and applications. Sage. https://doi.org/10.4135/9781412985772
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
Nusrat, M., & Sultana, N. (2019). Soft skills for sustainable employment of business graduates of Bangladesh. Higher Education, Skills and Work-Based Learning, 9(3), 264-278. https://doi.org/10.1108/HESWBL-01-2018-0002
O'Connor, S., Odewusi, T., Smith, P. M., & Booth, R. G. (2022). Digital professionalism on social media: The opinions of undergraduate nursing students. Nurse Education Today, 111, Article 105322. https://doi.org/10.1016/j.nedt.2022.105322
Samnakngan Lekhatikarn Sapha Kan Sueksa (OEC) (2019). Research report about the research and development of grades 1 to 3 competencies. https://www.thaiedreform.org/wp-content/uploads/2019/08/Core_competency_01.pdf
Owusu, J., Hayat, N., Oppong, P. K., & Owusu-Ansah, W. (2022). Achieving entrepreneurial intention through entrepreneurial orientation, social network ties, and market intelligence generation perspectives. International Journal of Research in Business and Social Science, 11(6), 86-97. https://doi.org/10.20525/ijrbs.v11i6.1901
Pagnoccolo, J., & Bertone, S. (2021). The apprentice experience: The role of interpersonal attributes and people-related generic skills. Education + Training, 63(2), 313-327. https://doi.org/10.1108/ET-05-2020-0116
Pető, R., & Reizer, B. (2021). Gender differences in the skill content of jobs. Journal of Population Economics, 34(3), 825-864. https://doi.org/10.1007/s00148-021-00825-6
Pirsl, D., Pirsl, T., & Ljajic, S. (2019). Communication and soft skills of hybrid sports science distance learning mode students Professional conference contribution,
Pop, C., & Khampirat, B. (2019). Self-assessment instrument to measure the competencies of Namibian graduates: Testing of validity and reliability. Studies in Educational Evaluation, 60, 130-139. https://doi.org/10.1016/j.stueduc.2018.12.004
Portela-Pino, I., Alvariñas-Villaverde, M., & Pino-Juste, M. (2021). Socio-emotional skills in adolescence. Influence of personal and extracurricular variables. International Journal of Environmental Research and Public Health, 18(9), Article 4811. https://doi.org/10.3390/ijerph18094811
Poveda-Brotons, R., Izquierdo, A., Perez-Soto, N., Pozo-Rico, T., Castejón, J.-L., & Gilar-Corbi, R. (2024). Building paths to success: A multilevel analysis of the effects of an emotional intelligence development program on the academic achievement of future teachers. Frontiers in Psychology, 15, Article 1377176. https://doi.org/10.3389/fpsyg.2024.1377176
Renatovna, A. G., & Renatovna, A. S. (2020). Developing critical thinking on elementary class pupils is the most important factor for preparing social relationship. Journal of Critical Reviews, 7(17), 438-448. https://doi.org/10.31838/jcr.07.17.61
Rovinelli, R. J., & Hambleton, R. K. (1977). On the use of content specialists in the assessment of criterion-referenced test item validity. Tijdschrift voor Onderwijsresearch, 2(2), 49-60.
Saga, T., Tanaka, H., Matsuda, Y., Morimoto, T., Uratani, M., Okazaki, K., Fujimoto, Y., & Nakamura, S. (2023). Automatic evaluation-feedback system for automated social skills training. Scientific Reports, 13(1), Article 6856. https://doi.org/10.1038/s41598-023-33703-0
Salovey, P., & Mayer, J. D. (1990). Emotional intelligence. Imagination, Cognition and Personality, 9(3), 185-211. https://doi.org/10.2190/dugg-p24e-52wk-6cdg
Sa-Nguanmanasak, T., & Khampirat, B. (2019). Comparing employability skills of technical and vocational education students of Thailand and Malaysia: A case study of international industrial work-integrated learning. Journal of Technical Education and Training, 11(3), 94-110. https://doi.org/10.30880/jtet.2019.11.03.012
Satimanon, T. (2017). Thailand’s labor mismatch: Contemporary situations and solutions. NIDA Case Research Journal, 9(1), Article 58.
Schoon, I. (2009). Measuring social competencies. RatSWD Working Paper, 58. https://doi.org/10.2139/ssrn.1447882
Schoon, I. (2021). Towards an Integrative Taxonomy of Social-Emotional Competences. Frontiers in Psychology, 12, Article 515313. https://doi.org/10.3389/fpsyg.2021.515313
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of educational research, 99(6), 323-338. https://doi.org/10.3200/JOER.99.6.323-338
Stolz, R. C., Blackmon, A. T., Engerman, K., Tonge, L., & McKayle, C. A. (2022). Poised for creativity: Benefits of exposing undergraduate students to creative problem-solving to moderate change in creative self-efficacy and academic achievement. Journal of Creativity, 32(2), Article 100024. https://doi.org/10.1016/j.yjoc.2022.100024
Succi, C., & Canovi, M. (2020). Soft skills to enhance graduate employability: Comparing students and employers’ perceptions. Studies in Higher Education, 45(9), 1834-1847. https://doi.org/10.1080/03075079.2019.1585420
Thomas, D. (2020). Social media addiction, critical thinking and achievement emotions among EFL students in Thailand. Asia Pacific Journal of Educators and Education, 35(1), 157-171. https://doi.org/10.21315/apjee2020.35.1.9
Thomas, S., Kågström, A., Eichas, K., Inam, A., Ferrer-Wreder, L., & Eninger, L. (2023). Children’s social emotional competence in Pakistan and Sweden: Factor structure and measurement invariance of the Social Competence Scale (teacher edition). Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1020963
Vandeweyer, M., Espinoza, R., Reznikova, L., Lee, M., & Herabat, T. (2020). Thailand’s education system and skills imbalances: Assessment and policy recommendations (Working paper No. 1641). OECD Publishing. https://doi.org/10.1787/b79addb6-en
Xi, C., & Wang, L. (2024). How parental migration status affects early development of rural children: The indirect role of family socioeconomic status and home environment. Early Education and Development, 35(2), 169-187. https://doi.org/10.1080/10409289.2022.2119798
Downloads
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 Buratin Khampirat, Kwanruan Pusaboon, Phanommas Bamrungsin, Dissakoon Chonsalasin
This work is licensed under a Creative Commons Attribution 4.0 International License.
CC-BY
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal. All authors agree for publishing their email adresses, affiliations and short bio statements with their articles during the submission process.
