MEASURING INVARIANCE OF THE UNIVERSITY STUDENT ENGAGEMENT INVENTORY IN CHILEAN UNIVERSITY STUDENTS

Jorge Maluenda-Albornoz; Juan Lira-Munizaga; José Berríos-Riquelme; Matías Zamorano-Veragua; Rodrigo Díaz-Sepúlveda

doi:10.4067/s0718-50652024000100224

Autores

Jorge Maluenda-Albornoz Industrial Engineering Department. University of Concepción https://orcid.org/0000-0001-8148-4948
Juan Lira-Munizaga Facultad de Psicología y Humanidades. Universidad San Sebastián https://orcid.org/0009-0001-2071-2473
José Berríos-Riquelme Social Sciences Department. Universidad de Tarapacá https://orcid.org/0000-0003-2947-4739
Matías Zamorano-Veragua Facultad de Psicología y Humanidades. Universidad San Sebastián https://orcid.org/0009-0000-3475-997X
Rodrigo Díaz-Sepúlveda Facultad de Psicología y Humanidades. Universidad San Sebastián

DOI:

https://doi.org/10.4067/s0718-50652024000100224

Palavras-chave:

Student engagement, Invariance, Validity, Reliability, Higher Education

Resumo

The University Student Engagement Inventory (USEI) has shown good psychometric properties in studies with different university students and diverse cultural contexts. Previous adaptation and evaluation studies in Chilean college students showed good validity and reliability results. Nevertheless, invariance studies have not been carried out in this population. This study aimed to evaluate the invariance properties of USEI in the Chilean university population. A study with an instrumental and cross-sectional type design was conducted using a sample of 468 Chilean university students. Analysis was prepared by performing a Confirmatory Factor Analysis, evaluation of configural, scalar, and strict invariance measures, criterion validity, and reliability evaluation. A three-factor structure was observed, with adequate fit, reliability, and criterion validity indices. The invariance examination by gender obtained positive results for configural, metric, scalar, and strict invariance measures. These results show that the University Student Engagement Inventory has good psychometric properties for use in the Chilean university population.

Referências

Abreu Alves, S., Sinval, J., Lucas Neto, L., Marôco, J., Goncalves Ferreira, A. & Oliveira, P. (2022). Burnout and dropout intention in medical students: The protective role of academic engagement. BMC Medical Education, 22(1), 1-11. https://doi.org/10.1186/s12909-021-03094-9

Acosta-Gonzaga, E. & Ramírez-Arellano, A. (2020). Estudio comparativo de técnicas de analítica del aprendizaje para predecir el rendimiento académico de los estudiantes de educación superior. CienciaUAT, 15(1), 63-75. http://dx.doi.org/10.29059/cienciauat.v15i1.1392

Allen, K-A. & Boyle, C. (2023). School belonging and student engagement: the critical overlaps, similarities, and implications for student outcomes. En S. L., Christenson, A. L., Reschly & C. Wylie, C. (Eds.), Handbook of Research on Student Engagement (2a ed., pp. 133-154). Springer. http://www.doi.org/10.1007/978-3-031-07853-8_7

Aspeé, J., González, J. & Cavieres-Fernández, E. (2019). Instrumento para medir el compromiso estudiantil integrando el desarrollo ciudadano, una propuesta desde latinoamérica. Revista Complutense de Educación, 30(2), 399-421. http://dx.doi.org/10.5209/RCED.57518

Assunção, H., Lin, S-W., Sit, P-S., Cheung, K-C., Harju-Luukkainen, H., Smith, T., Maloa, B., Campos, J. A. D. B., Ilic, I. S., Esposito, G., Freda, M. F. & Marôco, J. (2020). University Student Engagement Inventory (USEI): Transcultural Validity Evidence Across Four Continents. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02796

Ato, M., López-García, J. J. & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales de Psicología, 29(3), 1038-1059. https://doi.org/10.6018/analesps.29.3.178511

Beaujean, A. A. (2014). Latent variable modeling using R: A step-by-step guide. Routledge.

Bollen, K. A. & Long, J. S. (1993). Testing structural equation models. Sage.

Byrne, B. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20(4), 872-882. https://www.redalyc.org/pdf/727/72720455.pdf

Byrne, B. M. & van de Vijver, F. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence. International Journal of Testing, 10(2), 107-132. http://dx.doi.org/10.1080/15305051003637306

Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. https://doi.org/10.1207/S15328007SEM0902_5

Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P. & Billiet, J. (2014). Measurement equivalence in cross-national research. Annual Review of Sociology, 40(1), 55-75. http://doi.org/10.1146/annurev-soc071913-043137

Deci, E. L. & Ryan, R. M. (1985). Self-determination Theory. Basic Psychological Needs in Motivation, Development, and Wellness. The Guilford Press.

Delfino, A. P. (2019). Student Engagement and Academic Performance of Students of Partido State University. Asian Journal of University Education, 15(3), 42-55. http://dx.doi.org/10.24191/ajue.v15i3.05

Guerra, F. y Jorquera, R. (2021). Análisis psicométrico de la Utrecht Work Engagement Scale en las versiones UWES-17S y UWES-9S en universitarios chilenos. Revista Digital de Investigación en Docencia Universitaria, 15(2). https://dx.doi.org/10.19083/ridu.2021.1542

Díaz-Mujica, A., García, D., López, Y., Maluenda, J., Hernández, H., & Pérez-Villalobos, M. (2018). Mediación Del Ajuste Académico Entre Variables Cognitivo-Motivacionales y la Intención de Abandono en primer año de Universidad. Congresos CLABES. Recuperado a partir de https://revistas.utp.ac.pa/index.php/clabes/article/view/1934

Dunn, T. J. & Kennedy, M. (2019). Technology Enhanced Learning in higher education; motivations, engagement and academic achievement. Computers and Education, 137, 104-113. https://doi.org/10.1016/j.compedu.2019.04.004

Esposito, G., Marôco, J., Passeggia, R., Pepicelli, G. & Freda, M. F. (2022). The Italian validation of the University Student Engagement Inventory. European Journal of Higher Education, 12(1), 35-55. https://doi.org/10.1080/21568235.2021.1875018

Elosua, P. (2005). Evaluación progresiva de la invarianza factorial entre las versiones original y adaptada de una escala de autoconcepto. Psicothema, 17(2), 356-362.

Fredricks, J. A., Filsecker, M. & Lawson, M. A. (2016). Student engagement, context, and adjustment: Addressing definitional, measurement, and methodological issues. Learning and Instruction, 43, 1-4. https://doi.org/10.1016/j.learninstruc.2016.02.002

Freiberg-Hoffmann, A., Romero-Medina, A., Curione, K. & Marôco, J. (2022). Adaptación y validación transcultural al español del University Student Engagement Inventory. Revista latinoamericana de psicología, 54, 187-195. https://doi.org/10.14349/rlp.2022.v54.21

González, L., Oñate, V., Longos, M., Espinoza, L., Lema, C., Pérez-Salas, C. y Sáez-Delgado, F. (2022). Análisis Psicométrico del Instrumento de Compromiso Escolar (SEI) en Estudiantes Secundarios en Chile. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica. RIDEP, 65(4), 47-60. 2 https://doi.org/10.21865/RIDEP65.4.04

Guzmán Arellano, C., Solar-Alveal, B., & Maluenda-Albornoz, J. (2024). Engagement agéntico: un análisis sobre su uso en el contexto educativo hispanohablante. Wimb Lu, 19(1), 1–23. https://doi.org/10.15517/wl.v19i1.55260

Hair, J. F., Black, W. C., Babin, B. J. & Anderson, R. E. (2014). Multivariate Data Analysis. (7a ed.), Pearson Education.

Hu, L., Bentler, P. M. & Hu, L. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Korhonen, V., Mattsson, M., Inkinen M. & Toom, A. (2019). Understanding the multidimensional nature of student engagement during the first year of higher education. Frontiers in Psychology, 10. https://www.doi.org/10.3389/fpsyg.2019.01056

Leal-Soto, F., Cuadros Jiménez, O., Ferrer-Urbina, R., & Dávila, J. (2023). Adaptación y validación del Inventario de Compromiso con la Clase en estudiantes secundarios y universitarios de Argentina, Bolivia y Chile. Revista Liminales. Escritos Sobre Psicología y Sociedad, 12(24), 149-168. https://doi.org/10.54255/lim.vol12.num24.780

Lei, H., Cui, Y. & Zhou, W. (2018). Relationships between student engagement and academic achievement: a meta-analysis. Social Behavior and Personality, 46(3), 517-528. https://doi.org/10.2224/sbp.7054

Liebana-Presa, C., Fernández-Martínez, M. E., Vázquez-Casares, A. M., López-Alonso, A. I. & Rodríguez-Borrego, M. A. (2018). Burnout and engagement among university nursing students. Enfermería Global, 17(2), 131-152. https://doi.org/10.6018/eglobal.17.2.268831

Maluenda-Albornoz, J., Contreras, M., Mujica, A. & Bernardo, A. (2020). Propiedades psicométricas del University Student Engagement Inventory en estudiantes de Ingeniería chilenos. Revista Iberoamericana de Diagnóstico y Evaluación - e Avaliação Psicológica, 57(4), 77-90. https://www.doi.org/10.21865/RIDEP57.4.06

Maluenda-Albornoz, J., Gutiérrez, A. B., Galve-González, C., Flores-Oyarzo, G., Infante-Villagrán, V. & Díaz-Mujica, A. (2021). Variables predictoras de la expectativa de desempeño y la intención de abandono en contexto de educación virtual de emergencia en estudiantes universitarios chilenos. Revista Caribeña De Investigación Educativa, 5(2), 81-91. https://doi.org/10.32541/recie.2021.v5i2.pp81-91

Maluenda-Albornoz, J., Flores-Oyarzo, G., Bernardo, A., & Díaz-Mujica, A. (2021a). Correlatos conductuales del Compromiso Académico en estudiantes de Ingeniería chilenos. Trilogía Ciencia Tecnología Sociedad, 13(24), 98-122. https://doi.org/10.22430/21457778.1754

Maluenda-Albornoz, J., Infante Villagrán, V., Chacano Osses, D., Gaete Cser, D. & Galve González, C. (2022). Integración social en la universidad durante la pandemia: predictores de la intención de abandono en estudiantes de primer año. Revista De La Educación Superior, 51(204), 101-116. https://doi.org/10.36857/resu.2022.204.2282

Maluenda-Albornoz, J., Infante-Villagrán, V., Galve-González, C., Flores-Oyarzo, G. & Berríos-Riquelme, J. (2022a). Early and Dynamic Socio-Academic Variables Related to Dropout Intention: A Predictive Model Made during the Pandemic. Sustainability, 14(2). https://doi.org/10.3390/su14020831

Maluenda-Albornoz, J., Bazignan C. & Rojas, X. (2022b). Belonging to Engineering During the First Year in Online Education. En 41st International Conference of the Chilean Computer Science Society (SCCC). IEEE (pp. 1-6) https://www.doi.org/10.1109/SCCC57464.2022.10000341

Maluenda-Albornoz, J., Berríos-Riquelme, J., Infante-Villagrán, V. & Lobos-Peña, K. (2023). Perceived Social Support and Engagement in First-Year Students: The Mediating Role of Belonging during COVID-19. Sustainability, 15(1) https://doi.org/10.3390/su15010597

Marôco, J., Assunção, H., Harju-luukkainen, H., Lin, S., Sit, P., Cheung, K., Maloa, B., Ilic, I. S., Smith, T. J. & Campos, J.A.D.B. (2020). Predictors of academic efficacy and dropout intention in university students: Can engagement suppress burnout? PLoS ONE, 15(10). https://doi.org/10.1371/journal.pone.0239816

Marôco, J., Marôco, A. L., Campos, J. A. D. B. & Fredricks, J. A. (2016). University student’s engagement: Development of the university student engagement inventory (USEI). Psicologia: Reflexão e. Crítica, 29(21), 1-12. https://doi.org/10.1186/s41155-016-0042-8

Medrano, L. A., Moretti, L. & Ortiz, A. (2015). Medición del Engagement Académico en Estudiantes Universitarios. Revista Iberoamericana de Diagnóstico y Evaluación - e Avaliação Psicológica, 2(40), 114-124.

Morales-Rodríguez F. M., Pérez-Mármol J. M. & Brown T. (2019). Education Burnout and Engagement in Occupational Therapy Undergraduate Students and Its Associated Factors. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02889

Nickerson, L. A. & Shea, K. M. (2020). First-Semester organic chemistry during COVID-19: prioritizing group work, flexibility, and student engagement. Journal of Chemical Education, 97(9), 3201-3205. https://doi.org/10.1021/acs.jchemed.0c00674

Paloș, R., Maricuţoiu, L. P. & Costea, I. (2019). Relations between academic performance, student engagement and student burn-out: A cross-lagged analysis of a two-wave study. Studies in Educational Evaluation, 60, 199-204. https://doi.org/10.1016/j.stueduc.2019.01.005

Putnick, D. L. & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004

Rahmatpour, P., Chehrzad, M., Ghanbari, A. & Sadat-Ebrahimi, S-R. (2019). Academic burnout as an educational complication and promotion barrier among undergraduate students: A cross-sectional study. Journal of Education and Health Promotion, 8(1), 201-201 https://doi.org/10.4103/jehp.jehp_165_19

Sharif Nia, H., Azad Moghddam, H., Marôco, J., Rahmatpour, P., Allen, K-A., Kaur, H., Kaveh, O., Gorgulu, O. & Pahlevan Sharif, S. (2022). A Psychometric Lens for E-Learning: Examining the Validity and Reliability of the Persian Version of University Students’ Engagement Inventory (P-USEI). The Asia-Pacific Education Researcher, 1-10. https://doi.org/10.1007/s40299-022-00677-y

Sharif-Nia, H., Marôco, J., Rahmatpour, P., Ghahrani, N., Muhammad Ibrahim, F., Mohammad Ibrahim, M. & Kaveh, O. (2023). Psychometrics evaluation of the university student engagement inventory in online learning among Arab students. BMC Nursing, 22. https://doi.org/10.1186/s12912-023-01318-5

She, L., Khoshnavay Fomani, F., Marôco, J., Allen, K-A., Sharif Nia, H. & Rahmatpour, P. (2023). Psychometric properties of the university student engagement inventory among Chinese students. Asian Association of Open Universities Journal, 18(1), 46-60. https://doi.org/10.1108/AAOUJ-08-2022-0111

Sinval, J., Casanova, J. R., Marôco, J. & Almeida, L. S. (2021). University student engagement inventory (USEI): Psychometric properties. Current Psychology 40(4), 1608-1620. https://doi.org/10.1007/s12144-018-0082-6

Spontón, C., Castellano, E., Salanova, M., Llorens, S., Maffei, L. & Medrano, L. A. (2018). Evaluación de un modelo sociocognitivo de autoeficacia, burnout y engagement en el trabajo: análisis de invarianza entre Argentina y España. Psychologia, 12(1), 89-101. https://www.doi.org/10.21500/19002386.3226

Wang, M-T., Fredricks, J., Ye, F., Hofkens, Y. & Schall Linn. J. (2017). Conceptualization and Assessment of Adolescents’ Engagement and Disengagement in School: A Multidimensional School Engagement Scale. European Journal of Psychological Assessment, 35(4), 1-15. https://doi.org/10.1027/1015-5759/a000431

Wong, T. Y., Parent, A-M. & Konishi, C. (2019). Feeling connected: the roles of student-teacher relationships and sense of school belonging on future orientation. International Journal of Educational Research, 94, 150-157. https://doi.org/10.1016/j.ijer.2019.01.008

Zhang, D., Bobis, J., Wu, X. & Cui, Y. (2020b). effects of an autonomy-supportive teaching intervention on Chinese physics students and their teacher. Research in science education, 50(2), 645-671. https://doi.org/10.1007/s11165-018-9706-y

Zhang, K., Wu, S., Xu, Y., Cao, W., Goetz, T. & Parks-Stamm, E. J. (2020a). Adaptability promotes student engagement under COVID-19: the multiple mediating effects of academic emotion. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.633265