Competences of Flexible Professionals: Validation of an Invariant Instrument across Mexico, Chile, Uruguay, and Spain
Abstract
:1. Introduction
1.1. Cross-Cultural Differences in Self-Assessment of Competences
1.2. Classifications of Competences
1.3. Current Study
2. Methods
2.1. Participants and Procedure
2.2. Instrument
2.3. Data Analysis
3. Results
3.1. Validation of the Measurement Instrument
3.2. Factorial Invariance Analysis
3.3. Latent Factor Mean Differences
4. Discussion
5. Conclusions
Author Contributions
Funding
Conflicts of Interest
Appendix A
Latent Factor | 2nd Order Factor Loading | R2 | Item Description | 1st Order Factor Loading | R2 | |
---|---|---|---|---|---|---|
F1 | Innovation | 0.913 | 0.834 | Ability to come up with new ideas and solutions | 0.859 | 0.737 |
Ability to use computers and the internet | 0.680 | 0.463 | ||||
Willingness to question prevailing ideas | 0.580 | 0.337 | ||||
F2 | Cooperation | 0.904 | 0.816 | Ability to mobilize the capacities of others | 0.782 | 0.611 |
Ability to work productively with others | 0.724 | 0.524 | ||||
F3 | Knowledge management | 0.910 | 0.828 | Mastery of your own field or discipline | 0.598 | 0.358 |
Knowledge of other fields or disciplines | 0.562 | 0.316 | ||||
Analytical thinking | 0.794 | 0.631 | ||||
Ability to rapidly acquire new knowledge | 0.796 | 0.633 | ||||
F4 | Communication | 0.831 | 0.691 | Ability to present products, ideas or reports to an audience | 0.782 | 0.612 |
Ability to write reports, memos or documents | 0.707 | 0.500 | ||||
Ability to make your meaning clear to others | 0.790 | 0.623 | ||||
Ability to write and speak in a foreign language | 0.382 | 0.146 | ||||
F5 | Organizational | 0.991 | 0.983 | Ability to use time efficiently | 0.605 | 0.366 |
Ability to coordinate activities | 0.766 | 0.586 | ||||
Ability to perform well under pressure | 0.724 | 0.523 | ||||
F6 | Participative competences | 0.999 | 0.999 | Ability to assert your authority | 0.444 | 0.623 |
Alertness to new opportunities | 0.734 | 0.539 | ||||
Ability to negotiate effectively | 0.689 | 0.475 |
References
- Bricall, J.M. University 2000: Executive Summary; Ministry of Education: Madrid, Spain, 2000.
- Krüger, K.; Jiménez, L.; Piqué, V. Higher education in the Spanish transition to a knowledge society. In European Studies on Inequalities and Social Cohesion; Warzywoda-Kruszyńska, W., Rokicka, E., Woźniak, W., Eds.; Lodz University Press: Lodz, Poland, 2007; pp. 59–109. [Google Scholar]
- Delamare, L.D.; Winterton, J. What Is Competence? Hum. Resour. Dev. Int. 2005, 8, 27–46. [Google Scholar]
- Cseh, M. Facilitating learning in multicultural teams. Adv. Dev. Hum. Res. 2003, 5, 26–40. [Google Scholar] [CrossRef]
- Boyatzis, R.E. The Competent Manager: A Model for Effective Performance; Wiley: New York, NY, USA, 1982. [Google Scholar]
- McClelland, D. Identifying competencies with behavioural-event interviews. Psychol. Sci. 1998, 9, 331–339. [Google Scholar] [CrossRef]
- Spencer, L.; Spencer, S. Competence at Work: A Model for Superior Performance; Wiley: New York, NY, USA, 1993. [Google Scholar]
- Mulder, M. Conceptions of Professional Competence. In International Handbook of Research in Professional and Practice-Based Learning; Billet, S., Harteis, C., Gruber, H., Eds.; Springer: Dordrecht, The Netherlands, 2014; pp. 107–137. [Google Scholar]
- Bloom, B.S.; Mesia, B.B.; Krathwohl, D.R. Taxonomy of Educational Objectives: The Classification of Educational Goals; David McKay Company: New York, NY, USA, 1964. [Google Scholar]
- Winterton, J. Competence across Europe: Highest common factor or lowest common denominator? J. Eur. Ind. Train. 2009, 33, 681–700. [Google Scholar] [CrossRef]
- Hartog, J. Capabilities, Allocation, and Earnings; Springer, Kluwer Academic Pub: Dordrecht, The Netherlands, 1992. [Google Scholar]
- Salganik, L.H.; Rychen, D.S. Key Competencies: For a Successful Life and a Well-Functioning Society; Hogrefe and Huber Pub: Boston, MA, USA, 2003. [Google Scholar]
- Blömeke, S.; Zlatkin-Troitschanskaia, O.; Kuhn, C.; Fege, J. Modeling and Measuring Competencies in Higher Education; Sense Publishers: Rotterdam, The Netherlands, 2013. [Google Scholar]
- Shavelson, R. On the measurement of competency. Empir. Res. Vocat. Educ. Train. 2010, 2, 41–64. [Google Scholar]
- Rychen, D.S.; Tiana, A. Developing Key Competencies in Education: Some Lessons from International and National Experience; UNESCO International Bureau of Education: Paris, France, 2004. [Google Scholar]
- Kennedy, D. Writing and Using Learning Outcomes: A Practical Guide; University College Cork: Cork, Ireland, 2007. [Google Scholar]
- Beneitone, P.; Esquetini, C.; González, J.; Maletá, M.M.; Siufi, G.; Wagennar, R. Tuning América Latina. Reflections on and Outlook for Higher Education in Latin America; Final Report; Publicaciones de la Universidad de Deusto: Bilbao, Spain, 2007. [Google Scholar]
- De Kraker, J.; Lansu, A. Competences and competence-based learning for sustainable development. In Crossing Boundaries. Innovative Learning for Sustainable Development in Higher Education; De Kraker, J., Lansu, A., van Dam-Mieras, M.C., Eds.; Verlag für Akademische Schriften: Frankfurt am Main, Germany, 2007; pp. 103–114. [Google Scholar]
- Lozano, R.; Merrill, M.; Sammalisto, K.; Ceulemans, K.; Lozano, F.J. Connecting Competences and Pedagogical Approaches for Sustainable Development in Higher Education: A Literature Review and Framework Proposal. Sustainability 2017, 9, 1889. [Google Scholar] [CrossRef] [Green Version]
- Zamora-Polo, F.; Sánchez-Martín, J.; Serrano, M.C.; Espejo-Antúnez, L. What Do University Students Know about Sustainable Development Goals? A Realistic Approach to the Reception of this UN Program amongst the Youth Population. Sustainability 2019, 11, 3533. [Google Scholar] [CrossRef] [Green Version]
- Mochizuki, Y.; Fadeeva, Z. Competences for sustainable development and sustainability: Significance and challenges for ESD. Int. J. Sustain. High. 2010, 11, 391–403. [Google Scholar] [CrossRef]
- Lambrechts, W.; Mulà, I.; Ceulemans, K.; Molderez, I.; Gaeremynck, V. The integration of competences for sustainable development in higher education: An analysis of bachelor programs in management. J. Clean. Prod. 2013, 48, 65–73. [Google Scholar] [CrossRef] [Green Version]
- Vandenberg, R.; Lance, C.E. A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organ. Res. Methods 2000, 3, 4–70. [Google Scholar] [CrossRef]
- Hambleton, R.K.; Patsula, L. Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. J. Appl. Test. Technol. 1999, 1, 1–13. [Google Scholar]
- Heine, S.J.; Lehman, D.R.; Peng, K.; Greenholtz, J. What’s wrong with cross-cultural comparisons of subjective Likert scales? The reference-group effect. J. Pers. Soc. Psychol. 2002, 82, 903–918. [Google Scholar] [CrossRef] [PubMed]
- Morse, B.; Weinhardt, J.M.; Griffeth, R.W.; De Oliveira, M.Z. Cross-cultural Measurement Invariance of the Employment Opportunity Index (EOI) in Mexican and Brazilian Professionals. Int. J. Sel. Assess. 2014, 22, 139–148. [Google Scholar] [CrossRef]
- González, J.; Wagenaar, R. Tuning Educational Structures in Europe. Universities’ Contribution to the Bologna Process; Publicaciones de la Universidad de Deusto: Bilbao, Spain, 2005. [Google Scholar]
- Calmand, J.; Frontini, M.; Rostan, M. Being flexible: Graduates facing changes in their work environment. In The Flexible Professional in the Knowledge Society: New Challenges for Higher Education; Allen, J., Van der Velden, R., Eds.; Springer: Dordrecht, The Netherlands, 2011; pp. 83–110. [Google Scholar]
- Alonso, L.E.; Fernández, C.J.; Nyssen, J.M. El Debate Sobre Las Competencias. Una Investigación Cualitativa en Torno a la Educación Superior y el Mercado de Trabajo en España; Agencia Nacional de Evaluación de la Calidad y Acreditación: Madrid, Spain, 2008. (In Spanish) [Google Scholar]
- National Agency for Quality Assessment and Accreditation (ANECA). Los Procesos de Inserción Laboral de los Titulados Universitarios en España. Factores de Facilitación y Obstaculización; Agencia Nacional de Evaluación de la Calidad y Acreditación: Madrid, Spain, 2009. (In Spanish) [Google Scholar]
- Allen, J.; Van der Velden, R. The Flexible Professional in the Knowledge Society; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
- Bentler, P.M. EQS Structural Equations Program Manual; Multivariate Software: Encino, CA, USA, 2006. [Google Scholar]
- Heijke, H.; Meng, C.; Ramaekers, G. An investigation into the role of human capital competences and their pay-off. Int. J. Manpow. 2003, 24, 750–773. [Google Scholar] [CrossRef] [Green Version]
- Nordhaug, O. Human Capital in Organizations, Competence, Training and Learning; Scandinavian University Press: Oslo, Norway, 1993. [Google Scholar]
- Semeijn, J.H.; Van Der Velden, R.; Heijke, H.; Van Der Vleuten, C.; Boshuizen, H.P.A. Competence indicators in academic education and early labour market success of graduates in health sciences. J. Educ. Work. 2006, 19, 383–413. [Google Scholar] [CrossRef]
- Billing, D. Teaching for transfer of core/key skills in higher education: Cognitive skills. High. Educ. 2007, 53, 483–516. [Google Scholar] [CrossRef]
- Usher, E.L.; Pajares, F. Self-Efficacy for self-regulated learning a validation Study. Educ. Psychol. Meas. 2008, 68, 443–463. [Google Scholar] [CrossRef]
- Meng, C.; Heijke, H. Student Time Allocation, the Learning Environment and the Acquisition of Competences; ROA Research Memorandum 001, Maastricht University: Maastricht, The Netherlands, 2005. [Google Scholar]
- Hernández-March, J.; Del Peso, M.M.; Leguey, S. Graduates’ Skills and Higher Education: The employers’ perspective. Tert. Educ. Manag. 2009, 15, 1–16. [Google Scholar] [CrossRef]
- Smits, W. Industry-specific or generic skills? Conflicting interests of firms and workers. Labour Econ. 2007, 14, 653–663. [Google Scholar] [CrossRef]
- García-Aracil, A.; Mora, J.G.; Vila, L.E. The rewards of human capital competences for young European higher education graduates. Tert. Educ. Manag. 2004, 10, 287–305. [Google Scholar] [CrossRef]
- García-Aracil, A.; Van Der Velden, R. Competencies for young European higher education graduates: Labor market mismatches and their payoffs. High. Educ. 2007, 55, 219–239. [Google Scholar] [CrossRef] [Green Version]
- Kellerman, P. Acquired and required competences of graduates. In Careers of University Graduates: Views and Experiences in Comparative Perspectives; Teichler, U., Ed.; Springer: Dordrecht, The Netherlands, 2007; pp. 115–131. [Google Scholar]
- Clemente-Ricolfe, J.S.; Escribá-Pérez, C. Analysis of the perception of generic skills acquired at university. Rev. Educ. 2013, 362, 535–561. [Google Scholar]
- Conchado, A.; Carot, J.M.; Bas, M.C. Competencies for knowledge management: Development and validation of a scale. J. Knowl. Manag. 2015, 19, 836–855. [Google Scholar] [CrossRef]
- Yuan, K.-H.; Bentler, P.M. 5. Three Likelihood-Based Methods for Mean and Covariance Structure Analysis with Nonnormal Missing Data. Sociol. Methodol. 2000, 30, 165–200. [Google Scholar] [CrossRef]
- Gerbing, D.W.; Anderson, J.C. The Effects of Sampling Error and Model Characteristics on Parameter Estimation for Maximum Likelihood Confirmatory Factor Analysis. Multivar. Behav. Res. 1985, 20, 255–271. [Google Scholar] [CrossRef] [PubMed]
- Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. Sociol. Methods. Res. 1992, 21, 230–258. [Google Scholar] [CrossRef]
- Steiger, J.H. Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivar. Behav. Res. 1990, 25, 173–180. [Google Scholar] [CrossRef] [Green Version]
- Kline, R.B. Principles and Practice of Structural Equation Modeling; Guilford press: New York, NY, USA, 2011. [Google Scholar]
- Byrne, B.M. Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema 2008, 20, 872–882. [Google Scholar]
- Chen, F.F.; Sousa, K.H.; West, S.G. Teacher’s Corner: Testing Measurement Invariance of Second-Order Factor Models. Struct. Equ. Model. A Multidiscip. J. 2005, 12, 471–492. [Google Scholar] [CrossRef]
- Cheung, G.W.; Rensvold, R.B. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Struct. Equ. Model. A Multidiscip. J. 2002, 9, 233–255. [Google Scholar] [CrossRef]
- Satorra, A. Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In Innovations in Multivariate Statistical Analysis: A Festschrift for Heinz Neudecker; Heijmans, R.D.H., Pollock, D.S.G., Satorra, A., Eds.; Kluwer Academic Publishers: London, UK, 2000; pp. 233–247. [Google Scholar]
- Hong, S.; Malik, M.L.; Lee, M.-K. Testing Configural, Metric, Scalar, and Latent Mean Invariance Across Genders in Sociotropy and Autonomy Using a Non-Western Sample. Educ. Psychol. Meas. 2003, 63, 636–654. [Google Scholar] [CrossRef]
- Hancock, G.R. Effect size, power, and sample size determination for structured means modeling and mimic approaches to between-groups hypothesis testing of means on a single latent construct. Psychometrika 2001, 66, 373–388. [Google Scholar] [CrossRef]
- Kivinen, O.; Nurmi, J. Job requirements and competences: Do qualifications matter? In Careers of University Graduates. Views and Experiences in Comparative Perspectives; Teichler, U., Ed.; Springer: Dordrecht, The Netherlands, 2007; pp. 131–142. [Google Scholar]
- Shmatko, N. Competences of Engineers. Evidence from a Comparative Study for Russia and EU countries. Foresight STI Gov. 2012, 6, 32–47. [Google Scholar]
Latent Factor | Cronbach’s α | Items | |
---|---|---|---|
F1 | Innovation | 0.728 | Ability to come up with new ideas and solutions |
Ability to use computers and the internet | |||
Willingness to question prevailing ideas | |||
F2 | Cooperation | 0.695 | Ability to mobilize the capacities of others |
Ability to work productively with others | |||
F3 | Knowledge management | 0.773 | Mastery of your own field or discipline |
Knowledge of other fields or disciplines | |||
Analytical thinking | |||
Ability to rapidly acquire new knowledge | |||
F4 | Communication | 0.677 | Ability to present products, ideas or reports to an audience |
Ability to write reports, memos or documents | |||
Ability to make your meaning clear to others | |||
Ability to write and speak in a foreign language | |||
F5 | Organizational | 0.761 | Ability to use time efficiently |
Ability to coordinate activities | |||
Ability to perform well under pressure | |||
F6 | Participative competences | 0.784 | Ability to assert your authority |
Alertness to new opportunities | |||
Ability to negotiate effectively |
S-B χ2 | df | S-B χ2 | CFI | RMSEA | RMSEA 90% CI | SRMR | |
---|---|---|---|---|---|---|---|
Spain | |||||||
Initial | 2712.5 | 146 | 1994.0 | 0.908 | 0.052 | [0.050–0.054] | 0.041 |
Improved | 2439.0 | 145 | 1803.4 | 0.917 | 0.049 | [0.047–0.051] | 0.039 |
Mexico | |||||||
Initial | 1889.4 | 146 | 1248.7 | 0.972 | 0.042 | [0.040–0.044] | 0.025 |
Improved | 1691.4 | 145 | 1121.5 | 0.975 | 0.040 | [0.048–0.052] | 0.024 |
Chile | |||||||
Initial | 1433.0 | 146 | 931.9 | 0.908 | 0.048 | [0.045–0.051] | 0.043 |
Improved | 1298.9 | 145 | 849.4 | 0.918 | 0.045 | [0.038–0.042] | 0.041 |
Uruguay | |||||||
Initial | 645.1 | 146 | 388.3 | 0.908 | 0.057 | [0.050–0.057] | 0.055 |
Improved | 612.0 | 145 | 366.5 | 0.916 | 0.055 | [0.048–0.061] | 0.053 |
Model | Model Comparison | S-B χ2 | df | S-B χ2 | CFI | RMSEA | RMSEA 90% CI | SRMR | |
---|---|---|---|---|---|---|---|---|---|
1 | Configural invariance | - | 6457.2 | 584 | 4199.9 | 0.945 | 0.046 | [0.045–0.047] | 0.043 |
2 | Metric invariance (1st order) | 2 vs. 1 | 6769.6 | 623 | 4055.8 | 0.942 | 0.046 | [0.045–0.047] | 0.052 |
3 | Scalar invariance | 3 vs. 1 | 11,157.4 | 680 | 7845.8 | 0.949 | 0.049 | [0.048–0.051] | 0.105 |
4 | Metric invariance (2nd order) | 4 vs. 1 | 11,575.3 | 698 | 8261.2 | 0.944 | 0.051 | [0.050–0.052] | 0.193 |
5 | Latent factor mean differences | 5 vs. 1 | 9209.9 | 680 | 6426.1 | 0.947 | 0.049 | [0.048–0.051] | 0.166 |
Competences | Mexico | Chile | Uruguay | ||||||
---|---|---|---|---|---|---|---|---|---|
Est. Diff. | Std. Err. | Cohen’s d | Est. Diff. | Std. Err. | Cohen’s d | Est. Diff. | Std. Err. | Cohen’s d | |
Innovation | 0.25 | 0.021 | 1.864 | 0.55 | 0.026 | 0.620 | 0.64 | 0.057 | 1.743 |
Interpersonal | 0.32 | 0.023 | 1.801 | 0.61 | 0.027 | 1.011 | 0.67 | 0.060 | 1.640 |
Knowledge management | 0.20 | 0.017 | 1.525 | 0.54 | 0.021 | 0.597 | 1.76 | 0.136 | 6.287 |
Communication | 0.32 | 0.027 | 1.386 | 0.81 | 0.032 | 0.628 | 0.85 | 0.070 | 1.454 |
Organizational | 0.21 | 0.020 | 2.422 | 0.51 | 0.025 | 0.719 | 0.57 | 0.053 | 5.387 |
Participative competences | 0.79 | 0.023 | 3.885 | 0.86 | 0.028 | 2.007 | 1.12 | 0.057 | 4.903 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Conchado Peiró, A.; Carot Sierra, J.M.; Vázquez Barrachina, E. Competences of Flexible Professionals: Validation of an Invariant Instrument across Mexico, Chile, Uruguay, and Spain. Sustainability 2020, 12, 5224. https://doi.org/10.3390/su12125224
Conchado Peiró A, Carot Sierra JM, Vázquez Barrachina E. Competences of Flexible Professionals: Validation of an Invariant Instrument across Mexico, Chile, Uruguay, and Spain. Sustainability. 2020; 12(12):5224. https://doi.org/10.3390/su12125224
Chicago/Turabian StyleConchado Peiró, Andrea, José Miguel Carot Sierra, and Elena Vázquez Barrachina. 2020. "Competences of Flexible Professionals: Validation of an Invariant Instrument across Mexico, Chile, Uruguay, and Spain" Sustainability 12, no. 12: 5224. https://doi.org/10.3390/su12125224