Evaluating Policy Efficacy in Higher Education: A Synthetic Control Analysis of Ecuador’s Higher Education Law on Research Productivity
Abstract
:1. Introduction
2. Methodology
2.1. Research Questions and Hypotheses
2.2. Dataset
2.3. Main Variable
2.4. Synthetic Control Methods
2.5. Construction of the Synthetic Control
2.6. Statistical Analysis
2.7. Robustness Check
3. Results
3.1. Descriptive Analysis of Publication Trends in Ecuador
3.2. Comparison of Actual vs. Synthetic Ecuador Publications
3.3. Robustness Check
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Conflicts of Interest
References
- Scoffham, S.; Rawlinson, S. Sustainability Education: A Classroom Guide; Bloomsbury Publishing: London, UK, 2022; ISBN 1-350-26207-2. [Google Scholar]
- Alam, G.M. Sustainable Education and Sustainability in Education: The Reality in the Era of Internationalisation and Commodification in Education—Is Higher Education Different? Sustainability 2023, 15, 1315. [Google Scholar] [CrossRef]
- Stanciu, A.C.; Condrea, E. Sustainability in Higher Education. In Proceedings of the 9th BASIQ International Conference on New Trends in Sustainable Business and Consumption, Constanța, Romania, 8–10 June 2023. [Google Scholar]
- Jastrzębska-Smolaga, H. Education for Sustainable Development. Ekon. I Sr. 2001. [Google Scholar] [CrossRef]
- Malik, R.S. Educational Challenges in 21st Century and Sustainable Development. J. Sustain. Dev. Educ. Res. 2018, 2, 9–20. [Google Scholar] [CrossRef]
- Argento, D.; Einarson, D.; Mårtensson, L.; Persson, C.; Wendin, K.; Westergren, A. Integrating Sustainability in Higher Education: A Swedish Case. Int. J. Sustain. High. Educ. 2020, 21, 1131–1150. [Google Scholar] [CrossRef]
- Kemper, J.A.; Ballantine, P.W.; Hall, C.M. The Role That Marketing Academics Play in Advancing Sustainability Education and Research. J. Clean. Prod. 2020, 248, 119229. [Google Scholar] [CrossRef]
- Kanaabi, M.; Kasule, G.W.; Owino, P. Policy Support and Research Productivity among Lecturers in Ugandan Public Universities: Case of Kyambogo University. Uganda High. Educ. Rev. 2021, 9, 52. [Google Scholar] [CrossRef]
- Peurach, D.J.; Glazer, J.L.; Winchell Lenhoff, S. The Developmental Evaluation of School Improvement Networks. Educ. Policy 2016, 30, 606–648. [Google Scholar] [CrossRef]
- Øvretveit, J.; Gustafson, D. Evaluation of Quality Improvement Programmes. BMJ Qual. Saf. 2002, 11, 270–275. [Google Scholar] [CrossRef]
- Cooke, J. A Framework to Evaluate Research Capacity Building in Health Care. BMC Fam. Pract. 2005, 6, 44. [Google Scholar] [CrossRef]
- Al Raee, M.; Ritzen, J.; de Crombrugghe, D. Innovation Policy & Labour Productivity Growth: Education, Research & Development, Government Effectiveness and Business Policy. Innovation 2017, 2017, 019. [Google Scholar]
- Millones-Gómez, P.A.; Yangali-Vicente, J.S.; Arispe-Alburqueque, C.M.; Rivera-Lozada, O.; Calla-Vásquez, K.M.; Calla-Poma, R.D.; Requena-Mendizábal, M.F.; Minchón-Medina, C.A. Research Policies and Scientific Production: A Study of 94 Peruvian Universities. PLoS ONE 2021, 16, e0252410. [Google Scholar] [CrossRef] [PubMed]
- Akcigit, U.; Pearce, J.; Prato, M. Tapping into Talent: Coupling Education and Innovation Policies for Economic Growth. Rev. Econ. Stud. 2024, rdae047. [Google Scholar] [CrossRef]
- Wang, X.; Hu, H. Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency. Sustainability 2017, 9, 1952. [Google Scholar] [CrossRef]
- Pedro, E.d.M.; Leitão, J.; Alves, H. Bridging Intellectual Capital, Sustainable Development and Quality of Life in Higher Education Institutions. Sustainability 2020, 12, 479. [Google Scholar] [CrossRef]
- Shibayama, S.; Baba, Y. Impact-Oriented Science Policies and Scientific Publication Practices: The Case of Life Sciences in Japan. Res. Policy 2015, 44, 936–950. [Google Scholar] [CrossRef]
- Gurau, C. Academic Excellence through Scholarly Research and Publications: A Multi-Stakeholder Perspective. Septentrio Conf. Ser. 2019. [Google Scholar] [CrossRef]
- Hallinger, P.; Nguyen, V.-T. Mapping the Landscape and Structure of Research on Education for Sustainable Development: A Bibliometric Review. Sustainability 2020, 12, 1947. [Google Scholar] [CrossRef]
- Saric, J.; Breu, T.; Fokou, G.; Gass, S.; Kiteme, B.; Masanja, H.; Utzinger, J.; Zeleke, G.; Käser, F. Research− Implementation Organisations and Their Role for Sustainable Development. Sustain. Dev. 2023, 31, 1401–1416. [Google Scholar] [CrossRef]
- Sianes, A.; Vega-Muñoz, A.; Tirado-Valencia, P.; Ariza-Montes, A. Impact of the Sustainable Development Goals on the Academic Research Agenda. A Scientometric Analysis. PLoS ONE 2022, 17, e0265409. [Google Scholar] [CrossRef]
- Ferrer-Estévez, M.; Chalmeta, R. Integrating Sustainable Development Goals in Educational Institutions. Int. J. Manag. Educ. 2021, 19, 100494. [Google Scholar] [CrossRef]
- Fioramonti, L.; Giordano, C.; Basile, F.L. Fostering Academic Interdisciplinarity: Italy’s Pioneering Experiment on Sustainability Education in Schools and Universities. Front. Sustain. 2021, 2, 631610. [Google Scholar] [CrossRef]
- Fahim, A.; Tan, Q.; Naz, B.; ul Ain, Q.; Bazai, S.U. Sustainable Higher Education Reform Quality Assessment Using SWOT Analysis with Integration of AHP and Entropy Models: A Case Study of Morocco. Sustainability 2021, 13, 4312. [Google Scholar] [CrossRef]
- Vallury, S.; Smith, A.P.; Chaffin, B.C.; Nesbitt, H.K.; Lohani, S.; Gulab, S.; Banerjee, S.; Floyd, T.M.; Metcalf, A.L.; Metcalf, E.C. Adaptive Capacity beyond the Household: A Systematic Review of Empirical Social-Ecological Research. Environ. Res. Lett. 2022, 17, 063001. [Google Scholar] [CrossRef]
- Fien, J. Advancing Sustainability in Higher Education: Issues and Opportunities for Research. High. Educ. Policy 2002, 15, 143–152. [Google Scholar] [CrossRef]
- Newig, J.; Jahn, S.; Lang, D.J.; Kahle, J.; Bergmann, M. Linking Modes of Research to Their Scientific and Societal Outcomes. Evidence from 81 Sustainability-Oriented Research Projects. Environ. Sci. Policy 2019, 101, 147–155. [Google Scholar] [CrossRef]
- Fini, R.; Rasmussen, E.; Siegel, D.; Wiklund, J. Rethinking the Commercialization of Public Science: From Entrepreneurial Outcomes to Societal Impacts. Acad. Manag. Perspect. 2018, 32, 4–20. [Google Scholar] [CrossRef]
- Aghion, P.; Dewatripont, M.; Hoxby, C.; Mas-Colell, A.; Sapir, A. The Governance and Performance of Universities: Evidence from Europe and the US. Econ. Policy 2010, 25, 7–59. [Google Scholar] [CrossRef]
- Noche, E.B.; Ventayen, R.J.M.; Galas, E.M. Deployment of Preprint Servers and Online Journals as Campus Research Management System Using Open-Source Applications. In Proceedings of the 2023 8th International Conference on Business and Industrial Research (ICBIR), Bangkok, Thailand, 18–19 May 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 353–358. [Google Scholar]
- Deliyannides, T.S.; Gabler, V. The University Library System, University of Pittsburgh: How & Why We Publish; IDS Project Press: Geneseo, NY, USA, 2013. [Google Scholar]
- Ratnaningsih, D.R.; Swadesi, B.; Putradianto, R.R.; Risky, A.N. Research Culture and Productivity Improvement through Online Journal System Development and Optimization; RSF Press: Paris, France, 2020; Volume 1, pp. 66–76. [Google Scholar]
- Whitley, R.; Glaser, J. Organisational Transformation and Scientific Change: The Impact of Institutional Restructuring on Universities and Intellectual Innovation; Emerald Group Publishing: Bingley, UK, 2014; ISBN 1-78350-683-0. [Google Scholar]
- Crespi, G.; Zuniga, P. Innovation and Productivity: Evidence from Six Latin American Countries. World Dev. 2012, 40, 273–290. [Google Scholar] [CrossRef]
- Ley Orgánica de Educación Superior; Director Del Registro Oficial. Ley Orgánica de Educación Superior, LOES; Asamblea Nacional del Ecuador: Quito, Ecuador, 2010.
- Guzmán, A.A.R.; Cobas, D.E.P.; Aldean, J.P.M.; Varela, R.E.P. Ley Orgánica de Educación Superior En Ecuador y Su Impacto En El Aseguramiento de La Calidad. Dilemas contemporáneos: Educación, Política y Valores. 2020. Available online: https://dilemascontemporaneoseducacionpoliticayvalores.com/index.php/dilemas/article/view/2418 (accessed on 6 September 2024).
- Montenegro, C.W.; Flores, D.A. An Integrated Model for ICT Governance and Management Applied to the Council for Evaluation, Accreditation and Quality Assurance of Higher Education Institutions in Ecuador (CEAACES). In Proceedings of the 2015 International Conference on Computing, Communication and Security (ICCCS), Pointe aux Piments, Mauritius, 4–5 December 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 1–9. [Google Scholar]
- Castillo-Mayén, R.; Montes-Berges, B. Análisis de Los Estereotipos de Género Actuales. An. De Psicol. Ann. Psychol. 2014, 30, 1044–1060. [Google Scholar] [CrossRef]
- Avilés, G.T. Impacto de Las Nuevas Políticas de Educación Superior En Las Universidades y Escuelas Politécnicas Del Ecuador. Rev. Empres. 2016, 10, 28–34. [Google Scholar]
- Abad, R.G.; Castro, J.C.O. Perfeccionamiento de Los Criterios de Evaluación Asociados a La Acreditación Institucional de La Universidad Católica de Cuenca, Extensión Azogues. Mendive. Rev. De Educ. 2015, 13, 158–168. [Google Scholar]
- Scimago, G. SCImago Journal & Country Rank: Un Nuevo Portal, Dos Nuevos Rankings. El Prof. De La Inf. 2007. [Google Scholar] [CrossRef]
- SJR—About, Us. Available online: https://www.scimagojr.com/aboutus.php (accessed on 19 May 2024).
- Sewerin, S.; Béland, D.; Cashore, B. Designing Policy for the Long Term: Agency, Policy Feedback and Policy Change. Policy Sci. 2020, 53, 243–252. [Google Scholar] [CrossRef]
- Hacker, J.S.; Pierson, P. Policy Feedback in an Age of Polarization. ANNALS Am. Acad. Political Soc. Sci. 2019, 685, 8–28. [Google Scholar] [CrossRef]
- Hanson, M. Institutional Theory and Educational Change. Educ. Adm. Q. 2001, 37, 637–661. [Google Scholar] [CrossRef]
- Little, J.W. Social Network Theory and Educational Change; Harvard Education Press: Cambridge, MA, USA, 2010; ISBN 1-61250-376-4. [Google Scholar]
- Guz, A.N.; Rushchitsky, J.J. Scopus: A System for the Evaluation of Scientific Journals. Int. Appl. Mech. 2009, 45, 351–362. [Google Scholar] [CrossRef]
- Scopus Preview—Scopus—Welcome to Scopus. Available online: https://www.scopus.com/home.uri (accessed on 19 May 2024).
- Mostert, S.P.; Ellenbroek, S.P.; Meijer, I.; Van Ark, G.; Klasen, E.C. Societal Output and Use of Research Performed by Health Research Groups. Health Res. Policy Syst. 2010, 8, 30. [Google Scholar] [CrossRef]
- Abadie, A. Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects. J. Econ. Lit. 2021, 59, 391–425. [Google Scholar] [CrossRef]
- Abadie, A.; Diamond, A.; Hainmueller, J. Synth: An R Package for Synthetic Control Methods in Comparative Case Studies. J. Stat. Softw. 2011, 42, 1–17. [Google Scholar] [CrossRef]
- Méndez-Vélez, F.; Palomeque-Cantos, R.; Borja-Pozo, C. Socio-Economic Evolution of Ecuador: Main Economic Indicators and Social Phenomena in Recent Years; AIP Publishing: Melville, NY, USA, 2022; Volume 2574. [Google Scholar]
- Tahamtan, I.; Bornmann, L. What Do Citation Counts Measure? An Updated Review of Studies on Citations in Scientific Documents Published between 2006 and 2018. Scientometrics 2019, 121, 1635–1684. [Google Scholar] [CrossRef]
- Payne, A.A.; Siow, A. Does Federal Research Funding Increase University Research Output? Citeseer, 1999. Available online: https://econpapers.repec.org/article/bpjbejeap/v_3aadvances.3_3ay_3a2003_3ai_3a1_3an_3a1.htm (accessed on 6 September 2024).
- Leydesdorff, L.; Bornmann, L.; Wagner, C.S. The Relative Influences of Government Funding and International Collaboration on Citation Impact. J. Assoc. Inf. Sci. Technol. 2019, 70, 198–201. [Google Scholar] [CrossRef] [PubMed]
- Uddin, A.; Singh, V.K. Measuring Research Output and Collaboration in South Asian Countries. Curr. Sci. 2014, 107, 31–38. [Google Scholar]
- Herrera-Franco, G.; Montalván-Burbano, N.; Mora-Frank, C.; Bravo-Montero, L. Scientific Research in Ecuador: A Bibliometric Analysis. Publications 2021, 9, 55. [Google Scholar] [CrossRef]
- Figg, W.D.; Dunn, L.; Liewehr, D.J.; Steinberg, S.M.; Thurman, P.W.; Barrett, J.C.; Birkinshaw, J. Scientific Collaboration Results in Higher Citation Rates of Published Articles. Pharmacother. J. Hum. Pharmacol. Drug Ther. 2006, 26, 759–767. [Google Scholar] [CrossRef]
- Nandigama, S. Global Virtual Exchange as a Sustainable Higher Education Practice: Developing Innovative Teaching and Learning Strategies Using Online Collaboration among Four International Universities. 2022. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4022489 (accessed on 6 September 2024).
- Quimbo, M.A.T.; Sulabo, E.C. Research Productivity and Its Policy Implications in Higher Education Institutions. Stud. High. Educ. 2014, 39, 1955–1971. [Google Scholar] [CrossRef]
Country | Contribution to Synthetic Control |
---|---|
Paraguay | 0.8679097 |
Bolivia | 0.03899964 |
Panama | 0.02671188 |
Uruguay | 0.01502694 |
Peru | 0.01477641 |
Venezuela | 0.009918728 |
Colombia | 0.009142159 |
Chile | 0.006639666 |
Argentina | 0.004917408 |
Mexico | 0.004029031 |
Brazil | 0.001928429 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Álvarez-Munoz, P.; Faytong-Haro, M.; Peralta Gamboa, D.A.; Aviles Valenzuela, A.M.; Pacheco-Olea, F. Evaluating Policy Efficacy in Higher Education: A Synthetic Control Analysis of Ecuador’s Higher Education Law on Research Productivity. Publications 2024, 12, 28. https://doi.org/10.3390/publications12030028
Álvarez-Munoz P, Faytong-Haro M, Peralta Gamboa DA, Aviles Valenzuela AM, Pacheco-Olea F. Evaluating Policy Efficacy in Higher Education: A Synthetic Control Analysis of Ecuador’s Higher Education Law on Research Productivity. Publications. 2024; 12(3):28. https://doi.org/10.3390/publications12030028
Chicago/Turabian StyleÁlvarez-Munoz, Patricio, Marco Faytong-Haro, Dennis Alfredo Peralta Gamboa, Angelo Marcos Aviles Valenzuela, and Fernando Pacheco-Olea. 2024. "Evaluating Policy Efficacy in Higher Education: A Synthetic Control Analysis of Ecuador’s Higher Education Law on Research Productivity" Publications 12, no. 3: 28. https://doi.org/10.3390/publications12030028
APA StyleÁlvarez-Munoz, P., Faytong-Haro, M., Peralta Gamboa, D. A., Aviles Valenzuela, A. M., & Pacheco-Olea, F. (2024). Evaluating Policy Efficacy in Higher Education: A Synthetic Control Analysis of Ecuador’s Higher Education Law on Research Productivity. Publications, 12(3), 28. https://doi.org/10.3390/publications12030028