Effects of Mobile Learning in English Language Learning: A Meta-Analysis and Research Synthesis
Abstract
:1. Introduction
1.1. M-Learning in English Education
1.2. Related Work
1.3. Purpose of the Study
2. Methods
2.1. Selection of the Studies
2.2. Data Coding
2.3. Calculation of the Effect Size
2.4. Moderating Effect Analysis
2.4.1. Education Level
2.4.2. Pedagogical Approach
2.4.3. Learning Environment
2.4.4. Mobile Device
2.4.5. Control Treatment
3. Results
3.1. Descriptive Data of the Studies
3.2. Effects of m-Learning on Student Learning
3.2.1. Heterogeneity Test
3.2.2. Publication Bias
3.3. Moderator Analysis
4. Discussion
4.1. Effects of M-Learning on Student Learning in English Education
4.2. Moderator Analysis
4.2.1. Education Level
4.2.2. Pedagogical Approach
4.2.3. Learning Environment
4.2.4. Mobile Device
4.2.5. Control Treatment
4.3. Implications for Theory and Practice
5. Limitations of the Study
6. Future Research
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- West, M.; Vosloo, S. Policy Guidelines for Mobile Learning; Kraut, R., Ed.; UNESCO Publishing: Paris, France, 2013; ISBN 978-92-3-001143-7. [Google Scholar]
- UNESCO Global Education Coalition. Available online: https://en.unesco.org/covid19/educationresponse/globalcoalition (accessed on 15 February 2023).
- Baran, E. A Review of Research on Mobile Learning in Teacher Education. Educ. Technol. Soc. 2014, 17, 17–32. [Google Scholar]
- van der Vlies, R. Digital Strategies in Education across OECD Countries: Exploring Education Policies on Digital Technologies; OECD: Paris, France, 2020. [Google Scholar]
- Hylén, J. Turning on Mobile Learning in Europe: Illustrative Initiatives and Policy Implications; UNESCO Publishing: Paris, France, 2012. [Google Scholar]
- Bazzanella, S. Digital Education Strategy and Implementation Plan—African Union; African Union: Addis Ababa, Ethiopia, 2022. [Google Scholar]
- Thomas, N.; Bowen, N.E.J.A.; Reynolds, B.L.; Osment, C.; Pun, J.K.H.; Mikolajewska, A. A Systematic Review of the Core Components of Language Learning Strategy Research in Taiwan. Engl. Teach. Learn. 2021, 45, 355–374. [Google Scholar] [CrossRef]
- Qiu, J. A Preliminary Study of English Mobile Learning Model Based on Constructivism. Theory Pract. Lang. Stud. 2019, 9, 1167–1172. [Google Scholar] [CrossRef] [Green Version]
- Orak, S.D.; Al-Khresheh, M.H. In between 21st Century Skills and Constructivism in Elt: Designing a Model Derived from a Narrative Literature Review. World J. Engl. Lang. 2021, 11, 166–176. [Google Scholar] [CrossRef]
- Aziza, N. The Importance of English Language. Int. J. Orange Technol. 2020, 2, 22–24. [Google Scholar]
- Rao, P. The Role of English as a Global Language. Res. J. Engl. 2019, 4, 65–79. [Google Scholar]
- Yu, Z.; Yu, L.; Xu, Q.; Xu, W.; Wu, P. Effects of Mobile Learning Technologies and Social Media Tools on Student Engagement and Learning Outcomes of English Learning. Technol. Pedagog. Educ. 2022, 31, 381–398. [Google Scholar] [CrossRef]
- Klimova, B. Evaluating Impact of Mobile Applications on EFL University Learners’ Vocabulary Learning—A Review Study. Procedia Comput. Sci. 2021, 184, 859–864. [Google Scholar] [CrossRef]
- Santos, J.; Figueiredo, A.S.; Vieira, M. Innovative Pedagogical Practices in Higher Education: An Integrative Literature Review. Nurse Educ. Today 2019, 72, 12–17. [Google Scholar] [CrossRef]
- Borenstein, M.; Hedges, L.V.; Higgins, J.P.T.; Rothstein, H.R. Introduction to Meta-Analysis, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2021; ISBN 9780470057247. [Google Scholar]
- Glass, G.V.; Smith, M.L.; McGaw, B. Meta-Analysis in Social Research; Sage Publications Incorporated: Thousand Oaks, CA, USA, 1981. [Google Scholar]
- Cohen, J. Quantitative Methods in Psychology. Psychol. Bull. 1992, 112, 155–159. [Google Scholar] [CrossRef]
- Hedges, L.V.; Olkin, I. Statistical Methods for Meta-Analysis; Academic Press: New York, NY, USA, 1985. [Google Scholar]
- Talan, T. The Effect of Mobile Learning on Learning Performance: A Meta-Analysis Study. Educ. Sci. Theory Pract. 2020, 20, 79–103. [Google Scholar] [CrossRef]
- Güler, M.; Bütüner, S.Ö.; Danişman, Ş.; Gürsoy, K. A Meta-Analysis of the Impact of Mobile Learning on Mathematics Achievement. Educ. Inf. Technol. 2021, 27, 1725–1745. [Google Scholar] [CrossRef]
- Burden, K.; Kearney, M.; Schuck, S.; Hall, T. Investigating the Use of Innovative Mobile Pedagogies for School-Aged Students: A Systematic Literature Review. Comput. Educ. 2019, 138, 83–100. [Google Scholar] [CrossRef]
- Kim, J.H.; Park, H. Effects of Smartphone-Based Mobile Learning in Nursing Education: A Systematic Review and Meta-Analysis. Asian Nurs. Res. 2019, 13, 20–29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Sung, Y.T.; Yang, J.M.; Lee, H.Y. The Effects of Mobile-Computer-Supported Collaborative Learning: Meta-Analysis and Critical Synthesis. Rev. Educ. Res. 2017, 87, 768–805. [Google Scholar] [CrossRef] [Green Version]
- Cho, K.; Lee, S.; Joo, M.H.; Becker, B.J. The Effects of Using Mobile Devices on Student Achievement in Language Learning: A Meta-Analysis. Educ. Sci. 2018, 8, 13–15. [Google Scholar] [CrossRef] [Green Version]
- Chen, Z.; Chen, W.; Jia, J.; An, H. The Effects of Using Mobile Devices on Language Learning: A Meta-Analysis. Educ. Technol. Res. Dev. 2020, 68, 1769–1789. [Google Scholar] [CrossRef]
- Lin, J.J.; Lin, H. Mobile-Assisted ESL/EFL Vocabulary Learning: A Systematic Review and Meta-Analysis. Comput. Assist. Lang. Learn. 2019, 32, 878–919. [Google Scholar] [CrossRef]
- Chen, M.L. The Impact of Mobile Learning on the Effectiveness of English Teaching and Learning—A Meta-Analysis. IEEE Access 2022, 10, 38324–38334. [Google Scholar] [CrossRef]
- Garzón, J.; Lampropoulus, G.; Burgos, D. Mobile English Learning: A Meta-Analysis. In Proceedings of the Learning Technologies and Systems for Education—ICWL 2022—21st International Conference, ICWL 2022, Tenerife, Spain, 21–23 November 2022; González-González, C.S., Fernández-Manjón, B., Li, F., Peñalvo, F.J.G., Sciarrone, F., Spaniol, M., García-Holgado, A., Moreira, M.A., Hemmje, M., Hao, T., Eds.; Springer: Berlin/Heidelberg, Germany, 2023. [Google Scholar]
- Gurevitch, J.; Koricheva, J.; Nakagawa, S.; Stewart, G. Meta-Analysis and the Science of Research Synthesis. Nature 2018, 555, 175–182. [Google Scholar] [CrossRef]
- Pigott, T.D.; Polanin, J.R. Methodological Guidance Paper: High-Quality Meta-Analysis in a Systematic Review. Rev. Educ. Res. 2020, 90, 24–46. [Google Scholar] [CrossRef] [Green Version]
- Garzón, J.; Kinshuk; Baldiris, S.; Gutiérrez, J.; Pavón, J. How Do Pedagogical Approaches Affect the Impact of Augmented Reality on Education? A Meta-Analysis and Research Synthesis. Educ. Res. Rev. 2020, 31, 100334. [Google Scholar] [CrossRef]
- Higgins, J.P.T.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2019. [Google Scholar]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. Syst. Rev. 2021, 10, 105906. [Google Scholar] [CrossRef] [PubMed]
- Krippendorff, K. Content Analysis: An Introduction to Its Methodology; Sage Publications: Thousand Oaks, CA, USA, 2018. [Google Scholar]
- Cohen, L.; Manion, L.; Morrison, K. Research Methods in Education; Routledge: London, UK, 2002; ISBN 9780203224342. [Google Scholar]
- Morris, S.B. Estimating Effect Sizes from Pretest-Posttest-Control Group Designs. Organ. Res. Methods 2008, 11, 364–386. [Google Scholar] [CrossRef]
- Morris, S.B.; DeShon, R.P. Combining Effect Size Estimates in Meta-Analysis with Repeated Measures and Independent-Groups Designs. Psychol. Methods 2002, 7, 105–125. [Google Scholar] [CrossRef]
- Thalheimer, W.; Cook, S. How to Calculate Effect Sizes from Published Research: A Simplified Methodology. Available online: https://paulogentil.com/pdf/How%20to%20calculate%20effect%20sizes%20from%20published%20research%20-%20a%20simplified%20methodology.pdf (accessed on 15 February 2023).
- Hedges, L.V.; Pigott, T.D. The Power of Statistical Tests for Moderators in Meta-Analysis. Psychol. Methods 2004, 9, 426–445. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Lipsey, M.W.; Wilson, D.B. Practical Meta-Analysis; Sage Publications: Thousand Oaks, CA, USA, 2001; ISBN 9780761921684. [Google Scholar]
- ISCED 2011; UNESCO International Standard Classification of Education. UNESCO Institute for Statistics: Montreal, QC, Canada, 2012; ISBN 9789291891238.
- Hainey, T.; Connolly, T.M.; Boyle, E.A.; Wilson, A.; Razak, A. A Systematic Literature Review of Games-Based Learning Empirical Evidence in Primary Education. Comput. Educ. 2016, 102, 202–223. [Google Scholar] [CrossRef]
- Bano, M.; Zowghi, D.; Kearney, M.; Schuck, S.; Aubusson, P. Mobile Learning for Science and Mathematics School Education: A Systematic Review of Empirical Evidence. Comput. Educ. 2018, 121, 30–58. [Google Scholar] [CrossRef]
- Garzón, J.; Acevedo, J. Meta-Analysis of the Impact of Augmented Reality on Students’ Learning Effectiveness. Educ. Res. Rev. 2019, 27, 244–260. [Google Scholar] [CrossRef]
- Huedo-Medina, T.B.; Sánchez-Meca, J.; Marín-Martínez, F.; Botella, J. Assessing Heterogeneity in Meta-Analysis: Q Statistic or I2 Index? Psychol. Methods 2006, 11, 193–206. [Google Scholar] [CrossRef] [Green Version]
- Duval, S.; Tweedie, R. Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis. Biometrics 2000, 56, 455–463. [Google Scholar] [CrossRef] [PubMed]
- Egger, M.; Smith, G.D.; Schneider, M.; Minder, C. Bias in Meta-Analysis Detected by a Simple, Graphical Test. BMJ 1997, 315, 629–634. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rosenthal, R. Parametric Measures of Effect Size. In The Handbook of Research Synthesis; Cooper, H., Hedges, L., Eds.; Russell Sage Foundation: New York, NY, USA, 1994; pp. 231–244. [Google Scholar]
- Ozer, O.; Kılıç, F. The Effect of Mobile-Assisted Language Learning Environment on EFL Students’ Academic Achievement, Cognitive Load and Acceptance of Mobile Learning Tools. EURASIA J. Math. Sci. Technol. Educ. 2018, 14, 2915–2928. [Google Scholar] [CrossRef]
- Elaish, M.M.; Shuib, L.; Ghani, N.A.; Yadegaridehkordi, E. Mobile English Language Learning (MELL): A Literature Review. Educ. Rev. 2019, 71, 257–276. [Google Scholar] [CrossRef]
- Cohen, A.; Henry, A. Focus on the Language Learner: Styles, Strategies and Motivation 1. In An Introduction to Applied Linguistics; Routledge: Abington, UK, 2019; pp. 165–189. [Google Scholar]
- Bolatli, G.; Kizil, H. The Effect of Mobile Learning on Student Success and Anxiety in Teaching Genital System Anatomy. Anat. Sci. Educ. 2021, 15, 155–165. [Google Scholar] [CrossRef] [PubMed]
- Afreen, R. Bring Your Own Device (BYOD) in Higher Education: Opportunities and Challenges. Int. J. Emerg. Trends Technol. Comput. Sci. 2014, 3, 233–236. [Google Scholar]
- Belda-medina, J.; Marrahi-gomez, V. The Impact of Augmented Reality (AR) on Vocabulary Acquisition and Student Motivation. Electronics 2023, 12, 749. [Google Scholar] [CrossRef]
- Elaish, M.M.; Shuib, L.; Abdul Ghani, N.; Yadegaridehkordi, E.; Alaa, M. Mobile Learning for English Language Acquisition: Taxonomy, Challenges, and Recommendations. IEEE Access 2017, 5, 19033–19047. [Google Scholar] [CrossRef]
Moderator | Description | ||||
---|---|---|---|---|---|
Education level | 7.90 | ||||
Preschool education | 2 | 0.51 | 0.66 | Medium | |
Primary education | 10 | 0.90 | <0.001 | Large | |
Secondary education | 21 | 0.80 | <0.001 | Large | |
Vocational education | 6 | 0.64 | 0.03 | Medium | |
Bachelor’s level | 22 | 1.11 | <0.001 | Very large | |
Pedagogical approach | 8.37 | ||||
Situated learning | 8 | 0.95 | <0.001 | Large | |
Game-based learning | 11 | 0.78 | <0.001 | Large | |
Collaborative learning | 7 | 1.45 | <0.001 | Very large | |
Multimedia learning | 6 | 0.65 | 0.88 | Medium | |
Learning environment | 7.96 * | ||||
Formal settings | 39 | 0.73 | <0.001 | Medium | |
Semi-formal settings | 17 | 1.08 | <0.001 | Large | |
Multiple settings | 6 | 1.38 | <0.001 | Very large | |
Mobile device | 12.06 * | ||||
Personal digital assistant | 2 | 1.58 | <0.001 | Huge | |
Smartphone | 47 | 0.97 | <0.001 | Large | |
Tablet | 13 | 0.56 | 0.07 | Medium | |
Control treatment | 23.85 * | ||||
Traditional lectures | 32 | 1.04 | <0.001 | Large | |
Traditional pedagogical tool | 21 | 0.88 | <0.001 | Large | |
Multimedia resource | 9 | 0.43 | 0.56 | Medium |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Garzón, J.; Lampropoulos, G.; Burgos, D. Effects of Mobile Learning in English Language Learning: A Meta-Analysis and Research Synthesis. Electronics 2023, 12, 1595. https://doi.org/10.3390/electronics12071595
Garzón J, Lampropoulos G, Burgos D. Effects of Mobile Learning in English Language Learning: A Meta-Analysis and Research Synthesis. Electronics. 2023; 12(7):1595. https://doi.org/10.3390/electronics12071595
Chicago/Turabian StyleGarzón, Juan, Georgios Lampropoulos, and Daniel Burgos. 2023. "Effects of Mobile Learning in English Language Learning: A Meta-Analysis and Research Synthesis" Electronics 12, no. 7: 1595. https://doi.org/10.3390/electronics12071595
APA StyleGarzón, J., Lampropoulos, G., & Burgos, D. (2023). Effects of Mobile Learning in English Language Learning: A Meta-Analysis and Research Synthesis. Electronics, 12(7), 1595. https://doi.org/10.3390/electronics12071595