A Case Study of Computational Thinking Analysis Using SOLO Taxonomy in Scientific–Mathematical Learning
Abstract
:1. Introduction
- -
- RQ1: To what extent does the SOLO taxonomy effectively reflect the development of computational thinking skills in pre-service elementary teachers after engagement in an educational robotics program focused on science and mathematics?
- -
- RQ2: Are there gender differences in the SOLO taxonomy levels achieved by pre-service elementary teachers after completing an intervention with educational robotics focusing on developing computational thinking skills in science and mathematics?
2. Theoretical Background
3. Materials and Methods
3.1. Study Design and Sample
3.2. Intervention
3.3. Data Analysis
4. Results
5. Discussion
6. Conclusions
7. Limitations of the Study and Future Lines of Research
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Computational Concept | SOLO Taxonomy Dimension | Items of Román-González Questionnaire [53] Associated with SOLO Taxonomy | |
---|---|---|---|
Addresses | Uni-structural | 3 | |
Multi-structural | 4 | ||
Loops | Uni-structural | 7 | |
Multi-structural | 8 | ||
Conditional | Simple | Uni-structural | 16 |
Multi-structural | 14 | ||
Compound | Uni-structural | 19 | |
Multi-structural | 18 | ||
While | Uni-structural | 24 | |
Multi-structural | 22 | ||
Functions | Uni-structural | 28 | |
Multi-structural | 25 |
References
- National Institute of Educational Technologies and Teacher Training. School of Computational Thinking and Artificial Intelligence 2021/22. From Teacher Training to Change in Methodology. Research Finding. Ministry of Education and Vocational Training. 2023. Available online: https://code.intef.es/wp-content/uploads/2023/04/09_22_Experimentacion_Investigacion-EPCIA-21-22_Investigacion-R3_ing.pdf (accessed on 13 January 2025).
- Salas-Pilco, S.Z. The impact of AI and robotics on physical, social-emotional and intellectual learning outcomes: An integrated analytical framework. Br. J. Educ. Technol. 2020, 51, 1808–1825. [Google Scholar] [CrossRef]
- Yim, I.H.Y.; Su, J. Artificial intelligence (AI) learning tools in K-12 education: A scoping review. J. Comput. Educ. 2025, 12, 93–131. [Google Scholar] [CrossRef]
- Román-González, M.; Moreno-León, J.; Robles, G. Complementary Tools for Computational Thinking Assessment. In Proceedings of the International Conference on Computational Thinking Education—CTE 2017 The Education University of Hong Kong, Hong Kong, China, 13–15 July 2017. [Google Scholar]
- Grover, S.; Pea, R. Computational thinking in K-12: A review of the state of the field. Educ. Res. 2013, 42, 38–43. [Google Scholar] [CrossRef]
- Bocconi, S.; Chioccariello, A.; Kampylis, P.; Dagienė, V.; Wastiau, P.; Engelhardt, K.; Earp, J.; Stupurienė, G. Reviewing Computational Thinking in Compulsory Education State of Play and Practices from Computing Education; Inamorato, A., Cachia, R., Giannoutsou, N., Punie, Y., Eds.; Publications Office of the European Union: Luxembourg, 2022; Available online: https://publications.jrc.ec.europa.eu/repository/handle/JRC128347 (accessed on 28 March 2025).
- Mukasheva, M.; Omirzakova, A. Computational thinking assessment at primary school in the context of learning programming. World J. Educ. Technol. Curr. Issues. 2021, 13, 336–353. [Google Scholar] [CrossRef]
- Vrachnos, E.; Jimoyiannis, A. Secondary Education Students’ Difficulties in Algorithmic Problems with Arrays: An Analysis Using the SOLO Taxonomy. Themes Sci. Technol. Educ. 2017, 10, 31–52. [Google Scholar]
- Yadav, A.; Gretter, S.; Good, J.; McLean, T. Computational thinking in teacher education. In Emerging Research, Practice, and Policy on Computational Thinking. Educational Communications and Technology: Issues and Innovations; Rich, P., Hodges, C., Eds.; Springer: Cham, Switzerland, 2017. [Google Scholar] [CrossRef]
- Bers, M.; Strawhacker, A.; Sullivan, A. The State of the Field of Computational Thinking in Early Childhood Education; Report No. 274; OECD Publishing: Paris, France, 2022. [Google Scholar] [CrossRef]
- Nouri, J.; Zhang, L.; Mannila, L.; Norén, E. Development of computational thinking, digital competence and 21st century skills when learning programming in K-9. Educ. Inq. 2019, 11, 1–17. [Google Scholar] [CrossRef]
- Sun, L.; You, X.; Zhou, D. Evaluation and development of STEAM teachers’ computational thinking skills: Analysis of multiple influential factors. Educ. Inf. Technol. 2023, 28, 14493–14527. [Google Scholar] [CrossRef]
- Weintrop, D.; Beheshti, E.; Horn, M.; Orton, K.; Jona, K.; Trouille, L.; Wilensky, U. Defining computational thinking for mathematics and science classrooms. J. Sci. Educ. Technol. 2016, 25, 127–147. [Google Scholar] [CrossRef]
- Wing, J.M. Computational thinking. Commun. ACM 2016, 49, 33–35. [Google Scholar] [CrossRef]
- Grover, S.; Pea, R. Computational Thinking: A competency whose time has come. In Computer Science Education: Perspectives on Teaching and Learning in School; Sentance, S., Barendsen, E., Carsten, S., Eds.; Bloomsbury Publishing: London, UK, 2018; pp. 19–38. [Google Scholar]
- NGSS Lead States. Next Generation Science Standards: For States, by States; The National Academies Press: Washington, DC, USA, 2013. [Google Scholar]
- Resnick, M.; Rusk, N. Coding at a crossroads. Commun. ACM 2020, 63, 120–127. [Google Scholar] [CrossRef]
- Cui, Z.; Ng, O. The interplay between mathematical and computational thinking in primary 1. school students’ mathematical problem-solving within a programming environment. J. Educ. Comput. Res. 2021, 59, 988–1012. [Google Scholar] [CrossRef]
- Bailey, D.H.; Borwein, J.M. High-precision numerical integration: Progress and challenges. J. Symb. Comput. 2020, 46, 741–754. [Google Scholar] [CrossRef]
- Herrero, J.F.Á.; Bautista, C.V. Didáctica de las ciencias, ¿de dónde venimos y hacia dónde vamos? UTE Teach. Technol. (Univ. Tarracon.) 2019, 7, 5–19. [Google Scholar] [CrossRef]
- Pei, C.; Weintrop, D.; Wilensky, U. Cultivating computational thinking practices and mathematical habits of mind in Lattice Land. Math. Think. Learn. 2018, 20, 75–89. [Google Scholar] [CrossRef]
- Gadanidis, G. Coding as a Trojan Horse for mathematics education reform. J. Comput. Math. Sci. Teach. 2015, 34, 155–173. [Google Scholar]
- Rambally, G. Integrating computational thinking in discrete structures. In Emerging Research, Practice, and Policy on Computational Thinking; Springer: Cham, Switzerland, 2017; pp. 99–119. [Google Scholar]
- Lockwood, E.; De Chenne, A. Enriching students’ combinatorial reasoning through the use of loops and conditional statements in Python. Int. J. Res. Undergrad. Math. Educ. 2022, 6, 303–346. [Google Scholar] [CrossRef]
- Sinclair, N.; Patterson, M. The dynamic geometrisation of computer programming. Math. Think. Learn. 2018, 20, 54–74. [Google Scholar] [CrossRef]
- Shumway, J.F.; Welch, L.E.; Kozlowski, J.S.; Clarke-Midura, J.; Lee, V.R. Kindergarten students’ mathematics knowledge at work: The mathematics for programming robot toys. Math. Think. Learn. 2023, 25, 380–408. [Google Scholar] [CrossRef]
- Ye, H.; Liang, B.; Ng, O.L.; Chai, C.S. Integration of computational thinking in K-12 mathematics education: A systematic review on CT-based mathematics instruction and student learning. Int. J. STEM Educ. 2023, 10, 3. [Google Scholar] [CrossRef]
- Chevalier, M.; Giang, C.; Piatti, A.; Mondada, F. Fostering computational thinking through educational robotics: A model for creative computational problem solving. Int. J. STEM Educ. Res. 2020, 7, 39. [Google Scholar] [CrossRef]
- De la Hoz, A.; Melo, L.; Álvarez, A.; Cañada, F.; Cubero, J. The Promotion of Healthy Hydration Habits through Educational Robotics in University Students. Healthcare 2023, 11, 2160. [Google Scholar] [CrossRef]
- De la Hoz, A.; Cañada, F.; Melo, L.V.; Alvarez, A.; Cubero, J. Teaching Human Hydration Science Content Through Computational Thinking and Educational Robotics. In Proceedings of the 15th Conference of the European Science Education Research Association (ESERA), Cappadocia, Turkey, 28 August–1 September 2023. [Google Scholar]
- Jaipal-Jamani, K.; Angeli, C. Effect of robotics on elementary preservice teachers’ self- efficacy, science learning, and computational thinking. J. Sci. Educ. Technol. 2017, 26, 175–192. [Google Scholar] [CrossRef]
- Biggs, J.B.; Collis, K.F. Evaluating the Quality of Learning: The SOLO Taxonomy (Structure of the Observed Learning Outcome); Academic Press: Cambridge, MA, USA, 1982. [Google Scholar]
- Biggs, J. What the student does: Teaching for enhanced learning. High. Educ. Res. Dev. 2012, 31, 39–55. [Google Scholar] [CrossRef]
- Brabrand, C.; Dahl, B. Using the SOLO taxonomy to analyze competence progression of university science curricula. High. Educ. 2009, 58, 531–549. [Google Scholar] [CrossRef]
- Almeida, A.; Araújo, E.; Figueiredo, J. Avaliando a Construção do Conhecimento em Programação Através da Taxonomia SOLO. In Proceedings of the Anais do XXXI Simpósio Brasileiro de Informática na Educação, Natal, Brazil, 24–28 November 2020; pp. 1813–1822. [Google Scholar]
- Fojcik, M.K.; Fojcik, M.; Sande, O.; Refvik, K.A.; Frantsen, T.; Bye, H. A content analysis of SOLO-levels in different computer programming courses in higher education. In Proceedings of the Norsk IKT-Konferanse for Forskning og Utdanning, Stavanger, Norway, 24–25 November 2020. [Google Scholar]
- Karvounidis, T.; Ladias, A.; Douligeris, C. Assessment of data carriers with the SOLO taxonomy in Scratch. In Proceedings of the 7th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM), Ioannina, Greece, 23–25 September 2022; pp. 1–7. [Google Scholar]
- Vidal-Szabó, P.; Estrella, S. Conocimiento Estadístico Especializado en Profesores de Educación Básica, basado en la taxonomía SOLO. Rev. Chil. Educ. Matemática 2021, 13, 134–148. [Google Scholar] [CrossRef]
- Obreque, A.S.; Uribe, M.E.M.; Richards, G.R. El aprendizaje de la Biología desde la taxonomía SOLO: Niveles SOLO en estudiantes universitarios. Contextos Estud. Humanidades Cienc. Soc. 2003, 10, 199–212. [Google Scholar]
- Uzumcu, O.; Bay, E. The effect of computational thinking skill program design developed according to interest driven creator theory on prospective teachers. Educ. Inf. Technol. 2021, 26, 565–583. [Google Scholar] [CrossRef]
- Sari, D.I.; Budayasa, I.K.; Juniati, D. The analysis of probability task completion; Taxonomy of probabilistic thinking-based across gender in elementary school students. In AIP Conference Proceedings; AIP Publishing: New York, NY, USA, 2017; Volume 1868. [Google Scholar]
- Tsan, J.; Boyer, K.E.; Lynch, C.F. How early does the CS gender gap emerge? A study of collaborative problem solving in 5th grade computer science. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education, Memphis, TN, USA, 2–5 March 2016; pp. 388–393. [Google Scholar]
- Obreque, A.S.; Salvatierra, M.O.; Danilo, D.L. Evaluation of school performance in students with excellent marks in biology. Rev. Espac. 2018, 39, 31. [Google Scholar]
- Román-González, M. Codigoalfabetización y Pensamiento Computacional en Educación Primaria y Secundaria: Validación de un Instrumento y Evaluación de Programas. Ph.D. Thesis, National University of Distance Education, Madrid, Spain, 2016. [Google Scholar]
- Lafuente Martínez, M.; Lévêque, O.; Benítez, I.; Hardebolle, C.; Zufferey, J.D. Assessing Computational Thinking: Development and Validation of the Algorithmic Thinking Test for Adults. J. Educ. Comput. Res. 2022, 60, 1436–1463. [Google Scholar] [CrossRef]
- World Medical Association. Declaration of Helsinki—Ethical Principles for Medical Research Involving Human Subjects. 2022. Available online: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/ (accessed on 17 October 2024).
- Ocaña, R. Discovering R-Commander, 3rd ed.; Andalusian School of Public Health (EASP): Andalusia, Spain, 2019; Available online: http://www.repositoriosalud.es/handle/10668/2574 (accessed on 28 May 2024).
- Yun, M.; Crippen, K.J. Computational thinking integration into pre-service science teacher education: A systematic review. J. Sci. Teach. Educ. 2025, 36, 225–254. [Google Scholar] [CrossRef]
- Nannim, F.A.; Ibezim, N.E.; Oguguo, B.C.; Nwangwu, E.C. Effect of project-based Arduino robot application on trainee teachers computational thinking in robotics programming course. Educ. Inf. Technol. 2024, 29, 13155–13170. [Google Scholar] [CrossRef]
- Rodrigues, R.N.; Brito-Costa, S.; Abbasi, M.; Costa, C.; Martins, F. Pre-service teachers’ competencies to develop computational thinking: A Portuguese tool to analyse Computational Thinking. EURASIA J. Math. Sci. Technol. Educ. 2024, 20, em2528. [Google Scholar] [CrossRef] [PubMed]
- De la Hoz Serrano, A.; Melo Niño, L.V.; Álvarez Murillo, A.; Martín Tardío, M.Á.; Cañada Cañada, F.; Cubero Juánez, J. Analysis of Gender Issues in Computational Thinking Approach in Science and Mathematics Learning in Higher Education. Eur. J. Investig. Health Psychol. Educ. 2024, 14, 2865–2882. [Google Scholar] [CrossRef] [PubMed]
- Watson, J.; Wright, S.; Fitzallen, N.; Kelly, B. Consolidating understanding of variation as part of STEM: Experimenting with plant growth. Math. Educ. Res. J. 2023, 35, 961–999. [Google Scholar] [CrossRef]
- Mol, S.M.; Matos, D.A.S. Uma análise sobre a Taxonomia SOLO: Aplicações na avaliação educacional. Estud. Avaliação Educ. 2019, 30, 722–747. [Google Scholar] [CrossRef]
- Sun, L.; Liu, J. A gender differential analysis of educational robots’ effects on primary teachers’ computational thinking: Mediating effect of programming attitudes. Educ. Inf. Technol. 2024, 29, 19753–19782. [Google Scholar] [CrossRef]
Level 2 Uni-Structural | Level 3 Multi-Structural | Level 4 Relational | Level 5 Extended Abstract |
---|---|---|---|
Paraphrase Define Identify Count Name Recite Follow Instructions | Combine Classify Structure Describe Enumerate List Algorithmic approach | Analyze Compare Contrast Integrate Relate Explain causes Apply theory | Theorize Generalize Hypothesize Predict Judge Reflect Transfer theory |
Computational Concept | SOLO Dimension | Female | Male | Total | |
---|---|---|---|---|---|
Addresses | Uni-structural | 83.54% | 100% | 88.39% | |
Multi-structural | 68.35% | 60.61% | 66.07% | ||
Loops | Repeat | Uni-structural | 75.95% | 84.85% | 78.57% |
Multi-structural | 35.44% | 45.45% | 38.39% | ||
Conditional | Simple | Uni-structural | 30.38% | 48.48% | 35.71% |
Multi-structural | 64.56% | 81.82% | 69.64% | ||
Compound | Uni-structural | 63.29% | 63.64% | 63.39% | |
Multi-structural | 73.42% | 81.82% | 75.89% | ||
While | Uni-structural | 45.57% | 63.64% | 50.89% | |
Multi-structural | 29.11% | 18.18% | 25.89% | ||
Functions | Uni-structural | 64.56% | 75.76% | 67.86% | |
Multi-structural | 36.71% | 63.64% | 44.64% | ||
Total | Uni-structural | 60.55% | 72.73% | 64.14% | |
Multi-structural | 51.27% | 58.59% | 53.42% |
Computational Concept | SOLO Dimension | Female | Male | Total | |
---|---|---|---|---|---|
Addresses | Uni-structural | 89.87% | 90.91% | 90.18% | |
Multi-structural | 77.22% | 72.73% | 75.89% | ||
Loops | Repeat | Uni-structural | 78.48% | 84.85% | 80.36% |
Multi-structural | 50.63% | 48.48% | 50.00% | ||
Conditional | Simple | Uni-structural | 37.97% | 48.48% | 41.07% |
Multi-structural | 73.42% | 72.73% | 73.21% | ||
Compound | Uni-structural | 63.29% | 60.61% | 62.50% | |
Multi-structural | 74.68% | 75.76% | 75.00% | ||
While | Uni-structural | 82.28% | 54.55% | 74.11% | |
Multi-structural | 43.04% | 39.39% | 41.96% | ||
Functions | Uni-structural | 89.87% | 93.94% | 91.07% | |
Multi-structural | 67.09% | 66.67% | 66.96% | ||
Total | Uni-structural | 73.63% | 72.22% | 73.21% | |
Multi-structural | 64.35% | 62.63% | 63.84% |
Computational Concept | SOLO Dimension | Mann–Whitney U Test | ||||
---|---|---|---|---|---|---|
Pretest | Posttest | |||||
S | p | S | p | |||
Addresses | Uni-structural | 1089 | 0.01 * | 1290 | 0.87 | |
Multi-structural | 1203 | 0.43 | 1245 | 0.62 | ||
Loops | Repeat | Uni-structural | 1188 | 0.30 | 1221 | 0.44 |
Multi-structural | 1173 | 0.33 | 1276 | 0.84 | ||
Conditional | Simple | Uni-structural | 1068 | 0.07 | 1167 | 0.31 |
Multi-structural | 1079 | 0.07 | 1295 | 0.94 | ||
Compound | Uni-structural | 1299 | 0.98 | 1269 | 0.79 | |
Multi-structural | 1194 | 0.35 | 1290 | 0.91 | ||
While | Uni-structural | 1068 | 0.08 | 942 | 0.00 * | |
Multi-structural | 1161 | 0.23 | 1256 | 0.73 | ||
Functions | Uni-structural | 1158 | 0.25 | 1251 | 0.50 | |
Multi-structural | 953 | 0.01 * | 1298 | 0.97 | ||
Total | Uni-structural | 924 | 0.01 * | 1240 | 0.68 | |
Multi-structural | 1068 | 0.13 | 1289 | 0.93 |
Computational Concept | SOLO Dimension | Wilcoxon Test | ||||||
---|---|---|---|---|---|---|---|---|
M | F | T | ||||||
S | p | S | p | S | p | |||
Addresses | Uni-structural | 6 | 0.15 | 88 | 0.28 | 137 | 0.70 | |
Multi-structural | 37 | 0.30 | 252 | 0.24 | 475 | 0.12 | ||
Loops | Repeat | Uni-structural | 18 | 1.00 | 217 | 0.72 | 351 | 0.75 |
Multi-structural | 42 | 0.81 | 222 | 0.04 * | 450 | 0.06 | ||
Conditional | Simple | Uni-structural | 39 | 1.00 | 312 | 0.34 | 561 | 0.40 |
Multi-structural | 30 | 0.35 | 285 | 0.25 | 493 | 0.56 | ||
Compound | Uni-structural | 35 | 0.43 | 259 | 0.12 | 475 | 0.04 * | |
Multi-structural | 30 | 0.80 | 155 | 0.07 | 315 | 0.06 | ||
While | Uni-structural | 72 | 0.46 | 76 | 0.00 * | 344 | 0.00 * | |
Multi-structural | 5.0 | 0.02 * | 315 | 0.09 | 408 | 0.00 * | ||
Functions | Uni-structural | 11 | 0.07 | 77.5 | 0.00 * | 143 | 0.00 * | |
Multi-structural | 56 | 0.82 | 136 | 0.00 * | 378 | 0.00 * | ||
Total | Uni-structural | 32 | 0.91 | 78 | 0.00 * | 111 | 0.00 * | |
Multi-structural | 32 | 0.53 | 78 | 0.00 * | 111 | 0.01 * |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
De la Hoz Serrano, A.; Álvarez-Murillo, A.; Fernández Torrado, E.J.; González Maestre, M.Á.; Melo Niño, L.V. A Case Study of Computational Thinking Analysis Using SOLO Taxonomy in Scientific–Mathematical Learning. Computers 2025, 14, 192. https://doi.org/10.3390/computers14050192
De la Hoz Serrano A, Álvarez-Murillo A, Fernández Torrado EJ, González Maestre MÁ, Melo Niño LV. A Case Study of Computational Thinking Analysis Using SOLO Taxonomy in Scientific–Mathematical Learning. Computers. 2025; 14(5):192. https://doi.org/10.3390/computers14050192
Chicago/Turabian StyleDe la Hoz Serrano, Alejandro, Andrés Álvarez-Murillo, Eladio José Fernández Torrado, Miguel Ángel González Maestre, and Lina Viviana Melo Niño. 2025. "A Case Study of Computational Thinking Analysis Using SOLO Taxonomy in Scientific–Mathematical Learning" Computers 14, no. 5: 192. https://doi.org/10.3390/computers14050192
APA StyleDe la Hoz Serrano, A., Álvarez-Murillo, A., Fernández Torrado, E. J., González Maestre, M. Á., & Melo Niño, L. V. (2025). A Case Study of Computational Thinking Analysis Using SOLO Taxonomy in Scientific–Mathematical Learning. Computers, 14(5), 192. https://doi.org/10.3390/computers14050192