Digital Learning Hubs: Evaluating Their Role in Fostering Complex and Computational Thinking
Abstract
1. Introduction
2. Literature Review and Conceptual Framework
2.1. Virtual Learning Ecosystems
2.2. Quality of User Experience (UX)
2.3. Complex Thinking
2.4. Computational Thinking
2.5. Evaluation of Digital Learning Hubs
3. Research Questions and Hypotheses
3.1. Research Questions
3.2. Hypotheses Development
4. Methodology
4.1. Platform Selection
- -
- Availability: publicly accessible platforms during the study period.
- -
- Relevance: international recognition in the educational field, identified through scientific literature and usage reports.
- -
- Coverage: A variety of educational resources are offered, such as content and academic levels.
- -
- Interactivity includes advanced functionalities such as learning personalization and collaborative tools.
4.2. Evaluation of Functionalities
- Internal functionalities: These include features directly related to the learning experience, such as personalization, content management, collaboration, assessment, gamification, and certification.
- External functionalities: Consider elements of initial access and interaction, such as registration, communication, privacy, availability, and languages/localization.
4.3. Usability Evaluation
- Effectiveness: ability to achieve specific objectives.
- Efficiency: optimization of time and effort when interacting with the platforms.
- Satisfaction: level of comfort and confidence perceived by users.
- Simplicity: clarity of navigation and ease of use.
4.4. Accessibility Evaluation
- Perceivable: provision of textual alternatives and distinguishable content.
- Operable: full use of the keyboard and adequate time to access the content.
- Understandable: textual clarity and error correction.
- Robust: compatibility with assistive technologies.
4.5. Evaluation of Course Availability
4.6. Instrument Validation
4.7. Data Analysis
- Descriptive: to identify general trends in functionality, usability, and accessibility, which allowed an initial characterization of the evaluated educational platforms.
- Correlational: to explore the relationships between the evaluated dimensions, highlighting significant interactions, such as the relationship between internal functionalities and the perception of usability.
- Comparative: to identify significant differences between Digital Learning Hubs and repositories, highlighting their strengths and weaknesses.
5. Results
5.1. Internal Functionalities and Usability
5.2. External Functionalities and Accessibility
- Platforms with scores above 3.5 in external functionalities achieved accessibility levels close to 3.0, while those below 2.0 obtained accessibility values below 2.0. The observed relationship confirms the importance of these functionalities in the perception of accessibility, especially those that facilitate initial access and user interaction, thus supporting hypothesis (H2).
5.3. Accessibility Principles Compliance
5.4. Accessibility and Usability in Platforms
5.5. Topic Representation in Platforms
6. Discussion
Threats to Validity
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
| Functionality | Category | Detail | Average LDH | Average Repositories | Difference | Frequency LDH (%) | Frequency Repositories (%) |
|---|---|---|---|---|---|---|---|
| Registration/Login | F01C1 | F01C1D1 F01C1D2 F01C1D3 F01C1D4 | 4.3 2.4 2 2 | 3.9 1.7 1.3 2 | +0.4 +0.7 +0.7 | 86% 48% 41% 39% | 78% 35% 26% 40% |
| F01C2 | F01C2D1 F01C2D2 F01C2D3 | 4.3 0.8 0.6 | 4 0.7 1 | +0.3 +0.1 −0.4 | 87% 15% 12% | 80% 14% 20% | |
| F01C3 | F01C3D1 F01C3D2 F01C3D3 | 0.6 3.9 0.4 | 0.9 3.4 0.8 | −0.3 +0.5 −0.4 | 13% 78% 9% | 17% 67% 16% | |
| Languages/Localization | F02C1 | F02C1D1 F02C1D2 F02C1D3 F02C1D4 F02C1D5 F02C1D6 | 2.6 0.5 0.3 1.2 0.5 0.3 | 2.9 0.4 0.2 1.1 0.4 0.3 | −0.3 +0.1 +0.1 +0.1 +0.1 | 51% 10% 7% 23% 10% 5% | 59% 9% 5% 22% 9% 5% |
| F02C2 | F02C2D1 F02C2D2 | 2.3 2.7 | 2.4 2.6 | −0.1 +0.1 | 46% 54% | 49% 51% | |
| Access/Availability | F03C1 | F03C1D1 F03C1D2 F03C1D3 F03C1D4 F03C1D5 F03C1D6 | 4.4 1.2 1 3 1.8 1.2 | 4.4 1 0.9 2.7 1.5 1 | +0.2 +0.1 +0.3 +0.3 +0.2 | 88% 23% 21% 61% 35% 24% | 88% 20% 18% 53% 30% 21% |
| F03C2 | F03C2D1 F03C2D2 F03C2D3 | 4.1 4.2 4.9 | 4.1 4.1 5.0 | +0.1 −0.1 | 83% 84% 99% | 82% 81% 99% | |
| F03C3 | F03C3D1 F03C3D2 | 3.1 1.9 | 3.1 1.9 | 62% 38% | 62% 38% | ||
| Content Management | F04C1 | F04C1D1 F04C1D2 F04C1D3 F04C1D4 F04C1D5 F04C1D6 | 3.8 4 2.8 2 2.7 0.7 | 3.5 4 2.9 1.7 2.3 0.8 | +0.3 −0.1 +0.3 +0.4 −0.1 | 75% 81% 57% 40% 54% 14% | 70% 81% 57% 35% 46% 17% |
| F04C2 | F04C2D1 F04C2D2 F04C2D3 F04C2D4 | 4.6 1.6 1.4 2.9 | 4.5 1.4 1.4 2.7 | +0.1 +0.2 +0.2 | 92% 33% 29% 57% | 89% 27% 27% 54% | |
| F04C3 | F04C3D1 F04C3D2 F04C3D3 F04C3D4 | 0.5 0.4 0.1 4 | 0.7 0.3 0 4 | −0.2 +0.1 +0.1 | 10% 7% 2% 81% | 13% 6% 1% 80% | |
| F04C4 | F04C4D1 F04C4D2 F04C4D3 | 1.2 2.5 0.5 | 1.2 2.4 0.4 | +0.1 +0.1 | 24% 50% 9% | 25% 49% 8% | |
| F04C5 | F04C5D1 F04C5D2 F04C5D3 | 1.2 3 0.7 | 1.2 3.1 0.8 | −0.1 −0.1 | 25% 60% 15% | 23% 61% 15% | |
| Personalization/Adaptability | F05C1 | F05C1D1 F05C1D2 | 2.1 2.9 | 2.6 2.4 | −0.5 +0.4 | 43% 57% | 52% 48% |
| F5C2 | F05C2D1 F05C2D2 | 2.5 2.5 | 2.7 2.3 | −0.2 +0.2 | 51% 49% | 55% 45% | |
| F05C3 | F05C3D1 F05C3D2 | 2.7 2.3 | 3.1 1.9 | −0.4 +0.4 | 53% 47% | 61% 39% | |
| F05C4 | F05C4D1 F05C4D2 | 2.8 2.2 | 3.2 1.8 | −0.4 +0.4 | 57% 43% | 65% 35% | |
| Assessment/Tracking | F06C1 | F06C1D1 F06C1D2 F06C1D3 F06C1D4 | 2.7 2.1 1.4 1.9 | 2.2 1.9 1.5 2.2 | +0.5 +0.2 −0.1 −0.3 | 54% 42% 29% 37% | 44% 37% 29% 45% |
| F06C2 | F06C2D1 F06C2D2 F06C2D3 F06C2D4 | 1.3 1.8 1.3 2.5 | 1.2 1.3 1.1 3 | +0.1 +0.5 +0.2 −0.5 | 27% 36% 25% 50% | 23% 26% 22% 60% | |
| F06C3 | F06C3D1 F06C3D2 F06C3D3 | 2.1 1.4 1.5 | 2.4 1.1 1.5 | −0.3 +0.3 | 41% 29% 30% | 47% 23% 30% | |
| Communication/Collaboration | F07C1 | F07C1D1 F07C1D2 F07C1D3 | 1.3 0.1 3.6 | 1.8 0.1 3.1 | −0.5 +0.5 | 26% 2% 72% | 37% 1% 62% |
| F07C2 | F07C2D1 F07C2D2 F07C2D3 | 1.7 1 2.3 | 1.0 1.5 2.5 | +0.7 −0.5 −0.2 | 34% 19% 47% | 20% 29% 50% | |
| F07C3 | F07C3D1 F07C3D2 F07C3D3 | 2.2 2.4 0.3 | 2.2 1.9 0.9 | +0.5 −0.6 | 44% 49% 7% | 45% 38% 18% | |
| F07C4 | F07C4D1 F07C4D2 F07C4D3 F07C4D4 | 0.4 3.3 1.2 0.1 | 0.4 3.6 0.7 0.3 | −0.3 +0.5 −0.2 | 8% 66% 24% 2% | 8% 72% 14% 6% | |
| Gamification | F08C1 | F08C1D1 F08C1D2 F08C1D3 F08C1D4 F08C1D5 | 1.4 1 0 0.2 2.4 | 1.2 0.6 0 0.1 3.1 | +0.2 +0.4 +0.1 −0.7 | 27% 20% 0% 5% 48% | 23% 12% 0% 2% 62% |
| F08C2 | F08C2D1 F08C2D2 F08C2D3 | 1.4 1.2 2.4 | 1.1 0.8 3.1 | +0.3 +0.4 −0.7 | 28% 24% 48% | 22% 15% 62% | |
| Security/Privacy | F09C1 | F09C1D1 F09C1D2 F09C1D3 F09C1D4 | 2.4 0.1 2.3 0.1 | 2.7 0.1 1.9 0.3 | −0.3 +0.4 −0.2 | 48% 3% 47% 3% | 55% 1% 38% 6% |
| F09C2 | F09C2D1 F09C2D2 F09C2D3 F09C2D4 | 1.3 0.5 2.5 0.6 | 1.7 0.2 2 1 | −0.4 +0.3 +0.5 −0.4 | 27% 10% 50% 13% | 34% 5% 41% 20% | |
| F09C3 | F09C3D1 F09C3D2 F09C3D3 | 0.5 4.2 0.3 | 0.3 4 0.7 | +0.2 +0.2 −0.4 | 11% 83% 6% | 6% 79% 15% | |
| F09C4 | F09C4D1 F09C4D2 F09C4D3 | 2.6 0.8 1.5 | 2.8 0.5 1.7 | +0.2 +0.3 −0.2 | 53% 16% 31% | 56% 10% 34% | |
| Certifications/Recognitions | F10C1 | F10C1D1 F10C1D2 F10C1D3 F10C1D4 | 1.9 0.5 0.2 2.3 | 1.8 0.2 0.1 2.9 | +0.1 +0.3 +0.1 −0.6 | 39% 10% 5% 46% | 35% 4% 2% 58% |
| F10C2 | F10C2D1 F10C2D2 | 2.6 2.4 | 1.9 3.1 | +0.7 −0.7 | 52% 48% | 38% 62% |
| Usability | Category | Detail | Average LDH | Average Repositories | Difference | Frequency LDH (%) | Frequency Repositories (%) |
|---|---|---|---|---|---|---|---|
| Effectiveness | U01C1 | U01C1D1 U01C1D2 U01C1D3 U01C1D4 U01C1D5 | 0.1 0.2 0.5 1.6 2.6 | 0.2 0.3 0.8 1.6 2.1 | −0.1 −0.1 −0.3 +0.5 | 1% 4% 10% 33% 52% | 3% 6% 15% 33% 43% |
| U01C2 | U01C2D1 U01C2D2 U01C2D3 U01C2D4 U01C2D5 | 0.1 0.2 0.6 1.9 2.2 | 0.2 0.3 0.8 1.8 1.9 | −0.1 −0.1 −0.2 +0.1 +0.3 | 2% 4% 13% 38% 43% | 4% 6% 16% 36% 38% | |
| U01C3 | U01C3D1 U01C3D2 U01C3D3 U01C3D4 U01C3D5 | 0.1 0.2 0.7 1.8 2.3 | 0.2 0.4 0.8 1.7 1.9 | −0.1 −0.2 −0.1 +0.1 +0.4 | 1% 4% 14% 35% 46% | 4% 7% 16% 34% 38% | |
| U01C4 | U01C4D1 U01C4D2 U01C4D3 U01C4D4 U01C4D5 | 0.2 0.6 2 2.3 | 0.1 0.3 0.8 1.9 1.9 | −0.1 −0.1 −0.2 −0.1 +0.4 | 1% 3% 11% 39% 46% | 3% 6% 15% 38% 38% | |
| Efficiency | U02C1 | U02C1D1 U02C1D2 U02C1D3 U02C1D4 U02C1D5 | 0.1 0.2 0.6 1.8 2.3 | 0.2 0.4 0.8 1.7 1.8 | −0.1 −0.2 −0.2 −0.1 +0.5 | 1% 4% 13% 37% 45% | 5% 8% 17% 34% 36% |
| U02C2 | U02C2D1 U02C2D2 U02C2D3 U02C2D4 U02C2D5 | 0.1 0.4 0.8 2 1.7 | 0.3 0.5 1 1.7 1.5 | −0.2 −0.1 −0.2 −0.3 +0.2 | 1% 8% 17% 41% 34% | 6% 9% 19% 35% 31% | |
| U02C3 | U02C3D1 U02C3D2 U02C3D3 U02C3D4 U02C3D5 | 0.1 0.3 0.8 2 1.8 | 0.2 0.5 1 1.8 1.5 | −0.1 −0.2 −0.2 +0.2 +0.3 | 2% 6% 17% 39% 36% | 4% 10% 19% 36% 31% | |
| Satisfaction | U03C1 | U03C1D1 U03C1D2 U03C1D3 U03C1D4 U03C1D4 | 0.1 0.3 0.7 1.9 2 | 0.3 0.5 0.8 1.8 1.6 | −0.2 −0.2 −0.1 +0.1 +0.4 | 2% 6% 13% 38% 41% | 6% 9% 17% 36% 33% |
| U03C2 | U03C2D1 U03C2D2 U03C2D3 U03C2D4 U03C2D5 | 0.1 0.3 0.7 1.9 2 | 0.3 0.5 0.9 1.8 1.6 | −0.2 −0.2 −0.2 +0.1 +0.2 | 2% 6% 15% 39% 39% | 5% 9% 18% 35% 33% | |
| U03C3 | U03C3D1 U03C3D2 U03C3D3 U03C3D4 U03C3D5 | 0.1 0.4 0.8 1.8 1.9 | 0.3 0.5 0.9 1.7 1.6 | −0.2 −0.1 −0.1 +0.1 +0.3 | 2% 8% 15% 37% 38% | 6% 11% 18% 34% 31% | |
| U03C4 | U03C4D1 U03C4D2 U03C4D3 U03C4D4 U03C4D5 | 0.1 0.3 0.7 1.9 2 | 0.2 0.4 1.1 1.6 1.7 | −0.1 −0.1 −0.4 +0.3 +0.3 | 2% 5% 15% 38% 40% | 4% 9% 21% 32% 33% | |
| Simplicity | U04C1 | U04C1D1 U04C1D2 U04C1D3 U04C1D4 U04C1D5 | 0.1 0.2 0.8 2 1.9 | 0.2 0.5 0.8 1.9 1.6 | −0.1 −0.3 −0.1 +0.3 | 2% 4% 16% 41% 38% | 5% 9% 16% 38% 33% |
| U04C2 | U04C2D1 U04C2D2 U04C2D3 U04C2D4 U04C2D5 | 0.1 0.3 0.8 1.8 2 | 0.3 0.5 0.8 1.7 1.7 | −0.2 −0.2 +0.1 +0.3 | 2% 6% 16% 35% 41% | 6% 9% 17% 34% 34% | |
| U04C3 | U04C3D1 U04C3D2 U04C3D3 U04C3D4 U04C3D5 | 0.1 0.4 0.8 1.7 2 | 0.2 0.4 0.6 1.9 1.9 | −0.1 +0.2 −0.2 +0.1 | 2% 7% 17% 33% 41% | 4% 8% 12% 38% 38% | |
| U04C4 | U04C4D1 U04C4D2 U04C4D3 U04C4D4 U04C4D5 | 0.1 0.2 0.6 2.1 2.1 | 0.2 0.4 0.7 1.9 1.8 | −0.1 −0.2 −0.1 +0.2 +0.3 | 1% 3% 12% 41% 42% | 4% 9% 14% 38% 36% | |
| Compatibility and Accessibility | U05C1 | U05C1D1 U05C1D2 U05C1D3 U05C1D4 U05C1D5 | 0.1 0.4 1.9 2.5 | 0.1 0.2 0.5 1.8 2.4 | −0.1 −0.1 −0.1 +0.1 +0.1 | 1% 2% 9% 38% 51% | 3% 4% 10% 35% 48% |
| U05C2 | U05C2D1 U05C2D2 U05C2D3 U05C2D4 U05C2D5 | 0.1 0.2 0.8 2 1.9 | 0.2 0.3 0.8 1.8 2 | −0.1 −0.1 +0.2 −0.1 | 1% 4% 16% 40% 39% | 4% 5% 16% 35% 40% | |
| Interactivity | U06C1 | U06C1D1 U06C1D2 U06C1D3 U06C1D4 U06C1D5 | 0.1 0.4 1.9 2.5 | 0.2 0.2 0.6 1.8 2.2 | −0.2 −0.1 −0.2 +0.1 +0.3 | 1% 3% 8% 37% 51% | 4% 4% 12% 36% 44% |
| U06C2 | U06C2D1 U06C2D2 U06C2D3 U06C2D4 U06C2D5 | 0.1 0.1 0.5 1.8 2.5 | 0.2 0.2 0.6 1.9 2.1 | −0.1 −0.1 −0.1 −0.1 +0.4 | 1% 2% 10% 36% 50% | 3% 5% 12% 37% 42% | |
| U06C3 | U06C3D1 U06C3D2 U06C3D3 U06C3D4 U06C3D5 | 0.1 0.1 0.6 2.2 2 | 0.2 0.4 0.6 2.1 1.7 | −0.1 −0.3 +0.1 +0.3 | 1% 3% 12% 45% 39% | 4% 7% 13% 42% 34% | |
| User-Centered Design | U07C1 | U07C1D1 U07C1D2 U07C1D3 U07C1D4 U07C1D5 | 0.1 0.2 0.8 2.1 1.8 | 0.2 0.5 0.9 1.7 1.6 | −0.1 −0.3 −0.1 +0.4 +0.2 | 2% 4% 17% 41% 37% | 5% 10% 19% 34% 33% |
| U07C2 | U07C2D1 U07C2D2 U07C2D3 U07C2D4 U07C2D5 | 0.2 0.4 1.1 1.5 1.9 | 0.7 0.6 0.9 1.5 1.3 | −0.5 −0.2 +0.2 +0.6 | 4% 8% 21% 30% 38% | 14% 12% 19% 29% 26% | |
| U07C3 | U07C3D1 U07C3D2 U07C3D3 U07C3D4 U07C3D5 | 0.1 0.2 0.8 2.1 1.8 | 0.3 0.6 1 1.5 1.6 | −0.2 −0.4 −0.2 +0.6 +0.2 | 2% 4% 16% 41% 36% | 6% 12% 19% 31% 32% | |
References
- Tawil, S.; Miao, F. Steering the Digital Transformation of Education: UNESCO’s Human-Centered Approach. Front. Digit. Educ. 2024, 1, 51–58. [Google Scholar] [CrossRef]
- Vincent-Lancrin, S.; González-Sancho, C. Interoperability: Unifying and Maximising Data Reuse within Digital Education Ecosystems; OECD Publishing: Paris, France, 2023. [Google Scholar]
- Bagga, M.K.; Agrati, L.S. Digitalization in education: Developing tools for effective learning and personalisation of education. Front. Educ. 2024, 9, 1463596. [Google Scholar] [CrossRef]
- Prado, B.D.B.; Gobbo Junior, J.A.; Bezerra, B.S. Emerging themes for digital accessibility in education. Sustainability 2023, 15, 11392. [Google Scholar] [CrossRef]
- Chong, H.T.; Lim, C.K.; Ahmed, M.F.; Tan, K.L.; Mokhtar, M.B. Virtual reality usability and accessibility for cultural heritage practices: Challenges mapping and recommendations. Electronics 2021, 10, 1430. [Google Scholar] [CrossRef]
- Fonseca, D.; García-Peñalvo, F.J.; Camba, J.D. New methods and technologies for enhancing usability and accessibility of educational data. Univers. Access Inf. Soc. 2021, 20, 421–427. [Google Scholar] [CrossRef]
- Dimitrova, M.; Bogdanova, G.; Noev, N.; Sabev, N.; Angelov, G.; Paunski, Y.; Ekmekci, M.; Krastev, A. Digital Accessibility for People with Special Needs: Conceptual Models and Innovative Ecosystems. In Proceedings of the 2023 8th International Conference on Smart and Sustainable Technologies (SpliTech), Split/Bol, Croatia, 20–23 June 2023; IEEE: New York, NY, USA, 2023; pp. 1–5. [Google Scholar]
- Timbi-Sisalima, C.; Sánchez-Gordón, M.; Hilera-Gonzalez, J.R.; Otón-Tortosa, S. Quality Assurance in E-Learning: A Proposal from Accessibility to Sustainability. Sustainability 2022, 14, 3052. [Google Scholar] [CrossRef]
- Granić, A. Technology Acceptance and Adoption in Education. In Handbook of Open, Distance and Digital Education; Springer: Singapore, 2022. [Google Scholar]
- Rusu, C.; Rusu, V.; Roncagliolo, S.; González, C. Usability and user experience: What should we care about? Int. J. Inf. Technol. Syst. Approach 2015, 8, 1–12. [Google Scholar] [CrossRef]
- Chvanova, M.S. Digital educational ecosystem’s functional abilities for promotion of master’s degree students’ research and innovative activities. Tambov Univ. Rev. Ser. Humanit. 2023, 28, 1043–1062. [Google Scholar] [CrossRef]
- Krakowski, A.; Greenwald, E.; Roman, N.; Morales, C.; Loper, S. Computational Thinking for Science: Positioning coding as a tool for doing science. J. Res. Sci. Teach. 2024, 61, 1574–1608. [Google Scholar] [CrossRef]
- Márquez Díaz, J.E.; Domínguez Saldaña, C.A.; Rodríguez Avila, C.A. Virtual World as a Resource for Hybrid Education. Int. J. Emerg. Technol. Learn. 2020, 15, 94–109. [Google Scholar] [CrossRef]
- Briscoe, G.; Sadedin, S.; Wilde, P. Digital Ecosystems: Ecosystem-Oriented Architectures. Nat. Comput. 2011, 10, 1143–1194. [Google Scholar] [CrossRef]
- Saggah, A.; Atkins, A.S.; Campion, R.J. A Repository Collaboration Model to Gamify Education Using Synergistic Digital Hub. In Proceedings of the 2020 4th World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), London, UK, 27–28 July 2020; IEEE: New York, NY, USA, 2020; pp. 651–655. [Google Scholar]
- Langegård, U.; Kiani, K.; Nielsen, S.J.; Svensson, P.A. Nursing students’ experiences of a pedagogical transition from campus learning to distance learning using digital tools. BMC Nurs. 2021, 20, 23. [Google Scholar] [CrossRef]
- Kucirkova, N.; Littleton, K. Digital learning hubs: Theoretical and practical ideas for innovating massive open online courses. Learn. Media Technol. 2017, 42, 324–330. [Google Scholar] [CrossRef]
- Crupi, A.; Del Sarto, N.; Di Minin, A.; Gregori, G.L.; Lepore, D.; Marinelli, L.; Spigarelli, F. The digital transformation of SMEs–a new knowledge broker called the digital innovation hub. J. Knowl. Manag. 2020, 24, 1263–1288. [Google Scholar] [CrossRef]
- Martins, D. Digital Human Resources Management HUB: Exploring their Importance as Learning Space. In Proceedings of the 23rd European Conference on Knowledge Management, Naples, Italy, 1–2 September 2022; University of Aveiro: Aveiro, Portugal, 2022; Volume 2. [Google Scholar]
- Barykin, S.; Kapustina, I.; Kirillova, T.; Yadykin, V.; Konnikov, Y. Economics of Digital Ecosystems. J. Open Innov. Technol. Mark. Complex. 2020, 6, 124. [Google Scholar] [CrossRef]
- Santos-Hermosa, G.; Ferran-Ferrer, N.; Abadal, E. Repositories of open educational resources: An assessment of reuse and educational aspects. Int. Rev. Res. Open Distrib. Learn. 2017, 18, 84–120. [Google Scholar] [CrossRef]
- Richardson, J.C.; Castellanos Reyes, D.; Janakiraman, S.; Duha, M.S.U. The process of developing a digital repository for online teaching using design-based research. TechTrends 2023, 67, 217–230. [Google Scholar] [CrossRef]
- Zibani, P.; Rajkoomar, M.; Naicker, N. A systematic review of faculty research repositories at higher education institutions. Digit. Libr. Perspect. 2022, 38, 237–248. [Google Scholar] [CrossRef]
- Rivas, A.; González-Briones, A.; Hernández, G.; Prieto, J.; Chamoso, P. Artificial neural network analysis of the academic performance of students in virtual learning environments. Neurocomputing 2021, 423, 713–720. [Google Scholar] [CrossRef]
- Dodero, J.; Palomo-duarte, M.; Ruiz-Rube, I.; Traverso, I.; Mota, J.; Balderas, A. Learning Technologies and Semantic Integration of Learning Resources. IEEE Rev. Iberoam. Tecnol. Aprendiz. 2015, 10, 11–16. [Google Scholar] [CrossRef]
- Rötkönen, E.; Winschiers-Theophilus, H.; Winschiers-Goagoses, N.; Zaman, T.; Itenge, H.; Tan, D.Y.W.; Sutinen, E. Creating Smart Connected Learning Ecosystems: A Hybrid Model for Design-Based Learning. IxD&A 2022, 52, 81–100. [Google Scholar]
- Vasileva, T.; Tchoumatchenko, V.; Lakkala, M.; Kosonen, K. Infrastructure supporting collaborative project based learning in engineering education. Int. J. Eng. Educ. 2011, 27, 656–669. [Google Scholar]
- Jacka, L. Successful Integration of Virtual Worlds in Learning Environments: A Case Study of a Supportive Learning Ecosystem. Interdiscip. J. Virtual Learn. Med. Sci. 2021, 12, 169–176. [Google Scholar]
- Morin, E. Introduccion al Pensamiento Complejo; Gedisa Editorial: Barcelona, Spain, 1995. [Google Scholar]
- Montoya, M.S.R.; McGreal, R.; Agbu, J.-F.O. Horizontes digitales complejos en el futuro de la educación 4.0: Luces desde las recomendaciones de UNESCO. RIED Rev. Iberoam. Educ. Distancia 2022, 25, 9–21. [Google Scholar]
- Ramírez-Montoya, M.S.; Castillo-Martínez, I.M.; Sanabria-Zepeda, J.C.; Miranda, J. Complex Thinking in the Framework of Education 4.0 and Open Innovation—A Systematic Literature Review. J. Open Innov. Technol. Mark. Complex. 2022, 8, 4. [Google Scholar] [CrossRef]
- Sanabria-Z, J.C.; Castillo-Martínez, I.M.; González-Pérez, L.I.; Ramírez-Montoya, M.S. Complex thinking through a Transition Design-guided Ideathon: Testing an AI platform on the topic of sharing economy. Front. Educ. 2023, 8, 1186731. [Google Scholar] [CrossRef]
- O Ochieng, V.; Gyasi, R.M. Open educational resources and social justice: Potentials and implications for research productivity in higher educational institutions. E-Learn. Digit. Media 2021, 18, 105–124. [Google Scholar] [CrossRef]
- Chaleta, E. Higher education and sustainable development goals (SDG)-potential contribution of the undergraduate courses of the school of social sciences of the University of Évora. Sustainability 2021, 13, 1828. [Google Scholar] [CrossRef]
- Chowdhary, K.R. “Natural Language Processing”, en Fundamentals of Artificial Intelligence; Springer: New Delhi, India, 2020; pp. 603–649. [Google Scholar]
- Wu, R.; Yu, Z. Do AI chatbots improve students learning outcomes? Evidence from a meta-analysis. Br. J. Educ. Technol. 2023, 55, 10–33. [Google Scholar] [CrossRef]
- Chakraborty, P. Computer, computer science, and computational thinking: Relationship between the three concepts. Hum. Behav. Emerg. Technol. 2024, 2024, 5044787. [Google Scholar] [CrossRef]
- Buitrago Flórez, F.; Casallas, R.; Hernández, M.; Reyes, A.; Restrepo, S.; Danies, G. Changing a generation’s way of thinking: Teaching computational thinking through programming. Rev. Educ. Res. 2017, 87, 834–860. [Google Scholar] [CrossRef]
- Yadav, A.; Stephenson, C.; Hong, H. Computational thinking for teacher education. Commun. ACM 2017, 60, 55–62. [Google Scholar] [CrossRef]
- Alfaro Ponce, B.; Patiño, A.; Sanabria-Z, J. Components of computational thinking in citizen science games and its contribution to reasoning for complexity through digital game-based learning: A framework proposal. Cogent Educ. 2023, 10, 2191751. [Google Scholar] [CrossRef]
- Susanti, R.D.; Taufik, M. Analysis of Student Computational Thinking in Solving Social Statistics Problems. Supremum J. Math. Educ. 2021, 5, 1–9. [Google Scholar] [CrossRef]
- Eickelmann, B.; Labusch, A.; Vennemann, M. Computational thinking and problem-solving in the context of IEA-ICILS 2018. In Empowering Learners for Life in the Digital Age, Proceedings of the IFIP TC 3 Open Conference on Computers in Education, OCCE 2018, Linz, Austria, 24–28 June 2018; Revised Selected Papers; Springer International Publishing: Cham, Switzerland, 2019; pp. 14–23. [Google Scholar]
- Alturkistani, A.; Lam, C.; Foley, K.; Stenfors, T.; Blum, E.R.; Van Velthoven, M.H.; Meinert, E. Massive open online course evaluation methods: Systematic review. J. Med. Internet Res. 2020, 22, e13851. [Google Scholar] [CrossRef] [PubMed]
- Huallpa, J.J.; Al, E. Exploring the ethical considerations of using Chat GPT in university education. Period. Eng. Nat. Sci. (PEN) 2023, 11, 105. [Google Scholar] [CrossRef]
- Mehrvarz, M.; Keshavarzi, F.; Heidari, E.; McLaren, B.M. Improving computational thinking: The role of students’ networking skills and digital informal learning. Interact. Learn. Environ. 2024, 32, 6081–6095. [Google Scholar] [CrossRef]
- Huang, R.; Tlili, A.; Chang, T.-W.; Zhang, X.; Nascimbeni, F.; Burgos, D. Disrupted classes, undisrupted learning during COVID-19 outbreak in China: Application of open educational practices and resources. Smart Learn. Environ. 2020, 7, 19. [Google Scholar] [CrossRef] [PubMed]
- Nusbaum, A.T.; Cuttler, C.; Swindell, S. Open educational resources as a tool for educational equity: Evidence from an introductory psychology class. Front. Educ. 2020, 4, 152. [Google Scholar] [CrossRef]
- Gherheș, V.; Stoian, C.E.; Fărcașiu, M.A.; Stanici, M. E-learning vs. face-to-face learning: Analyzing students’ preferences and behaviors. Sustainability 2021, 13, 4381. [Google Scholar] [CrossRef]
- Rose, D. Universal design for learning. J. Spec. Educ. Technol. 2000, 15, 47–51. [Google Scholar] [CrossRef]
- Fatmawati, A. Evaluasi Usability pada Learning Management System OpenLearning Menggunakan System Usability Scale. Inovtek Polbeng-Seri Inform. 2021, 6, 120–134. [Google Scholar] [CrossRef]
- Creswell, J.W.; Poth, C.N. Qualitative Inquiry and Research Design: Choosing Among Five Approaches; Sage Publications: Thousand Oaks, CA, USA, 2016. [Google Scholar]
- May, T.; Perry, B. Social Research: Issues, Methods and Process; McGraw-Hill Education: Maidenhead, UK, 2022. [Google Scholar]
- Creswell, J.W.; Creswell, J.D. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches; SAGE Publications: Thousand Oaks, CA, USA, 2017. [Google Scholar]
- Arshad, R.; Majeed, A.; Afzal, H.; Muzammal, M.; ur Rahman, A. Evaluation of navigational aspects of Moodle. Int. J. Adv. Comput. Sci. Appl. 2016, 7, 258–264. [Google Scholar] [CrossRef]
- Ortega-Morán, J.F.; Pagador, J.B.; Sánchez-Peralta, L.F.; Sánchez-González, P.; Noguera, J.; Burgos, D.; Gómez, E.J.; Sánchez-Margallo, F.M. Validation of the three web quality dimensions of a minimally invasive surgery e-learning platform. Int. J. Med. Inform. 2017, 107, 1–10. [Google Scholar] [CrossRef] [PubMed]
- Soltanzadeh, L.; Sangar, A.B.; Majidzadeh, K. The Review of Usability Evaluation Methods on Tele health or Telemedicine Systems. Front. Health Inform. 2022, 11, 112. [Google Scholar] [CrossRef]
- Ryan, G.S.; Haroon, M.; Melvin, G. Evaluation of an educational website for parents of children with ADHD. Int. J. Med. Inform. 2015, 84, 974–981. [Google Scholar] [CrossRef] [PubMed]
- Kenter, R.M.F.; Schønning, A.; Inal, Y. Internet-Delivered Self-help for Adults With ADHD (MyADHD): Usability Study. Jmir Form. Res. 2022, 6, e37137. [Google Scholar] [CrossRef] [PubMed]
- Gordillo, A.; Barra, E.; Aguirre, S.; Quemada, J. The usefulness of usability and user experience evaluation methods on an e-Learning platform development from a developer’s perspective: A case study. In Proceedings of the 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, Madrid, Spain, 22–25 October 2014; IEEE: New York, NY, USA, 2014. [Google Scholar]
- Amante, L.; Souza, E.B.; Quintas-Mendes, A.; Miranda-Pinto, M. Designing a mooc on computational thinking, programming and robotics for early childhood educators and primary school teachers: A pilot test evaluation. Educ. Sci. 2023, 13, 863. [Google Scholar] [CrossRef]
- Umutlu, D. Tpack leveraged: A redesigned online educational technology course for stem preservice teachers. Australas. J. Educ. Technol. 2022, 38, 99–116. [Google Scholar] [CrossRef]
- Creswell, J.W.; Clark, V.L.P. Designing and Conducting Mixed Methods Research; Sage Publications: Thousand Oaks, CA, USA, 2017. [Google Scholar]
- Poma, A.; Rodríguez, G.; Torres, P. User Experience Evaluation in MOOC Platforms: A Hybrid Approach. In Iberoamerican Workshop on Human-Computer Interaction; Springer International Publishing: Cham, Switzerland, 2021; pp. 208–224. [Google Scholar]
- Abubakari, M.S.; Hungilo, G. Evaluating an e-Learning platform at graduate school based on user experience evaluation technique. J. Phys. Conf. Ser. 2021, 1737, 012019. [Google Scholar] [CrossRef]
- Martin, J.L.; Salvatierra, H.A.; González, J.R.H. MOOCs for all: Evaluating the accessibility of top MOOC platforms. Int. J. Eng. Educ. 2016, 32, 2274–2283. [Google Scholar]
- Nurbekova, Z.; Aimicheva, G.; Baigusheva, K.; Sembayev, T.; Mukametkali, M. A Decision-Making Platform for Educational Content Assessment Within a Stakeholder-Driven Digital Educational Ecosystem. Int. J. Eng. Pedagog. 2023, 13, 4–23. [Google Scholar] [CrossRef]
- Oliva-Cordova, L.M.; Garcia-Cabot, A.; Alejandra Recinos-Fernandez, S.; Suleny Bojorquez-Roque, M.; Amado-Salvatierra, H.R. Evaluating technological acceptance of virtual learning environments (VLE) in an emergency remote situation. Int. J. Eng. Educ. 2022, 38, 421–436. [Google Scholar]
- Bojórquez-Roque, M.S.; Garcia-Cabot, A.; Garcia-Lopez, E.; Oliva-Córdova, L.M. Digital competence learning ecosystem in higher education: A mapping and systematic review of the literature. IEEE Access 2024, 12, 87596–87614. [Google Scholar] [CrossRef]








| No. | Platform Name | URL |
|---|---|---|
| R01 | Agrega | agrega2.es |
| R02 | Archive | archive.org |
| R03 | Europeana | europeana.eu |
| R04 | HippoCampus | hippocampus.org |
| R05 | MERLOT | merlot.org |
| R06 | NDL | ndl.iitkgp.ac.in |
| R07 | OER Commons | oercommons.org |
| R08 | Open Michigan | open.umich.edu |
| R09 | OpenStax | openstax.org |
| R10 | RITEC | repositorio.tec.mx |
| R11 | TED-Ed | ed.ted.com |
| R12 | Wikiversity | wikiversity.org |
| No. | Platform Name | URL |
|---|---|---|
| H01 | Alison | alison.com |
| H02 | Coursera | coursera.org |
| H03 | edX | edx.org |
| H04 | FutureLearn | futurelearn.com |
| H05 | GitHub Education | education.github.com |
| H06 | INTEF | intef.es |
| H07 | Khan Academy | khanacademy.org |
| H08 | MiriadaX | miriadax.net |
| H09 | OpenCourseWare | ocw.mit.edu |
| H10 | OpenLearn | open.edu/openlearn |
| H11 | P2PU | p2pu.org |
| H12 | Saylor Academy | saylor.org |
| H13 | Udemy | udemy.com |
| Functionality (10) | Attributes (32) | |
|---|---|---|
| F01 | Registration/Login | Login methods, password recovery and security, ease of registration |
| F02 | Languages/Localization | Available languages, cultural adaptation |
| F03 | Access/Availability | Content language, compatible devices, offline access to resources |
| F04 | Content Management | Content types, resource organization, content updates, resource evaluation, user-generated content management |
| F05 | Personalization/Adaptability | Interest-based recommendations, progress adaptation, skill-based adjustments, personalized learning paths |
| F06 | Assessment/Tracking | Assessment tools, progress monitoring, customized reporting |
| F07 | Communication/Collaboration | Communication methods, collaborative tools, automated notifications, technical support |
| F08 | Gamification | Gamification elements, progress-based rewards |
| F09 | Security/Privacy | Data protection, role-based access levels, security standards compliance, help center |
| F10 | Certifications/Recognition | Certification types, official recognition |
| Category (7) | Indicators (23) | |
|---|---|---|
| U01 | Effectiveness | - Easily find educational content. |
| - Facilitates access to necessary content. | ||
| - Efficient access to content. | ||
| - Provides appropriate tools for accessing content. | ||
| U02 | Efficiency | - Finds content in minimal time. |
| - Optimizes effort and clicks required. | ||
| - Minimizes effort to locate content. | ||
| U03 | Satisfaction | - The system is comfortable to use. |
| - Easy to use. | ||
| - Intuitive design with no frustration. | ||
| - Overall experience is satisfactory. | ||
| U04 | Simplicity | - Navigation is straightforward. |
| -The interface is clear and not confusing. | ||
| - Avoids unnecessary visual elements. | ||
| - Interaction is easy without learning new tools. | ||
| U05 | Compatibility and Accessibility | - Works well across different devices. |
| - Accessible for users with diverse technical needs. | ||
| U06 | Interactivity | - Quickly responds to user actions. |
| - Provides a seamless experience. | ||
| - Allows uncomplicated interaction. | ||
| U07 | User-Centered Design | - Designed with user needs in mind. |
| - Enables feedback on system usage. | ||
| - Understands user’s needs when accessing educational content. |
| No. | Principle (4) | Guideline (12) |
|---|---|---|
| A01 | Perceivable | 1.1. Provide text alternatives |
| 1.2. Provide alternatives for time-based media | ||
| 1.3. Create adaptable content | ||
| 1.4. Make content distinguishable | ||
| A02 | Operable | 2.1. Make all functionality keyboard accessible |
| 2.2. Provide enough time to read and use content | ||
| 2.3. Avoid content that causes seizures | ||
| 2.4. Help users navigate | ||
| A03 | Understandable | 3.1. Ensure text content is readable |
| 3.2. Make web pages operate predictably | ||
| 3.3. Help users avoid and correct errors | ||
| A04 | Robust | 4.1. Maximize compatibility with assistive technologies |
| No. | Criterion | Description |
|---|---|---|
| CA1 | Platform | Name of the Digital Learning Hub analyzed. |
| CA2 | Total Courses | Total number of courses available on the platform. |
| CA3 | Complex Thinking Courses (%) | The percentage of courses related to complex thinking is related to the total. |
| CA4 | Computational Thinking Courses (%) | Percentage of courses focused on computational thinking relative to the total. |
| CA5 | Other Categories Courses (%) | Proportion of courses in other subject areas. |
| CA6 | Access Type | Defines whether courses are free, require enrollment, or are paid. |
| CA7 | Assessment and Certification | Indicates whether courses include formal assessments and official certification upon completion. |
| Validation Type | Method Used | Details |
|---|---|---|
| Content Validation | Expert review | Five experts in educational technology and human–computer interaction evaluated the instrument. |
| Pilot Test | Student evaluation | Conducted with 15 students to ensure clarity and consistency in the assessment criteria. |
| Reliability Analysis | Cronbach’s Alpha (α) | Functionalities (α = 0.83), Usability (α = 0.87), Overall (α = 0.85). |
| Accessibility Tool | TAW (Web Accessibility Test) | Automated tool based on WCAG 2.1, widely validated in accessibility studies. |
| U01 | U02 | U03 | U04 | U05 | U06 | U07 | σ | ||
|---|---|---|---|---|---|---|---|---|---|
| H01 | 2.3 | 2.3 | 2.4 | 2.2 | 2.3 | 2.3 | 2.2 | 2.3 | 0.07 |
| H02 | 2.5 | 2.4 | 2.5 | 2.4 | 2.5 | 2.4 | 2.4 | 2.44 | 0.05 |
| H03 | 2.4 | 2.3 | 2.4 | 2.3 | 2.4 | 2.4 | 2.3 | 2.36 | 0.05 |
| H04 | 2.2 | 2.1 | 2.2 | 2.1 | 2.2 | 2.2 | 2.1 | 2.16 | 0.05 |
| H05 | 1.9 | 1.9 | 2 | 1.9 | 1.9 | 2 | 1.9 | 1.93 | 0.05 |
| H06 | 1.8 | 1.8 | 1.8 | 1.8 | 1.9 | 1.9 | 1.8 | 1.86 | 0.05 |
| H07 | 2.4 | 2.3 | 2.4 | 2.3 | 2.4 | 2.4 | 2.3 | 2.36 | 0.05 |
| H08 | 2 | 2 | 2.1 | 2 | 2.1 | 2.1 | 2 | 2.06 | 0.03 |
| H09 | 2.3 | 2.2 | 2.3 | 2.2 | 2.3 | 2.3 | 2.3 | 2.26 | 0.05 |
| H10 | 2 | 2 | 2 | 2 | 2.1 | 2.1 | 2 | 2.03 | 0.03 |
| H11 | 1.8 | 1.8 | 1.8 | 1.8 | 1.9 | 1.8 | 1.8 | 1.85 | 0.02 |
| H12 | 1.9 | 1.9 | 1.9 | 1.9 | 2 | 1.9 | 1.9 | 1.94 | 0.02 |
| H13 | 2.3 | 2.2 | 2.3 | 2.2 | 2.3 | 2.3 | 2.3 | 2.26 | 0.05 |
| R01 | 1.7 | 1.6 | 1.7 | 1.6 | 1.7 | 1.7 | 1.7 | 1.67 | 0.0 |
| R02 | 1.8 | 1.8 | 1.8 | 1.8 | 1.9 | 1.8 | 1.8 | 1.85 | 0.0 |
| R03 | 2 | 2 | 2 | 2 | 2.1 | 2.1 | 2 | 2.01 | 0.0 |
| R04 | 1.9 | 1.9 | 2 | 1.9 | 2 | 2 | 1.9 | 1.95 | 0.0 |
| R05 | 2.1 | 2.1 | 2.2 | 2.1 | 2.2 | 2.2 | 2.1 | 2.16 | 0.0 |
| R06 | 1.9 | 1.9 | 1.9 | 1.9 | 2 | 1.9 | 1.9 | 1.95 | 0.0 |
| R07 | 1.9 | 1.9 | 1.9 | 1.9 | 2 | 1.9 | 1.9 | 1.95 | 0.0 |
| R08 | 1.8 | 1.8 | 1.8 | 1.8 | 1.9 | 1.8 | 1.8 | 1.85 | 0.0 |
| R09 | 1.9 | 1.9 | 1.9 | 1.9 | 2 | 1.9 | 1.9 | 1.95 | 0.0 |
| R10 | 1.7 | 1.7 | 1.7 | 1.7 | 1.8 | 1.7 | 1.7 | 1.72 | 0.0 |
| R11 | 2.3 | 2.3 | 2.3 | 2.3 | 2.4 | 2.4 | 2.3 | 2.32 | 0.1 |
| R12 | 1.8 | 1.8 | 1.8 | 1.8 | 1.9 | 1.8 | 1.8 | 1.85 | 0.0 |
| Hypothesis | Result | Comments |
|---|---|---|
| H1 | Accepted | A positive correlation (r = 0.89, p < 0.001) confirms the critical role of internal functionalities. |
| H2 | Accepted | Significant relationships (r = 0.91, p < 0.001) emphasize external functionalities’ impact on inclusivity. |
| H3 | Partially Accepted | High performance in perceivability; significant deficiencies in Operable and Understandable. |
| H4 | Accepted | Strong correlation (r = 0.87, p < 0.001); demonstrates the interconnectedness of these variables. |
| H5 | Partially Accepted | Only 10% of the evaluated platforms provide substantial resources in these areas, underscoring significant opportunities for enhancement. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Alvarez-Icaza, I.; Oliva-Córdova, L.M.; Tariq, R.; Martín-Núñez, J.L. Digital Learning Hubs: Evaluating Their Role in Fostering Complex and Computational Thinking. Future Internet 2026, 18, 55. https://doi.org/10.3390/fi18010055
Alvarez-Icaza I, Oliva-Córdova LM, Tariq R, Martín-Núñez JL. Digital Learning Hubs: Evaluating Their Role in Fostering Complex and Computational Thinking. Future Internet. 2026; 18(1):55. https://doi.org/10.3390/fi18010055
Chicago/Turabian StyleAlvarez-Icaza, Inés, Luis Magdiel Oliva-Córdova, Rasikh Tariq, and José Luis Martín-Núñez. 2026. "Digital Learning Hubs: Evaluating Their Role in Fostering Complex and Computational Thinking" Future Internet 18, no. 1: 55. https://doi.org/10.3390/fi18010055
APA StyleAlvarez-Icaza, I., Oliva-Córdova, L. M., Tariq, R., & Martín-Núñez, J. L. (2026). Digital Learning Hubs: Evaluating Their Role in Fostering Complex and Computational Thinking. Future Internet, 18(1), 55. https://doi.org/10.3390/fi18010055

