Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective
Abstract
:1. Introduction
2. Background
2.1. Usability and Usability Evaluation
2.2. Microsoft Teams
2.3. Evaluation of Microsoft Teams and Online Learning Platforms
3. Evaluation Procedure and Results
4. Discussion of Results
5. Research Insights
6. Conclusions and Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Heuristics | Explanation |
---|---|
Ensures visibility of system status | Users should always be kept up to date on developments by the design, which should provide important and relevant feedback in a timely manner. |
Maximizes match between the system and the real world | The interface should be user-friendly. Instead of using internal jargon, utilize words, phrases, and ideas that the user is already familiar with. Present information in a natural and logical order, and observe real-world conventions. |
Maximizes user control and freedom | Users can undo mistakes and stop unwanted actions, while also having an “emergency exit” that is marked clearly and available to them. |
Consistent and matches standards | Users should not have to guess whether various expressions, circumstances, or actions mean the same thing. Operating system rules and standards are adhered to. |
Prevents errors | Since concise error messages are crucial, the best designs take care to predict problems before they occur. Before users take an action, error-prone scenarios should either be avoided, detected, or provided with a confirmation option. |
Supports recognition rather than recall | The amount of memory required from the user should be reduced by making elements, options, and actions visible. When users navigate between different parts of the interface, they should not need to remember a lot of information. For example, menu options should be obvious and simple to find. |
Supports flexibility and efficiency of use | The design serves both inexperienced and experienced users by using shortcuts that accelerate interactions for expert users whilst such shortcuts remain hidden from novice users. The design should allow users to customize routine actions. |
Uses aesthetic and minimalist design | Interface should not have unnecessary information or less frequently used functions because having such information added to an interface has the potential to reduce the visibility of core functions. |
Helps users recognize, diagnose and recover from errors | Expressing error messages in simple terms where the problem is identified clearly and offering a recommendation for a fix. |
Provides help and documentation | The system should be self-explanatory to enable users to carry out the tasks that they require, documentation might be needed. |
References
- World Health Organization. WHO Timeline—COVID-19, March 2020. Available online: https://www.who.int/news-room/detail/27-04-2020-who-timeline-covid-19 (accessed on 4 September 2020).
- Robinson, C.C.; Hullinger, H. New benchmarks in higher education: Student engagement in online learning. J. Educ. Bus. 2008, 84, 101–109. [Google Scholar] [CrossRef]
- Nielsen, J.; Molich, R. Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Seattle, WA, USA, 1–5 April 1990. [Google Scholar]
- International Organization for Standardization. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)-Part 11: Guidance on Usability; International Organization for Standardization: Geneva, Switzerland, 1998. [Google Scholar]
- IEEE Brand Experience. Introduction to Web Usability and Accessibility. IEEE Brand Experience. Available online: https://brand-experience.ieee.org/resources/usability/ (accessed on 26 January 2022).
- Interaction Design Foundation. What Is Usability? The Interaction Design Foundation, UX Courses. 2014. Available online: https://www.interaction-design.org/literature/topics/usability (accessed on 26 January 2022).
- Nielsen, J. Usability 101: Introduction to Usability. Nielsen Norman Group, 3 January 2012. Available online: https://www.nngroup.com/articles/usability-101-introduction-to-usability/ (accessed on 26 January 2022).
- Barnum, C.M. Usability Testing Essentials: Ready, Set…Test! Morgan Kaufmann: Burlington, MA, USA, 2020. [Google Scholar]
- Ismail, H.; Khelifi, A.; Harous, S. A Cognitive Style Based Framework for Usability Evaluation of Online Lecturing Platforms-A Case Study on Zoom and Teams. Int. J. Eng. Pedagog. 2022, 12, 104–122. [Google Scholar] [CrossRef]
- Quiñones, D.; Rusu, C. How to develop usability heuristics: A systematic literature review. Comput. Stand. Interfaces 2017, 53, 89–122. [Google Scholar] [CrossRef]
- Usability Evaluation Methods|Usability.Gov. Usability.gov. 2019. Available online: https://www.usability.gov/how-to-and-tools/methods/usability-evaluation/index.html (accessed on 4 February 2022).
- Nielsen, J.; Robert, M. Usability Inspection Methods; John Wiley: New York, NY, USA, 1994; ISBN 0-471-01877-5-14. [Google Scholar]
- Nielsen, J. Usability inspection methods. In Proceedings of the Conference Companion on Human Factors in Computing Systems, Boston, MA, USA, 28 April 1994; pp. 413–414. [Google Scholar]
- Interaction Design Foundation. “What Is Heuristic Evaluation?” The Interaction Design Foundation, UX Courses. 2019. Available online: www.interaction-design.org/literature/topics/heuristic-evaluation (accessed on 27 October 2020).
- Nielsen, J. 10 Heuristics for User Interface Design. Nielsen Norman Group, Nielsen Norman Group, 24 April 1994. Available online: https://www.nngroup.com/articles/ten-usability-heuristics/ (accessed on 24 September 2022).
- Squires, D.; Preece, J. Predicting Quality in Educational Software: Evaluating for Learning, Usability and the Synergy between Them. Interact. Comput. 1999, 11, 467–483. [Google Scholar] [CrossRef]
- Albion, P. Heuristic evaluation of educational multimedia: From theory to practice. In Proceedings of the ASCILITE 1999: 16th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education: Responding to Diversity, Brisbane, Australia, 5–8 December 1999; pp. 9–15. [Google Scholar]
- Brayshaw, M.; Gordon, N.; Nganji, J.; Wen, L.; Butterfield, A. Investigating heuristic evaluation as a methodology for evaluating pedagogical software: An analysis employing three case studies. In International Conference on Learning and Collaboration Technologies; Springer: Cham, Switzerland, 2014. [Google Scholar]
- Jokela, T.; Koivumaa, J.; Pirkola, J.; Salminen, P.; Kantola, N. Methods for quantitative usability requirements: A case study on the development of the user interface of a mobile phone. Pers. Ubiquitous Comput. 2006, 10, 345–355. [Google Scholar] [CrossRef]
- Spataro, J. Microsoft Teams Reaches 13 Million Daily Active Users, Introduces 4 New Ways for Teams to Work Better Together. Microsoft 365 Blog. 2019. Available online: https://www.microsoft.com/en-us/microsoft-365/blog/2019/07/11/microsoft-teams-reaches-13-million-daily-active-users-introduces-4-new-ways-for-teams-to-work-better-together/ (accessed on 26 August 2022).
- Foley, M. Microsoft: Teams Now has More Than 270 Million Monthly Active Users. ZDNet. 2022. Available online: https://www.zdnet.com/article/microsoft-teams-now-has-more-than-270-million-monthly-active-users/ (accessed on 21 August 2022).
- Arora, A.K.; Srinivasan, R. Impact of pandemic COVID-19 on the teaching–learning process: A study of higher education teachers. Prabandhan Indian J. Manag. 2020, 13, 43–56. [Google Scholar] [CrossRef] [PubMed]
- Aboagye, E.; Yawson, J.A.; Appiah, K.N. COVID-19 and E-learning: The challenges of students in Tertiary Institutions. Soc. Educ. Res. 2021, 2, 1–8. [Google Scholar] [CrossRef]
- Bsharat, T.R.; Behak, F. The impact of Microsoft teams’ app in enhancing teaching-learning English during the Coronavirus (COVID-19) from the English teachers’ perspectives’ in Jenin city. Malays. J. Sci. Health Technol. 2020, 7. [Google Scholar] [CrossRef]
- Sari, T.; Nayır, F. Challenges in distance education during the (Covid-19) pandemic period. Qual. Res. Educ. 2020, 9, 328–360. [Google Scholar] [CrossRef]
- Abushamleh, H.; Jusoh, S. Usability Evaluation of Distance Education Tools Used in Jordanian Universities. In 2021 Innovation and New Trends in Engineering, Science and Technology Education Conference (IETSEC); IEEE: Amman, Jordan, 2021; pp. 1–5. [Google Scholar] [CrossRef]
- Pal, D.; Vanijja, V. Perceived usability evaluation of Microsoft Teams as an online learning platform during COVID-19 using system usability scale and technology acceptance model in India. Child. Youth Serv. Rev. 2020, 119, 105535. [Google Scholar] [CrossRef] [PubMed]
Usability Attribute | Application in Online Teaching |
---|---|
Specified users | Educators |
Effectively meeting goal | Delivering online lecture |
Context | Online Teaching in Higher Education institutions |
Heuristics | Experts’ Evaluation (Microsoft Teams) | Experts’ Evaluation (Zoom) |
---|---|---|
Ensures visibility of system status | 4 | 5 |
4 | 4 | |
2 | 3 | |
3 | 4 | |
Avg: 3.25 | Avg: 4 | |
Maximizes match between the system and the real world | 5 | 5 |
4 | 4 | |
3 | 4 | |
4 | 4 | |
Avg: 4 | Avg: 4.25 | |
Maximizes user control and freedom | 4 | 4 |
3 | 2 | |
4 | 4 | |
3 | 3 | |
Avg: 3.5 | Avg: 3.25 | |
Consistent and matches standards | 4 | 4 |
4 | 4 | |
4 | 4 | |
4 | 4 | |
Avg: 4 | Avg: 4 | |
Prevents Errors | 4 | 4 |
4 | 3 | |
2 | 3 | |
3 | 4 | |
Avg: 3.25 | Avg: 3.5 | |
Supports recognition rather than recall | 3 | 4 |
2 | 3 | |
3 | 4 | |
2 | 4 | |
Avg: 2.5 | Avg: 3.75 | |
Supports flexibility and efficiency | 4 | 3 |
3 | 3 | |
3 | 3 | |
4 | 4 | |
Avg: 3.5 | Avg: 3.25 | |
Uses aesthetic and minimalist design | 4 | 3 |
4 | 4 | |
4 | 4 | |
4 | 4 | |
Avg: 4 | Avg: 3.75 | |
Helps users recognize and recover from errors | 4 | 4 |
3 | 3 | |
4 | 4 | |
3 | 4 | |
Avg: 3.5 | Avg: 3.75 | |
Provides help and documentation | 4 | 4 |
4 | 4 | |
4 | 2 | |
4 | 4 | |
Avg: 4 | Avg: 3.5 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Al-Qora’n, L.; Salem, O.A.S.; Gordon, N. Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective. Computers 2022, 11, 175. https://doi.org/10.3390/computers11120175
Al-Qora’n L, Salem OAS, Gordon N. Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective. Computers. 2022; 11(12):175. https://doi.org/10.3390/computers11120175
Chicago/Turabian StyleAl-Qora’n, Lamis, Omar Al Sheik Salem, and Neil Gordon. 2022. "Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective" Computers 11, no. 12: 175. https://doi.org/10.3390/computers11120175
APA StyleAl-Qora’n, L., Salem, O. A. S., & Gordon, N. (2022). Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective. Computers, 11(12), 175. https://doi.org/10.3390/computers11120175