Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus
Abstract
1. Introduction
- What are the similarities and differences in LAL practices among English language teachers in Norway and Cyprus?
- How confident are teachers in their LAL competencies?
- What are teachers’ perceived training needs regarding LAL?
- How do teachers view digital environments for LAL training?
1.1. Educational Contexts
1.2. Literature Review
2. Materials and Methods
2.1. Participants
2.2. Teaching Experience
2.3. Assessment Training and Practices
2.4. Data Collection and Instruments
2.5. Data Analysis
3. Results
3.1. Content of Teacher Assessment (Q.6)
3.2. Feedback Practices (Q.7)
3.3. Assessment Methods (Q.8)
3.4. Comparative Analysis of Norwegian and Cypriot Teachers’ Confidence Levels (Q.9) and Preferred Training Needs (Q.10) in Assessment
3.5. Online Training Format (Q.11)
3.6. Training Materials (Q.12)
4. Discussion
4.1. Explicit Justification for Selecting Norway and Cyprus
4.2. Strengthening Discussion Through Theoretical Connections
4.3. Expanded Implications with Concrete Recommendations
4.4. Study Limitations
5. Conclusions
Author Contributions
Funding
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
AfL | assessment-for-learning |
AL | assessment literacy |
CEFR | Common European Framework of Reference for Languages |
CoP | community of practice |
LAL | language assessment literacy |
PLC | professional learning community |
SEN | special educational needs |
Appendix A. Teacher Questionnaire
Appendix A.1. General Information
- (1)
- Gender:
- male
- female
- (2)
- Age:
- under 25
- 26–35
- 36–45
- 46–55
- 56+
- (3)
- Years of teaching experience:
- pre-service teacher
- 1–5
- 6–10
- 10–15
- 15+
- (4)
- Age range of your learners (you may choose more than one answer):
- 6–12
- 13–15
- 16–17
- over 18
- (5)
- Have you received any testing and assessment training?
- Yes
- No
Appendix A.2. Assessment Practices
- (6)
- Which of these skills/areas do you assess? (more than one answer is possible)
- Speaking
- Writing
- Vocabulary
- Grammar
- Reading
- Listening
- Other? Please specify ________
- (7)
- What feedback do you give on your learners’ assessment results? (more than one answer is possible)
- Mark (percentage, points, letter grade, etc.)
- Brief comments (e.g., “well done!”)
- Detailed comments on learners’ work (written/oral)
- Comments/hints on how to improve their learning
- Other? Please specify: _____________________________________________
- (8)
- How often do you use the following methods to assess your learners’ English (please tick ✔)?
Very Frequently | Frequently | Sometimes | Never | |
1. Oral presentations | ||||
2. Tests with open-ended answers | ||||
3. Portfolio assessment | ||||
4. Peer assessment | ||||
5. Tests with closed answers (e.g., gaps, multiple choice, matching exercises) | ||||
6. Self-assessment | ||||
7. Extended writing, e.g., letters, essays | ||||
8. Active class participation | ||||
9. Translation (L1/L2) | ||||
10. Other? Please specify:_________ |
Appendix A.3. Assessment Profiles and Training Needs
- (9)
- FIRST, please indicate how confident you feel about the following areas (please tick ✔)
- (10)
- THEN, wherever you feel you need training, mark the last column on the right with a tick ✔:
Question 9 | Question 10 | ||||
Very Confident | Confident | Somewhat Confident | Not Confident | I’d Like Training in This (✔): | |
1. I can identify different purposes of assessment. | |||||
2. I can choose assessment methods that are suitable for my learners. | |||||
3. I can design classroom-based tests. | |||||
4. I can assess my learners’ listening skills. | |||||
5. I can assess my learners’ speaking skills. | |||||
6. I can assess my learners’ reading skills. | |||||
7. I can assess my learners’ writing skills. | |||||
8. I can assess my learners’ skills in an integrated way, e.g., reading a text and writing about it. | |||||
9. I can use self-assessment to assess my learners. | |||||
10. I can use peer assessment to assess my learners. | |||||
11. I can use student portfolios to assess my learners. | |||||
12. I can assess learners with special learning needs, e.g., dyslexia, learning impairment. | |||||
13. I can prepare my learners for external tests, e.g., school leaving exams, international exams. | |||||
14. I can use assessment results to make decisions about individual students. | |||||
15. I can use assessment results to plan teaching. | |||||
16. I can identify how tests influence my teaching. | |||||
17. I can identify the relevance of the Common European Framework of Reference (CEFR) for the assessment of my learners. | |||||
18. I can explain assessment results to pupils. | |||||
19. I can explain assessment results to parents and others. | |||||
20. I can recognize inappropriate (e.g., invalid, unreliable, biased) assessment methods. |
- (11)
- The format I prefer for a training event offered in an online learning environment on language assessment is …… (please tick ✔):
Very Useful | Somewhat Useful | Less Useful | Not Useful at All | |
1. Printed self-study materials | ||||
2. Interactive online course | ||||
3. Online resources for self-study | ||||
4. Combination of online self-study and face-to-face course | ||||
5. Other? Please specify: ____________________ |
- (12)
- In a training course about assessment in an online learning environment, I would find the following useful (please tick ✔):
Very Useful | Somewhat Useful | Less Useful | Not Useful At All | |
1. Short video presentation illustrating specific points | ||||
2. Materials to read (articles, summaries) | ||||
3. Introduction to practical materials | ||||
4. Discussing assessment materials with other teachers | ||||
5. Trying out and evaluating assessment materials | ||||
6. Other? Please specify: ________________________ |
References
- Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. [Google Scholar] [CrossRef] [PubMed]
- Borg, M. (2001). Teachers’ beliefs. ELT Journal, 55(2), 186–188. [Google Scholar] [CrossRef]
- Borg, S. (2003). Teacher cognition in language teaching: A review of research on what language teachers think, know, believe, and do. Language Teaching, 36(2), 81–109. [Google Scholar] [CrossRef]
- Bøhn, H. (2018). Assessing content in a curriculum-based EFL oral exam: The importance of higher-order thinking skills. Journal of Language Teaching and Research, 9(1), 16–26. Available online: https://www.academypublication.com/issues2/jltr/vol09/01/01.html (accessed on 1 May 2025). [CrossRef]
- Bøhn, H., & Tsagari, D. (2021). Teacher educators’ conceptions of language assessment literacy in Norway. Journal of Language Teaching and Research, 12(2), 2. [Google Scholar] [CrossRef]
- Bøhn, H., & Tsagari, D. (2022). Language assessment literacy: Understanding the construct from Norwegian EFL teachers’ perspective. Studies in Language Assessment, 11(1), 119–148. [Google Scholar] [CrossRef]
- Bøhn, H., & Tsagari, D. (2024). Collaborative assessment cultures and the development of LAL. In B. Baker, & L. Taylor (Eds.), Language assessment literacy and competence volume 1: Research and reflections from the field (pp. 223–230). Cambridge University Press. [Google Scholar]
- Burner, T. (2019). Assessment in secondary education (Norway). In K. Hognestad, M. T. Tatto, & I. Menter (Eds.), Bloomsbury education and childhood studies. Bloomsbury. Available online: http://www.becs-bloomsbury.com/becscol/article (accessed on 1 May 2025).
- Burns, A. (1996). Starting all over again: From teaching adults to teaching beginners. In D. Freeman, & J. C. Richards (Eds.), Teacher learning in language teaching (pp. 154–177). Cambridge University Press. Available online: https://books.google.com/books?hl=en&lr=&id=GWzIOgRvgp8C&oi=fnd&pg=PA154&dq=info:IkJoa30yrhQJ:scholar.google.com&ots=CBzjXfPJrb&sig=GNNEYaomEsTMxbSkVlygYZ9eFVU (accessed on 1 May 2025).
- Caspersen, J., & Smeby, J.-C. (2023). Research-based teacher education in Norway—A longitudinal perspective. International Journal of Educational Research, 119, 102177. [Google Scholar] [CrossRef]
- Chvala, L., & Graedler, A.-L. (n.d.). Assessment in English. In S. Dobson, & R. Engh (Eds.), Vurdering for læring i fag (pp. 75–89). Cappelen Damm Høyskoleforlaget. [Google Scholar]
- Cohen, L., Manion, L., & Morrison, K. (2011). Research methods in education (7th ed.). Routledge. [Google Scholar] [CrossRef]
- Council of Europe. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge University Press. [Google Scholar]
- Cyprus Ministry of Education, Sport and Youth (MOEC). (n.d.). Foreign languages. Available online: https://archeia.moec.gov.cy/mc/2/xenes_glosses_gymnasio_lykeio.pdf (accessed on 1 May 2025).
- Eurydice. (2024). Norway. Available online: https://eurydice.eacea.ec.europa.eu/national-education-systems/norway/assessment-single-structure-education (accessed on 1 May 2025).
- Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. [Google Scholar] [CrossRef]
- Gay, G. (2018). Culturally responsive teaching: Theory, research, and practice (3rd ed.). Teachers College Press. [Google Scholar]
- Hansen, J., Eliassen, E., Romøren, A. S. H., Kleppe, R., Garmann, N. G., & Bjørnestad, E. (2023). Acquisition of the majority language in Norwegian ECEC: Relating language-learning environment in ECEC to expressive vocabulary. Nordisk Barnehageforskning, 20(1), 1. [Google Scholar] [CrossRef]
- Hasselgreen, A., Carlsen, C., & Helness, H. (2004). European survey of language and assessment needs. Part one: General findings. Available online: http://www.ealta.eu.org/documents/resources/survey-report-pt1.pdf (accessed on 1 May 2025).
- Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. [Google Scholar] [CrossRef]
- Karagiorgi, Y., & Petridou, A. (2019). National literacy assessment: The identification of students ‘at risk’ in Cyprus. Research Papers in Education, 34(1), 1–13. [Google Scholar] [CrossRef]
- Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100–120. [Google Scholar] [CrossRef]
- Kvasova, O., & Kavytska, T. (2014). The assessment competence of university foreign language teachers: A Ukrainian perspective. Language Learning in Higher Education, 4(1), 159–177. [Google Scholar] [CrossRef]
- Lamprianou, I., Tsagari, D., & Kyriakou, N. (2021). The longitudinal stability of rating characteristics in an EFL examination: Methodological and substantive considerations. Language Testing, 38(2), 273–301. [Google Scholar] [CrossRef]
- Looney, J., Husby, A., & Røynestad, T.-D. (2008). Case study: Norway (Teaching, learning and assessment for adults: Improving foundation skills teaching). OECD Publishing. [Google Scholar]
- Maaoui, A., Tsagari, D., & Dammak, H. (2023). The relationship between language educators’ perceptions and assessment practices during the COVID-19 crisis. Languages, 8(1), 54. [Google Scholar] [CrossRef]
- Mavroudi, A., & Tsagari, D. (2018). Profiling of English language teachers as trainees in an online course and ensuing implications. Computers & Education, 126, 1–12. [Google Scholar] [CrossRef]
- Meletiadou, E., & Tsagari, D. (2012). Investigating the attitudes of adolescent EFL learners towards the peer assessment of writing. In D. Tsagari (Ed.), Research on English as a foreign language in Cyprus (Vol. 2, pp. 225–245). University of Nicosia Press. [Google Scholar]
- Meletiadou, E., & Tsagari, D. (2016). The washback effect of peer assessment on adolescent EFL learners in Cyprus. In D. Tsagari (Ed.), Classroom-based assessment in L2 contexts (pp. 138–160). Cambridge Scholars Publishing. Available online: https://gnosis.library.ucy.ac.cy/handle/7/52215 (accessed on 1 May 2025).
- Norhagen, S. L., Krumsvik, R. J., & Røkenes, F. M. (2024). Developing professional digital competence in Norwegian teacher education: A scoping review. Frontiers in Education, 9, 1363529. [Google Scholar] [CrossRef]
- Norwegian Directorate for Education and Training. (2015). Vurdering for læring—Om satsingen [Assessment for learning—A note on the priority area]. Utdannings-Direktoratet. Available online: https://www.hvl.no/en/library/find-databases-and-other-resources/utdanningsdirektoratet-the-norwegian-directorate-for-education-and-training/ (accessed on 1 May 2025).
- Norwegian Directorate for Education and Training. (2016). Samarbeid og tolkningsfellesskap [Collaboration and a shared assessment culture]. Utdannings-Direktoratet. Available online: https://www.regjeringen.no/en/dep/kd/organisation/kunnskapsdepartementets-etater-og-virksomheter/Subordinate-agencies-2/norwegian-directorate-for-education-and-/id426533/ (accessed on 1 May 2025).
- Norwegian Directorate for Education and Training. (2019). Erfaringer fra nasjonal satsing på vurdering for læring (2010–2018) [Experiences from the national priority programme assessment for learning (2018–2019)]. Utdannings-direktoratet. Available online: https://www.udir.no/tall-og-forskning/finn-forskning/rapporter/erfaringer-fra-nasjonal-satsing-pa-vurdering-for-laring-2010-2018/ (accessed on 1 May 2025).
- Norwegian Directorate for Education and Training. (2025). Eksamen [Examination]. Utdannings-Direktoratet. Available online: https://www.udir.no/eksamen-og-prover/eksamen/ (accessed on 1 May 2025).
- OECD. (2011). OECD reviews of evaluation and assessment in education: Norway. OECD Publishing. Available online: https://www.oecd.org/en/publications/oecd-reviews-of-evaluation-and-assessment-in-education-norway-2011_9789264117006-en.html (accessed on 1 May 2025).
- Phipps, S., & Borg, S. (2009). Exploring tensions between teachers’ grammar teaching beliefs and practices. System, 37(3), 380–390. [Google Scholar] [CrossRef]
- Pill, J., & Harding, L. (2013). Defining the language assessment literacy gap: Evidence from a parliamentary inquiry. Language Testing, 30(3), 381–402. [Google Scholar] [CrossRef]
- Scarino, A. (2013). Introspection and retrospection as windows on teacher knowledge, values, and ethical dispositions. In Second language teacher education. Routledge. [Google Scholar]
- Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534–539. [Google Scholar]
- Taylor, L. (2009). Developing assessment literacy. Annual Review of Applied Linguistics, 29, 21–36. [Google Scholar] [CrossRef]
- Taylor, L. (2012). Ethics in language assessment. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. John Wiley & Sons, Ltd. [Google Scholar] [CrossRef]
- Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. [Google Scholar] [CrossRef]
- Tsagari, D. (2016). Assessment orientations of state primary EFL teachers in two mediterranean countries. Center for Educational Policy Studies Journal, 6(1), 9–30. [Google Scholar] [CrossRef]
- Tsagari, D. (2021). Gauging the assessment literacy levels of English teachers in Norway. European Journal of Applied Linguistics and TEFL, 10(1), 161–191. Available online: https://www.researchgate.net/publication/354380545_%27Gauging_the_Assessment_Literacy_Levels_of_English_Teachers_in_Norway%27_The_European_Journal_of_Applied_Linguistics_and_TEFL (accessed on 1 May 2025).
- Tsagari, D., & Giannikas, C. N. (2021). The impact of CERT-mania on English language learning and teaching: The Cypriot case. European Journal of Applied Linguistics and TEFL, 10(1), 193–215. Available online: https://www.theeuropeanjournal.eu/download/EJALTEFL_01_2021.pdf (accessed on 1 May 2025).
- Tsagari, D., & Kontozi, A. (2016). Formative assessment practices in private EFL classes in Cyprus. In D. Tsagari (Ed.), Classroom-based assessment in L2 contexts (pp. 273–295). Cambridge Scholars Publishing. Available online: https://www.cambridgescholars.com/product/978-1-4438-9102-8 (accessed on 1 May 2025).
- Tsagari, D., & Rousoulioti, T. (2025). Enhancing assessment literacy for teachers of less commonly taught languages: Insights from greek as a second language. Trends in Higher Education, 4(1), 12. [Google Scholar] [CrossRef]
- Tsagari, D., & Vogt, K. (2017). Assessment literacy of foreign language teachers around Europe: Research, challenges and future prospects. Papers in Language Testing and Assessment, 6(1), 41–63. [Google Scholar] [CrossRef]
- Tsagari, D., & Vogt, K. (Eds.). (2022). Contextualizing language assessment literacy [special issue]. Studies in Language Assessment (SiLA), Formerly Papers in Language Testing and Assessment (PLTA), 11(1). Available online: https://www.altaanz.org/2022.html (accessed on 1 May 2025).
- Tveit, S. (2009). Educational assessment in Norway—A time of change. In C. Wyatt-Smith, & J. J. Cumming (Eds.), Educational assessment in the 21st century: Connecting theory and practice (pp. 227–243). Springer. [Google Scholar] [CrossRef]
- Utdanningsdirektoratet. (n.d.). Vurderingspraksis. Utdanningsdirektoratet. Available online: https://www.udir.no/laring-og-trivsel/vurdering/ (accessed on 1 May 2025).
- Vattøy, K.-D., & Gamlem, S. M. G. (2024). Students’ experiences of peer feedback practices as related to awareness raising of learning goals, self-monitoring, self-efficacy, anxiety, and enjoyment in teaching EFL and mathematics. Scandinavian Journal of Educational Research, 68(5), 904–918. [Google Scholar] [CrossRef]
- Vescio, V., Ross, D., & Adams, A. (2008). A review of research on the impact of professional learning communities on teaching practice and student learning. Teaching and Teacher Education, 24(1), 80–91. [Google Scholar] [CrossRef]
- Vogt, K., Bøhn, H., & Tsagari, D. (2024). Language assessment literacy. Language Teaching, 57(3), 325–340. [Google Scholar] [CrossRef]
- Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374–402. [Google Scholar] [CrossRef]
- Vogt, K., & Tsagari, D. (in-print). Language assessment literacy: Professional development for language teachers with a context-and experience-sensitive orientation. In C. Dalton-Puffer, T. Bacovsky-Novak, H. Heaney, & J. Hüttner (Eds.), Current challenges in language teacher education Cambridge scholars publishing. Cambridge Scholars Publishing. [Google Scholar]
- Vogt, K., Tsagari, D., & Spanoudis, G. (2020). What do teachers think they want? A comparative study of in-service language teachers’ beliefs on LAL training needs. Language Assessment Quarterly, 17(4), 386–409. [Google Scholar] [CrossRef]
- Wenger, E. (1998, July 28). Communities of practice: Learning, meaning, and identity. Higher Education. Cambridge University Press. [Google Scholar] [CrossRef]
- Wiese, E., & Nortvedt, G. A. (2023). Teacher assessment literacy in culturally and linguistically diverse classrooms: A Norwegian case study. Teaching and Teacher Education, 135, 104357. [Google Scholar] [CrossRef]
- Yan, X., Zhang, C., & Fan, J. J. (2018). “Assessment knowledge is important, but …”: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158–168. [Google Scholar] [CrossRef]
- Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). SAGE Publications, Inc. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tsagari, D.; Armostis, S. Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus. Educ. Sci. 2025, 15, 927. https://doi.org/10.3390/educsci15070927
Tsagari D, Armostis S. Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus. Education Sciences. 2025; 15(7):927. https://doi.org/10.3390/educsci15070927
Chicago/Turabian StyleTsagari, Dina, and Spyros Armostis. 2025. "Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus" Education Sciences 15, no. 7: 927. https://doi.org/10.3390/educsci15070927
APA StyleTsagari, D., & Armostis, S. (2025). Contextualizing Language Assessment Literacy: A Comparative Study of Teacher Beliefs, Practices, and Training Needs in Norway and Cyprus. Education Sciences, 15(7), 927. https://doi.org/10.3390/educsci15070927