Search Results (5)

The assessment of mathematical competence, particularly in real-world problem-solving contexts, has become increasingly crucial in high school educational evaluation. While traditional methods have shifted towards emphasizing problem-solving skills, they remain predominantly outcome-oriented, often failing to adequately capture the nuanced cognitive processes underlying students’ problem-solving behaviors. To address this gap, this study introduces a process-oriented assessment method leveraging eye-tracking technology. Fifty-three university students (primarily first- and second-year undergraduates) in China were recruited to solve six context-based mathematical problems of varying difficulty levels while wearing portable eye-tracking glasses, allowing for natural problem-solving behaviors in a paper-and-pencil test format. The study established a multidimensional model of eye movement features to evaluate problem-solving processes. Using China’s National College Entrance Examination (CNCEE) mathematics scores as the dependent variable, a Partial Least Squares Regression (PLSR) analysis achieved its best predictive performance (prediction R² of 0.271) based on multidimensional eye movement features when solving the most difficult problem. The first visual intake duration on problem-reading areas and key information regions emerged as significant contributors of the students’ CNCEE scores. These findings substantiate the potential of eye-tracking technology as a valuable tool for educational assessment, offering insights into the assessment of students’ mathematical competence and supporting the development of more comprehensive learning diagnosis and intervention strategies. Full article

The level of difficulty of mathematical test items is a critical aspect for evaluating test quality and educational outcomes. Accurately predicting item difficulty during test creation is thus significantly important for producing effective test papers. This study used more than ten years of content and score data from China’s Henan Provincial College Entrance Examination in Mathematics as an evaluation criterion for test difficulty, and all data were obtained from the Henan Provincial Department of Education. Based on the framework established by the National Center for Education Statistics (NCES) for test item assessment methodology, this paper proposes a new framework containing eight features considering the uniqueness of mathematics. Next, this paper proposes an XGBoost-based SHAP model for analyzing the difficulty of mathematics tests. By coupling the XGBoost method with the SHAP method, the model not only evaluates the difficulty of mathematics tests but also analyzes the contribution of specific features to item difficulty, thereby increasing transparency and mitigating the “black box” nature of machine learning models. The model has a high prediction accuracy of 0.99 for the training set and 0.806 for the test set. With the model, we found that parameter-level features and reasoning-level features are significant factors influencing the difficulty of subjective items in the exam. In addition, we divided senior secondary mathematics knowledge into nine units based on Chinese curriculum standards and found significant differences in the distribution of the eight features across these different knowledge units, which can help teachers place different emphasis on different units during the teaching process. In summary, our proposed approach significantly improves the accuracy of item difficulty prediction, which is crucial for intelligent educational applications such as knowledge tracking, automatic test item generation, and intelligent paper generation. These results provide tools that are better aligned with and responsive to students’ learning needs, thus effectively informing educational practice. Full article

As one of the most important examinations in China, the National College Entrance Examination (commonly known as the Gaokao, hereafter denoted Gaokao) has a long history and has attracted attention from the Chinese educational community, among others. This study focused on mathematics test items of the Gaokao from the perspective of mathematical culture and examined the national papers (drafted by the Ministry of Education of the People’s Republic of China) of tests from 1978 to 2021 in order to investigate the content and time variation characteristics of mathematics test items reflecting mathematical culture since its restoration. A mathematical culture categorization conceptual framework was established based on previous studies and was applied to test item analysis. Mathematical culture in test items was classified using four categories: Historical Topics, Interdisciplinary Connections, Social Roles, and Aesthetics & Recreation. These were used for data coding and analysis. The results showed that mathematical culture in the mathematics test items of the Gaokao over a 44-year period, in terms of content categories, was diverse but uneven in distribution, with greater focus on demonstrating the social roles of mathematics and less on the historical development of mathematical knowledge. Moreover, the average number of items with mathematical culture during this period was small and fluctuated over time. The content of topics related to social context and technology also changed over time with the distinct characteristics of the times and changes in society. This study provides empirical evidence on how mathematical culture is integrated into test items and how they have changed over time. Full article

The annual exam questions in China National College Entrance Examination (CNCEE, commonly known as Gaokao) have attracted wide attention from the entire society in China. This paper analyzes an important math exam question related to always holding inequalities with an unknown parameter from the 2020 CNCEE and builds different solutions via parameter separation or classified discussion, and then gives a systematic and effective design framework for questions related to problems of always holding inequalities and zeros of functions with an unknown parameter for the CNCEE. The framework reveals the internal mechanism of designing the math exam questions in the CNCEE. According to the design framework, two simulated math exam questions with reference solutions will be proposed. Full article

International consensus has been reached for the 2030 Agenda, and governments have adopted measures for the gradual implementation of Sustainable Development Goals (SDGs). In this implementation, education plays a crucial role. Recently, the extent to which Education for Sustainable Development (ESD) has become the norm in national curricula, teacher education, and student assessment has been a focus of extensive research. The present study introduces the geography curriculum and the reform of the National College Entrance Examination (NCEE) in China in the 2000s. A global indicator framework for SDGs is used to analyze sustainable development (SD) content and characteristics in NCEE geography papers. Findings reveal that SD accounts for an average of 71% of score points among the 24 sets of papers. Sustainable agriculture, terrestrial ecosystems, settlements, and water are well reflected in questions, especially water-related ecosystems, resilient agricultural practices, transportation system, tourism, desertification, and degraded land and soil. Sustainable development questions have the characteristics of setting open questions, paying attention to question situation, being close to real life, being moderately difficult, paying attention to regional SD and human-nature relationship, and diversifying question-setting patterns. According to the analysis of papers, SD plays an important role in geography education. Full article