You are currently on the new version of our website. Access the old version .

532 Results Found

  • Article
  • Open Access
6 Citations
4,481 Views
19 Pages

An Effectiveness Study of Generative Artificial Intelligence Tools Used to Develop Multiple-Choice Test Items

  • Toni A. May,
  • Yiyun Kate Fan,
  • Gregory E. Stone,
  • Kristin L. K. Koskey,
  • Connor J. Sondergeld,
  • Timothy D. Folger,
  • James N. Archer,
  • Kathleen Provinzano and
  • Carla C. Johnson

24 January 2025

Generative artificial intelligence (GenAI) tools developed to support teaching and learning are widely available. Trustworthiness concerns, however, have prompted calls for researchers to study their effectiveness and for educators and educational re...

  • Article
  • Open Access
2 Citations
2,692 Views
18 Pages

6 April 2025

Multiple-choice (MC) tests are widely used in educational settings but have been criticized for promoting passive recognition rather than active retrieval. Our research explores how adding a simple component to MC tests—answer justification&mda...

  • Communication
  • Open Access
2 Citations
2,524 Views
6 Pages

26 June 2023

The use of large lecture halls in business and economic education often dictates the use of multiple-choice exams to measure student learning. This study asserts that student performance on these types of exams can be viewed as the result of the proc...

  • Article
  • Open Access
7 Citations
3,408 Views
14 Pages

25 August 2021

Since schools cannot use face-to-face tests to evaluate students’ learning effectiveness during the COVID-19 pandemic, many schools implement computer-based tests (CBT) for this evaluation. From the perspective of Sustainable Development Goal 4, whet...

  • Article
  • Open Access
3,595 Views
22 Pages

Answering Multiple-Choice Questions in Which Examinees Doubt What the True Answer Is among Different Options

  • Fernando Sánchez Lasheras,
  • José Curbelo,
  • Jaime Baladrón Romero,
  • Alberto García Guerrero,
  • Carmen Peñalver San Cristóbal,
  • Tomás Villacampa and
  • Paula Jiménez Fonseca

1 December 2022

This research explores the results that an examinee would obtain if taking a multiple-choice questions test in which they have doubts as to what the true answer is among different options. This problem is analyzed by making use of combinatorics and a...

  • Article
  • Open Access
2 Citations
3,290 Views
16 Pages

7 December 2021

This study investigated the scalability of a cognitive multiple-choice test through the Mokken package in the R programming language for statistical computing. A 2019 mathematics West African Examinations Council (WAEC) instrument was used to gather...

  • Article
  • Open Access
3 Citations
3,610 Views
19 Pages

The Impact of Script Concordance Testing on Clinical Decision-Making in Paramedic Education

  • Katarzyna Naylor,
  • Jane Hislop,
  • Kamil Torres,
  • Zakaria A. Mani and
  • Krzysztof Goniewicz

22 January 2024

This study investigates the effectiveness of the Script Concordance Test (SCT) in enhancing clinical reasoning skills within paramedic education. Focusing on the Medical University of Lublin, we evaluated the SCT’s application across two cohort...

  • Article
  • Open Access
2,588 Views
32 Pages

Unsupervised Optical Mark Recognition on Answer Sheets for Massive Printed Multiple-Choice Tests

  • Yahir Hernández-Mier,
  • Marco Aurelio Nuño-Maganda,
  • Said Polanco-Martagón,
  • Guadalupe Acosta-Villarreal and
  • Rubén Posada-Gómez

8 September 2025

The large-scale evaluation of multiple-choice tests is a challenging task from the perspective of image processing. A typical instrument is a multiple-choice question test that employs an answer sheet with circles or squares. Once students have finis...

  • Article
  • Open Access
3 Citations
2,379 Views
18 Pages

Students claim that multiple-choice questions can be tricky, particularly those with competitive incorrect choices or choices like none-of-the-above (NOTA). Additionally, assessment researchers suggest that using NOTA is problematic for assessment. I...

  • Article
  • Open Access
6 Citations
4,495 Views
11 Pages

18 August 2020

Machines usually employ a guess-and-check strategy to analyze data: they take the data, make a guess, check the answer, adjust it with regard to the correct one if necessary, and try again on a new data set. An active learning environment guarantees...

  • Feature Paper
  • Article
  • Open Access
2 Citations
6,153 Views
6 Pages

Background: The number of answer options is an important element of multiple-choice questions (MCQs). Many MCQs contain four or more options despite the limited literature suggesting that there is little to no benefit beyond three options. The purpos...

  • Project Report
  • Open Access
1 Citations
1,779 Views
9 Pages

5 September 2025

Retention of foundational knowledge is critical in dental education, yet the implications of Ebbinghaus forgetting curve are often overlooked. This study examined how well dental students retained core periodontal concepts and how confident in their...

  • Article
  • Open Access
10 Citations
3,442 Views
15 Pages

A Touchscreen-Based, Multiple-Choice Approach to Cognitive Enrichment of Captive Rhesus Macaques (Macaca mulatta)

  • Antonino Calapai,
  • Dana Pfefferle,
  • Lauren C. Cassidy,
  • Anahita Nazari,
  • Pinar Yurt,
  • Ralf R. Brockhausen and
  • Stefan Treue

24 August 2023

Research on the psychological and physiological well-being of captive animals has focused on investigating different types of social and structural enrichment. Consequently, cognitive enrichment has been understudied, despite the promising external v...

  • Article
  • Open Access
1,061 Views
9 Pages

Evaluation of Multiple-Choice Tests in Head and Neck Ultrasound Created by Physicians and Large Language Models

  • Jacob P. S. Nielsen,
  • August Krogh Mikkelsen,
  • Julian Kuenzel,
  • Merry E. Sebelik,
  • Gitta Madani,
  • Tsung-Lin Yang and
  • Tobias Todsen

Background/Objectives: Otolaryngologists are increasingly using head and neck ultrasound (HNUS). Determining whether a practitioner of HNUS has achieved adequate theoretical knowledge remains a challenge. This study assesses the performance of two la...

  • Article
  • Open Access
11 Citations
3,665 Views
16 Pages

27 August 2021

The development and evaluation of valid assessments of scientific reasoning are an integral part of research in science education. In the present study, we used the linear logistic test model (LLTM) to analyze how item features related to text comple...

  • Article
  • Open Access
5 Citations
3,018 Views
23 Pages

30 November 2023

Recent advances in natural language processing have increased interest in automatic question generation, particularly in education (e.g., math, biology, law, medicine, and languages) due to its efficiency in assessing comprehension. Specifically, mul...

  • Article
  • Open Access
21 Citations
7,578 Views
21 Pages

We conducted two studies to replicate and extend, as well as test, the limits of previous findings regarding an apparent disconnect between scientific-reasoning skills in psychological science, on the one hand, and scores on standardized tests of gen...

  • Article
  • Open Access
5 Citations
3,384 Views
22 Pages

Host Range and Impact of Dichrorampha aeratana, the First Potential Biological Control Agent for Leucanthemum vulgare in North America and Australia

  • Sonja Stutz,
  • Rosemarie De Clerck-Floate,
  • Hariet L. Hinz,
  • Alec McClay,
  • Andrew J. McConnachie and
  • Urs Schaffner

12 May 2021

We evaluated the potential of the European root-feeding moth Dichrorampha aeratana as a biological control agent for the invasive weed Leucanthemum vulgare (oxeye daisy) in North America and Australia. The taxonomic proximity of the ornamental Shasta...

  • Proceeding Paper
  • Open Access
1,616 Views
5 Pages

Design and Application of a Computer Tool to Evaluate the Goodness of Fit for Tests Designed to Be Self-Taught

  • I. T. Molina-Martínez,
  • V. Andrés-Guerrero,
  • I. Bravo-Osuna,
  • R. Ruiz-Caro,
  • P. Pastoriza,
  • M. D. Veiga-Ochoa,
  • R. Herrero-Vanrell and
  • M. E. Gil-Alegre

31 October 2018

Nowadays, multiple choice questions play an important role in the self-evaluation process. The present work undertakes the design of a computer tool—Excel® worksheet—that will allow the calculation of different parameters that are usually employed fo...

  • Article
  • Open Access
12 Citations
1,403 Views
9 Pages

Evaluation of Chatbot Responses to Text-Based Multiple-Choice Questions in Prosthodontic and Restorative Dentistry

  • Reinhard Chun Wang Chau,
  • Khaing Myat Thu,
  • Ollie Yiru Yu,
  • Richard Tai-Chiu Hsung,
  • Denny Chon Pei Wang,
  • Manuel Wing Ho Man,
  • John Junwen Wang and
  • Walter Yu Hang Lam

21 June 2025

Background/Objectives: This study aims to evaluate the response accuracy and quality of three AI chatbots—GPT-4.0, Claude-2, and Llama-2—in answering multiple-choice questions in prosthodontic and restorative dentistry. Methods: A total o...

  • Article
  • Open Access
15 Citations
4,194 Views
10 Pages

Developing the eMedical Student (eMS)—A Pilot Project Integrating Medical Students into the Tele-ICU during the COVID-19 Pandemic and beyond

  • Joshua Ho,
  • Philip Susser,
  • Cindy Christian,
  • Horace DeLisser,
  • Michael J. Scott,
  • Lynn A. Pauls,
  • Ann M. Huffenberger,
  • C. William Hanson,
  • John M. Chandler and
  • Krzysztof Laudanski
  • + 1 author

The COVID-19 pandemic has accelerated the demand for virtual healthcare delivery and highlighted the scarcity of telehealth medical student curricula, particularly tele-critical care. In partnership with the Penn E-lert program and the Department of...

  • Technical Note
  • Open Access
2 Citations
5,177 Views
12 Pages

18 December 2020

Global dietary consumption strongly determines agricultural land requirements. Yet, it is currently difficult for individual consumers to quantify the environmental impact of their individual diet. One relatively easy to understand metric is the Huma...

  • Article
  • Open Access
8 Citations
3,559 Views
22 Pages

Mapping the Memory Structure of High-Knowledge Students: A Longitudinal Semantic Network Analysis

  • Simone A. Luchini,
  • Shuyao Wang,
  • Yoed N. Kenett and
  • Roger E. Beaty

Standard learning assessments like multiple-choice questions measure what students know but not how their knowledge is organized. Recent advances in cognitive network science provide quantitative tools for modeling the structure of semantic memory, r...

  • Article
  • Open Access
18 Citations
12,551 Views
17 Pages

5 September 2024

ChatGPT is a large language model trained on increasingly large datasets to perform diverse language-based tasks. It is capable of answering multiple-choice questions, such as those posed by diverse medical examinations. ChatGPT has been generating c...

  • Article
  • Open Access
7 Citations
2,629 Views
11 Pages

Special Teaching Formats during the COVID-19 Pandemic—A Survey with Implications for a Crisis-Proof Education

  • Karin Christine Huth,
  • Leonard von Bronk,
  • Maximilian Kollmuss,
  • Stefanie Lindner,
  • Jürgen Durner,
  • Reinhard Hickel and
  • Miriam Esther Draenert

30 October 2021

Modern teaching formats have not been considered necessary during the COVID-19 pandemic with uncertain acceptance by students. The study’s aim was to describe and evaluate all measures undertaken for theoretical and practical knowledge/skill transfer...

  • Article
  • Open Access
3 Citations
1,576 Views
11 Pages

The quality of academic performance and learning outcomes depend on various factors, both psychological and contextual. The academic context includes the training activities and the type of evaluation or examination, which also influences cognitive a...

  • Case Report
  • Open Access
26 Citations
10,632 Views
14 Pages

The Psychological Impact of the COVID-19 Pandemic in Remote Learning in Higher Education

  • Lívea Dornela Godoy,
  • Raquel Falcoski,
  • Roberta Monteiro Incrocci,
  • Fabiana Maris Versuti and
  • Fernando E. Padovan-Neto

27 August 2021

Stressful events can cause a significant impact on education; however, it is not yet clear how the interplay between anxiety, work, and social dysfunction relates to learning impairments. In this study, we investigated the impact of the COVID-19 pand...

  • Article
  • Open Access
27 Citations
60,681 Views
18 Pages

18 March 2021

Universities strive to ensure quality education focused on the diversity of the student body. According to experiential learning theory, students display different learning preferences. This study has a three-fold objective: to compare learning style...

  • Article
  • Open Access
1 Citations
2,032 Views
23 Pages

11 April 2024

In this work, we study the persistence of some fundamental previous ideas in physics in a group of freshmen at the Universidad Politécnica de Madrid (Spain). For this purpose, we analyze the answers to a questionnaire consisted of 24 multiple-...

  • Article
  • Open Access
9 Citations
3,572 Views
11 Pages

Critical Issues of Working during the COVID-19 Pandemic: Italian Healthcare Workers’ Experience

  • Silvia Vicentini,
  • Arianna Mercurio,
  • Carolina Romascu,
  • Martina Battaglia,
  • Noemi Tribbia,
  • Francesca Siviero,
  • Antonello Grossi,
  • Maria Maddalena Martucci and
  • Diego De Leo

Background: The COVID-19 pandemic has strongly impacted on healthcare services’ organization and healthcare workers’ mental health, increasing the risk of psychological symptoms and burnout. Italy has been one of the most affected countri...

  • Article
  • Open Access
2 Citations
2,192 Views
12 Pages

Formative Assessment of Diagnostic Testing in Family Medicine with Comprehensive MCQ Followed by Certainty-Based Mark

  • Charles Herbaux,
  • Aurélie Dupré,
  • Wendy Rénier,
  • Ludovic Gabellier,
  • Emmanuel Chazard,
  • Philippe Lambert,
  • Vincent Sobanski,
  • Didier Gosset,
  • Dominique Lacroix and
  • Patrick Truffert

17 August 2022

Introduction: The choice of diagnostic tests in front of a given clinical case is a major part of medical reasoning. Failure to prescribe the right test can lead to serious diagnostic errors. Furthermore, unnecessary medical tests are a waste of mone...

  • Article
  • Open Access
3 Citations
3,315 Views
14 Pages

The diamondback moth, Plutella xylostella L. (Lepidoptera: Plutellidae), is an important insect pest of cruciferous crops. Understanding its preference patterns can lead to more efficient management methods, such as trap crops. Several strains of P....

  • Article
  • Open Access
1 Citations
3,114 Views
13 Pages

Toward a Framework of Integrating Ability: Conceptualization and Design of an Integrated Physics and Mathematics Test

  • Haydée De Loof,
  • Stijn Ceuppens,
  • Jolien De Meester,
  • Leen Goovaerts,
  • Lieve Thibaut,
  • Mieke De Cock,
  • Wim Dehaene,
  • Fien Depaepe,
  • Heidi Knipprath and
  • Peter Van Petegem
  • + 1 author

26 February 2023

The awareness that many problems in our society are interdisciplinary in nature and require the integration of multiple STEM (Science, Technology, Engineering, Mathematics) concepts to solve them has given rise to a new instructional approach, called...

  • Article
  • Open Access
10 Citations
3,621 Views
10 Pages

Rural Community Perceptions and Interests in Pharmacogenomics

  • John Stegelmeier,
  • Christopher Nartker,
  • Charles Barnes,
  • Hugo Rayo,
  • Rebecca Hoover,
  • Julia Boyle,
  • Shanna O’Connor and
  • Jared Barrott

Pharmacogenomics testing is a rapidly expanding field with increasing importance to individualized patient care. However, it remains unclear whether the general public in rural areas would be willing to engage in this service. The objective of this s...

  • Article
  • Open Access
3 Citations
2,874 Views
11 Pages

23 March 2021

Physical education should focus not only on students’ motor and emotional development but also on their cognitive development. The purpose of the present study was to examine whether elementary students’ health-related knowledge and physical activity...

  • Article
  • Open Access
2 Citations
2,670 Views
10 Pages

Feeding Preferences of Domestic and Wild Ungulates for Forage Trees in the Dry Tropics

  • Kenny López Benavides,
  • Lester Rocha,
  • Emmanuel Serrano and
  • Jordi Bartolomé Filella

18 October 2022

Silvopastoralism based on livestock feeding on forage trees is becoming a sustainable alternative to traditional grazing on the open pastures of dry tropical Central America. Four autochthonous trees, Acacia pennatula, Enterolobium cyclocarpum, Gliri...

  • Article
  • Open Access
1 Citations
1,419 Views
12 Pages

Evaluation of an On-Site Disaster Medical Management Course in Nepal

  • Joy Li-Juan Quah,
  • Joost Bierens and
  • Venkataraman Anantharaman

The great 2015 Nepal earthquake of magnitude 7.6 killed about 9000 people. To better ensure a more coordinated disaster response, a Basic On-Site Disaster Medical Support (BOS-DMS) course was designed in 2017. This study evaluates the effectiveness o...

  • Article
  • Open Access
5 Citations
8,113 Views
15 Pages

Detection of Gender-Biased Items in the Peabody Picture Vocabulary Test

  • François Pichette,
  • Sébastien Béland and
  • Justyna Leśniewska

This study investigated possible gender bias on a vocabulary test, using a method suggested by Andrich and Hagquist to detect “real” differential item functioning (DIF). A total of 443 adult ESL learners completed all 228 items of the Pea...

  • Article
  • Open Access
4 Citations
3,581 Views
12 Pages

A multi-cohort instructor-blinded research study was completed at the School of Pharmacy, University of Waterloo, to test the impact on study learning endpoints when an online flipped classroom teaching style was implemented during the COVID-19 pande...

  • Article
  • Open Access
1 Citations
2,344 Views
7 Pages

Echocardiography is fundamental to diagnostic medicine, yet medical students seldom learn it. Simulation-based training to improve echocardiography learning is promising. This study examined how simulation-based echocardiography training affects fina...

  • Article
  • Open Access
449 Citations
19,704 Views
17 Pages

What Disease Does This Patient Have? A Large-Scale Open Domain Question Answering Dataset from Medical Exams

  • Di Jin,
  • Eileen Pan,
  • Nassim Oufattole,
  • Wei-Hung Weng,
  • Hanyi Fang and
  • Peter Szolovits

12 July 2021

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical...

  • Article
  • Open Access
11 Citations
11,368 Views
11 Pages

1 February 2019

A well-known hypothesis in education and amongst the general public is that matching instructional method with an individual’s modality-specific learning style improves learning and cognitive performance. Several critical reviews in the past de...

  • Article
  • Open Access
1,780 Views
19 Pages

This study investigates the use of Google NotebookLM for the automatic generation of educational assessment items. A mixed-methods approach was adopted, combining quantitative psychometric evaluation with qualitative student feedback. Six tests, each...

  • Article
  • Open Access
12 Citations
5,542 Views
11 Pages

How Well Do COP22 Attendees Understand Graphs on Climate Change Health Impacts from the Fifth IPCC Assessment Report?

  • Helen Fischer,
  • Stefanie Schütte,
  • Anneliese Depoux,
  • Dorothee Amelung and
  • Rainer Sauerborn

Graphs are prevalent in the reports of the Intergovernmental Panel on Climate Change (IPCC), often depicting key points and major results. However, the popularity of graphs in the IPCC reports contrasts with a neglect of empirical tests of their unde...

  • Article
  • Open Access
4 Citations
5,120 Views
12 Pages

Medi-Test: Generating Tests from Medical Reference Texts

  • Ionuț Pistol,
  • Diana Trandabăț and
  • Mădălina Răschip

19 December 2018

The Medi-test system we developed was motivated by the large number of resources available for the medical domain, as well as the number of tests needed in this field (during and after the medical school) for evaluation, promotion, certification, etc...

  • Article
  • Open Access
1 Citations
2,323 Views
15 Pages

Forage Preference, Voluntary Intake, and In Vivo Digestibility of Six Tropical Tree Leaves by Sheep in Semi-Arid Areas in Benin Republic (West Africa)

  • Euvrard L. R. Gninkplékpo,
  • Bossima Ivan Koura,
  • Paolo D. A. Lesse,
  • Alain Yaoïtcha,
  • Jodelet Accalogoun,
  • Jean-Luc Hornick,
  • Jean-François Cabaraux and
  • Marcel R. B. Houinato

8 March 2024

Livestock supplementation with forage trees is becoming a sustainable alternative to traditional grazing on the open pastures during the dry season in Benin. However, little is known about the feeding preferences of sheep and the digestibility of suc...

  • Article
  • Open Access
1 Citations
2,349 Views
26 Pages

Solid-state physics has important applications in the development of modern technologies. Although solid-state concepts, such as electric and thermal conductivity, are included in the curricula at all educational levels, even university students have...

  • Article
  • Open Access
1,220 Views
18 Pages

Expanding the Team: Integrating Generative Artificial Intelligence into the Assessment Development Process

  • Toni A. May,
  • Kathleen Provinzano,
  • Kristin L. K. Koskey,
  • Connor J. Sondergeld,
  • Gregory E. Stone,
  • James N. Archer and
  • Naorah Rimkunas

11 September 2025

Effective assessment development requires collaboration between multidisciplinary team members, and the process is often time-intensive. This study illustrates a framework for integrating generative artificial intelligence (GenAI) as a collaborator i...

  • Article
  • Open Access
2,538 Views
16 Pages

Bebras-Based Assessment for Computational Thinking: Performance and Gender Analysis

  • Juan J. Santaengracia,
  • Belén Palop,
  • Trinidad García,
  • Celestino Rodríguez Pérez and
  • Luis J. Rodríguez-Muñiz

This study presents the design and validation process of a new Bebras-based instrument to assess computational thinking (CT) in 7th-grade students. An initial version of the test, composed of 18 multiple-choice items, was piloted with 80 students and...

  • Article
  • Open Access
16 Citations
8,769 Views
16 Pages

The assessment of knowledge and skills acquired by the student at each academic stage is crucial for every educational process. This paper proposes and tests an approach based on a structured assessment test for mathematical competencies in higher ed...

of 11