Formative Assessment of Diagnostic Testing in Family Medicine with Comprehensive MCQ Followed by Certainty-Based Mark
Abstract
:1. Introduction
2. Methods
2.1. Participants
2.2. Procedure and Data Collection Method
2.3. Scoring Scale
2.4. Faculty Tests and Context
2.5. Statistical Analysis
3. Results
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. List of Laboratory and Imaging Studies
- Complete blood count
- Reticulocytes
- Blood sugar level
- Urea
- Serum creatinine
- Basic serum electrolytes (Na, K, Cl)
- Calcium
- Phosphorus
- Albumin
- Serum protein electrophoresis
- NT-proBNP
- CPK
- Troponin
- PT, PTT
- INR
- D-dimer
- Arterial blood gas test total CO2
- Lactate concentration
- CRP
- Erythrocyte sedimentation rate
- Liver function tests (ALT, AST, GGT, ALP)
- Total bilirubin, unconjugated bilirubin
- Lipid profile (cholesterol, triglycerides)
- Lipase
- LDH
- Haptoglobin
- PCT
- Urine culture
- Sputum culture
- Blood culture
- Sputum culture for Mycobacterium tuberculosis
- Stool culture
- Lyme serology
- HIV serology
- TPHA-VDRL
- Anti-HBc Ab
- Anti-HBs Ab
- Antigen HBs
- HAV serology
- HCV serology
- HDV serology
- Chlamydia trachomatis PCR
- Mantoux test
- Microscopic examination of blood films for malaria
- Rapid strep test
- Neisseria gonorrheae test (swab)
- Lumbar puncture
- TSH
- T3, T4
- Prolactin
- Glycated hemoglobin test
- Bone marrow examination
- Ferritin
- Serum iron, total iron-binding capacity, transferrin saturation
- ABO and Rh (D) typing
- Irregular antibodies
- Vitamins B9 and B12
- Immunoglobulin quantitation
- Blood immunofixation
- Fibrinogen
- Factor II and Factor V quantification
- Anti-nuclear antibodies
- Rheumatoid factor
- Cryoglobulin
- Complement (CH50, C3, C4)
- ANCA
- Urine electrolytes
- Total quantity of protein in a 24 h urine collection test
- Proteinuria/creatininuria index
- Anti-transglutaminase IgA
- Chest X-ray
- Abdominal X-ray
- Bone X-ray of a limb
- Cervical spine X-ray
- X-rays of the thoracic spine
- X-rays of the lumbosacral spine
- Radiography of the pelvis
- CT scan of the chest without contrast
- CT angiography of the chest
- CT of abdomen and pelvis with contrast
- CT of abdomen and pelvis without contrast
- CT of the neck without contrast
- Abdominal ultrasonography
- Abdominal MRI
- Arterial Doppler of lower extremities
- Venous Doppler of lower extremities
- Supra-aortic trunk Echo-Doppler
- Whole body FDG—PET /CT
- Cranial CT scan
- Head MRI with Gadolinium contrast
- Ventilation/perfusion lung scan
- Bone densitometry
- Bone scintigraphy
- CT scan of facial bones
- Transfontanelle ultrasonography
- Dilated fundus examination
- Slit lamp examination
- Cardiac ultrasound
- Bronchial fibroscopy
- Colonoscopy
- Oesophagogastroduodenoscopy
- Capsule endoscopy
- Panendoscopy (of upper aerodigestive tract)
- Cystoscopy
- Urine test strip
- 12-lead ECG
- Pulmonary function testing
Appendix B
Appendix B.1. cMCQ #1
Appendix B.2. cMCQ #2
Appendix C
Appendix C.1. Standard MCQ #1
- Presence of the HLAB 27 antigen
- Biological inflammatory syndrome with high CRP
- Family or personal history of psoriasis
- Presence of marginal erosions on the heads of the 5th metatarsals (radiographs)
- Inefficiency of nonsteroidal anti-inflammatory drugs on pain
Appendix C.2. Standard MCQ #2
- In the absence of nitrite in the urine test strip, a urine culture is not necessary
- A lumbar puncture must be performed after brain imaging
- A lumbar puncture must be performed after a coagulation test
- Fall on Vitamin K antagonist in a patient on delirium requires brain imaging
- Performing blood cultures is not necessary
References
- Lehnert, B.E.; Bree, R.L. Analysis of appropriateness of outpatient CT and MRI referred from primary care clinics at an academic medical center: How critical is the need for improved decision support? J. Am. Coll. Radiol. 2010, 7, 192–197. [Google Scholar] [CrossRef] [PubMed]
- Chan, P.S.; Patel, M.R.; Klein, L.W.; Krone, R.J.; Dehmer, G.J.; Kennedy, K.; Nallamothu, B.K.; Weaver, W.D.; Masoudi, F.A.; Rumsfeld, J.S.; et al. Appropriateness of percutaneous coronary intervention. JAMA 2011, 306, 53–61. [Google Scholar] [CrossRef] [PubMed]
- Rabinowitz, H.K. The modified essay question: An evaluation of its use in a family medicine clerkship. Med. Educ. 1987, 21, 114–118. [Google Scholar] [CrossRef]
- Wood, E.J. What are Extended Matching Sets Questions? Biosci. Educ. 2003, 1, 1–8. [Google Scholar] [CrossRef]
- Pottier, P.; Hardouin, J.-B.; Hodges, B.D.; Pistorius, M.-A.; Connault, J.; Durant, C.; Clairand, R.; Sébille, V.; Barrier, J.-H.; Planchon, B. Exploring how students think: A new method combining think-aloud and concept mapping protocols. Med. Educ. 2010, 44, 926–935. [Google Scholar] [CrossRef]
- Schuwirth, L.W.T.; van der Vleuten, C.P.M. Different written assessment methods: What can be said about their strengths and weaknesses? Med. Educ. 2004, 38, 974–979. [Google Scholar] [CrossRef]
- Veloski, J.J.; Rabinowitz, H.K.; Robeson, M.R.; Young, P.R. Patients don’t present with five choices: An alternative to multiple-choice tests in assessing physicians’ competence. Acad. Med. 1999, 74, 539–546. [Google Scholar] [CrossRef]
- Palmer, E.J.; Devitt, P.G. Assessment of higher order cognitive skills in undergraduate education: Modified essay or multiple choice questions? Research paper. BMC Med. Educ. 2007, 7, 49. [Google Scholar] [CrossRef]
- Javaeed, A. Assessment of Higher Ordered Thinking in Medical Education: Multiple Choice Questions and Modified Essay Questions. MedEdPublish 2018, 7, 128. [Google Scholar] [CrossRef]
- Bloom, B.S. Taxonomy of educational objectives. In Cognitive Domain; McKay: New York, NY, USA, 1956; Volume 1, pp. 20–24. [Google Scholar]
- Adams, N.E. Bloom’s taxonomy of cognitive learning objectives. J. Med. Libr. Assoc. 2015, 103, 152–153. [Google Scholar] [CrossRef]
- Chaudhary, N.; Bhatia, B.D.; Mahato, S.K. Framing a Well-Structured Single Best Response Multiple Choice Questions (MCQs)-An Art to be Learned by a Teacher. J. Univers. Coll. Med. Sci. 2014, 2, 60–64. [Google Scholar] [CrossRef]
- Mehta, G.; Mokhasi, V. Item Analysis of Multiple Choice Questions—An Assessment of the Assessment Tool. Int. J. Health Sci. Res. (IJHSR) 2014, 4, 197–202. [Google Scholar]
- Mehta, M.; Banode, S.; Adwal, S. Analysis of multiple choice questions (MCQ): Important part of assessment of medical students. Int. J. Med. Res. Rev. 2016, 4, 199–204. [Google Scholar] [CrossRef]
- Leclercq, D. Validity, Reliability, and Acuity of Self-Assessment in Educational Testing. In Item Banking: Interactive Testing and Self-Assessment; NATO ASI Series; Leclercq, D.A., Bruno, J.E., Eds.; Springer: Berlin/Heidelberg, Germany, 1993; pp. 114–131. [Google Scholar]
- Gardner-Medwin, A.R. Confidence-Based Marking-towards Deeper Learning and Better Exams, 1st ed.; Routledge: London, UK, 2006. [Google Scholar]
- Schoendorfer, N.; Emmett, D. Use of certainty-based marking in a second-year medical student cohort: A pilot study. Adv. Med. Educ. Pract. 2012, 3, 139–143. [Google Scholar] [CrossRef] [PubMed]
- Barr, D.A.; Burke, J.R. Using confidence-based marking in a laboratory setting: A tool for student self-assessment and learning. J. Chiropr. Educ. 2013, 27, 21–26. [Google Scholar] [CrossRef]
- Tweed, M.; Thompson-Fawcett, M.; Schwartz, P.; Wilkinson, T.J. Determining measures of insight and foresight from responses to multiple choice questions. Med. Teachnol. 2013, 35, 127–133. [Google Scholar] [CrossRef]
- Brown, T.A.; Shuford, E.H. Quantifying Uncertainty into Numerical Probabilities for the Reporting of Intelligence; RAND Corporation: Santa Monica, CA, USA, 1973. [Google Scholar]
- Shuford, E.H.; Albert, A.; Edward Massengill, H. Admissible probability measurement procedures. Psychometrika 1966, 31, 125–145. [Google Scholar] [CrossRef]
- Castaigne, J.L.; Abry, S.; Bailly, B.; Sylvestre, E. Aller Plus Loin Avec les QCM Grâce aux Degrés de Certitude. PENSERA Network, Grenoble, France. Available online: https://www.slideshare.net/JeanLoup_Castaigne/aller-plus-loin-avec-les-qcm-grce-aux-degrs-de-certitude (accessed on 13 December 2015).
- Draaijer, S.; Jordan, S.; Ogden, H. Calculating the Random Guess Score of Multiple-Response and Matching Test Items. In Technology Enhanced Assessment; Communications in Computer and Information Science; Ras, E., Guerrero Roldán, A.E., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 210–222. [Google Scholar]
- Charlin, B.; Lubarsky, S.; Millette, B.; Crevier, F.; Audétat, M.-C.; Charbonneau, A.; Fon, N.C.; Hoff, L.; Bourdy, C. Clinical reasoning processes: Unravelling complexity through graphical representation. Med. Educ. 2012, 46, 454–463. [Google Scholar] [CrossRef]
- CNG, Établissement Public Administratif. Épreuves Classantes Nationales (ECN). Paris, France. Available online: https://www.cng.sante.fr/concours-examens/epreuves-classantes-nationales-ecn (accessed on 25 March 2022).
- Nwadinigwe, P.I.; Naibi, L. The Number of Options in a Multiple-Choice Test Item and the Psychometric Characteristics. J. Educ. Pract. 2013, 4, 189–196. [Google Scholar]
- Vyas, R.; Supe, A.N. Multiple choice questions: A literature review on the optimal number of options. Natl. Med. J. India 2008, 21, 130–133. [Google Scholar]
- Leclercq, D.; Poumay, M. Trois nouveaux indices de réalisme dans l’auto-évaluation des performances. Cah. Du Serv. De Pédagogie Expérimentale 2003, 15, 189–196. [Google Scholar]
- Abdulghani, A.H.; Almelhem, M.; Basmaih, G.; Alhumud, A.; Alotaibi, R.; Wali, A.; Abdulghani, H.M. Does Self-Esteem leads to high achievement of the science college’s students? A study from the six health science colleges. Saudi J. Biol. Sci. 2019, 27, 636–642. [Google Scholar] [CrossRef]
- Huang, L.; Thai, J.; Zhong, Y.; Peng, H.; Koran, J.; Zhao, X.-D. The Positive Association Between Empathy and Self-Esteem in Chinese Medical Students: A Multi-Institutional Study. Front. Psychol. 2019, 10, 1921. [Google Scholar] [CrossRef] [PubMed]
- Spoto-Cannons, A.C.; Isom, D.M.; Feldman, M.; Zwygart, K.K.; Mhaskar, R.; Greenberg, M.R. Differences in medical student self-evaluations of clinical and professional skills. AMEP 2019, 10, 835–840. [Google Scholar] [CrossRef] [PubMed]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Herbaux, C.; Dupré, A.; Rénier, W.; Gabellier, L.; Chazard, E.; Lambert, P.; Sobanski, V.; Gosset, D.; Lacroix, D.; Truffert, P. Formative Assessment of Diagnostic Testing in Family Medicine with Comprehensive MCQ Followed by Certainty-Based Mark. Healthcare 2022, 10, 1558. https://doi.org/10.3390/healthcare10081558
Herbaux C, Dupré A, Rénier W, Gabellier L, Chazard E, Lambert P, Sobanski V, Gosset D, Lacroix D, Truffert P. Formative Assessment of Diagnostic Testing in Family Medicine with Comprehensive MCQ Followed by Certainty-Based Mark. Healthcare. 2022; 10(8):1558. https://doi.org/10.3390/healthcare10081558
Chicago/Turabian StyleHerbaux, Charles, Aurélie Dupré, Wendy Rénier, Ludovic Gabellier, Emmanuel Chazard, Philippe Lambert, Vincent Sobanski, Didier Gosset, Dominique Lacroix, and Patrick Truffert. 2022. "Formative Assessment of Diagnostic Testing in Family Medicine with Comprehensive MCQ Followed by Certainty-Based Mark" Healthcare 10, no. 8: 1558. https://doi.org/10.3390/healthcare10081558