Next Article in Journal
Short-End Injection Capillary Electrophoresis and Multivariate Analysis for Simultaneous Determination of Heavy Metals in Passiflora incarnata Tea
Next Article in Special Issue
Distance Learning in Pandemic Age: Lessons from a (No Longer) Emergency
Previous Article in Journal
Income Change One Year after Confirmed Cancer Diagnosis and Its Associated Factors in Japanese Patients
Previous Article in Special Issue
Flourishing or Languishing? Predictors of Positive Mental Health in Medical Students during the COVID-19 Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Beyond the Digital Competencies of Medical Students: Concerns over Integrating Data Science Basics into the Medical Curriculum

by
Diana Lungeanu
1,2,
Alina Petrica
3,4,*,
Raluca Lupusoru
1,2,4,
Adina Maria Marza
3,5,6,
Ovidiu Alexandru Mederle
3,5,6 and
Bogdan Timar
4,7,8
1
Center for Modeling Biological Systems and Data Analysis, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
2
Department of Functional Sciences, Faculty of Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
3
Department of Surgery, Faculty of Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
4
“Pius Brinzeu” Emergency County Clinical Hospital, 300723 Timisoara, Romania
5
Multidisciplinary Center for Research, Evaluation, Diagnosis and Therapies in Oral Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
6
Emergency Municipal Clinical Hospital, 300079 Timisoara, Romania
7
Center for Molecular Research in Nephrology and Vascular Disease, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
8
Second Department of Internal Medicine, Faculty of Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(23), 15958; https://doi.org/10.3390/ijerph192315958
Submission received: 25 September 2022 / Revised: 26 November 2022 / Accepted: 27 November 2022 / Published: 30 November 2022

Abstract

:
Introduction. Data science is becoming increasingly prominent in the medical profession, in the face of the COVID-19 pandemic, presenting additional challenges and opportunities for medical education. We retrospectively appraised the existing biomedical informatics (BMI) and biostatistics courses taught to students enrolled in a six-year medical program. Methods. An anonymous cross-sectional survey was conducted among 121 students in their fourth year, with regard to the courses they previously attended, in contrast with the ongoing emergency medicine (EM) course during the first semester of the academic year 2020–2021, when all activities went online. The questionnaire included opinion items about courses and self-assessed knowledge, and questions probing into the respondents’ familiarity with the basics of data science. Results. Appreciation of the EM course was high, with a median (IQR) score of 9 (7–10) on a scale from 1 to 10. The overall scores for the BMI and biostatistics were 7 (5–9) and 8 (5–9), respectively. These latter scores were strongly correlated (Spearman correlation coefficient R = 0.869, p < 0.001). We found no correlation between measured and self-assessed knowledge of data science (R = 0.107, p = 0.246), but the latter was fairly and significantly correlated with the perceived usefulness of the courses. Conclusions. The keystone of this different perception of EM versus data science was the courses’ apparent value to the medical profession. The following conclusions could be drawn: (a) objective assessments of residual knowledge of the basics of data science do not necessarily correlate with the students’ subjective appraisal and opinion of the field or courses; (b) medical students need to see the explicit connection between interdisciplinary or complementary courses and the medical profession; and (c) courses on information technology and data science would better suit a distributed approach across the medical curriculum.

1. Introduction

Information and communications technology (ICT) has pervasively influenced our lives for years, with the COVID-19 pandemic precipitating great changes in this area across society. Education is undergoing a swift and dramatic transformation in paradigm, in the context of digital policies aiming beyond mere digital literacy, such as those of the European Union [1]. Medical educators face the challenges of re-thinking their teaching approaches and adapting their courseware to synchronous and asynchronous educational activities, or even restructuring the whole curriculum [2,3,4,5,6]. They are compelled to find solutions to incentivize their students’ resilience and help them develop higher-order thinking. Communities of educators have teamed up to develop and share workable solutions under Creative Commons licenses or as open-source software implementations [2,6]. In recent years, data science has emerged as an interdisciplinary field encompassing informatics, statistics, computer science, data management and mathematics, borrowing tools from machine learning and data mining. It has been instrumental in societal transformation, including education (where revolutionizing learning analytics makes use of the stakeholders’ data sense-making abilities) and the medical profession (where insights from data are of crucial importance). To develop their medical expertise, medical students and residents start by attending formal education programs and then journal papers serve to continue this education for the majority of medical professionals. Knowledge of data science and an ability to understand the results of research papers can be decisive complements to clinical practice [7,8] and medical students should become aware of that potential [9]. Moreover, there are controversial pros and cons regarding the employment of learning analytics in education [10,11] and the appropriate integration of data science into medical programs [12,13,14,15].
Worldwide, medical curricula have included interdisciplinary courses on ICT and biostatistics. International boards of experts have issued recommendations and guidelines for such courses and specializations at different levels [16,17,18,19,20]. At our University, since 1992, the medical curriculum has included mandatory courses on medical informatics and biostatistics and we have been trying to align the courses’ syllabi to international standards [21]. Four years ago, we re-designed the courses as a coordinated introduction to the basics of data science in the first and second year of the academic medical program, aiming to yield results after one six-year academic cycle. Nevertheless, the transformational context of the pandemic has called for reflection and a rethinking of priorities, so we face decisions about optimizing the transfer of the gained know-how into new courseware and the associated educational approaches we should deploy.
Taking all of these factors into consideration, we conducted a retrospective appraisal of the two existing biomedical informatics (BMI) and biostatistics courses, as a survey of the fourth-year medical students, in the context of the COVID-19 pandemic; this assessment was an exploratory analysis and was run in contrast with the emergency medicine (EM) course, during the clinical stage of the undergraduate medical program. The research objectives were as follows: (a) to assess the residual knowledge of BMI and biostatistics; (b) to collect students’ opinion and attitudes towards the two previous data science courses as opposed to the EM course; and (c) to analyze the possible pandemic-related confounders or determinants of individual perceptions in regard to the quality of the above-mentioned courses, such as students’ overall satisfaction with life, perception of work effectiveness and online professional activity, level of depression, health and support from the university.

2. Materials and Methods

2.1. Study Design and Participants

An online cross-sectional survey was employed for data collection: an anonymous questionnaire (implemented using Google Forms) was distributed to the students attending the EM course during the first semester of the academic year 2020–2021, when all activities went online; students were requested to distribute the questionnaire to their peers (i.e., same generation, attending a similar clinical program). The survey was active mid-semester, between 27 November 2020 and 6 December 2020 (it closed after three consecutive days with no answer). It started with information about the study’s goals and the measures taken to assure personal data protection. For each individual, actual data collection proceeded after informed consent had been granted (required confirmation was included as the questionnaire’s first item).
Figure 1 shows the study flow diagram. BMI, biostatistics and EM courses are mandatory in the six-year medical program of our university. The survey targeted four areas, implemented as distinct sections of the questionnaire: (a) level of depression, perception of work effectiveness and overall satisfaction with life and online professional activity during the ongoing COVID-19 pandemic; (b) residual knowledge of BMI and biostatistics and opinion of the previous BMI and biostatistics courses; (c) feedback about the ongoing EM course; and (d) opinion of the prospective applicability of e-learning and online instruments in medical education.
Depression was measured with the nine-item Patient Health Questionnaire (PHQ-9), validated for the Romanian population [22,23] and proven to be a valid screening tool for depression in various settings (i.e., not only in clinical settings, as initially developed) and also for the general population [24,25,26,27].
Residual knowledge of BMI and biostatistics was gauged with 14 multiple choice questions. These questions were designed for this particular investigation, based on the courses’ syllabi and on our repository of questions used in ordinary end-of-course examinations. The answers were manually coded by two independent reviewers and any disagreements were resolved by consensus. Supplementary File S1 shows the syllabi for the biomedical informatics and biostatistics courses in the academic years 2017–2018 and 2018–2019, respectively.
Students’ opinions and feedback were collected on five-point Likert-type scales. The overall opinion of each course was recorded as integer marks between 1 and 10. For the ongoing EM course, opinions were separately collected for lectures and practical classes, for this was the first time the students had experienced online clinical activities. The face validity of the questions designed for this project was assured by the Delphi technique in the development process; no prior formal validation was conducted.
Supplementary File S2 details the tools employed for data collection and presents the full questionnaire.

2.2. Data Analysis

Descriptive statistics comprised the mean and standard deviation for age, a normally distributed numerical variable. Normality was tested with the Shapiro–Wilk statistical test; subsequently, the ANOVA parametric test was used for the statistical significance of observed differences between the genders. Scale scores were treated as rank variables, described by the median and the inter-quartile range (IQR); non-parametric methods were further employed for statistical analysis, such as the Kruskal–Wallis test, Wilcoxon signed rank test and Spearman coefficient of correlation. Categorical variables were described by the observed frequencies (i.e., counts) and their corresponding percentages; the Chi-square test was applied for statistical significance (either asymptotic, or Monte-Carlo simulation based on 10,000 samples).
For meaningful groups of questions within the anonymous questionnaire (such as PHQ-9, residual knowledge, self-assessed knowledge, or course usefulness), the actual reliability of measurements was assessed based on Cronbach’s alpha. Values over 0.8 were considered as proving good internal consistency.
For the group scales concerning the level of knowledge (either measured or self-assessed), in addition to the raw totals, a zero-max rescaling was applied, with the maximum set at 100%. Additional descriptive statistics were also presented for these rescaled scorings, treated as ranks.
The statistical analysis was conducted at a 95% level of confidence (i.e., 5% level of statistical significance). All reported probability values were two-tailed and highly significant values were also marked. Data were analyzed with the statistical software IBM SPSS v. 20.0 (Armonk, NY, USA) and the statistical packages R v.4.0.5 (https://cran.r-project.org/, accessed on 22 September 2022).

3. Results

One hundred and twenty-one students aged between 21 and 27 years responded: 28 were male, 84 female and 9 preferred not to declare their gender. With only one exception (a male student), respondents answered all questions. The EM course during which the questionnaire was distributed enrolled 79 students; thus, high response and dissemination rates could be inferred, exceeding by 50% the number of students with whom EM professors directly interacted during that time.
Table 1 synthesizes the results of the short quiz aimed at assessing the residual knowledge on data science (presumed to have been acquired during the BMI and biostatistics courses attended two years earlier), in parallel with the self-assessed level of knowledge. While Cronbach’s alpha for the self-assessment was high (based on five items), the value for the 14-item quiz was low (although the number of items was almost three times higher). The students’ opinions of the approach in terms of the examination and usefulness of the two courses were fair and the high values of their respective Cronbach’s alpha coefficients suggest the good reliability of these collected data. Table 1 also includes descriptive statistics for the marks, capturing the overall opinion of each of the two previous courses. It is notable that opinions were unanimous across the genders, on all aspects regarding the two previous data science courses.
Descriptive statistics of the self-assessed level of acquired EM knowledge are presented in Table 2, together with students’ opinions in regard to e-learning practical classes and prospective online examination on the EM course. Although the online activities and examinations were seen as poor substitutes for traditional approaches, the respondents acknowledged a high level of newly acquired knowledge concerning EM. This high regard for the EM course was also reflected by the overall marks given to the lectures and practical classes. When asked about their familiarity with and opinion of 360-degree video technology used in teaching EM course (Q53 and Q54), respondents were optimistic about its educational usefulness, although their declared familiarity with this technology was one level below their confidence in its benefits. Similarly to the opinions about previous courses, there was no significant difference across the genders in regard to the EM course and its associated activities.
Table 3 presents associations concerning the BMI and biostatistics courses as a two-by-two correlation matrix between the measured residual knowledge, self-assessed level of knowledge, opinions of the examinations and usefulness of previous courses and overall marks students gave to the courses. There was an insignificant correlation between the residual and self-assessed level of knowledge (Spearman coefficient R = 0.107, p = 0.246), but the high level of correlation between the two overall marks given to the BMI and biostatistics courses is noteworthy. At the same time, the residual knowledge did not correlate with any of the students’ subjective appraisals, namely their perceptions or opinions. On the other hand, all of these perceptions and opinions were significantly two-by-two correlated.
Table 4 synthesizes the two-by-two correlation between the overall marks given to each course or particular activity; there was a strong and highly significant correlation between similar activities: (a) the ongoing EM activities (lectures and practical classes); and (b) the previous BMI and biostatistics courses. In contrast, the correlation between the appreciation of EM activities and previous data science courses was rather weak (although it was statistically significant).
Supplementary File S3 comprises four additional tables, containing results considered helpful for contextualizing the above data; we regarded them as non-essential for conveying the main message of this paper, but as still important for further exploring the possible confounders in the feedback we collected in a limited time window in the fall of 2020.
Table S1 presents the students’ opinion and concerns regarding their online professional activity, perception of work effectiveness, depression and overall satisfaction with life. Except for life satisfaction, there was no significant difference between the genders.
Table S2 shows the students’ perception of their own abilities in employing the ICT technology for independent online activities, their motivation towards attending such activities and the prospective applicability of e-learning and online activities in medical education: they seemed confident in their ICT abilities, but their levels of motivation and confidence in the educational validity of these existing curriculum activities were lower.
Two supplementary correlation matrices (Tables S3 and S4) show the strength of association between the levels of satisfaction with education, life, health and perceived support from the university, and the overall marks students gave to the data science and EM courses, respectively. The marks did not appear to depend on the levels of depression or satisfaction.

4. Discussion

Students responded to the survey request with enthusiasm and eagerness to provide feedback, although they were not fully satisfied with their health, professional life, or life in general: the results shown in Supplementary File S3 help to put the course feedback in a larger context, regarding respondents’ satisfaction and personal perspective on their profession and life. Our survey shows that, as the online educational activities gained momentum and all stakeholders acquired much needed know-how in the new academic context, the students’ professional lives improved. Nevertheless, their level of satisfaction remained rather low in regard to the perceived support from the university and with life in general. Our findings confirm other reported concerns related to education during the COVID-19 pandemic and students’ struggle to adapt [28,29,30,31], or issues regarding the basis of present medical education [32].
We found a weak but statistically significant correlation between the perceptions and attitudes concerning the courses and the levels of satisfaction with regard to life, health and perceived support from the university. However, we found no evidence to suggest that frustration or depression engendered the feedback on any of the surveyed courses.
We contrasted students’ opinions of two different course profiles, at distinct stages of the undergraduate medical program: on the one hand, the two BMI and biostatistics courses, previously taught during the preclinical stage; and on the other hand, the ongoing activities of the EM course, during the clinical stage. Online teaching and learning EM were obviously challenging for teachers and students alike. Nevertheless, students seemed willing to overcome the difficulties and seized every opportunity to improve their preparedness for their chosen career, i.e., the medical profession, in line with other reports about technology-enhanced teaching being well-received by medical students [33]. Notably, compared with the results reported by Baashar et al. [33], the students who participated in our project obtained good marks in further objective EM examinations at the end of that semester, thus confirming their good preparedness, in addition to their commitment and declared motivation [34].
The feedback about the two previous data science courses reveals students’ disconnection from the topic: self-assessed and measured residual knowledge were not correlated. In addition, the reliability of the measured knowledge was low, an issue that could have two roots: (a) the questions were irrelevant, i.e., they lacked validity; and (b) there were too few items for such a broad range of subjects and concepts. In contrast, the respondents seemed rather confident in their knowledge and practical abilities in regard to the actual employment of ICT in their current professional activities. Moreover, the self-assessed knowledge significantly correlated with the opinions of the courses and their usefulness. When the two courses were re-designed in 2017, they were intended as a coordinated introduction to biomedical data science and it seemed we achieved that goal: the participants’ perceptions and overall feedback on the courses strongly correlated. Nonetheless, the feedback itself was reserved: the courses did not appear to fit into the undergraduate medical program and two different underlying reasons might explain this feedback we received. Firstly, having data science courses in the preclinical stage might be too early; biostatistics might be better suited to the later stages of medical education, when the need for making sense of data is more apparent. Secondly, such courses conveying interdisciplinary or complementary knowledge might seem non-essential to the medical profession and therefore not a priority for students. On the other hand, biomedical informatics in the early stages would help to make sure that the necessary digital competencies are mastered. We also acknowledge the strong correlation between the marks given to the two courses, which suggests that the students did not perceive them as disconnected. To sum up, having multiple course modules along the medical curriculum in a manner of progressive complexity might be more effective. Thus, questions and concerns arise in regard to the priorities of the basic curriculum. Personal career preferences towards immediate action or research activities might also play a role in prioritizing learning efforts, as discussed by Hammaker et al. [35].
Apparent usefulness in the medical profession seems to be the keystone of students’ involvement and commitment: the specific problems to which data science would bring solutions should be perceptible to the medical students. Courses that could be seen as new to the profession, such as informatics and biostatistics, should blend into the curriculum, with evident applicability. Established authors have advocated the importance of data science in medical education and timely implementation approaches have been suggested [9,36,37]. The United States’ National Library of Medicine offers data science and informatics training programs designed for researchers and healthcare workers [38]. The disconnection we found between self-assessed and measured knowledge might have been generated by our failure in conveying the weighty concepts of biomedical data science. On the other hand, the pattern that emerged from the feedback we collected was the students’ self-confidence in their practical abilities to use information technology for their everyday needs, combined with no perceived necessity for additional insight into medical data. Making sense of data did not constitute a concern for the students we surveyed, so this should be a concern for educators.
Innovative educational approaches, such as active learning, self-directed and implicit learning, flipped classrooms, or gaming, might help us put the basics of data science into the right context, as they have already been brought into the discussion [2,5,6,39,40,41,42]. In 2013, Bok et al. [43] proposed workplace learning in medical education as a context for measuring and documenting competence development, together with formative feedback in addition to summative decisions. Contextual learning might be a fruitful implementation of such courses (i.e., courses with no foreseen or immediate usefulness for beginners). Moreover, acquaintance with the basics of data science would bring about a two-fold gain for medical students: (a) helping them to become better future professionals; and (b) helping them to understand the concept of learning analytics and become actively involved in self-regulating their own learning, as has been suggested for years [9]. Based on the experience from other areas of higher education, medical educators can help their students to gain meta-cognitive understanding and build self-regulating abilities [44,45].
In a broader context, apart from academics and medical professionals, other stakeholders should also be involved as agents of this change in medical education, such as healthcare organizations and medical students [3,46,47]. However, finding the balance between learners’ personal preferences and an adherence to academic requirements and standards is a challenge that might generate frustration for some medical students. Although we acknowledge that an effective education is a collective endeavor, we believe it remains the duty of the faculty and professors to find functional approaches in the pursuit of equilibrium. Moreover, to this end, educational approaches should be tailored to each curricular theme.

Generalization Limitations

The main limitations were generated by the cross-sectional design of the survey and the limited number of questions in each of its sections. The low reliability of the residual knowledge assessment was a caveat we acknowledge throughout the paper.
The opinions were collected from students of one university and one generation, thus representing a limited sample of feedback information to draw conclusions from. An additional limitation was produced by the opportunistic nature of this investigation during the COVID-19 pandemic and the skipping of the formal validation stage during questionnaire deployment.
With these limitations in mind, our exploratory investigation identifies opinions and issues for further discussion and investigation on a larger scale and using intervention-based designs, rather than making categorical judgments or offering purportedly miraculous solutions.
On the other hand, our survey has the advantage of data being collected during the very time when the traditional approaches reached their limits and when information technology and data-related sciences became strongly engaged in medical education. This unprecedentedly challenging situation has created both hurdles and opportunities in medical education and our efforts were focused on measures to not miss the latter.

5. Conclusions

We believe that our survey contributes evidence on the need to provide an adequate medical background and rationale for all complementary courses in the medical curriculum and for biomedical data science in particular. The results also provide additional evidence to support the broadening of educational approaches themselves and the incorporation of contextual or implicit learning, as well as active or self-directed learning, into the interdisciplinary courses of the medical curriculum.
Our message, asking for integration and contextualization, is aimed at medical education stakeholders at various levels, from institutional policy makers to curriculum designers and teachers themselves. We opt for a distributed approach, which offers a beneficial solution in terms of contextualizing data science assets for the medical profession and fostering long-term practices in terms of the use of data in daily medical practice.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph192315958/s1. Supplementary file S1: Syllabi for the biomedical informatics and biostatistics courses in the academic years 2017–2018 and 2018–2019, respectively (.PDF). Supplementary file S2: Description of data collection instruments and full 62-item questionnaire deployed in the survey (.PDF). Supplementary file S3: Additional results (.PDF).

Author Contributions

Conceptualization, D.L., A.P., O.A.M. and B.T.; methodology, D.L., A.P., R.L., O.A.M. and B.T.; validation, D.L., A.P., R.L. and A.M.M.; formal analysis, D.L., A.P., R.L. and B.T.; resources, O.A.M. and B.T.; data curation, D.L. and R.L.; writing—original draft preparation, D.L. and A.P.; writing—review and editing, D.L., A.P., R.L., A.M.M., O.A.M. and B.T.; supervision, O.A.M. and B.T.; project administration, D.L. and A.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Data collection and analysis were approved by the Ethics Committee of “Victor Babes” University of Medicine and Pharmacy (ID number 53, received on 9 November 2020) and followed the European Union General Data Protection Regulation (GDPR).

Informed Consent Statement

Informed consent was obtained from all the subjects involved in the survey.

Data Availability Statement

The curated data file is openly available at https://doi.org/10.6084/m9.figshare.20358966.v1.

Acknowledgments

We acknowledge the valuable contributions of the anonymous students who agreed to provide the feedback in this survey.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. European Commission Digital Education Action Plan (2021–2027)|European Education Area. Available online: https://education.ec.europa.eu/focus-topics/digital-education/action-plan (accessed on 22 July 2022).
  2. Vallée, A.; Blacher, J.; Cariou, A.; Sorbets, E. Blended Learning Compared to Traditional Learning in Medical Education: Systematic Review and Meta-Analysis. J. Med. Internet Res. 2020, 22, e16504. [Google Scholar] [CrossRef] [PubMed]
  3. van Dam, P.J.; Griffin, P.; Peterson, G.M.; Reeves, N.S.; Kirkwood, L.; Prior, S.J. Organizational Support in Healthcare Redesign Education: A Mixed-Methods Exploratory Study of Expert Coach and Executive Sponsor Experiences. Int. J. Environ. Res. Public Health 2020, 17, 5308. [Google Scholar] [CrossRef] [PubMed]
  4. Zhong, J.; Li, Z.; Hu, X.; Wang, L.; Chen, Y. Effectiveness Comparison between Blended Learning of Histology Practical in Flipped Physical Classrooms and Flipped Virtual Classrooms for MBBS Students. BMC Med. Educ. 2022, 22, 795. [Google Scholar] [CrossRef]
  5. Winkel, A.F.; Gillespie, C.; Park, A.; Branzetti, J.; Cocks, P.; Greene, R.E.; Zabar, S.; Triola, M. Bridging the Gap from Student to Doctor: Developing Coaches for the Transition to Residency. Med. Educ. Online 2023, 28, 2145103. [Google Scholar] [CrossRef]
  6. Bughrara, M.S.; Swanberg, S.M.; Lucia, V.C.; Schmitz, K.; Jung, D.; Wunderlich-Barillas, T. Beyond COVID-19: The Impact of Recent Pandemics on Medical Students and Their Education: A Scoping Review. Med. Educ. Online 2023, 28, 2139657. [Google Scholar] [CrossRef]
  7. Puskarich, M.A.; Callaway, C.; Silbergleit, R.; Pines, J.M.; Obermeyer, Z.; Wright, D.W.; Hsia, R.Y.; Shah, M.N.; Monte, A.A.; Limkakeng, A.T.; et al. Priorities to Overcome Barriers Impacting Data Science Application in Emergency Care Research. Acad. Emerg. Med. 2019, 26, 97–105. [Google Scholar] [CrossRef]
  8. Janke, A.T.; Overbeek, D.L.; Kocher, K.E.; Levy, P.D. Exploring the Potential of Predictive Analytics and Big Data in Emergency Care. Ann. Emerg. Med. 2016, 67, 227–236. [Google Scholar] [CrossRef]
  9. Khamisy-Farah, R.; Gilbey, P.; Furstenau, L.B.; Sott, M.K.; Farah, R.; Viviani, M.; Bisogni, M.; Kong, J.D.; Ciliberti, R.; Bragazzi, N.L. Big Data for Biomedical Education with a Focus on the COVID-19 Era: An Integrative Review of the Literature. Int. J. Environ. Res. Public Health 2021, 18, 8989. [Google Scholar] [CrossRef]
  10. Cirigliano, M.M.; Guthrie, C.; Pusic, M.V.; Cianciolo, A.T.; Lim-Dunham, J.E.; Spickard, A.; Terry, V. “Yes, and …” Exploring the Future of Learning Analytics in Medical Education. Teach. Learn Med. 2017, 29, 368–372. [Google Scholar] [CrossRef] [PubMed]
  11. ten Cate, O.; Dahdal, S.; Lambert, T.; Neubauer, F.; Pless, A.; Pohlmann, P.F.; van Rijen, H.; Gurtner, C. Ten Caveats of Learning Analytics in Health Professions Education: A Consumer’s Perspective. Med. Teach. 2020, 42, 673–678. [Google Scholar] [CrossRef] [PubMed]
  12. ten Cate, O.; Borleffs, J.; van Dijk, M.; Westerveld, T. Training Medical Students for the Twenty-First Century: Rationale and Development of the Utrecht Curriculum “CRU+”. Med. Teach. 2018, 40, 461–466. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Ostatnikova, D.; Hopkins, M.A.; Riles, T.; Robinson, E.; Hnilicova, S. Universities and Their Educational Mission in the 21st Century: Medical Education Innovations at Comenius University Faculty of Medicine. Bratisl. Med. J. 2019, 120, 617–620. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Goldstein, N.D.; LeVasseur, M.; McClure, L.A. On the Convergence of Epidemiology, Biostatistics, and Data Science. Harv. Data Sci. Rev. 2020, 2–16. [Google Scholar] [CrossRef]
  15. Tarantola, A.; Gautier, L. Biostatistics to Better Detect Fishy Findings. Lancet Infect. Dis. 2021, 21, 316–317. [Google Scholar] [CrossRef]
  16. Kulikowski, C.A.; Shortliffe, E.H.; Currie, L.M.; Elkin, P.L.; Hunter, L.E.; Johnson, T.R.; Kalet, I.J.; Lenert, L.A.; Musen, M.A.; Ozbolt, J.G.; et al. AMIA Board White Paper: Definition of Biomedical Informatics and Specification of Core Competencies for Graduate Education in the Discipline. J. Am. Med. Inform. Assoc. 2012, 19, 931–938. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Mantas, J.; Ammenwerth, E.; Demiris, G.; Hasman, A.; Haux, R.; Hersh, W.; Hovenga, E.; Lun, K.C.; Marin, H.; Martin-Sanchez, F.; et al. Recommendations of the International Medical Informatics Association (IMIA) on Education in Biomedical and Health Informatics. Methods Inf. Med. 2010, 49, 105–120. [Google Scholar] [CrossRef] [PubMed]
  18. Jidkov, L.; Alexander, M.; Bark, P.; Williams, J.G.; Kay, J.; Taylor, P.; Hemingway, H.; Banerjee, A. Health Informatics Competencies in Postgraduate Medical Education and Training in the UK: A Mixed Methods Study. BMJ Open 2019, 9, e025460. [Google Scholar] [CrossRef] [PubMed]
  19. Hübner, U.; Thye, J.; Shaw, T.; Elias, B.; Egbert, N.; Saranto, K.; Babitsch, B.; Procter, P.; Ball, M.J. Towards the TIGER International Framework for Recommendations of Core Competencies in Health Informatics 2.0: Extending the Scope and the Roles. Stud. Health Technol. Inform. 2019, 264, 1218–1222. [Google Scholar] [CrossRef] [PubMed]
  20. Joshi, A.; Bruce, I.; Amadi, C.; Amatya, J. Developing Evidence-Based Population Health Informatics Curriculum: Integrating Competency Based Model and Job Analysis. Online J. Public Health Inf. 2021, 13, e10. [Google Scholar] [CrossRef]
  21. Lungeanu, D.; Tractenberg, R.E.; Bersan, O.S.; Mihalas, G.I. Towards the Integration of Medical Informatics Education for Clinicians into the Medical Curriculum. Stud. Health Technol. Inform. 2009, 150, 936–940. [Google Scholar] [CrossRef]
  22. Kroenke, K.; Spitzer, R.L.; Williams, J.B.W. The PHQ-9. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef] [PubMed]
  23. Lupascu, N.; Timar, B.; Albai, A.; Roman, D.; Potre, O.; Timar, R. Validation and Cross-Cultural Adaptation of the Depression Patient’s Health Questionnaire–9 in the Romanian Population of Patients with Type 2 Diabetes Mellitus. Diabetes Metab. Syndr. Obes. 2019, 12, 841–849. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Pranckeviciene, A.; Saudargiene, A.; Gecaite-Stonciene, J.; Liaugaudaite, V.; Griskova-Bulanova, I.; Simkute, D.; Naginiene, R.; Dainauskas, L.L.; Ceidaite, G.; Burkauskas, J. Validation of the Patient Health Questionnaire-9 and the Generalized Anxiety Disorder-7 in Lithuanian Student Sample. PLoS ONE 2022, 17, e0263027. [Google Scholar] [CrossRef] [PubMed]
  25. Martin, A.; Rief, W.; Klaiberg, A.; Braehler, E. Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the General Population. Gen. Hosp. Psychiatry 2006, 28, 71–77. [Google Scholar] [CrossRef] [PubMed]
  26. Kocalevent, R.D.; Hinz, A.; Brähler, E. Standardization of the Depression Screener Patient Health Questionnaire (PHQ-9) in the General Population. Gen. Hosp. Psychiatry 2013, 35, 551–555. [Google Scholar] [CrossRef] [PubMed]
  27. Wang, W.; Bian, Q.; Zhao, Y.; Li, X.; Wang, W.; Du, J.; Zhang, G.; Zhou, Q.; Zhao, M. Reliability and Validity of the Chinese Version of the Patient Health Questionnaire (PHQ-9) in the General Population. Gen. Hosp. Psychiatry 2014, 36, 539–544. [Google Scholar] [CrossRef]
  28. Puljak, L.; Čivljak, M.; Haramina, A.; Mališa, S.; Čavić, D.; Klinec, D.; Aranza, D.; Mesarić, J.; Skitarelić, N.; Zoranić, S.; et al. Attitudes and Concerns of Undergraduate University Health Sciences Students in Croatia Regarding Complete Switch to E-Learning during COVID-19 Pandemic: A Survey. BMC Med. Educ. 2020, 20, 416. [Google Scholar] [CrossRef]
  29. Reddy, R.K.; Palmer, E.G. Response to: ‘Medical Students’ Preference for Returning to the Clinical Setting during the COVID-19 Pandemic. Med. Educ. 2020, 54, 1192. [Google Scholar] [CrossRef]
  30. Rose, S. Medical Student Education in the Time of COVID-19. JAMA 2020, 323, 2131–2132. [Google Scholar] [CrossRef]
  31. Compton, S.; Sarraf-Yazdi, S.; Rustandy, F.; Radha Krishna, L.K. Medical Students’ Preference for Returning to the Clinical Setting during the COVID-19 Pandemic. Med. Educ. 2020, 54, 943–950. [Google Scholar] [CrossRef]
  32. ten Cate, O.; Schultz, K.; Frank, J.R.; Hennus, M.P.; Ross, S.; Schumacher, D.J.; Snell, L.S.; Whelan, A.J.; Young, J.Q. Questioning Medical Competence: Should the Covid-19 Crisis Affect the Goals of Medical Education? Med. Teach. 2021, 43, 817–823. [Google Scholar] [CrossRef] [PubMed]
  33. Baashar, Y.; Alkawsi, G.; Ahmad, W.N.W.; Alhussian, H.; Alwadain, A.; Capretz, L.F.; Babiker, A.; Alghail, A. Effectiveness of Using Augmented Reality for Training in the Medical Professions: Meta-Analysis. JMIR Serious Games 2022, 10, e32715. [Google Scholar] [CrossRef] [PubMed]
  34. Petrica, A.; Lungeanu, D.; Ciuta, A.; Marza, A.M.; Botea, M.O.; Mederle, O.A. Using 360-Degree Video for Teaching Emergency Medicine during and beyond the COVID-19 Pandemic. Ann. Med. 2021, 53, 1520–1530. [Google Scholar] [CrossRef]
  35. Hammaker, A.C.; Dodwad, S.-J.M.; Salyer, C.E.; Adams, S.D.; Foote, D.C.; Ivascu, F.A.; Kader, S.; Abelson, J.S.; al Yafi, M.; Sutton, J.M.; et al. A Multi-Institutional Study from the US ROPE Consortium Examining Factors Associated with Directly Entering Practice upon Residency Graduation. Surgery 2022, 172, 906–912. [Google Scholar] [CrossRef] [PubMed]
  36. Weissgerber, T.L. Learning from the Past to Develop Data Analysis Curricula for the Future. PLoS Biol. 2021, 19, e3001343. [Google Scholar] [CrossRef]
  37. Bolt, T.; Nomi, J.S.; Bzdok, D.; Uddin, L.Q. Educating the Future Generation of Researchers: A Cross-Disciplinary Survey of Trends in Analysis Methods. PLoS Biol. 2021, 19, e3001313. [Google Scholar] [CrossRef]
  38. Florance, V. Training for Research Careers in Biomedical Informatics and Data Science Supported by the National Library of Medicine; Springer: Cham, Germany, 2020; pp. 13–22. [Google Scholar]
  39. Schwartzstein, R.M.; Roberts, D.H. Saying Goodbye to Lectures in Medical School—Paradigm Shift or Passing Fad? N. Engl. J. Med. 2017, 377, 605–607. [Google Scholar] [CrossRef]
  40. Gustin, M.P.; Abbiati, M.; Bonvin, R.; Gerbase, M.W.; Baroffio, A. Integrated Problem-Based Learning versus Lectures: A Path Analysis Modelling of the Relationships between Educational Context and Learning Approaches. Med. Educ. Online 2018, 23, 1489690. [Google Scholar] [CrossRef] [Green Version]
  41. Harasym, P.H.; Tsai, T.C.; Munshi, F.M. Is Problem-Based Learning an Ideal Format for Developing Ethical Decision Skills? Kaohsiung J. Med. Sci. 2013, 29, 523–529. [Google Scholar] [CrossRef] [Green Version]
  42. Hasan Sapci, A.; Aylin Sapci, H. Teaching Hands-On Informatics Skills to Future Health Informaticians: A Competency Framework Proposal and Analysis of Health Care Informatics Curricula. JMIR Med. Inform. 2020, 8, e15748. [Google Scholar] [CrossRef]
  43. Bok, H.G.; Teunissen, P.W.; Favier, R.P.; Rietbroek, N.J.; Theyse, L.F.; Brommer, H.; Haarhuis, J.C.; van Beukelen, P.; van der Vleuten, C.P.; Jaarsma, D.A. Programmatic Assessment of Competency-Based Workplace Learning: When Theory Meets Practice. BMC Med. Educ. 2013, 13, 123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Jivet, I.; Scheffel, M.; Schmitz, M.; Robbers, S.; Specht, M.; Drachsler, H. From Students with Love: An Empirical Study on Learner Goals, Self-Regulated Learning and Sense-Making of Learning Analytics in Higher Education. Internet High Educ. 2020, 47, 100758. [Google Scholar] [CrossRef]
  45. Tsai, Y.S.; Rates, D.; Moreno-Marcos, P.M.; Muñoz-Merino, P.J.; Jivet, I.; Scheffel, M.; Drachsler, H.; Delgado Kloos, C.; Gašević, D. Learning Analytics in European Higher Education—Trends and Barriers. Comput. Educ. 2020, 155, 103933. [Google Scholar] [CrossRef]
  46. Meeuwissen, S.N.E.; Whittingham, J.R.D. Student Participation in Undergraduate Medical Education: A Continuous Collective Endeavour. Perspect. Med. Educ. 2020, 9, 3–4. [Google Scholar] [CrossRef] [Green Version]
  47. Geraghty, J.R.; Young, A.N.; Berkel, T.D.M.; Wallbruch, E.; Mann, J.; Park, Y.S.; Hirshfield, L.E.; Hyderi, A. Empowering Medical Students as Agents of Curricular Change: A Value-Added Approach to Student Engagement in Medical Education. Perspect. Med. Educ. 2020, 9, 60–65. [Google Scholar] [CrossRef]
Figure 1. Study flow diagram.
Figure 1. Study flow diagram.
Ijerph 19 15958 g001
Table 1. Measured residual and self-assessed knowledge of BMI and biostatistics and students’ opinions of the two courses (including examinations, perceived usefulness and overall appraisal for each).
Table 1. Measured residual and self-assessed knowledge of BMI and biostatistics and students’ opinions of the two courses (including examinations, perceived usefulness and overall appraisal for each).
Question(s)/VariableAllMalesFemalesNot Declaredp-Value (a),(b)
N = 121N = 28N = 84N = 9
Q21 to Q34Residual knowledge Total28 (a),#12 (10–15)12 (10–15) #12 (10–15)10 (8–14)0.608
14 items, Cronbach’s alpha = 0.369
Percentage scale residual knowledge (a),#57.14 (47.62–71.43) #47.62
(38.10–66.67)
Q35 to Q39I learnt Total25 (a)
Biomedical data science
16 (14–19)16 (15–20.5)16 (14–19)13 (12–21)0.58
5 items, Cronbach’s alpha = 0.929
Percentage scale I learnt (a)64 (56–76)64 (60–82)64 (56–76)52 (48–84)
Q40Examination Total10 (a)
Biomedical data science
8 (6–9)8 (7–9)8 (6–9)6 (6–8)0.123
Q412 items, Cronbach’s alpha = 0.868
Q42Usefulness Total10 (a)
Biomedical data science
8 (6–9)8 (7–9)8 (6–9)6 (6–8)0.798
Q432 items, Cronbach’s alpha = 0.826
Q44Overall opinion BMI course (b)7 (5–9)6.5 (5–8)8 (5–9)7 (3–9)0.449
Q45Overall opinion of the biostatistics course (b)8 (5–9)8 (6–9)8 (5–9)8 (4–9)0.967
(a) median (IQR) for the totals (sum of the items); Kruskal–Wallis statistical test for significance of observed differences between the three gender groups; (b) mark between 1 and 10; median (IQR); Kruskal–Wallis statistical test for significance of observed differences between the three gender groups. Notation: IQR, inter-quartile range; #, one missing value for a male respondent.
Table 2. Opinions of the ongoing EM course, including separate appraisals for lectures, practical activities and 360-degree video scenarios employed as online educational instruments.
Table 2. Opinions of the ongoing EM course, including separate appraisals for lectures, practical activities and 360-degree video scenarios employed as online educational instruments.
Question(s)/VariableAllMalesFemalesNot Declaredp-Value (a),(b),(c)
N = 121N = 28N = 84N = 9
Q47I learnt EM Total15 (a)13 (9–15)12 (9–15)15 (9–15)14 (12–15)0.189
3 items, Cronbach’s alpha = 0.929
Percentage scale I learnt EM (a)86.67
(60–100)
80
(60–100)
100
(60–100)
93.33
(80–100)
Q48E-learning is a valid substitute for clinical practice (b)2 (1–3)2 (1–3)2 (1–3)2 (1–3)0.704
Q49Online examination is valid (b)3 (1–3)2 (1–3)3 (1–3)1 (1–3)0.606
Q51Overall opinion EM practicals (c)9 (8–10)9 (7.5–10)9 (8–10)9 (7–9)0.398
Q52Overall opinion EM lectures (c)9 (7–10)8 (6–10)9 (7–10)8 (6–9)0.559
Q53Video 360 familiar (b)3 (2–4)3 (1–4)3 (2–4)3 (1–3)0.089
Q54Video 360 useful (b)4 (3–5)4 (3–5)4 (3–5)4 (3–4)0.492
(a) median (IQR) for the totals (sum of the items); Kruskal–Wallis statistical test for significance of observed differences between the three gender groups; (b) rank scores between 1 and 5; median (IQR); Kruskal–Wallis statistical test for significance of observed differences between the three gender groups; (c) mark between 1 and 10; median (IQR); Kruskal–Wallis statistical test for significance of observed differences between the three gender groups. Notation: IQR, inter-quartile range.
Table 3. Associations concerning the BMI and biostatistics courses: two-by-two correlation matrix between the measured residual knowledge, self-assessed level of knowledge, opinions of the examination approach and usefulness of previous courses and overall marks students gave to each course.
Table 3. Associations concerning the BMI and biostatistics courses: two-by-two correlation matrix between the measured residual knowledge, self-assessed level of knowledge, opinions of the examination approach and usefulness of previous courses and overall marks students gave to each course.
Variable Residual Knowledge #Self-Assessed KnowledgeExamination ApproachUsefulness of Data ScienceBMI MarkBiostats Mark
Residual knowledge #R1.0000.1070.029−0.071−0.0360.013
p.0.2460.7530.4440.6950.889
N120120120120120120
Self-assessed knowledgeR0.1071.0000.699 **0.529 **0.589 **0.691 **
p0.246.<0.001<0.001<0.001<0.001
N120121121121121121
Examination approachR0.0290.699 **1.0000.574 **0.572 **0.634 **
p−0.753<0.001.<0.001<0.001<0.001
N120121121121121121
Usefulness of data scienceR−0.0710.529 **0.574 **1.0000.591 **0.581 **
p0.444<0.001<0.001.<0.001<0.001
N120121121121121121
BMI markR−0.0360.589 **0.572 **0.591 **1.0000.869 **
p0.695<0.001<0.001<0.001.<0.001
N120121121121121121
Biostats markR0.0130.691 **0.634 **0.581 **0.869 **1.000
p0.889<0.001<0.001<0.001<0.001.
N120121121121121121
Significant R values over 0.5 are in bold. Notations: BMI, biomedical informatics; N, number of paired values in the correlation analysis; p, p-value for statistical significance; R, Spearman coefficient of correlation; #, one missing value for a male respondent; **, statistical significance, p < 0.01.
Table 4. Associations between the EM lectures and practical activities and the two data science courses: two-by-two correlation matrix between the overall marks students gave to each course or activity.
Table 4. Associations between the EM lectures and practical activities and the two data science courses: two-by-two correlation matrix between the overall marks students gave to each course or activity.
Variable EM Practicals MarkEM Lectures MarkBMI MarkBiostats Mark
EM practical markR1.0000.730 **0.477 **0.387 **
p.<0.001<0.001<0.001
N121121121121
EM lectures markR0.730 **1.0000.362 **0.256 **
p<0.001.<0.0010.005
N121121121121
BMI markR0.477 **0.362 **1.0000.869 **
p<0.001<0.001.<0.001
N121121121121
Biostats markR0.387 **0.256 **0.869 **1.000
p<0.0010.005<0.001.
N121121121121
Significant R values over 0.5 are in bold. Notations: BMI, biomedical informatics; EM, emergency medicine; N, number of paired values in the correlation analysis; p, p-value for statistical significance; R, Spearman coefficient of correlation; **, statistical significance, p < 0.01.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lungeanu, D.; Petrica, A.; Lupusoru, R.; Marza, A.M.; Mederle, O.A.; Timar, B. Beyond the Digital Competencies of Medical Students: Concerns over Integrating Data Science Basics into the Medical Curriculum. Int. J. Environ. Res. Public Health 2022, 19, 15958. https://doi.org/10.3390/ijerph192315958

AMA Style

Lungeanu D, Petrica A, Lupusoru R, Marza AM, Mederle OA, Timar B. Beyond the Digital Competencies of Medical Students: Concerns over Integrating Data Science Basics into the Medical Curriculum. International Journal of Environmental Research and Public Health. 2022; 19(23):15958. https://doi.org/10.3390/ijerph192315958

Chicago/Turabian Style

Lungeanu, Diana, Alina Petrica, Raluca Lupusoru, Adina Maria Marza, Ovidiu Alexandru Mederle, and Bogdan Timar. 2022. "Beyond the Digital Competencies of Medical Students: Concerns over Integrating Data Science Basics into the Medical Curriculum" International Journal of Environmental Research and Public Health 19, no. 23: 15958. https://doi.org/10.3390/ijerph192315958

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop