1. Introduction
About 40 years ago, the realization that results from scientific research did not consistently find their way into everyday clinical care led to the introduction of empirical medical practice, i.e., evidence-based practice (EBP) [
1]. In contrast to relying on expert opinions not based on empirical studies (eminence-based medicine), EBP focuses on critical appraisal, systematic literature reviews, and high quality national or even international scientific standards [
2,
3]. Theoretically, this patient-oriented, contextual process of evidence collection, collaboration, and critical reasoning allows for solid clinical decisions. EBP thus permanently strives toward increasing positive patient outcomes using applied knowledge of “what works best” in the ongoing challenge to improve care, following these steps: start with a defined question, seek out the relevant knowledge, critically evaluate this knowledge, and apply this evaluation’s findings in clinical practice.
Although the importance of EBP is widely accepted, there is a constant debate in the scientific community on how to achieve it. Authors from various medical fields—from statistics to psychosomatics—have suggested different approaches and definitions to address the perceived institutional as well as individual challenges for implementing and conducting EBP [
4]. For example, Musalek postulated the necessity to integrate evidence-based medicine in the concept of human-based medicine, allowing for more subjectivity in an attempt to acquire a holistic view on patient needs [
5]. Horwitz et al. suggested using the term medicine-based evidence, which represents more than just wordplay, by contradicting EBP in such a way that it is concentrated on clinical practice [
6]. Medicine-based evidence means that longitudinal patient profiles, i.e., the biological, clinical, psychological, and social environmental history that match the index patient profile, provide the comparative empirical base for specific case management.
Still, the main quest for EBP is to develop a coherent decision-making theory in view of related science disciplines, given the complexity of physiological and pathological processes and the continuous shift between states of health and disease. The transition from the formerly dominating traditional way to conduct medicine, eminence-based medicine, is an ongoing process that will probably never be completed in view of real-life clinical care and unpredictable emergency situations.
Already in 1999, Isaacs and Fitzgerald suggested seven alternatives to evidence-based medicine in the renowned British Medical Journal, namely, eminence, vehemence, eloquence, providence, diffidence, nervousness, and confidence-based medicine [
7]. Although meant as a sarcastic comment, it clearly highlights the gap between theory and practice in everyday medicine. Especially with the need to solve complex surgical and clinical challenges in the specific environment of making decisions under uncertainty in medicine, the notion that medicine is art (the art of healing) rather than science becomes a fact, with the EBP guidelines successfully substituted with senior expert intuition [
8,
9]. So, it seems that concepts such as EBP, human-based medicine, and eminence-based medicine are not mutually exclusive in medical practice.
As already mentioned, we have seen several proposed rewordings ranging from medicine-based and human-based medicine, and praise for decisions based on extrapolation as well as calls for not abolishing the tradition of eminence-based medicine, which is a well-known concept in the Austrian medical school looking back on a tradition of several hundred years [
5,
10,
11]. In the last decades, the digitalization of information access, mirrored in the constantly rising use of smartphone-based medical applications at point-of-care, has opened up new opportunities to provide (online) evidence-based rather than eminence-based healthcare [
8,
12,
13]. More recently published concepts argue for integrating or even replacing evidence-based medicine with theory-driven and co-designed-based approaches [
11]. So, the field is constantly evolving, but also returning to its more traditional roots while failing to connect the loose ends of global disciplines.
Coined by Albert Bandura, the concept of beliefs about capabilities, or self-efficacy, originates from social cognitive psychology and is linked to intentions and behaviors [
14]. For measuring individual beliefs about one´s capability to use the components of EBP, the EBP capability beliefs scale (EBPCBS) is widely used. It was originally developed using a Swedish sample of registered nurses, and is considered a valid and reliable tool that can be used on a one-dimensional scale [
15]. The tool has been tested in studies among nurses, health professionals, medical students, physical therapists, pharmacists, and social workers in different countries [
16,
17]). Mirroring the notion that EBP is a step-by-step process, the measure of EBP capability beliefs takes into account the sequential order and increasing complexity of the task. Thus, for the purpose of ability assessment as undertaken using the EBPCBS, the item response theory (e.g., as proposed in the Rasch model), is applicable, which is a widely used psychometric model for analyzing categorical data while balancing respondent skills and item difficulty [
18].
Nowadays, the concept of EBP has become crucial for educating medical students and training young clinicians in critical thinking and statistical reasoning when practicing medicine [
2,
3,
8,
19]. Considering that EBP is a well-known concept in academic medicine and perceived as the backbone of high-quality clinical care, very little is known of how the current academic discussion and societal trends affect EBP in the Austrian healthcare setting. Using the EBSCBS, this study focused on (i) collecting data on the self-perceived levels of capability beliefs and use, and (ii) comparing these measures between employees and students at the Medical University Vienna, Austria.
3. Results
Although 1253 participants (644 employees and 609 students) responded, we excluded six employees (three males and three females) who did not fill out responses for both EBPCB and EBP use, resulting in a study sample in total of 1247 participants, i.e., 638 employees and 609 students (51.2% vs. 48.8% of the total study sample).
Table 1 shows the socio-demographic characteristics of the study sample. As expected, the employees were older than the students, with more females (employees: 63.9%, students: 56.7%) in both academic groups. More than half of the employees reported having more than ten years in the profession, whereas in the student group, first (28.5%) and second (19.4%) year students were most common.
Table 2 depicts the results of the statistical comparison using T tests between employees and students in EBP capability beliefs and use. The employee group rated a mean value of 3.7 on the EBP capability beliefs index, scoring between 3.4 (
Appraise research reports) and 4.1 (
Search other sources) on the six EBP activities. The student group rated a mean value of 3.4 on the EBP capability beliefs index, scoring between 3.1 (
Appraise research reports) and 3.9 (
Search other sources). The employee group rated a mean value of 3.5 on the EBP use index, scoring between 3.0 (
Appraise research reports) and 4.4 (
Search other sources) on the six EBP activities. The student group rated a mean value of 3.2 on the EBP use index, scoring between 2.5 (
Implement knowledge) and 4.6 (
Search other sources). The professional groups differed statistically significantly in all items and the two indices (all
p < 0.05), with the students scoring lower in all items of EBP use except for
Search other sources.
We examined the correlation between the EBP capability beliefs index, EBP use index, and seniority level (
Table 3). We found a strong relationship between the two EBP indices for both professional groups (r > 0.6,
p < 0.001), whereas the number of years in profession did not correlate with the indices in the employees, but the year of studies (students) showed a negligible, hence statistically significant correlation with the EBP use index (r = 0.1,
p < 0.001).
In total, 118 participants (9.4%), 59 employees and 59 students, provided additional material in the text comment box. Eight study subjects (one employee and seven students) responding “no” were not considered for further analysis. Qualitative context analysis revealed that six participants found praising words for the survey, whereas the majority of 52 participants (27 employees and 25 students) criticized aspects of the survey content. Specifically, 35 participants (15 employees and 20 students) criticized the EBP items.
Examples of quotes from employees are:
1. “Some items are formulated in a strange way. Use other sources of information (e.g., books, magazines, colleagues)—everyone talks to colleagues about cases, etc. Contribute to changing the professional activity by including the (current) level of knowledge—if my activity is not based on my knowledge, what then? Assess whether the professional activity is based on research findings—if this means questioning current actions and comparing them with current research findings, it is not 100% clear.”
2. “What is meant by ’evaluation of research reports?”
3. “I do not understand the points ’Contributing to the change in professional activity by including the (current) state of knowledge’ and ’Assessing whether the professional activity is based on research findings’. What does this mean?”
Examples for quotes by students are:
1. “I found some questions difficult to understand. For example, I am unsure whether the question ’Assess whether clinical practice is based on research findings’ could be answered by a medical student with anything other than Never, since one does not teach this. The situation is similar with ’Formulating questions about student activity to search for new research-based knowledge’ or ’Contributing to the change in student activity by including the (current) state of knowledge.”
2. “Formulating questions to search for new, research-based knowledge—this wording is very difficult for me to understand. I find the question interesting, because I often have the feeling that studying at the Medical University Vienna is 100% science and 0% nature. I appreciate the scientific work, but would also like to see nature included, for example an elective course on Traditional European Medicine.”
4. Discussion
EBP has contributed substantially to the improvement of the quality of research by transparently documenting the problems with existing research and subsequently developing better research standards [
9,
21]. EBP has also improved the practice of medicine by developing methods and techniques for generating systematic literature reviews and clinical practice guidelines. To improve clinical outcomes and patient safety, and to reduce healthcare costs, implementing EBP is critical. As far as we know, this study is the first one collecting data on respective practices and beliefs among healthcare professionals and medical students at an Austrian medical university. The present study revealed differences in capability beliefs to perform EBP among employees and students in an academic setting. The original term EBP is constantly evolving and being reworded, ranging from medicine-based and human-based medicine to suit the specific requirements of different scientific disciplines. In our study, we did not strive to create another idea or concept of EBP, as we used an already well-known and validated survey tool.
A Chinese study found that about three quarters of physicians regularly applied EBM in their routine daily practice [
22]. However, a review showed that physicians (both in in- and out-patient settings) encountered various obstacles when using EBP in clinical practice, including a lack of time, EBP skills, patient-related factors, and their own attitudes [
4]. Murphy et al. found a lack of practical guidance tailored to students and their supervisors during clinical placements, potentially decreasing their capability and willingness for using EBP [
21]. Organizational culture for EBP was significantly and positively related to EBP beliefs and EBP implementation among health professionals in the U.S.A. [
19]. In our study, the two professional groups differed in their reported EBP capability beliefs and use, with higher ratings observed among employees. This result is in contrast to a Swedish study using the same assessment tool that reported opposite results with higher ratings (except for the item
Search other sources) among students compared to health professionals [
23]. However, the differences in EBP capability beliefs in this study were not statistically significant and the study population was quite small. In our study, we found higher ratings for
Search other sources among students for EBP use. Contradicting findings in different study populations and different countries could highlight the role of organization-specific educators in promoting an EBP culture, e.g., by adapting the medical curricula and postgraduate programs. So, establishing an EBP culture among educators might affect the EBP capability beliefs and future intentions of students to adopt EBP in clinical routines during their clinical placement [
23].
In line with other authors, we found that high EBP capability beliefs were strongly correlated with more frequent EBP use [
16,
19]. The number of years in profession did not correlate with both EBP indices in the employee group. Among students, the year of studies only showed a negligible correlation with the EBP use index, and this statistical significance could be interpreted as being sample size related. In accordance with other studies, the students reported medium scale EBP capability beliefs and lower scale EBP use on the items
Implement knowledge and
Evaluate practice [
17,
23]. As these are concluding steps of the EBP process, it seems that medical students would profit from educational and organizational support in these activities.
In the present study, we found moderate and rather high capability beliefs to perform and use EBP among both employees and students, with the items
Search databases and
Search other sources as dominant steps in the EBP process according to the participants. This result is in agreement with a review on teaching EBP, suggesting a high EBP competence among health students and also an increasing use of EBP promoting technology, i.e., mobile devices, simulations, and web content [
24]. Our observations could be interpreted as a general trend towards increased online health information seeking behavior and the use of electronic devices among all strata of the Austrian population, as observed worldwide [
12,
13]. Notably, the constant availability of digital content could also impact capability beliefs and use of EBP among medical students representing the so-called digital natives, i.e., those individuals born after 1980 [
25,
26]. This aspect seems to be neglected in the tools for assessing progress and efficiency regarding the research, teaching, and evaluation of EBP practices in a stepwise manner. The EBPCBS instrument used in our study, as well as other tools and conceptual frameworks, was grounded on the concept of an inherent understanding of just these subsequent steps [
3,
15,
27]. However, in theory the step-by-step process would argue for a more evenly distributed ratings picture, without overlooking the first EBP step
Formulate questions, which is potentially perceived as being more banal and superfluous in everyday clinical practice, especially amongst more experienced health professionals [
23,
28]. Moreover, this might be the turning point where concepts of eminence-based medicine, intuition, and seniority take over, simply leading to a strict following of the process to absurdity [
8,
9].
In the pertinent international literature, researchers use heterogeneous EBP assessment tools, constantly design new ones in different languages, and test them in various study populations and clinical settings [
19,
27]. This limits the comparability of the retrieved results and usefulness of the tools, hampering the advancement of EBP for clinical practice and (continuous) medical education. Although we used the validated EBPCBS in our survey, qualitative context analysis of free text comments indicated the possibility of potential sources of misunderstanding in the wording of the scale. In addition, the stepwise EBP process, or as such following the item response theory, was violated when taking into account the answers of the participants [
18]. This was unexpected and should motivate future in-depth qualitative studies assessing for contextual factors influencing the capability beliefs and use of EBP.
Time resources for educators for continuous teaching and training as well as for regular evaluations and feedback loops are key for supervising students. Likewise, students also need time to practice recently acquired medical skills and knowledge. So far, little is known on the interconnection between EBP and the hardly measurable concepts referring to eminence-based medicine or senior expert intuition [
7]. A sound EBP culture could eventually assist in raising awareness for the existence of these concepts, helping former students who enter the professional world to understand the influence of hierarchy in everyday clinical decision making [
8,
9]. To establish an organizational EBP culture ensuring an excellent quality of care for patients, our findings suggest that medical curricula should be screened and adapted, and supported by high-level clinical management initiatives and sustainable strategies.
As for the study limitations, the cross-sectional nature of our study did not allow for any causal attributions. Participation rates were high in view of previous Medcampus surveys [
25,
29] and the total number of participants of 1247 was significantly higher [
22,
23] or similar [
16,
30,
31] to related studies. Employees of the Medical University Vienna that were the recipients of the invitation to participate in this survey mainly consisted of medical doctors and only very few representatives of other health professions, such as biologists, physiotherapists or psychologists. Similarly, the vast majority of enrolled students were medical students, with very few exceptions such as medical informatics students. Following the directives of the local Data Protection Committee, we were not able to ask for specific sub-professions in the questionnaire to protect the identity of the underrepresented professions and studies. To address this issue, we concretely asked for opinions of medical doctors and medical students in the invitation letter for study participation.
Only German-speaking, highly educated people affiliated with the Medical University Vienna were eligible to participate in this study. This limits the generalizability of the study results to other sections of academic and especially non-academic populations. Nevertheless, this study aimed at assessing EBP practices in an academic German-speaking study population affiliated with the largest medical university in Austria. Given the mono-centric design of this study, existing sub-cultures and traditions may limit the direct implications for other universities and clinics. Future studies should assess contextual factors to explore the potential organizational differences for the teaching and use of EBP between different health professional groups, also testing for potential differences with respect to gender and diversity.
The study questionnaire assessed the self-reported capability beliefs of EBP using a validated scale, and a pre-test was also conducted [
15]. However, the qualitative context analysis of free text comments revealed potential sources of misunderstanding in the wording of the items, as expressed by quite a small number of study subjects. The reasons for this should be further evaluated by face-to-face interviews among employees and students to differentiate between an unfamiliarity of the terminology and the EBP process itself. Furthermore, to advance this field of research in a changing and demanding profession, our findings suggest elucidating whether a survey is the appropriate format to collect data on EBP capability belief and use, and whether the scale would be a valid and reliable measure despite good psychometric properties [
32]. Additionally, it was beyond the scope of this study to assess the impact of non-evidence-based practices and beliefs, such as alternative medicine in general or Traditional European Medicine specifically, as stated in one of the free text comments. Methods including Delphi surveys, mixed-method approaches, workshops, and longitudinal assessments might be useful to complement cross-sectional surveys in this context.