Next Article in Journal
Challenges Associated with the Implementation of an Exercise and Sport Intervention Program in a Greek Refugee Camp: A Report of Professional Practice
Next Article in Special Issue
Diagnosing Gaps in the Development of Palliative and End-of-Life Care: A Qualitative Exploratory Study
Previous Article in Journal
Spatial Variations of Trace Metals and Their Complexation Behavior with DOM in the Water of Dianchi Lake, China
Previous Article in Special Issue
Validation of the Hong Kong Chinese version of the Support Person’s Unmet Needs Survey—Short Form
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Student’s Inventory of Professionalism (SIP): A Tool to Assess Attitudes towards Professional Development Based on Palliative Care Undergraduate Education

1
Symptom Control and Palliative Medicine Department, Clínica Universidad de Navarra, 31008 Pamplona (Navarra), Spain
2
ATLANTES Research Programme, Institute for Culture and Society, University of Navarra, 31008 Pamplona (Navarra), Spain
3
Instituto de investigación sanitaria de Navarra (IdiSNA), 31009 Pamplona (Navarra), Spain
4
Epidemiology Department, Faculty of Medicine, University of Navarra, 31008 Pamplona (Navarra), Spain
5
Radiation Oncology Department, Clínica Universidad de Navarra, 31008 Pamplona (Navarra), Spain
6
Medical Education Unit. Faculty of Medicine, University of Navarra, 31008 Pamplona (Navarra), Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(24), 4925; https://doi.org/10.3390/ijerph16244925
Submission received: 30 September 2019 / Revised: 29 November 2019 / Accepted: 30 November 2019 / Published: 5 December 2019
(This article belongs to the Special Issue Palliative and End-of-Life Care)

Abstract

:
Introduction: Quality medical education, centered on a patient’s needs, is crucial to develop the health professionals that our society requires. Research suggests a strong contribution of palliative care education to professionalism. The aim of this study was to design and validate a self-report inventory to measure student’s professional development. Method: Sequential exploratory strategy mixed method. The inventory is built based on the themes that emerged from the analysis of four qualitative studies about nursing and medical students’ perceptions related to palliative care teaching interventions (see Ballesteros et al. 2014, Centeno et al. 2014 and 2017, Rojí et al. 2017). The structure and psychometrics of the inventory obtained is tested in two different surveys with two different groups of medical students. Inventory reliability and construct validity are tested in the first survey group. To verify the inventory structure, a confirmatory factor analysis is performed in a second survey group. Results: The inventory has 33 items and seven dimensions: a holistic approach, caring for and understanding the patient, personal growth, teamwork, decision-making, patient evaluation, and being a health care professional. Cronbach’s-alpha was 0.73–0.84 in all seven domains, ICC: 0.95. The confirmatory factor analysis comparative fit index (CFI) was 1 with a standardized root mean square Index 0.088 (SRMR) and obtained a 0.99 goodness-of-fit R-square coefficient. Conclusions: this new inventory is grounded on student’s palliative care teaching experiences and seems to be valid to assess student’s professional development.

1. Introduction

Health faculties should provide future professionals with the necessary competencies that society, patients, and the very profession acknowledge as their professional role. Medical education is moving again towards patient-centered models of care that assess the holistic experience of patient’s illness [1]. This way of practicing medicine shows, not only patients’ satisfaction, but also the positive impact on patient’s health treatment adherence and optimization of health care costs [2,3,4,5]. Bombeke et al. [6] found that students, despite expressing positive attitudes toward patient-centeredness teaching models, feel that they do not receive sufficient training during their medical studies to attain the level of competent behavior needed in today’s challenging hospital environment. When it comes to dealing with time pressure, tiredness, and non-patient-centered role models, they lose focus. Finally, they concluded that a supportive student–doctor relationship and student-centered education and guidance that addresses the needs of the doctor-as-person are central to the development of patient-centeredness.
Education experts state that palliative care education (PCE) enables undergraduate students to act professionally, helping them to acquire skills that are crucial for their professional development [7,8]. Challenges to student professionalism may arise from emotionally charged situations, such as handling patients and families during death and dying experiences. Appropriate behavior mastered in these circumstances may likewise be applied to other emotionally challenging situations [9]. When the students reflect about palliative care practice, they do not only learn about symptom control and end-of-life care, but they interact with interdisciplinary teams, where they are able to find role models of how to deal with complex psychological, social, ethical, cultural, and religious situations [10,11,12,13,14,15,16,17].
Our team has achieved a deep understanding about how PCE could be a good patient-centered teaching model and we have published four qualitative studies that focus on students’ experiences related to palliative care (PC) teaching interventions. The first one was a qualitative exploratory study on narrative reflections of nurse students after a PC optional course; most of the students concluded that the course was an essential component in their training, which contributed to a personal and professional development [18]. The second was done following the same methodology, but the narratives about the PC course were done by medical students, and they expressed an overall improvement of their vision of medicine [19]. The third study analyzed the narratives of medical students, but this time about a bedside PC clinical experience, this experience promoted a deep reflection, that provided for most of the students a deeper understanding of core values of medical practice, and some of them even described this bedside experience as life-changing [20]. Finally, we published the analysis of a reflective exercise of a PC end-of-life decision-making course for medical students, performed at a modern art museum, the results of which showed that PCE helps medical students address several competencies related to being patient-centered and empathic [21]. The thematic analysis of these previously published studies done by our group shows a wider range of aspects than those measured in the actual questionnaires that assess PCE, focused on measuring fears and attitudes towards end-of-life patients care, or symptom control knowledge [22,23,24,25,26]. On the basis of the overall thematic analysis of these studies, we realized that it was possible to obtain an inventory that covers the five assessment areas defined by Wilkinson as a blueprint for assessing professionalism [27]. This researcher provided, after carrying out a systematic review on this topic, a clustered definition of professionalism into the following five assessable components: adherence to ethical principles, effective interactions with patients and people who are important to those patients, effective interactions with other agents working in the system, reliability and commitment to self-maintenance, and gaining of competences. We also explored the existence of a published questionnaire that had already assessed the professionalism cluster defined by Wilkinson. However, the ones we found, when compared with Wilkinson´s framework, only addressed partial areas, were too general, or lacked well-explained validation processes [28,29,30].
To meet the need of a questionnaire that allows undergraduate students to self-report their ability to perform patient-centeredness medicine, and to assess the improvement of their attitudes towards end-of-life teaching interventions, we developed an original inventory based on nurse and medical students’ reflections after PCE interventions. The aim of this study is to design and validate a student’s self-report professionalism inventory based on PCE.

2. Methods

The design and validation process of the inventory followed a mixed method with sequential exploratory strategy. This strategy is useful when developing and testing a new instrument [31]. The Research Ethics Committee at the University of Navarre approved this study (reference: P125/2016). Participants signed informed consent forms. Data were collected and managed anonymously.

2.1. Design of the Inventory

The inventory was built on the 150 themes obtained in the thematic analysis of four qualitative studies [23,24,25,26] on undergraduate palliative care education interventions carried out and published by our group. With those 150 themes we wrote 150 possible items for the inventory. Three researchers (AN, CC, MA) analyzed each item through constant comparison: duplications were eliminated, and items with similar statements were gathered, obtaining the basis for the first version of a 55-items inventory with 0–10 scales to evaluate agreement or disagreement with the item statement.

2.2. Population

Almost three hundred medical students from the University of Navarra participated in the two validation studies. In the first survey, 4th year students completed the survey concerning two diverse educational activities (66 before the thirty days educational activity on compassion and 62 before receive usual one day lectures on clinical topics; and 34 and 30 respectively, after the activities); median age 21, 65% female; 30% were from Navarra and 70% from other regions of the country or foreigners (4 were international students from Spanish-speaking countries).
In the second survey, 6th year students filled in the inventory at the beginning of their last year of medical education, and when they finished their palliative care curriculum (median age 23, 63% female and from all over Spain), 197 students of 206 implemented the inventory at the beginning of the academic course.

2.3. First Survey with 128 Medical Students

In a first survey, as we mentioned, the questionnaire was applied to a sample of 128 medical students in the 4th academical year: half participated in an educational intervention on professionalism and half before they received usual one day lectures on clinical topics.
The teaching intervention on professionalism started with a 4 h compassion workshop and was follow by a clerkship and a clinical case on compassion observed. In the first half of the workshop there was a brainstorming on the concept followed by the discussion of two clinical scenes from the mainstream film “Whit”. In the second half, lived experiences of a professional, a patient, and a relative were presented followed by free questions from the students. This workshop was just a few days before the first clinical clerkship at the hospital and is part of the curriculum of the University of Navarra within a program to enhance professional identity. After the 4 weeks clerkship, students present an evaluation of a written clinical case on compassion. In this way, the teaching intervention pretended to start and induce the 1 month reflection on this concrete professional value.
With the response of the students, psychometric properties of the inventory were studied as follows:
(1) Reliability: internal consistency with Cronbach’s alpha, t-test stability with intraclass correlation coefficient in a 24 h interval
(2) Construct validity: hypothesis testing with the two different educational interventions (Mann–Whitney U test). As no similar questionnaire could be found to compare changes after the intervention, a hypothesis was applied, whereby an increased score on the inventory was to be expected after a teaching activity, being both higher and statistically significant to the change observed after a day of usual clinical lectures [32].
(3) Responsiveness to the professionalism teaching intervention was tested with the Wilcoxon test.
(4) Structure: (a) An item selection was done through the initial factor analysis performed with Varimax rotation; (b) exploratory factor analysis (EFA) using Promax power rotation was used to identify sub-scales, and the Kaiser–Meyer–Olkin test (KMO) was done to assure that the inventory was suitable for EFA.

2.4. Second Survey with 164 Medical Students

In a second survey, the 33-items questionnaire was applied to a sample of 164 students in their 6th year at the beginning of the academic course. Structural validity (the confirmatory factor analysis structural equations model and goodness of fit statistics, expecting a comparative fit index (CFI) between 0.8–1, and a standardized root mean square index (SRMR) close to 0.08) [33], and internal consistence (Cronbach´s α coefficient) of the 33-item inventory, was performed with the response of the students. The feasibility of the inventory was also tested in this group measuring the time for completion and the response ratio.
The final inventory structure was qualitatively compared by two researchers (AN, MA) with the Wilkinson assessment areas framework for professionalism [27]. Wilkinson proposal consisted in five themes: (1) Adherence to ethical practice principles, (2) effective interactions with patients and with people who are important to those patients, (3) effective interaction with other people working within the health system, (4) reliability, and (5) commitment to autonomous maintenance and continuous improvement of competence.

3. Results

The inventory is a list of 33 items presented in only one sheet (Table 1 shows an English version of the SIP to facilitate understanding, as translated by an English native speaker with the review of the authors. The original and validated version is offered in (Table S1) in Spanish). That list of items represents the end point of a process of synthesis on more than 600 students’ reflections about the impact that palliative care medical teaching has had on their professionalism. The inventory was tested for psychometric properties with two different samples of 128 and 164 medical students in the two successive versions of 55 and 33 items, respectively. Each item is presented written as a statement in first person to be read, followed by a scale 0–10 expressing the auto-evaluation of the respondent on a level of agreement with the statement (0 = no agreement at all, 10 = total agreement). The items are grouped into seven sub-scales following the results of the factorial analysis: holistic approach (11 items), caring for and understanding the patient (6 items), personal growth (4 items), teamwork (3 items), decision-making (6 items), patient assessment (6 items), and being a health care professional (1 item). We call the new assessment tool “Student’s Inventory on Professionalism” to indicate with the name the construct explored and that it is grounded in students’ perceptions. Its acronym “SIP” suggests how fast and easy it can be completed.
Table 2 shows an overview of all the psychometric characteristics of the inventory. Construct validity was confirmed with the hypothesis test. The difference in average scores in the group, which took part in the compassion teaching activity, was 17 points ±22, compared to the difference of 5 points ±13, given the values, which appear in the group that attended usual clinical lectures (test re-test Mann–Whitney, p < 0.02). Intra-observer stability showed a good intraclass correlation with all the values over 0,4. The inventory also showed responsiveness to the professionalism teaching activity. Out of a total of 320 points, the average points total went from 238 ± 31 to 255 ± 30 after the teaching activity, with a significant increase of 17 points (Wilcoxon test, p < 0.001). After the intervention, an increase in the score was found in 28 of the 33 questions, a statistically significant increase and at least one whole point increase out of ten was found in 9 of the 33 questions. The inventory was easy to complete for all the students without comprehension difficulties and in less than fifteen minutes.
In the design process and with the aim to reduce the length of the tool, an initial factorial analysis was carried out with the 4th year student’s response to the 55-item proposal showing 14 factors. The method used was principal-components analysis with orthogonal varimax rotation. Factor 1 explained 70% of the whole variability of the inventory, with a saturation load above 0.35 for all the scales. This means that the inventory succeeded in measuring a common conception. After the factor analysis of the 55-item proposal, it was not possible to group questions following proper categories because we got 14 factors and all of them with valid eigenvalues over 1. Then, a careful analysis allowed us to discard four items due to saturation below 0.4 for Factor 1. Qualitative semantic analysis of the 51 remaining items, pairing those with similar wording and/or meaning, accomplished by three researchers, allowed to reduce the entire set to 32 statements. As an item asked two concepts at the same time, if the student was able to seek for “help” and “advice”, we decided to unfold this item in two questions. Minor changes were introduced in some of the items for better comprehension and, finally, we got the 33-item inventory.
SIP categories were obtained with an exploratory factor analysis of the final 33-item inventory version (ProMax power rotation) showing nine factors that were grouped on seven categories, each category expressing a construct with a name (three factors were joined in one subscale because of content similarities) (KMO = 0.81). All the items had a reasonable inter-item reliability; six factors obtained a Cronbach’s alpha between 0.64 and 0.88. As a factor is only one item, it is not applicable for Cronbach’s alpha analysis. The confirmatory factor analysis comparative fit index (CFI) of the seven latent constructs using a structural equation model was 1 with a Standardized Root Mean Square index 0.088 (SRMR), all the items explained between 0.45 to 0.89 of the value of the construct where it is located, and the equation goodness of fit statistics showed a 0.99 overall R-square coefficient for the inventory with appropriate coefficients for each item (Table 3). The correlation between different constructs of the inventory showed how the final seven inventory dimensions are related and at the same time different enough to measure the cited variables (Table 4). The final seven inventory dimensions presented a good reliability, final Cronbach’s alpha values showed a good internal consistency, even the values of the constructs obtained with the 6th year students of the second sample (response variation 0.73 to 0.84) were better than the ones obtained with the seven dimensions analyzed with the first sample response.
All components of professionalism described by Wilkinson et al. are covered in the inventory (Table 5). SIP addresses, with several items, the component of adherence to ethical principles and the effective interaction of the professional with the patient and colleagues. The exploration of the commitment to improvement is also ensured as well as the reliability. The only elements that the students left out in their reflections and are related to professionalism are those that correspond to practical or very specific aspects of professional behavior, such as to how to assume responsibility, stay within professional limits, exercise leadership, or exercise in the audit.

4. Discussion

The result of this study was the design and validation of the first version of an original inventory for students´ self-report of professionalism. It has been designed following health students´ learning experiences on patient-centeredness, end-of-life, and palliative care education interventions [18,19,20,21] and tested on a professionalism education intervention focused on medical compassion.
Content validity emerges with the process of developing the inventory. Data qualitative selection followed by data quantitative selection resulted in the actual SIP version. The studies on which this inventory is based, and other similar works [34,35,36], provided students with a self-perception of professionalism learning. Thereby, they create nothing more than hypotheses, which cannot be presented as tested or generalizable. After the solid process of creating the inventory presented in this study, these hypotheses are ready to be subject to empirical tests.
Professionalism is a wide concept, with contextual and cultural differences. Except Penn State College of Medicine Professionalism Questionnaire (PSCOM) [28], no other tool assesses all the areas that this concept covers [28,29,30,37]. Furthermore, the items contained in the SIP consider aspects such as caring and compassion, sensitivity, tolerance, openness, communication, respect for patient dignity and autonomy, respect for other health care professionals and staff including teamwork, relationship building, motivation, insight, commitment, excellence and scholarship, and so forth, that cover the five areas described by Wilkinson et al. as a blueprint to assess professionalism [27]. Therefore, the SIP would provide a valid method for evaluating whether medical education interventions centered in the student as a person contribute to the development of professional identities among future health professionals. The SIP also could test the indirect impact on the students of non-specific professionalism teaching interventions.
The SIP, as a self-administered scale, assesses attitudes and can aid reflection, but cannot assess what a student actually does. When compared with other self-administered scales, the SIP has a more patient-centered approach than the PSCOM, which focuses more on organizational areas [28]. To assess what students actually do, it is better to use tools applicable during clinical encounters, such as the mini clinical evaluation exercise (mini-CEX) [38], or the ones that ask for the patient’s opinion [39], but, in the end, all of them are limited to what happens during the clinical encounter and cannot evaluate professionalism areas related to commitment to improvement.
In the psychometric analysis carried out, the SIP was a valid tool shown to be reliable and sensitive for measuring the efficacy of professionalism in educational activities. The SIP structure’s preliminary data provides a preliminary support to the inventory and factorial analysis with a confirmatory factor analysis on a new sample contributed to reinforcing it. As the 33 items are clustered into seven sub-scales conformed by different conceptual areas, in the future, it will be possible to test whether those areas behave like genuine sub-scales, maintaining internal consistency and providing partial scores which make it possible to compare different professionalism training activities and different lecturers or universities. As a limitation of the statistical analysis of the structure of the inventory, we have to admit that the sample of the first survey was only 128 inventories, not sufficient to obtain a reliable and accurate result for an exploratory factor analysis, that was the main reason why we tested the inventory again on a second sample of 164 inventories, although the first survey obtained a KMO of 0.81.
To analyze SIP construct validity, we employed the hypothesis test, assuming that an educational intervention on compassion would increase the score on the scale. We have found that the initial average of all questions was high (nearly all the scores were above six). The behavior of the inventory could be biased by the vocational component among medical students at the end of the compassion teaching intervention, but it is also possible that the high scores prior to the intervention were due to a complacency bias or ceiling effect. It is also difficult to interpret properly the inventory responsiveness, because there was not an initially established value to indicate what would be considered as a significant increase in the attitudes explored. Moreover, the inventory was first tested on a single university, with a strong teaching in humanities; this also could contribute to the initial responses´ high average. Those effects could be reduced in future interventions, if the SIP is employed at the end of the teaching session, asking to score each item on self-perception, before and after the intervention.
The SIP responsiveness was as expected. The scores obtained after 24 h with the re-test were totally stable. In addition, the results, after the professionalism teaching intervention, were uniformly positive. Furthermore, the internal consistency obtained by the SIP confirms this reliability, this consistence was improved through the psychometric and semantic data selection. The factorial analysis applied, ensures, at the same time, that different items contribute with unique, identifiable information.
The results of the validation strategy used, including a teaching experience, allow us to assert that the SIP promises to be a sensitive tool for detecting the effects of teaching activities in professionalism. If the inventory detected statistically significant changes in one out of every three items, with a very small sample and after a very short five-hour intervention, it would be expected that this same behavior would be maintained with more consistent interventions for more numerous groups where the statistical power is not as compromised. As another limitation, the research team cannot deny that the use of the first version of this inventory would lead to modifications to complete its capability as an on-going process of continuous validation [40].

5. Conclusions

The SIP is a new and promising inventory, with a reasonable internal consistency and reliability, and sensitive to assess the effectiveness of global educational interventions in professionalism. These properties lead us to think that it is a suitable inventory for future prospective studies related to palliative care and professionalism education interventions. These studies also would help with the necessary further validation of the inventory.
The SIP will allow to test if the initial student’s reaction of enthusiasm and surprise with their PCE is constant over time, after going through years of medical practice. It would also help to perform comparative analyses on the performance of educational activities in different professions and between different universities. Including sociodemographic variables in future studies would allow us to study which other personal and cultural factors influence professionalism learning.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/16/24/4925/s1. Table S1. Annex. INVENTARIO SIP.

Author Contributions

All authors meet criteria for authorship as stated in the Uniform Requirements for Manuscripts Submitted to Biomedical Journals. A.N.: study design, data collection, statistical and qualitative analysis, and manuscript writer. M.A.: study design, data collection, qualitative analysis, and manuscript revision. J.L.-F.: study design, statistical analysis, and manuscript revision. A.G.: study design, statistical analysis, and manuscript revision. A.A.: study design, data collection, statistical analysis, and manuscript revision. L.A.: study design, statistical analysis, and manuscript revision. C.C.: study design, data collection, statistical and qualitative analysis, and manuscript revision.

Funding

This research received no external funding.

Acknowledgments

To Jose Pereira, Director of the College of Family Physicians of Canada (CFPC), and Carole Robinson, Associate Professor of the British Columbia University Nursing School for their valuable insights during this project.

Conflicts of Interest

The author declares that there are no conflicts of interests.

References

  1. Stewart, M.; Brown, J.B.; Weston, W.W.; McWhinney, I.R.; McWilliam, C.L.; Freeman, T.R. Patient-centered medicine. In Transforming the Clinical Method, 3rd ed.; Radcliffe Publishing Ltd.: Cornwall, UK, 2014. [Google Scholar]
  2. Epstein, R.M.; Franks, P.; Fiscella, K.; Shields, C.G.; Meldrum, S.C.; Kravitz, R.L.; Duberstein, P.R. Measuring patient-centred communication in patient-physician consultations: Theoretical and practical issues. Soc. Sci. Med. 2005, 61, 1516–1528. [Google Scholar] [CrossRef]
  3. Lewin, S.; Skea, Z.; Entwistle, V.A.; Zwarenstein, M.; Dick, J. Interventions for providers to promote a patient-centred approach in clinical consultations. Cochrane Database Syst. Rev. 2001, 4, CD003267. [Google Scholar]
  4. Mead, N.; Bower, P. Patient-centred consultations and outcomes in primary care: A review of the literature. Patient Educ. Couns. 2002, 48, 51–61. [Google Scholar] [CrossRef]
  5. Little, P.; Everitt, H.; Williamson, I.; Warner, G.; Moore, M.; Gould, C.; Ferrier, K.; Payne, S. Preferences of patients for a patient-centred approach to consultation in primary care: Observational study. BMJ 2001, 322, 468–472. [Google Scholar] [CrossRef] [Green Version]
  6. Bombeke, K.; Symons, L.; Debaene, L.; De Winter, B.; Schol, S.; Van Royen, P. Help, I’m losing patient-centredness! Experiences of medical students and their teachers. Med. Educ. 2010, 44, 662–673. [Google Scholar] [CrossRef]
  7. Barnard, D.; Quill, T.; Hafferty, F.W.; Arnold, R.; Plumb, J.; Bulger, R.; Field, M. Preparing the ground: Contributions of the preclinical years to medical education for care near the end of life. Acad. Med. 1999, 74, 499–505. [Google Scholar] [CrossRef]
  8. National Board of Medical Examiners. Embedding Professionalism in Medical Education: Assessment as a tool for Implementation; Report From an Invitational Conference Cosponsored by the Association of American Medical Colleges and the National Board of Medical Examiners; National Board of Medical Examiners: Washington, DC, USA, 2003. [Google Scholar]
  9. Borgstrom, E.; Cohn, S.; Barclay, S. Medical professionalism: Conflictin values for tomorrow’s doctors. J. Gen. Intern. Med. 2010, 25, 1330–1336. [Google Scholar] [CrossRef] [Green Version]
  10. Field, D. Special not different: General practitioners’ accounts of their care of dying people. Soc. Sci. Med. 1998, 46, 1111–1120. [Google Scholar] [CrossRef]
  11. Field, D.; Wee, B. Preparation for palliative care: Teaching about death, dying and bereavement in UK medical schools 2000–2001. Med. Educ. 2002, 36, 561–567. [Google Scholar] [CrossRef]
  12. Olthuis, G.; Dekkers, W. Medical education, palliative care and moral attitude: Some objectives and future perspectives. Med. Educ. 2003, 37, 928–933. [Google Scholar] [CrossRef]
  13. Schulz, C.; Moller, M.F.; Seidler, D.; Schnell, M.W. Evaluating an evidence-based curriculum in undergraduate palliative care education: Piloting a phase II exploratory trial for a complex intervention. BMC Med. Educ. 2013, 13, 1. [Google Scholar] [CrossRef] [Green Version]
  14. Braun, U.K.; Gill, A.C.; Teal, C.R.; Morrison, L.J. The utility of reflective writing after a palliative care experience: Can we assess medical student’s professionalism? J. Palliat. Med. 2013, 16, 1342–1349. [Google Scholar] [CrossRef] [Green Version]
  15. Tait, G.R.; Hodges, B.D. Residents learning from a narrative experience with dying patients: A qualitative study. Adv. Health Sci. Educ. Theory Pract. 2013, 18, 727–743. [Google Scholar] [CrossRef]
  16. Strano-Paul, L.; Lane, S.; Wei-Hsin, L.; Chandran, L. Impact of a home hospice visit program on third-year medical students. J. Palliat. Care 2015, 31, 5–12. [Google Scholar] [CrossRef]
  17. Centeno, C.; Rodríguez-Núñez, A. The contribution of undergraduate palliative care education: Does it influence the clinical patient’s care? Curr. Opin. Support. Palliat. Care 2015, 9, 375–391. [Google Scholar] [CrossRef]
  18. Ballesteros, M.; Centeno, C.; Arantzamendi, M. A qualitative exploratory study of nursing students‘ assessment of the contribution of palliative care learning. Nurse Educ. Today 2014, 34, e1–e6. [Google Scholar] [CrossRef]
  19. Centeno, C.; Ballesteros, M.; Carrasco, J.M.; Arntzamendi, M. Does Palliative Care education matter to medical students? The experience of attending an undergraduate course in palliative care. BMJ Support Palliat. Care 2014, 6, 128–134. [Google Scholar] [CrossRef]
  20. Rojí, R.; Noguera-Tejedor, A.; Pikabea-Díaz, F.; Carrasco, J.M.; Centeno, C. Palliative care bedside teaching: A qualitative analysis of medical students’ reflective writings after clinical practices. J. Palliat. Med. 2017, 20, 147–154. [Google Scholar] [CrossRef]
  21. Centeno, C.; Robinson, C.; Noguera-Tejedor, A.; Arantzamendi, M.; Echarri, F.; Pereira, J. Palliative care and the arts: Vehicles to introduce medical students to patient-centred decision-making and the art of caring. BMC Med Educ. 2017, 17, 257. [Google Scholar] [CrossRef] [Green Version]
  22. Frey, R.A.; Gott, M.; Neil, H. Education Instruments used to measure the effectiveness of palliative care education initiatives at the undergraduate level: A critical literature review. BMJ Support Palliat. Care 2013, 3, 114–119. [Google Scholar] [CrossRef] [Green Version]
  23. Hammel, J.; Sullivan, A.; Block, S.; Twycross, D. End-of-Life palliative care education for final-year medical students: A comparison of Britain and the United States. J Palliat. Med. 2007, 10, 1356–1366. [Google Scholar] [CrossRef] [PubMed]
  24. Ostgathe, C.; Voltz, R.; Nauck, F.; Klaschik, E. Undergraduate training in palliative medicine in Germany: What effect does a curriculum without compulsory palliative care have on medical students knowledge, skills, and attitudes? Palliat. Med. 2007, 21, 155–156. [Google Scholar] [CrossRef] [PubMed]
  25. Hegedus, K.; Zana, A.; Szabó, G. Effect of end of life education on the attitudes towards death of medical students and health care workers. Palliat. Med. 2008, 22, 264–269. [Google Scholar] [CrossRef] [PubMed]
  26. Mason, S.R.; Ellershaw, J.E. Preparing for palliative medicine; evaluation of an education programme for fourth year medical undergraduates. Pall. Med. 2008, 22, 687–692. [Google Scholar] [CrossRef]
  27. Wilkinson, T.J.; Wade, W.; Knock, L.D. A blueprint to assess professionalism: Results of a systematic review. Acad. Med. 2009, 84, 551–558. [Google Scholar] [CrossRef]
  28. Blackall, G.F.; Melnick, S.A.; Shoop, G.H.; George, J.; Lerner, S.M.; Wilson, P.K.; Kreher, M. Professionalism in medical education: The development and validation of a survey instrument to assess attitudes toward professionalism. Med. Teach. 2007, 29, e58–e62. [Google Scholar] [CrossRef]
  29. Goldie, J. Assessment of professionalism: A consolidation of current thinking. Med. Teach. 2013, 35, e952–e956. [Google Scholar] [CrossRef]
  30. Nittur, N.; Kibble, J. Current Practices in Assessing Professionalismin United States and Canadian Allopathic Medical Students and Residents. Cureus 2017, 9, e1267. [Google Scholar] [CrossRef] [Green Version]
  31. Onwuegbuzie, A.J.; Bustamante, R.M.; Nelson, J.A. Mixed Research as a Tool for Developing Quantitative Instruments. J. Mix. Methods Res. 2010, 4, 56–78. [Google Scholar] [CrossRef]
  32. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; De Vet, H.C. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international delphi study. Qual. Life Res. 2010, 19, 539–549. [Google Scholar] [CrossRef] [Green Version]
  33. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  34. Brand, A.H.; Harrison, A.; Kumar, K. “It Was Definitely Very Different”: An evaluation of palliative care teaching to medical students using a mixed methods approach. J. Palliat. Care 2015, 31, 21–28. [Google Scholar] [CrossRef] [PubMed]
  35. Billings, M.E.; Engelberg, R.; Curtis, J.R.; Block, S.; Sullivan, A.M. Determinants of medical students’ perceived preparation to perform end-of-life care, quality of end-of-life care education, and attitudes toward end-of-life care. J. Palliat. Med. 2010, 13, 319–326. [Google Scholar] [CrossRef] [PubMed]
  36. Karger, A.; Scherg, A.; Schmitz, A.; Wenzel-Meyburg, U.; Raski, B.; Vogt, H.; Schulz, C. A pilot study on undergraduate palliative care education–A study on Changes in knowledge, attitudes and self-perception. J. Palliat. Care Med. 2015, 5, 236. [Google Scholar]
  37. Al-Eraky, M.M. Twelve Tips for teaching medical professionalism at all levels of medical education. Med. Teach. 2015, 37, 1018–1025. [Google Scholar] [CrossRef]
  38. Norcini, J.J.; Blank, L.L.; Duffy, F.D.; Fortna, G.S. The mini-CEX: A method for assessing clinical skills. Ann. Intern. Med. 2003, 138, 476–481. [Google Scholar] [CrossRef]
  39. Humphrey, H.J.; Smith, K.; Reddy, S.; Scott, D.; Madara, J.L.; Arora, V.M. Promoting an environment of professionalism: The University of Chicago “Roadmap.”. Acad. Med. 2007, 87, 1098–1107. [Google Scholar] [CrossRef]
  40. Dowing, S.M. Validity: On the meaningful interpretation of assessment data. Med Educ. 2003, 37, 830–837. [Google Scholar] [CrossRef]
Table 1. Items and subscales of the Students’ Inventory of Professionalism (SIP).
Table 1. Items and subscales of the Students’ Inventory of Professionalism (SIP).
Sub-Scale#Item
Holistic Care 1I have learned to listen to patients
2I have learned to show humanity to the patient
3I have learned to devote time to each patient´s needs
4I have learned to give emotional and spiritual support to my patients
5I feel capable of adapting to each patient
6I feel capable of giving hope to the patient, without creating false expectations, when discussing the progress of their illness
7I feel capable of helping the patient maintain their dignity despite their deteriorating condition
8I feel capable of helping my patients’ families and giving them support for their needs
9I have learned how to gain patients’ trust
10I have learned how to give bad news to patients in a caring manner
11I feel capable of managing my feelings appropriately when treating patients in complex situations
Care and understanding 12I have learned that caring is the essence of my profession
13I have learned how to be close to my patients
14I have learned that when a patient has a disease with a poor/incurable condition, still, it is always possible to do something
15I have learned to take into account the patient’s previous experiences in order to better understand him or her
16My clinical experience has helped me to understand how the patients adapt to their illness
17I feel capable of listening to others before making a difficult decision
Personal Growth18My clinical experience has helped me to grow as a person
19My clinical experience has helped me to better understand my professional colleagues
20My clinical experience has helped me to maintain (or recover) my initial commitments to developing as a healthcare professional
21I have learned to value the gratitude I receive from patients with an advanced disease
Teamwork22I feel capable of working in a team
23I have learned how to seek advice from colleagues when needed
24I have learned to seek help when I need it
Decision-making25I feel capable of involving the patient and their families in making decisions at the end of life
26I reassess my treatment plan when it causes suffering
27I have learned to keep an open-mind and not to judge the patient on first impressions
28I have learned to respect the patient’s wishes
29I have learned to individualize the decision-making process
30I have learned that each treatment must be personalized
Patient assessment31I feel capable of undertaking appropriate symptom evaluation
32I feel capable of performing a multidimensional, holistic assessment of patients
Being a professional33I have learned that my profession is science with compassion
Table 2. Psychometric properties of the Students’ Inventory of Professionalism (SIP).
Table 2. Psychometric properties of the Students’ Inventory of Professionalism (SIP).
PropertyAnalysisnSample Statistical TestResult
ReliabilityInitial Internal consistency (first sample)128First SurveyCronbach’s Alpha for factor 1 to 5
(Scale reliability coefficient for factor 6
Factor 7 only one scale)
Factor 1 = 0.88
Factor 2 = 0.83
Factor 3 = 0.76
Factor 4 = 0.64
Factor 5 = 0.65
Factor 6 = 0.33
Factor 7: Not applicable
Stability: Test-retest28First SurveyIntraclass coefficient of correlation (ICC)Global ICC r = 0.95; All Items ICC r > 0.4.
Final Internal consistency (second sample)164Second SurveyCronbach’s Alpha for construct 1 to 5
(Scale reliability coefficient for construct 6
Construct 7 only one scale)
Construct 1 = 0.84
Construct 2 = 0.78
Construct 3 = 0.73
Construct 4 = 0.83
Construct 5 = 0.81
Construct 6 = 0.84
Construct 7: Not applicable
Construct ValidityHypotheses-testing32 vs 28 (1)First Survey
Two subgroups: pre-post different educational activity
Mann-Whitney U, to test differences in mean valuesMean difference:
- Intervention group 17 ± 22
- Control group 5 ± 13, p < 0.002
ResponsivenessIntervention testing32 (1)First Survey: pre-post professionalism teaching intervention The Wilcoxon signed-rank test Mean difference = 17
238 ± 31 pre-intervention to 255 ± 30 post-intervention p < 0.001
StructureItems selection to reduce sample128First SurveyFactor Analysis with Varimax rotation14 factors. Factor 1 explains 70% of the whole variability with loads greater than 0.35 for each variable. Reduce 55 to 33 Items
Exploratory Factor Analysis to determinate sub-scales128First SurveyFactor Analysis with Promax power rotation Nine factors were chosen explaining 68% of the total variability of the 33 variables.
Kaiser-Meyer-Olkin (KMO) = 0.81 (adequate sample) and were resumed in seven dimensions
Confirmatory Factor Analysis164Second SurveyStructural Equation ModelEquation Goodness of Fit Statistics 0.99
(1) Only 28 pairs were valid for the inter-observer reliability analysis and 32 for the responsiveness analysis, due to difficulties in the pairs identification process.
Table 3. SIP confirmatory factor analysis of the seven latent constructs (n = 164, medical students, 6th year).
Table 3. SIP confirmatory factor analysis of the seven latent constructs (n = 164, medical students, 6th year).
SubscaleItemAverageSD SC (1)R-Squared (2)Inter-Item Reliability
Overall = 0.99If item is removedItem-rest correlationCronbach’s alpha
Holistic Care18.51.40.500.260.840.370.84
27.71.80.460.220.840.28
37.12.10.550.310.830.45
46.22.40.680.460.810.61
57.11.80.670.450.820.55
66.22.10.640.420.810.71
77.72.20.650.420.820.53
86.92.10.710.500.810.63
96.52.10.700.490.810.63
104.62.60.440.200.820.51
115.62.50.530.280.830.46
Care and understanding128.31.90.610.380.750.500.78
1381.70.700.490.740.56
147.72.10.560.310.750.51
157.41.70.670.450.730.61
166.72.10.700.500.750.50
178.41.60.580.340.750.50
Personal Growth188.61.40.750.580.670.540.73
197.91.70.720.530.640.58
208.22.10.670.460.670.54
217.72.20.590.360.700.50
Teamwork228.71.30.710.510.870.610.83
238.61.40.890.800.680.80
248.61.40.830.690.740.72
Decision-making2572.60.560.320.800.550.81
267.22.40.570.330.780.60
277.61.90.600.370.800.47
287.91.80.780.610.760.67
297.720.830.700.750.71
308.61.40.650.430.800.51
Patient assessment316.91.80.790.63Average interitem covariance 2.520.84
326.81.90.950.92
Being a healthcare professional338.41.60.890.81NA
(1) Confirmatory factor Load or Standardized Coefficients (SC) of the structural equations model: express to what extent each item explains the construct or subscale within which it is included. (2) Squared multiple correlation coefficients (R-squared): express goodness of fit statistics for non-recursive systems that involve endogenous variables with reciprocal causations.
Table 4. Correlation between constructs of the inventory.
Table 4. Correlation between constructs of the inventory.
Correlation between Sub-Scales (1)HCCUPGTWDMPA
Holistic Care (HC)-
Care and Understanding (CU)0.85-
Personal Growth (PG)0.580.76-
Team-work (TW)0.360.410.48-
Decision-making (DM)0.630.740.540.46-
Patient assessment (PA)0.470.480.530.280.57-
Being a healthcare professional (BHP)0.280.530.570.230.520.52
(1) The correlation was statistically significant (p < 0.001) among all the subscales using the Structural Equations Model.
Table 5. How elements of professionalism (Wilkinson et al., 2009) matched with items of the Student’s Inventory of Professionalism.
Table 5. How elements of professionalism (Wilkinson et al., 2009) matched with items of the Student’s Inventory of Professionalism.
Assessable Components of ProfessionalismElementsItem Related in SIP Inventory
Adherence to ethical principlesHonesty and integrity2, 12, 33
Confidentiality9
Moral reasoning7
Respect27, 28
Effective interaction with patientsRespect for diversity4, 15, 5
Politeness6
Empathy1, 10, 13
Manner31, 32
Include patient in decision making25, 8
Maintain professional boundaries-
Teamwork22
Effective interaction with coworkersBalance availability with oneself care23
Manner/demeanor24
Respect17
Politeness/patience-
Maintain professional boundaries-
ReliabilityOrganized2
Accountability 29, 30
Take responsibility-
Commitment to improvementPersonal awareness, reflectiveness11, 16
Lifelong learning18, 19, 21
Advance knowledge20
Deal with uncertainty14, 26
Provide feedback-
People management/Leadership-
Seek and respond to an audit-

Share and Cite

MDPI and ACS Style

Noguera, A.; Arantzamendi, M.; López-Fidalgo, J.; Gea, A.; Acitores, A.; Arbea, L.; Centeno, C. Student’s Inventory of Professionalism (SIP): A Tool to Assess Attitudes towards Professional Development Based on Palliative Care Undergraduate Education. Int. J. Environ. Res. Public Health 2019, 16, 4925. https://doi.org/10.3390/ijerph16244925

AMA Style

Noguera A, Arantzamendi M, López-Fidalgo J, Gea A, Acitores A, Arbea L, Centeno C. Student’s Inventory of Professionalism (SIP): A Tool to Assess Attitudes towards Professional Development Based on Palliative Care Undergraduate Education. International Journal of Environmental Research and Public Health. 2019; 16(24):4925. https://doi.org/10.3390/ijerph16244925

Chicago/Turabian Style

Noguera, Antonio, María Arantzamendi, Jesús López-Fidalgo, Alfredo Gea, Alberto Acitores, Leire Arbea, and Carlos Centeno. 2019. "Student’s Inventory of Professionalism (SIP): A Tool to Assess Attitudes towards Professional Development Based on Palliative Care Undergraduate Education" International Journal of Environmental Research and Public Health 16, no. 24: 4925. https://doi.org/10.3390/ijerph16244925

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop