Next Article in Journal
The Scarface Score: Deciphering Response to DNA Damage Agents in High-Grade Serous Ovarian Cancer—A GEICO Study
Previous Article in Journal
Evaluation of Staging Systems for Cancer of the Nasal Vestibule
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 15
Issue 11
10.3390/cancers15113029
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Electronic Patient-Reported Outcome Measures (ePROMs) Improve the Assessment of Underrated Physical and Psychological Symptom Burden among Oncological Inpatients

by
Eva Warnecke
1,
Maria Rosa Salvador Comino
1,
Dilara Kocol
2,
Bernadette Hosters
3,
Marcel Wiesweg
4,
Sebastian Bauer
4,
Anja Welt
4,
Anna Heinzelmann
1,
Sandy Müller
1,
Martin Schuler
4,
Martin Teufel
2 and
Mitra Tewes
1,*
1
Department of Palliative Medicine, West German Cancer Center, University Hospital Essen, University of Duisburg-Essen, 45122 Essen, Germany
2
Department of Psychosomatic Medicine and Psychotherapy, West German Cancer Center, LVR-Klinikum Essen, University of Duisburg-Essen, 45122 Essen, Germany
3
Directorate of Nursing, University Hospital Essen, 45122 Essen, Germany
4
Department of Medical Oncology, West German Cancer Center, University Hospital Essen, University of Duisburg-Essen, 45122 Essen, Germany
*
Author to whom correspondence should be addressed.
Cancers 2023, 15(11), 3029; https://doi.org/10.3390/cancers15113029
Submission received: 6 April 2023 / Revised: 19 May 2023 / Accepted: 29 May 2023 / Published: 1 June 2023
(This article belongs to the Section Cancer Survivorship and Quality of Life)
Review Reports Versions Notes

Abstract

:

Simple Summary

Professionals of the healthcare system face the challenge of providing suitable care delivery for inpatients with advanced cancer. External assessments, such as nurse-reported symptom burden, tend to underrate patients’ distress, as has already been shown in different studies. In contrast to that, patient-reported outcome measures (PROMs) have been shown to be effective as a systematic assessment; however, they are not yet implemented into daily routine. The aim of this retrospective study is to compare the information provided by PROMs and nurse-reported assessment to identify overlaps and differences in the current symptom burden. Therefore, collected data were analyzed from both PROMs and nurse-reported assessment from 230 inpatients of a major German Comprehensive Cancer Center. We discovered that some features of physical and psychological distress were underrated by nursing staff. Supplementing daily symptom assessment used by nursing staff with systematic ePROMs may improve the quality of supportive and palliative care of inpatients with advanced cancer.

Abstract

For advanced cancer inpatients, the established standard for gathering information about symptom burden involves a daily assessment by nursing staff using validated assessments. In contrast, a systematic assessment of patient-reported outcome measures (PROMs) is required, but it is not yet systematically implemented. We hypothesized that current practice results in underrating the severity of patients’ symptom burden. To explore this hypothesis, we have established systematic electronic PROMs (ePROMs) using validated instruments at a major German Comprehensive Cancer Center. In this retrospective, non-interventional study, lasting from September 2021 to February 2022, we analyzed collected data from 230 inpatients. Symptom burden obtained by nursing staff was compared to the data acquired by ePROMs. Differences were detected by performing descriptive analyses, Chi-Square tests, Fisher’s exact, Phi-correlation, Wilcoxon tests, and Cohen’s r. Our analyses pointed out that pain and anxiety especially were significantly underrated by nursing staff. Nursing staff ranked these symptoms as non-existent, whereas patients stated at least mild symptom burden (pain: meanNRS/epaAC = 0 (no); meanePROM = 1 (mild); p < 0.05; r = 0.46; anxiety: meanepaAC = 0 (no); meanePROM = 1 (mild); p < 0.05; r = 0.48). In conclusion, supplementing routine symptom assessment used daily by nursing staff with the systematic, e-health-enabled acquisition of PROMs may improve the quality of supportive and palliative care.

1. Introduction

As part of routine clinical practice in the inpatient setting with advanced cancer patients (ACPs), medical and nursing staff face the daily challenge of providing suitable care delivery [1]. Since ACPs are often confronted with physical and psychological symptoms, symptom management has gained increasing importance in providing individualized and high-quality patient-centered care [2]. Therefore, the expertise of medical and nursing staff in the inpatient and outpatient settings plays an important role. Additionally, the patient’s declaration of the severity of symptom burden influences the procedure of decision making. To prioritize patients’ symptom burden, one of the key questions is what bothers them the most. Hence, there is a growing interest in using validated assessments. In most inpatient settings, validated assessments are the standard sources of reporting symptoms. They are often and firstly used by nursing staff [3]. However, these assessments often are the only source of information on symptom burden, even though different studies have already shown that healthcare professionals have a tendency to underrate the severity of symptoms compared to the patients themselves and their relatives [4]. In addition, other studies have estimated that the severity of ACPs’ symptom burden often remains undetected and unaddressed [5]. Consequently, a considerable number of patients suffer from unaddressed extensive physical and psychological symptom burden [6].
To improve the circumstances of high and undetected symptom burden, in Germany, the German S3-guidelines on palliative care and the German network for quality development (DNQP), among others, recommend the incorporation of patient-reported outcome measures (PROMs) in clinical routine. PROMs “describe any report or measure of health reported by the patient, without external interpretation by a clinician or researcher” [7]. One of the overarching goals according to the German S3-guidelines is the “improvement of symptom control in palliative care for patients with incurable cancer and their families” [8]. The systematic use of PROMs could help us to achieve this target. Patients using PROMs declare inapparent symptoms and high symptom burden earlier [3]. Additionally, some versions of ePROMs have the feature of directly informing nursing staff about high symptom burden. As a result, nursing staff can take a direct response and initiate adequate symptom management immediately [9]. Since the use of PROMs facilitates the earlier detection of symptoms and needs, it may lead to the earlier integration of palliative care than before.
Studies have shown that integrating palliative care at an early stage of cancer’s disease leads to significant improvements in quality of life and mood. Comparing ACPs receiving standard care with those who are receiving early palliative care, it becomes evident that they had less aggressive care at the end of life [10,11]. Moreover, the systematic use of PROMs leads to an improvement in communication between patients and healthcare providers [12,13], increased survival rates [14,15,16], and less visits to the emergency room [9].
To our knowledge, there are studies that have dealt with PROMs to identify patients with unmet palliative care needs [17], its integration in clinical settings [18,19], the effects of the early integration of palliative care [11], or symptom burden [20,21]. Moreover, a few studies have compared PROMs and clinician-reported symptom burden [22].
However, our study is the first to directly compare the effects of and differences in using different tools (self-reported and nurse-reported) simultaneously to gather information about the severity of symptom burden.
On the one hand, we are accustomed to the information provided by the established assessments used by nursing staff. On the other hand, the incorporation of PROMs is required to be part of the daily routine, but it is still not properly integrated into German hospitals.
The purpose of this study is to compare the information provided by ePROMs with nurse-reported symptom burden. We aim to identify overlaps and differences in current symptom burden. Our objective is to determine whether symptom burden reported solely by nurses, as established in daily routine, reflects the patient’s perspective and their subjective severity of symptoms. Furthermore, we wish to decipher a better understanding of the value of information provided by PROMs. Additionally, based on our findings, we will derive advantages and disadvantages that may influence our attitude towards the ideal use of self- and nurse-reported tools.

2. Materials and Methods

We designed a retrospective, non-interventional, monocentric study, developed among the inpatients of a major German Comprehensive Cancer Center. A total of 230 inpatients with a histologically confirmed tumor disease were recruited between September 2021 and February 2022.

2.1. Study Protocol, Patient Recruitment

Patients who met the eligibility criteria, defined as above 18 years of age, undergoing inpatient treatment, and having a histologically confirmed tumor disease were asked to report their symptom burden once during their inpatient treatment. They were requested to do so using our electronic version of PROMs (ePROMs) called ePOS, an abbreviation of electronic psycho-oncological and palliative screening. We considered any patient who received our version of PROMs on the day of the inpatient admission or within the first days of the inpatient stay as a participant in our study. The timing of recruitment depended on the patients’ general condition. Due to organizational constraints, such as a limited number of tablets available for each inpatient ward, patients were instructed to fill in PROMs immediately after receiving them. Reading the instructions and completing the information typically takes about 10 to 15 min. During patient recruitment, we also included patients with repeated inpatients stays.

2.2. Questionnaires

The nursing staff of the medical oncology wards at the observed University Hospital regularly assess the patients’ clinical condition using an established tool. Currently, they use an assessment called the outcome-oriented nursing assessment instrument AcuteCare (epaAC 2.1) [23], which consists of more than 60 validated items. Patient information is collected digitally, allowing real-time data usage. The information is available in the hospital’s computerized system within minutes, making it accessible to all clinicians involved in the patients’ care. The assessment focuses on identifying nursing-relevant risk factors and evaluating patients’ abilities in various categories such as activity, mobility, grooming, nutrition, elimination, cognition and consciousness, communication and interaction, sleep, breathing, pain, and wounds. In addition, other important aspects are documented, including pain, recorded with validated tools such as the numeric rating scale (NRS) [24] or the German version of pain assessment in advanced dementia (PAINAID), abbreviated as BESD [25]. Furthermore, the risk for developing pneumonia, current nutritional status, and mucositis is also documented. Nursing staff compile this information once per shift, deriving it from observing and assessing patients’ behavior, body language, and descriptions during their interactions and visits.
The ePROMs questionnaire used in our study, called ePOS (electronic psycho-oncological and palliative screening), consists of 51 items. It includes a total of four questionnaires and two questions regarding the patient’s subjective need for psychological or palliative care support. The first questionnaire included is the Patient Health Questionnaire 8 (PHQ-8), which contains eight questions. It has been “established as a valid diagnostic and severity measure for depressive disorders in large clinical studies” [26]. The second questionnaire integrated into our version of ePROMs is the Generalized Anxiety Disorder GAD-7. “Both the GAD-7 and its abbreviated two-item version (GAD-2) have good operating characteristics for detecting generalized anxiety, panic, social anxiety and post-traumatic stress disorder” [27]. In addition, ePOS includes the Hornheider Screening Instrument (HSI), which is used to identify patients with “psychosocial care needs” [28]. To collect information about symptom burden, ePOS utilizes the minimal documentation system MIDOS2, which is “a German version of the Edmonton Symptom Assessment Scale (ESAS)” [29]. It contains questions that gather information about the current state of various typical symptoms such as “nausea, dyspnoea [sic], constipation, weakness, tiredness, anxiety” [29]. Symptoms are ranked on a four-point Likert scale (0 = no symptoms, 1 = mild symptoms, 2 = moderate symptoms, 3 = severe symptoms) (Table 1).

2.3. Statistical Methods

The sample size calculation was conducted using G*Power version 3.1.9.6 [30]. We aimed to achieve a power of 95% and an α-error of 5% for our analyses by defining the appropriate test families.
Data management and analyses were performed using the Statistical Program for Social Sciences SPSS version 27.0 and 29.0.0.0 (IBM Corporation, Armonk, NY, USA). Descriptive data, including median, mean values, and z-standardization, were generated to provide an overview of the patients’ characteristics and to identify differences between ePROMs and nurse-reported symptom burden. As some items in ePROMs and nurse-reported symptom burden were ranked using different scale levels, we aimed to create comparability downscaling some scales, from a four-point Likert scale to a nominal type (yes/no). We acknowledge that the process of downscaling may result in a potential loss of information. The original four-point Likert scale allows responses to encompass finer distinctions and nuances. By converting it to a binary scale, the differentiation between different levels of symptom burden is eliminated [31].
We conducted a three-step approach to compare the severity of symptom burden reported using the aforementioned tools.
Due to the discrepancy that ePROMs information was collected only once while information in epaAC was obtained daily, we decided to analyze the data provided by epaAC from the same day and, if possible, from nearly the same time that ePROMs were filled in. This approach aimed to ensure a valid basis for further analyses. Additionally, we analyzed every PROM and its corresponding entry in epaAC, understanding that it might introduce bias. However, we proceeded in this manner to derive advantages and disadvantages from our results.
First, we focused on the results of the descriptive analysis, comparing median or mean values and z-standardization based on the type of scale level. Since collected data were not normally distributed, non-parametric tests were used for further analyses. Different tests were performed to assess significant differences in symptom burden, considering the variety of scale levels. For scales rated as nominal, the Chi-squared test (X2) was performed. The null hypothesis was defined as no differences between ePROMs and nurse-reported symptom burden. For items with expected cell frequencies less than five, such as nausea, dyspnea, depressiveness, and concentration, Fisher’s exact (p) was conducted [32].
The Phi-coefficient (φ) was also calculated for items with a rejected null hypothesis as a measure of association with effect sizes ranging from 0.1 to 0.3 (small), 0.3 to 0.5 (medium), and greater than 0.5 (large) [33].
In addition, we performed the Wilcoxon test with a defined significance level of p < 0.05 for the symptom burden of pain and anxiety, which were rated on a four-point Likert scale. As our sample size consisted of more than 25 participants, we focused on the asymptotic significance of the Wilcoxon test as an indicator of significant difference, following the work of Harris and Hardin [34].
To measure the strength of the relationship between two symptoms analyzed with the Wilcoxon test, we conducted Cohen’s r as the effect size. The effect sizes of Cohen’s r are the same as those for the Phi-coefficient (φ): 0.1–0.3 (small), 0.3–0.5 (medium), and greater than 0.5 (large) [35].

3. Results

The sample size calculation recommended recruiting the highest number of participants for the X2 test family. Based on this recommendation, a total of 230 participants were recruited for the study. Data collection took place between September 2021 and February 2022. Eligible patients received our digital version of PROMs called ePOS once during their inpatient treatment. Some patients with repeated inpatient stays were asked to fill in PROMs more than once.
Out of the total collective of participants, 110 (47.8%) patients completed the tablet-based questionnaire in its entirety. Additionally, 189 (82.2%) patients started filling in their information at least once. Among them, 34 (14.8%) patients filled in the information twice, while 7 (3.0%) patients self-reported their symptoms three times. Unfortunately, during the study period, 13 (5.7%) patients, who reported their symptom burden at least once using our version of ePROMs, passed away.

3.1. Patient Characteristics

The main characteristics of the inpatients who received ePROMs are as follows (Table 2):
The analyses of sociodemographic features revealed that the majority of participants were female (n = 127; 55.2%). The mean age was 56 years (SD ± 15.07), ranged from 18 to 86 years. Out of the total participants, 111 (48.3%) were married, and 119 (51.7%) had children. Although most patients suffered from an incurable disease (UICC IV) (n = 123; 53.5%), 72 (31.3%) patients were still employed.
The analyses of medical features delivered the following results. The leading tumor diagnosis was soft-tissue sarcoma (n = 75; 39.1%), followed by lung cancer (n = 38; 20.1%). As already mentioned, some participants received ePROMs more than once because of repeated inpatient treatment. Note that the number of tumor diagnoses differs from the total sample size of 230. It was counted only once to avoid confounding due to the fact of it being an unchangeable feature.
At the time of presentation, 175 (76.1%) were diagnosed with metastatic disease. Among the participants with an advanced tumor disease at stage III and IV UICC (initial), the majority (n = 178; 77.4%) had a good ECOG performance status (ECOG 0–2; n = 150; 65.2%). Additionally, by the time of screening, most of the participants had received first-line therapy (n = 146; 63.5%), including chemotherapy, radiation, and/or immune/targeted therapies.

3.2. Differences in Symptom Burden

The comparison of descriptive data, including median or mean values and z-standardization, highlights differences in symptom burden between nurse-reported symptoms and ePROMs. The analyzed categories, such as nausea, dyspnea, difficulties with sleep, depressiveness/sadness, weakness/exhaustion, concentration/attention, and pain and anxiety, showed varying ratings between the two sources.
The analysis of the data indicates that symptoms, particularly those that may not be apparent at first sight and are associated with psychological distress, appear to be underrated by nursing staff. Patients using ePROMs reported feeling burdened by difficulties with sleep, depressiveness, weakness, and concentration, while nursing staff rated these features as non-existent (Table 3). Furthermore, the analysis of pain and anxiety also showed differences between ePROMs and nurse-reported symptom burden. Patients using ePROMs declared that they experience mild symptoms of pain and anxiety, whereas nurses tended to rate these symptoms as non-existent (Table 3).
However, it is worth noting that the symptoms of nausea and dyspnea/breathing were rated similarly by both ePROMs and nurse-reported assessment tools, with both sources indicating an inexistent burden (Table 3).
Statistical tests were conducted to further examine the differences in symptom burden. The Chi-squared (X2) and the Fisher’s exact (p) tests indicated that only difficulties with sleep showed a statistically significant difference (p < 0.00, Table 3) with a small negative measure of association (φ = −0.22).
Regarding pain and anxiety, the non-parametric Wilcoxon test showed a statistically significant difference (p < 0.05) between ePROMs and nurse-reported symptom burden.
The effect sizes, measured by Cohen’s r, indicated a medium effect size for pain (r = 0.46 and r = 0.46) and anxiety (r = 0.48).

4. Discussion

In this retrospective, non-interventional, monocentric study, we compared the severity of symptom burden reported by nursing staff, using established and validated assessments, to symptom burden reported by patients themselves using ePROMs. Our findings indicate that ePROMs provide a different perspective on symptom burden compared to nurse-reported symptoms, particularly in the areas of psychological distress. These results emphasize the importance of incorporating PROMs into our daily routine.
Our patient cohort suffered from relatively low symptom burden, which seemed to be independent of the method used for gathering information. Descriptive analyses have revealed that in most cases, symptoms were either non-existent or perceived as mild.
In contrast to epaAC, that focuses on identifying nursing-relevant risk factors and evaluating patients’ abilities, our ePROMs primarily address features of psychological health (Table 4).
Although the overall burden appeared low, there were differences in the information collected by nurses and ePROMs. Our data showed that specific symptoms remained undetected or underrated by nursing staff, which is consistent with previous studies [14,36]. Symptoms associated with psychological distress [36], such as difficulties with sleep, pain, and anxiety, were underrated in the nurse-reported method, highlighting the potential of self-reported instruments in identifying patients with unmet clinical needs. These findings may help to explain why other studies have found that patients using PROMs tend to report their symptoms earlier [3] than they are apparent to nursing staff. It could be assumed that patients may feel uncomfortable directly discussing their symptoms and needs. Further investigations are needed to explore patients’ motivation for reporting symptoms earlier when using PROMs.
Analyzing the data of every participant, regardless of whether ePROMs were entirely completed, we derived conclusions regarding the appropriateness of using ePROMs as a single source of information for every inpatient. The correct utilization of PROMs depends on various conditions, such as the patients’ current condition, disease progression, or cognitive function [37]. In our analysis, a high number of missing data indicated that many inpatients refused to complete ePROMs for various reasons, such as subjectively having no need for a screening, having already undergone screening, no change in symptom burden, or experiencing a reduced general condition. These results align with the findings from other studies, which identified that patients who feel too sick or do not feel inclined to complete PROMs tend to be non-compliant [3]. Furthermore, the inability of patients to use electronic devices can contribute to incomplete ePROMs [13]. Consequently, patients with a high symptom burden or those who are unfamiliar with electronic devices [38] may be underrepresented. Therefore, it is important to recognize that using PROMs as a single source of information may not be suitable for every subgroup as it can lead to a lack of proper clinical information.
Importantly, utilizing a digital version of PROMs offers clear advantages. Real-time feedback [39,40] is a crucial feature, allowing clinicians to monitor patients’ condition and promptly respond when symptom burden is high [9]. As already stated by Eid et al., this is one of “the ePROs merits in oncology clinical care, which is their ability to enable regular and real-time monitoring of patient symptoms and needs, therefore enhancing the efficiency of care” [13]. It enables timely interventions and contributes to reducing overall symptom burden and improving patients’ quality of life [10]. Furthermore, it can reduce the number of ER visits [9]. These findings highlight the urgency of systematically integrating PROMs into German hospitals.
Simultaneously using both assessments employed by nursing staff and ePROMs provides additional information regardless of the patients’ condition or compliance. The approach suggests that customized treatment for certain patients may only be ensured by using both tools complementarily at the same time. This finding underlines the work of Ahern et al. [40].

5. Limitations

This study has a number of limitations that should be acknowledged. First, it is a monocentric study. Additionally, it was conducted in a leading center for patients with soft-tissue sarcoma, leading to potential center bias. The choice of location and its feature as a center may limit the generalizability of the findings to other settings or patient populations.
Second, our data may not include patients with high symptom burden or those who are in a somnolent or comatose state, as our version of ePROMs may not be suitable for patients with a poor general condition. This could result in the exclusion of a specific subset of patients, limiting the overall representativeness of the study.
Third, as the study population had a relatively low symptom burden, the differences between nursing and ePROMs assessments may not be fully explored. Further research is needed to investigate the disparities between these assessments in inpatients with higher clinical burden.
Fourth, the availability of our version of ePROMs, only available in the German language, may exclude patients with foreign backgrounds who do not speak German. This could lead to the underrepresentation of foreign patients.
Additionally, the analysis of PROMs can be challenging due to missing data, which may introduce bias and limit the accuracy of the results. Efforts should be made to address missing data issues and consider appropriate methods for handling missing data in future studies.
Furthermore, a significant limitation in data analysis is that ePROMs and the assessments used by nursing staff did not employ the same questionnaires and scales. This lack of standardization makes it difficult to analyze and directly compare each item. It results in a potential loss of information. To improve comparability, some four-point Likert scales had to be downscaled to a nominal type, which may further limit the precision of the analysis.

6. Conclusions

Overall, our study revealed discrepancies between ePROMs and nurse-reported symptom burden, particularly in the assessment of symptoms dealing with psychological distress. Symptoms, such as anxiety and difficulties with sleep were rated milder by nursing staff compared to patients using ePROMs. A similar result was observed for pain.
Based on these findings, it is recommended to utilize both ePROMs and assessments conducted by nursing staff in conjunction with each other. This combined approach enables a more comprehensive and accurate evaluation of symptom burden. By supplementing daily symptom assessments used by nursing staff with systematic ePROMs, healthcare providers can gain a more holistic understanding of patients’ symptoms regardless of patients’ compliance. Consequently, the quality of supportive care for ACPs in the inpatient setting can be improved.
However, further research is needed to fully understand the benefits and limitations of incorporating ePROMs in routine clinical practice.

Author Contributions

Conceptualization, B.H., M.T. (Mitra Tewes) and E.W.; methodology, B.H. and M.T. (Mitra Tewes); validation, E.W., D.K., M.T. (Mitra Tewes) and M.R.S.C.; formal analysis, E.W. and D.K.; investigation, E.W.; resources, M.S., M.W., S.B., A.W., M.T. (Martin Teufel) and M.T. (Mitra Tewes); data curation, E.W. and D.K.; writing—original draft preparation, E.W.; writing—review and editing, E.W., D.K., B.H., M.R.S.C., A.H., S.M., M.W., M.S., S.B., A.W., M.T. (Martin Teufel) and M.T. (Mitra Tewes); visualization, E.W. and M.T. (Mitra Tewes); supervision, M.T. (Mitra Tewes) and M.R.S.C.; project administration, M.T. (Mitra Tewes); funding acquisition, M.S. and M.T. (Mitra Tewes). All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge support by the Open Access Publication Fund of the University of Duisburg-Essen.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of the University Hospital Essen (21-10201-BO; 28 September 2021).

Informed Consent Statement

Patient consent was waived due to analyzing retrospective data evaluated from existing medical records and routine clinical questionnaires.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy and ethical considerations.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hagan, T.L.; Xu, J.; Lopez, R.P.; Bressler, T. Nursing’s role in leading palliative care: A call to action. Nurse Educ. Today 2018, 61, 216–219. [Google Scholar] [CrossRef]
  2. Teunissen, S.C.; Wesker, W.; Kruitwagen, C.; de Haes, H.C.; Voest, E.E.; de Graeff, A. Symptom prevalence in patients with incurable cancer: A systematic review. J. Pain Symptom Manag. 2007, 34, 94–104. [Google Scholar] [CrossRef] [PubMed]
  3. Basch, E.; Jia, X.; Heller, G.; Barz, A.; Sit, L.; Fruscione, M.; Appawu, M.; Iasonos, A.; Atkinson, T.; Goldfarb, S.; et al. Adverse symptom event reporting by patients vs. clinicians: Relationships with clinical outcomes. J. Natl. Cancer Inst. 2009, 101, 1624–1632. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Chang, V.T.; Arnold, R.M.; Savarese, D. Approach to symptom assessment in palliative care. In UpToDate2020; Wolters Kluwer: Alphen aan den Rijn, The Netherlands, 2017. [Google Scholar]
  5. Basch, E.; Mody, G.N.; Dueck, A.C. Electronic Patient-Reported Outcomes as Digital Therapeutics to Improve Cancer Outcomes. JCO Oncol. Pract. 2020, 16, 541–542. [Google Scholar] [CrossRef] [PubMed]
  6. Newcomb, R.A.; Nipp, R.D.; Waldman, L.P.; Greer, J.A.; Lage, D.E.; Hochberg, E.P.; Jackson, V.A.; Fuh, C.X.; Ryan, D.P.; Temel, J.S.; et al. Symptom burden in patients with cancer who are experiencing unplanned hospitalization. Cancer 2020, 126, 2924–2933. [Google Scholar] [CrossRef] [PubMed]
  7. Denniston, A.K.; Kyte, D.; Calvert, M.; Burr, J.M. An introduction to patient-reported outcome measures in ophthalmic research. Eye 2014, 28, 637–645. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. German Guideline Program in Oncology (German Cancer Society, G.C.A., AWMF): Palliative Care for Patients with Incurable Cancer, Extended Version—Short Version 2.2, 2020 AWMF-Registration Number 128/001OL. Available online: https://leitlinienprogramm-onkologie.de/Leitlinien.7.0.html (accessed on 13 September 2022).
  9. Bigi, S.; Borelli, E.; Potenza, L.; Gilioli, F.; Artioli, F.; Porzio, G.; Luppi, M.; Bandieri, E. Early palliative care for solid and blood cancer patients and caregivers: Quantitative and qualitative results of a long-term experience as a case of value-based medicine. Front. Public Health 2023, 11, 1092145. [Google Scholar] [CrossRef]
  10. Basch, E.; Leahy, A.B.; Dueck, A.C. Benefits of Digital Symptom Monitoring With Patient-Reported Outcomes During Adjuvant Cancer Treatment. J. Clin. Oncol. 2021, 39, 701–703. [Google Scholar] [CrossRef]
  11. Temel, J.S.; Greer, J.A.; Muzikansky, A.; Gallagher, E.R.; Admane, S.; Jackson, V.A.; Dahlin, C.M.; Blinderman, C.D.; Jacobsen, J.; Pirl, W.F.; et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N. Engl. J. Med. 2010, 363, 733–742. [Google Scholar] [CrossRef] [Green Version]
  12. Etkind, S.N.; Daveson, B.A.; Kwok, W.; Witt, J.; Bausewein, C.; Higginson, I.J.; Murtagh, F.E. Capture, transfer, and feedback of patient-centered outcomes data in palliative care populations: Does it make a difference? A systematic review. J. Pain Symptom Manag. 2015, 49, 611–624. [Google Scholar] [CrossRef] [Green Version]
  13. Eid, R.; Haddad, F.G.; Kourie, H.R.; Kattan, J. Electronic patient-reported outcomes: A revolutionary strategy in cancer care. Future Oncol. 2017, 13, 2397–2399. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Basch, E.; Deal, A.M.; Dueck, A.C.; Scher, H.I.; Kris, M.G.; Hudis, C.; Schrag, D. Overall Survival Results of a Trial Assessing Patient-Reported Outcomes for Symptom Monitoring During Routine Cancer Treatment. J. Am. Med. Assoc. 2017, 318, 197–198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Denis, F.; Basch, E.; Septans, A.L.; Bennouna, J.; Urban, T.; Dueck, A.C.; Letellier, C. Two-Year Survival Comparing Web-Based Symptom Monitoring vs. Routine Surveillance Following Treatment for Lung Cancer. J. Am. Med. Assoc. 2019, 321, 306–307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Barbera, L.; Sutradhar, R.; Seow, H.; Mittmann, N.; Howell, D.; Earle, C.C.; Li, Q.; Thiruchelvam, D. The impact of routine Edmonton Symptom Assessment System (ESAS) use on overall survival in cancer patients: Results of a population-based retrospective matched cohort analysis. Cancer Med. 2020, 9, 7107–7115. [Google Scholar] [CrossRef]
  17. Kaufmann, T.L.; Getz, K.D.; Hsu, J.Y.; Bennett, A.V.; Takvorian, S.U.; Kamal, A.H.; DeMichele, A. Identification of Patient-Reported Outcome Phenotypes Among Oncology Patients With Palliative Care Needs. JCO Oncol. Pract. 2021, 17, e1473–e1488. [Google Scholar] [CrossRef]
  18. Seipp, H.; Haasenritter, J.; Hach, M.; Becker, D.; Schütze, D.; Engler, J.; Ploeger, C.; Bösner, S.; Kuss, K. Integrating patient- and caregiver-reported outcome measures into the daily care routines of specialised outpatient palliative care: A qualitative study (ELSAH) on feasibility, acceptability and appropriateness. BMC Palliat. Care 2022, 21, 60. [Google Scholar] [CrossRef]
  19. Amini, M.; Oemrawsingh, A.; Verweij, L.M.; Lingsma, H.F.; Hazelzet, J.A.; Eijkenaar, F.; van Leeuwen, N. Facilitators and barriers for implementing patient-reported outcome measures in clinical care: An academic center’s initial experience. Health Policy 2021, 125, 1247–1255. [Google Scholar] [CrossRef]
  20. Buttiron Webber, T.; Marra, D.; Puntoni, M.; Giuliano, S.; Briata, I.M.; Cevasco, I.; Clavarezza, M.; D’Amico, M.; Defferrari, C.; Gozza, A.; et al. Patient-versus physician-reported outcomes in a low-dose tamoxifen trial in noninvasive breast cancer. Breast J. 2021, 27, 817–823. [Google Scholar] [CrossRef]
  21. Naehrig, D.N.; Dhillon, H.M.; Asher, R.; Grimison, P.; Grant, S.; Lacey, J. Patient-reported outcome measures and supportive care need assessment in patients attending an Australian comprehensive care centre: A multi-method study. Support Care Cancer 2021, 29, 5037–5046. [Google Scholar] [CrossRef]
  22. Sørensen, J.; Sjøgren, P.; Stine, C.; Sørensen, T.V.; Heinecke, K.; Larsen, H.; Eidemak, I.; Kurita, G.P. Patient-reported outcome measures (PROMs) and palliative-care clinician reported outcomes (ClinROs) mutually improve pain and other symptoms assessment of hospitalized cancer-patients. Scand. J. Pain 2022, 22, 569–577. [Google Scholar] [CrossRef]
  23. Baumberger, D.; Hunstein, D. The linkage of nursing assessment and nursing workload. Stud. Health Technol. Inform. 2009, 146, 36–40. [Google Scholar]
  24. Hawker, G.A.; Mian, S.; Kendzerska, T.; French, M. Measures of adult pain: Visual Analog Scale for Pain (VAS Pain), Numeric Rating Scale for Pain (NRS Pain), McGill Pain Questionnaire (MPQ), Short-Form McGill Pain Questionnaire (SF-MPQ), Chronic Pain Grade Scale (CPGS), Short Form-36 Bodily Pain Scale (SF-36 BPS), and Measure of Intermittent and Constant Osteoarthritis Pain (ICOAP). Arthritis Care Res. 2011, 63 (Suppl. 11), S240–S252. [Google Scholar]
  25. Basler, H.D.; Hüger, D.; Kunz, R.; Luckmann, J.; Lukas, A.; Nikolaus, T.; Schuler, M.S. Assessment of pain in advanced dementia. Construct validity of the German PAINAD. Schmerz 2006, 20, 519–526. [Google Scholar] [CrossRef] [PubMed]
  26. Kroenke, K.; Strine, T.W.; Spitzer, R.L.; Williams, J.B.; Berry, J.T.; Mokdad, A.H. The PHQ-8 as a measure of current depression in the general population. J. Affect. Disord. 2009, 114, 163–173. [Google Scholar] [CrossRef] [PubMed]
  27. Kroenke, K.; Spitzer, R.L.; Williams, J.B.; Löwe, B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. Gen. Hosp. Psychiatry 2010, 32, 345–359. [Google Scholar] [CrossRef]
  28. Buchhold, B.; Lutze, S.; Freyer-Adam, J.; Jünger, M.; Ramp, M.; Konschake, W.; Jülich, A.; Nordt, C.; Peters, S.; Arnold, A.; et al. Validation of the psychometric properties of a “Modified Version of the Hornheider Screening Instrument” (HSI-MV) using a sample of outpatient and inpatient skin tumor patients. J. Dtsch. Dermatol. Ges. 2022, 20, 597–609. [Google Scholar] [CrossRef]
  29. Stiel, S.; Matthes, M.E.; Bertram, L.; Ostgathe, C.; Elsner, F.; Radbruch, L. Validation of the new version of the minimal documentation system (MIDOS) for patients in palliative care: The German version of the edmonton symptom assessment scale (ESAS). Schmerz 2010, 24, 596–604. [Google Scholar] [CrossRef]
  30. Faul, F.; Erdfelder, E.; Lang, A.G.; Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 2007, 39, 175–191. [Google Scholar] [CrossRef]
  31. Donna, L.; Mohr, W.J.W.; Freund, R.J. Statistical Methods, 4th ed.; Academic Press: Cambridge, MA, USA, 2022; pp. 651–683. [Google Scholar]
  32. Barceló, J.A. Chi-Square Analysis. In The Encyclopedia of Archaeological Sciences; Wiley-Blackwell: Oxford, UK, 2018; pp. 1–5. [Google Scholar]
  33. Zysno, P. The modification of the Phi-coefficient reducing its dependence on the marginal distributions. Methods Psychol. Res. Online 1997, 2, 41–52. [Google Scholar]
  34. Harris, T.; Hardin, J.W. Exact Wilcoxon Signed-Rank and Wilcoxon Mann–Whitney Ranksum Tests. Stata J. 2013, 13, 337–343. [Google Scholar] [CrossRef] [Green Version]
  35. Gignac, G.; Szodorai, E. Effect size guidelines for individual differences researchers. Personal. Individ. Differ. 2016, 102, 74–78. [Google Scholar] [CrossRef]
  36. Hahn, C.; Joo, S.H.; Chae, J.H.; Lee, C.U.; Kim, T.S. Feasibility of Psychosocial Distress Screening and Management Program for Hospitalized Cancer Patients. Psychiatry Investig. 2017, 14, 734–745. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Ito, N.; Ishii, Y.; Aoyama, M.; Abo, H.; Sakashita, A.; Matsumura, Y.; Miyashita, M. Routine patient assessment and the use of patient-reported outcomes in specialized palliative care in Japan. J. Patient Rep. Outcomes 2023, 7, 25. [Google Scholar] [CrossRef] [PubMed]
  38. Bausewein, C.; Simon, S.; Benalia, H.; Downing, J.; Mwangi-Powell, F.; Daveson, B.; Harding, R.; Higginson, I. Implementing patient reported outcome measures (PROMs) in palliative care—users’ cry for help. Health Qual. Life Outcomes 2011, 9, 27. [Google Scholar] [CrossRef] [Green Version]
  39. Karsten, M.M.; Kühn, F.; Pross, T.; Blohmer, J.U.; Hage, A.M.; Fischer, F.; Rose, M.; Grittner, U.; Gebert, P.; Ferencz, J.; et al. PRO B: Evaluating the effect of an alarm-based patient-reported outcome monitoring compared with usual care in metastatic breast cancer patients-study protocol for a randomised controlled trial. Trials 2021, 22, 666. [Google Scholar] [CrossRef] [PubMed]
  40. Ahern, S.; Ruseckaite, R.; Ackerman, I.N. Collecting patient-reported outcome measures. Intern. Med. J. 2017, 47, 1454–1457. [Google Scholar] [CrossRef]
Table
Table 1. Overview of the content of nurse-reported assessment and ePROMs.
Table 1. Overview of the content of nurse-reported assessment and ePROMs.
Nurse-ReportedePROMs (ePOS)
Basic data:
BMI, level of care, home care services		Psycho-oncological and palliative care needs
AmbulatingDepression:
Patient Health Questionnaire PHQ-8
Personal hygiene and dressingAnxiety:
Generalized Anxiety Disorder Scale GAD-7
FeedingPsychosocial burden:
Hornheider Screening Instrument HSI
Continence and toiletingSymptom burden:
Minimal documentation system MIDOS2
Communication and interaction
Sleep
Regulation of body functions
Pain and feelings
Decubitus and wounds
Wound documentation and special documentation including NRS for pain
Table
Table 2. Demographics and patients’ characteristics.
Table 2. Demographics and patients’ characteristics.
Total (n = 230)
Sociodemographic characteristics
Sex
n (%)		Female127 (55.2)
Male103 (44.8)
Age mean
y (±SD)		 55.99 (±15.07)
Marital status
n (%)		Married
In a relationship
Single
Divorced
Living separately
Widowed
Missing information		111 (48.3)
18 (7.8)
32 (13.9)
9 (3.9)
2 (0.9)
9 (3.9)
49 (21.3)
Children
n (%)		Yes119 (51.7)
No59 (25.7)
Missing information52 (22.6)
Employment
n (%)		Yes72 (31.3)
No97 (42.2)
Missing information61 (26.5)
Medical characteristics
Cancer diagnosis *
n (%)		Soft-tissue sarcoma75 (39.1)
Lung cancer38 (20.1)
Uveal melanoma21 (11.1)
Gastrointestinal cancer19 (10.1)
Hepatobiliary cancer and pancreatic cancer13 (6.9)
Others23 (11.0)
Line of therapy
n (%)		05 (2.2)
1146 (63.5)
239 (17.0)
318 (7.8)
>322 (9.6)
ECOG
n (%) 		ECOG 078 (33.9)
ECOG 145 (19.6)
ECOG 227 (11.7)
ECOG 312 (5.2)
ECOG 41 (0.4)
Missing information67 (29.1)
Initial tumor stage (UICC) n (%) I7 (3.0)
II17 (7.4)
III55 (23.9)
IV123 (53.5)
Missing information28 (12.2)
Metastasized
n (%)		Yes175 (76.1)
No54 (23.5)
Missing information1 (0.4)
Psychiatric treatment
n (%)		At the moment13 (5.7)
Never134 (58.3)
Before27 (11.7)
Missing information56 (24.3)
Tranquillizer,
antidepressants, hypnotics
n (%)		Daily use20 (8.7)
Sometimes18 (7.8)
Never140 (60.9)
Missing information52 (22.6)
* unchangeable feature was counted only once during data collection (n ≠ 230) to avoid confounding.
Table
Table 3. Overview of descriptive and further analysis.
Table 3. Overview of descriptive and further analysis.
Nominal Ranked Symptoms, Results of the Chi-Squared Tests (X2), the Fisher’s Exact (p), and the Phi-Coefficient (φ)
SymptomnMedianSymptom BurdenX2Asymp. Sig.pφ
Nausea
(ePOS)		1740.00No (0)4.35 ***-0.10-
Nausea
(epaAC)		2250.00No (0)
Dyspnea
(ePOS)		1730.00No (0)1.36 ***-0.29-
Breathing (epaAC)2250.00No (0)
Difficulties with sleep
(ePOS)		1641.00Difficulties with sleep (1)7.560.01(n = 161)-−0.22
Difficulties with sleep
(epaAC)		2250.00No difficulties with sleep (0)
Depressiveness (ePOS)1721.00Depressiveness (1)0.73 ***-1.00-
Sadness (epaAC)2220.00No sadness (0)
Weakness (ePOS)1741.00Weakness (1)0.000.56
(n = 170)		--
Exhaustion (epaAC)2250.00No exhaustion (0)
Concentration (ePOS)1741.00Difficulties with concentration (1)0.81 ***-1.00-
Attention (epaAC)2250.00No difficulties with attention (0)
Symptoms Ranked with 4-point Likert, Results of the Wilcoxon Test, and the Cohen’s r
SymptomnMeanSymptom BurdenZAsymp. Sig.p-Valuer
Pain
(ePOS)		1751.06Mild pain (1)−8.54 1
−8.55 2		0.000.000.46 1
0.46 2
Pain
(NRS) 1		2260.25No pain (0)
Pain
(epaAC) 2		2240.21No pain (0)
Anxiety
(ePOS)		1740.01No anxiety (0)−8.830.000.000.48
Anxiety
(epaAC)		2220.93Mild anxiety (1)
Nominal rated symptoms: 0 = no; 1 = yes; *** expected cell frequencies less than five. Four-point Likert scale: 0 = no symptom burden; 1 = mild symptom burden; 2 = moderate symptom burden; 3 = severe symptom burden. Nurse-reported: epaAC and NRS. PROMs: ePOS. 1 pain (ePOS vs. NRS). 2 pain (ePOS vs. epaAC).
Table
Table 4. Comparison of the advantages and disadvantages of ePROMs and nurse-reported symptom burden.
Table 4. Comparison of the advantages and disadvantages of ePROMs and nurse-reported symptom burden.
ePROMsNurse-Reported
AdvantagesUnrecorded stresses become transparentDaily overview
Subjective symptom burden in the spotlightIndependent of patients’ condition
Psychological distress to be detected
Alerts when symptom burden is high
DisadvantagesDepends on:
-
Compliance
-
Condition
Focused on nursing related risk factors and patients’ abilities
Only once while inpatient undergoing treatmentLess focus on psychological distress
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Warnecke, E.; Salvador Comino, M.R.; Kocol, D.; Hosters, B.; Wiesweg, M.; Bauer, S.; Welt, A.; Heinzelmann, A.; Müller, S.; Schuler, M.; et al. Electronic Patient-Reported Outcome Measures (ePROMs) Improve the Assessment of Underrated Physical and Psychological Symptom Burden among Oncological Inpatients. Cancers 2023, 15, 3029. https://doi.org/10.3390/cancers15113029

AMA Style

Warnecke E, Salvador Comino MR, Kocol D, Hosters B, Wiesweg M, Bauer S, Welt A, Heinzelmann A, Müller S, Schuler M, et al. Electronic Patient-Reported Outcome Measures (ePROMs) Improve the Assessment of Underrated Physical and Psychological Symptom Burden among Oncological Inpatients. Cancers. 2023; 15(11):3029. https://doi.org/10.3390/cancers15113029

Chicago/Turabian Style

Warnecke, Eva, Maria Rosa Salvador Comino, Dilara Kocol, Bernadette Hosters, Marcel Wiesweg, Sebastian Bauer, Anja Welt, Anna Heinzelmann, Sandy Müller, Martin Schuler, and et al. 2023. "Electronic Patient-Reported Outcome Measures (ePROMs) Improve the Assessment of Underrated Physical and Psychological Symptom Burden among Oncological Inpatients" Cancers 15, no. 11: 3029. https://doi.org/10.3390/cancers15113029

APA Style

Warnecke, E., Salvador Comino, M. R., Kocol, D., Hosters, B., Wiesweg, M., Bauer, S., Welt, A., Heinzelmann, A., Müller, S., Schuler, M., Teufel, M., & Tewes, M. (2023). Electronic Patient-Reported Outcome Measures (ePROMs) Improve the Assessment of Underrated Physical and Psychological Symptom Burden among Oncological Inpatients. Cancers, 15(11), 3029. https://doi.org/10.3390/cancers15113029

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop