Next Article in Journal
Decomposition of Flavonols in the Presence of Saliva
Previous Article in Journal
Application of Advanced Measuring Methods for Identification of Stresses and Deformations of Automotive Structures
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Purpose of Patient-Reported Outcome (PRO) Post Its Digitalization and Integration into Clinical Practice: An Interdisciplinary Redefinition Resembling PROs Theoretical and Practical Evolvement

1
Techno-anthropology, Department of Planning, Aalborg University (AAU), 9000 Aalborg, Denmark
2
Health Informatics, Department of Communication and Psychology, Aalborg University (AAU), 9000 Aalborg, Denmark
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(21), 7507; https://doi.org/10.3390/app10217507
Submission received: 4 September 2020 / Revised: 15 October 2020 / Accepted: 22 October 2020 / Published: 26 October 2020
(This article belongs to the Section Applied Biosciences and Bioengineering)

Abstract

:
Patient-reported outcomes (PROs) digitalization and integration into clinical practice has widened its purpose, which makes it relevant to reconceptualize PRO accordingly. Therefore, this study aims to describe and critically discuss the purposes of PRO and to suggest an interdisciplinary definition of PRO aligned with current applications. The findings in this study are based on a formerly conducted scoping review on PRO and patient participation; hence, a sub-study focusing on the purpose of PRO. The purposes of PRO pertain to research and drug testing; quality and economy; patient-centered care; politicization and democratization; and organization and culture. The suggested definition describes PRO as a validated questionnaire; developed in collaboration between patients, clinicians, and other pertinent stakeholders; systematically applied; mediated digitally or paper-based; completed directly by the patient, with assistance or by a qualified proxy; composed of generic, disease-specific, condition-specific or preference-based measures; consisting of content pertaining to the patient’s physical and mental health condition, functioning, symptoms, well-being or health-related quality of life (HRQoL); providing objective and/or subjective outcomes, and individual and/or population data. An alternative understanding of PRO is meant to enhance the link between purposes and definitions of PRO, facilitating interdisciplinary stakeholder discussions on PRO, potentially improving future PRO interventions.

1. Introduction

Since the 1880s, Western healthcare systems have successfully and primarily focused on acute diseases, the reduction of deaths, and the treatment and prevention of such conditions [1]. However, presently healthcare systems in Western countries are facing several challenges due to aging populations; increasing amounts of chronically ill citizens; continuous accumulation of information and data and innovations in clinical practice and technology [2]. Consequently, a paradigm shift in healthcare is slowly evolving, which entails a shift from a heavy focus on deadly diseases and acute conditions, towards a heavier emphasis on chronic illness and patient’s health-related quality of life (HRQoL) [3]. On top of this, a new type of patient is emerging, demanding adequate information, and active participation when managing their health [2]. Therefore, new healthcare measures, value-based healthcare, standardization of data, coordination of patient pathways, and more holistic healthcare systems are focal subjects in current healthcare [4,5,6].
It is within this complex context, Patient-reported outcome (PRO) is anticipated to be an advantageous instrument, on an individual level as part of clinical practice or on a population level as part of research and preventive healthcare [7]. Thus, PROs are spreading horizontally across sectors and disease areas and vertically across organizational levels, widening its functionality [8]. An evolvement especially made possible by PROs digitalization, supported by current health data policies regarding themes such as e.g., “the patient as an active partner”, “health by and with people”, “knowledge on time”, “prevention” and “a health knowledge commons” [9,10].
A common definition of PRO was coined by the American Food and Drug Administrations (FDA) in 2009, as part of their “Guidance for Industry” report, where PRO is considered: “Any report of the status of patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else” [11]. A definition making it clear that PRO concerns patients’ health condition, reported directly by the patient; however, the phrase ‘any report’; allows flexible interpretations of a PROs actual content as this remains quite unclear. However, a full read of the white paper, reveals that PRO, according to FDA, mainly is an instrument used in clinical trials when testing drugs [11]. Hence, the report “does not address the use of PRO instruments for purposes beyond the evaluation of claims made about a medical product in labeling” [FDA]; meaning that patient-oriented and disease management purposes are not included in this description of PRO. Patient-reported outcome measures (PROMs) are applied when measuring patients’ health conditions and belongs under the umbrella term patient-reported data. Other types of data in this category are patient-reported experience measures (PREMs), used to assess the quality of care based on patient’s satisfaction and surveys based on patient-reported data [7]. The different scopes of PREM and PROM mean they act as complementary tools when evaluating the quality of healthcare [12]. The term PROM is typically used when PRO is considered a measure or when referred to as a questionnaire. Examples of frequently used PROM questionnaires are the five-item World Health Organization Well-Being Index (WHO-5) and Short Form-36 (SF-36), which measures patients’ well-being and HRQoL, respectively [13,14]. The WHO-5 questionnaire is used to calculate patients well-being over the last two weeks on a six-point Likert scale by asking patients to consider the following statements: (a) I have felt cheerful and in good spirit, (b) I have felt calm and relaxed, (c) I have felt active and vigorous, (d) I woke up feeling fresh and rested, (e) My daily life has been filled with things that interest me [13]. The SF-36 measures patients HRQoL on eight different dimensions categorized as, (1) physical functioning, (2) social functioning, (3) role physical, (4) role emotional, (5) bodily pain, (6) mental health, (7) general health, (8) vitality. Scores can be summarized within each domain, in a physical component score (PCS), and as a mental component score (MCS) [14]. Thus, examples of two typical uses of PROM questionnaires to assess the health status of patients. However, some of the more notable strengths of PROs as part of clinical practice concern their ability to provide a more holistic description and produce actionable data [15,16,17]; subsequently, allowing more individualized healthcare [18], features typically promoted through the application of disease-specific PROM questionnaires.
Considering the paradigmatic and structural changes of Western healthcare systems and the digitalization of PRO, it is interesting to clarify how the purposes and interpretations of PRO have evolved. Hence, the aim of this study is to identify and critically discuss the purposes of PRO, while describing different interpretations of PRO; enabling, the construction of an interdisciplinary definition of PRO that bridges the conceptualization and purpose of PRO. Thus, this article offers a critical and interdisciplinary understanding of PRO, supplementing descriptive and functional presentations of PRO. An alternative definition potentially having a beneficial impact on clinical practice, as stronger coherence between theory and practice should improve stakeholders’ understanding and use of PRO. Thus, the clarification of different purposes from a critical perspective is meant, not only as a conceptual contribution but also as an attempt to improve future initiatives and interventions based on PRO. At the very least, the critical and interdisciplinary angle on PRO presented in this article has the potential to instigate relevant discussions among stakeholders, which is a starting point when aiming to optimize the application of PROs as part of clinical practice.
In Section 2, “Materials and Methods,” the applied method and analytical approach are explained. Section 3, “Results,” contains examples of different definitions and various descriptions of PRO’s purposes. In Section 4, “Discussion,” the identified purposes are scrutinized critically to elucidate challenges when operationalizing the purposes, leading to the suggestion of an interdisciplinary reconceptualization of PRO.

2. Materials and Methods

The identified purposes of PRO presented in this article emanates from empirical material stemming from a formerly conducted scoping review regarding the link between PRO and patient participation [19]. Thus, the analysis of the empirical data with a focus on the identification of PRO’s purposes, presented in this article, functions as a sub-study of the original scoping review. A second sub-study on PRO’s functionalities is presented in a different article, where 25 different functionalities are identified; with a particular focus on PROs functionality post its digitalization [20]. The literature included in this paper derives from the following databases: PubMed, Embase, CINAHL, and Scopus. During the search, the term “patient-reported outcome” was combined with search strings containing words and concepts deemed to cover aspects of “patient recognition,” “patient participation,” or “patient empowerment.” Studies of primary care RCT studies where PRO functions as a secondary endpoint and children’s studies were excluded, while articles explaining what PRO is and literature on PRO’s functionality, purpose, and application in clinical practice were included. An approach, initially leading to 6,895 articles, diminishing to 4,343 articles after duplicates were removed, which therefore equals the number of abstracts screened for eligibility; resulting in the full read of 256 articles. Detailed explanations and visualizations of the original search process are accessible in the original review manuscript concerning the association between PRO and patient participation [19].
The articles were analyzed systematically and thematically, in accordance with theoretical guidelines [19,21]. The magnitude of the scoping review allowed different analytical approaches to the data material. Thus, inspired by Braun and Clarke’s (2006) conceptualization and approach to thematic analyses, the scoping review is considered the data corpus (the research project’s entire data), whereas the empirical data incorporated in this article should be considered a data set (data used for a particular analysis) [22]. Hence, findings presented in this article are based on a thematic analysis with a narrow focus on PRO’s purposes and conceptualization. Arguably, the analysis did to some extent begin during the analytical work with the scoping review, since this process inductively revealed “purposes of PRO” as a relevant theme to explore further. Hence, the reason why the data corpus subsequently was scrutinized with a “theoretical” focus on the purposes of PRO. The first step was to identify empirical material that provided an understanding of PRO’s purposes, which was then sorted into one single document. The next step was to categorize the various purposes of PRO into categories based on repeated patterns identified in the empirical data; resulting, in the identification of five overall purposes. In the description of PRO’s purposes in this article, additional inputs from books and grey literature have subsequently been added when deemed relevant.

3. Results

In this section, the identified purposes of PRO are presented. The five overall purposes of PRO concerns: research and drug testing, quality and economy, patient-centred care, politics and democracy, and organization and culture. The reason why some themes are grouped is that the concepts in the literature and practice are difficult to separate from one another; hence, the choice of making coupled categories.

3.1. PRO as a Research and Drug Testing Tool

Historically, PRO is a product of different healthcare developments. Thus, the collection of patient data is traced all the way back to the Crimean War (1854), where Florence Nightingale initiated a systematic collection of data regarding soldiers’ cause of death [23,24]. Furthermore, PRO is connected to certain disease-specific and generic health measures, developed since the 1940s [25,26]. Measures initially perceived as indicators of “outcomes” and “health status”; however, as the collection and development of health status assessment measures evolved during the 1970′s the concept of “quality-of-life” (QoL) gained ground; subsequently, paving the way for “health-related quality-of-life” (HRQoL) measures [26,27,28]. The same period, where theoretical frameworks such as e.g., Avedis Donabedian’s structure-process-outcome model (1966) [29] and the biopsychosocial model (1977) emerged [30]. Furthermore, the 1970s was the decade where the collection of aggregated PROs was initiated in Sweden, establishing the beginning of systematic integration of PROs into national clinical databases [31,32]. Later on, Arthur Kleinmann’s (1988) ideas regarding the separation of health status and psychosocial outcomes in chronic disease care were introduced, marking a shift regarding the relevance of patient participation and patient empowerment, essentially, accentuating a less paternalistic healthcare approach [33]. During the last part of the 20th century, the evidence-based medicine approach gained support, emphasizing systematization, measurability and standardization of healthcare interventions [23,34], paradigmatic aspects, aligned with focal methodological requirements concerning PRO instruments [11].
Originally, PRO was used for group-level research and medical research [26,35], as secondary endpoints in clinical trials [36,37], e.g., when testing new drugs [38,39] or evaluating the comparative effectiveness of healthcare interventions [40,41]. Hence, the collection of PRO data established a systematic approach eliciting patients’ perspectives on how healthcare interventions affected their health status [35]; whether they, for example, experienced adverse effects [27,28], side-effects [38], comorbidity or an increased burden of illness due to a specific treatment [26]. PRO data is also useful in cases where treatments or drugs have almost similar clinical efficacy [42] since it might help explain non-compliance with the drug regime based on patients’ experiences [32], potentially enhancing appraisals of drugs effect [11,30]. Consequently, the FDA made the use of PROs to support claims in approved medical product labelling mandatory in 2009 [11].
Thus, considering PROs genealogy and original application the International Society for Quality of Life Research (ISOQOL) definition of PRO as: “…a measurement of any aspect of a patient’s health that comes directly from the patient, without interpretation of the patient’s response by a physician or anyone else” [43], is quite fitting. An interpretation having commonalities with the FDA version elaborated upon in the introduction; however, ISOQOL explicitly refers to PRO as a measurement tool.

3.2. PRO as a Quality and Economy Instrument

PRO as a measurement tool paved its way into healthcare as it offers supplementary indicators on quality and economy. The conceptualization of quality in healthcare is linked to a striving towards an economically effective system, based on the premise that more care does not necessarily lead to better outcomes [44]. In other words, the increased focus on economic effectiveness aspires from a perception that an increase in quality of healthcare and a decrease in expenses not only are attainable but also more sustainable [45]. An approach immanent in the so-called ‘Triple Aim’, where improvements in the quality of healthcare and the health of the population are assessed in comparison to economic efficiency [46,47]. Aims aligned with PRO’s functionality, making it a reasonably useful tool concerning the measurement and assurance of the quality of healthcare [44,48]. Furthermore, PRO-based quality assessments incorporate patients’ perspectives regarding health outcomes most important to them [25,48]; enabling qualitative healthcare improvements in concordance with a patient-centred approach [49], while ensuring more useful parameters when evaluating patients’ health and well-being improvements [46]. A configuration of quality and patient value based on economic terms, meaning that the quality of healthcare supposedly mirrors patients’ needs, as it adapts to consumers’ wishes [50].
Especially the digitalization of PROs has enabled its integration into value-based healthcare (VBHC) systems, where quality is captured through the comparison of patient outcomes weighted against treatment costs [45,48]. In practice, VBHC systems integrate aggregated PRO data providing a more structured measurement of patient value. Consequently, the VBHC approach may to some extent replace, or the least complement the traditional volume-based reimbursement system; in other words, quality gains (values) are to a greater extent merged with quantity measures (volume) when assessing the quality of healthcare [32,47,48,51]. As a result, providers are benchmarked and paid according to their performances; hence, a tool complementing market-oriented healthcare systems [46,50,52]. A system that might lead to more transparency by improving the accountability of providers [53,54], and an approach facilitating knowledge sharing by accentuating best practices, potentially improving for instance patient safety [46].
Another application of PROs having economic implications is as part of an algorithmic triage system. In this context, patients are automatically sorted into predetermined color categories (green, yellow, red), based on their health status; thus, some patients are allowed to skip consultations at the hospital. A system, potentially ensuring reallocation of resources as it allows providers to move resources from green to red patients; hence, a tool providing room and time for those patients most in need [55]. Essentially, an increase in productivity since the patients staying at home and those showing up at the hospital site are handled simultaneously by the digitalized healthcare system.

3.3. PRO as Patient-Centred Care

In 2001, the Institute of Medicine (Washington D.C., US) accentuated the importance of patient-centered care [56] and defined it as: “…care that respects and responds to the individual patient’s preferences, needs and values and ensures that clinical decision incorporates patients’ values” [57]. Thus, there is a conceptual connection between patient-centred care and PRO-based VBHC, since values, needs and preferences are focal in both cases.
Patient-centered care is a holistic approach focusing on the well-being of patients, preferably reflected in every action taken by healthcare professionals [58], what PRO then enables are the patients to get involved and take a central position in their healthcare [25,49]. Consequently, patient-centered care might result in more independent and active patients with improved management of their health, which is a paradigmatic shift compared to the traditional provider paternalism, where patients were placed as passive, non-responsible receivers of healthcare [33,59]. Therefore, as part of a patient-centered approach, the collaboration between physicians and patients is supposed to transform into a sort of partnership, which however rests on active and genuine engagement by the actors involved [57,60,61].
This demonstrates that there are common grounds between PRO and patient-centered care. Thus, as part of clinical practice, PRO might facilitate a more holistic care approach and an environment promoting patient engagement [49,62,63]. Moreover, PRO is known to promote patient-centered care by capturing and explicating issues that matter to the majority of patients [16,25], since it integrates the patient voice and facilitates patient involvement in health care [64,65]; thus, evidence supports that PRO enhances physician-patient communication [66,67] and that PRO encourage and affects the degree of shared decision-making (SDM) in clinical practice [32,46,50,68]. Furthermore, PRO’s facilitation of patient participation might have an empowering effect on patients [3,69,70] and ensure that patients are recognized and treated as individuals, and not merely as diagnoses [18].
In this context, the definition of PRO presented by a Danish expert group, hosted by the Danish Knowledge Center for User Involvement in Health Care (ViBIS) in 2016, is of relevance, since they interpret PRO as: “Data concerning the patient’s health condition such as physical and mental health, symptoms, health-related quality of life and functional ability reported directly by the patients themselves” [7]. Once more, a definition essentially complying with the FDA version; however, a more detailed version of what constitutes a PRO. Furthermore, PROs interpretative evolvement is interesting as it, based on the presented definitions in this article, chronologically shifts from being “any report,” “measurement,” to “data.” Therefore, it is deliberate that VIBiS definition is placed in this section since the emphasis on PRO as data arguably is linked to a more patient-oriented focus; hence, it is the use of PRO data that might promote patient’s engagement, empowerment, and self-management.

3.4. PRO as a Political and Democratic Tool

Another theme regards PROs’ political and potential democratic attributes. The current politicization of the healthcare sector stems, among other things, from two coinciding developments. Firstly, as health care costs increase in many western countries, the sustainability of the sector is being questioned, turning it into a hot political topic [58,71]. Secondly, patients’ increased accessibility and accumulation of knowledge through digital platforms; subsequently, mobilizing and empowering them, might affect their expectations and their political engagement pertaining to the quality of healthcare [58].
A development embedded in recent healthcare policies where patient involvement exists as a sort of axiomatic strategy [72]. Therefore, the present political agenda is underpinned by PROs functionality, since it is plausible to perceive PRO as an instrument giving voice to individual patients and patient groups; hence, the reason why it might be categorized as a political and democratic tool [36,71]. The inclusion of the patient perspective as a valuable source of information is on the one hand, based on an acknowledgement that patients are experts on their health situation and on the other hand, a result of increasing consensus that patient involvement is the ethically right path to take [36,58]. A normativity, which presently becomes apparent during funding processes, where patient involvement more often is part of the requirements when designing research projects. Therefore, patients’ voice mediated by PRO, might directly or indirectly, influence the forming of clinical practice and the shaping of healthcare policies [36].

3.5. PRO as an Organizational and Cultural Shift

Based on the former sections PROs purpose concerns, among other things, research, clinical practice, and healthcare policies, which means that PRO also affects organizational structures and cultures. For example, the application of PRO on a routine basis might impact clinical workflow, work practice, organizational structures, infrastructures as well as stakeholders’ attitudes and values, [69,73,74,75,76]. Hence, the reason why PRO in this section is claimed to be a tool, which actively or passively can be used to commence changes and cultural shifts in healthcare organizations.
PRO is supposed to function as a system composed of outcomes that matters to patients, which is relevant as prior systems and data at times acted as alternative representations of reality deviating from patients’ values and needs [42]. Hence, PROs’ evocation of patients’ values allows managers to construct a more patient-centered healthcare system [64]; a cultural shift and system change promoted by political institutions as they encourage providers and stakeholders to focus more on outcome measures and less on processual indicators [41,57].
As part of clinical practice, the application of PROs faces several organizational and cultural barriers; especially, insufficient time seems to be one of the more pronounced barriers [77,78]. On the one hand, some physicians perceive PRO as being too time-consuming as it makes decision-making more complex and less effective [34]. On top of this, doctors’ inability to interpret data due to no clear guidelines and lack of education is another aspect affecting the amount of time spent on PRO as part of clinical practice [41,79,80]. On the other hand, different studies have shown that PROs do not increase the length of clinical encounters [81,82,83]. Thus, PRO does to some extent affect the time dimension as part of patient-clinician consultation; however, to what extent is being contested. Another organizational aspect pertains to whether PROs fit into clinical workflow and practice [26,67]; however, numerous studies have verified that PROs are feasible in such a context [83,84]. Secondly, the increased work burden of the health care professionals should be kept to a minimum to avoid it turning into an implementation barrier [62,85]. Thirdly, proper and timely PRO data availability during a consultation is decisive for its use in clinical practice [50,86]. Therefore, even though PROs have a huge potential, its functionality rests on attitudinal cultures supporting patient engagement and genuine partnerships between patients and physicians supported by appropriate organizational setups [57,62]. Put differently, to ensure that PRO’s purpose is fulfilled organizational and cultural changes are mandatory; vice versa, it is reasonable to perceive PRO as a tool potentially instigating such transformations, since PROs “automatically” affects time, workflow, and use of data in clinical practice. Therefore, it is not surprising that attitudes towards PRO among healthcare professionals are differing; nonetheless, a central point since a cultural shift relies heavily on healthcare professionals’ and leaders’ engagement [30,49]. Moreover, PRO data might be utilized as a communication tool within multidisciplinary teams [35,67] or serve as a coordination tool by sharing data across different healthcare actors [30], potentially enhancing coordination of for example patient pathways across organizations and sectors [8].

4. Discussion

As described in Section 3, results are visualized in Figure 1, PRO’s purpose is multifaceted as it might act as a: research and drug testing tool; quality and economy instrument; a way to enhance and enable patient-centred care; means to politicize and democratize healthcare and an artefact facilitating organizational and cultural transitions.
In the following section focal issues related to the identified purposes are scrutinized critically to create awareness on challenges when materializing the purposes. Moreover, as elucidated above, various interpretations of PRO co-exist, as PRO is labeled as “any report,” “measurement,” or “data.” Empirical findings indicating that PRO has evolved, not just in purpose, but also conceptually. The issue is that the three definitions of PRO, created by FDA, ISOQOL, and ViBIS, do not fully mirror the complexity of PRO’s different purposes. A discrepancy, which might be problematic as a gap between the conceptualization of PRO and its purposes potentially confuses stakeholders; subsequently, impacting the utility of PROs as part of clinical practice. Therefore, the last part of the discussion contains an interdisciplinary interpretation of PRO aiming to provide clarity and strengthen the link between the purposes and the definition of PRO.

4.1. Realization of PRO’s Patient-Oriented and Economic Purposes?

As elucidated, PRO traditionally is part of the outcome data branch, which has shaped its use formerly. Hence, PRO was traditionally used as secondary endpoint data when measuring patients’ outcomes following a healthcare intervention [37]. However, PRO is currently also used as a primary endpoint, underscoring that the use of PRO has undergone a noticeable change [86]; arguably, reflecting how PRO’s purpose has changed as HRQoL aspects have become a crucial part of today’s healthcare.
Thus, when PRO is applied as an independent variable, the purposes of PRO alter in a patient-oriented direction, since such interventions are meant to affect patient behavior; hence, the current focus on PRO’s effects on SDM, patient participation, empowerment, and self-management. Therefore, PRO no longer merely measure health outcomes but also instigates actions related to patient-centered healthcare by activating patients. An essential shift in PRO’s intended purpose, which is decisive to grasp, to fully comprehend the transformative impact PROs plausibly have on clinical practice and healthcare henceforth.
Regarding PRO’s economic features these rests on certain assumptions and have important implications. This is because PRO systems where data describes the quality of treatment and outcomes according to the patients require patients that are willing to frequently complete questionnaires and to actively engage in the management of their health condition [43,53]. An important point, making it relevant to continuously evaluate patient participation and response rates, ensuring the feasibility of the system in the long run. In other words, the possibilities the digitalization of PRO offers need to be balanced with patients’ needs and preferences. Furthermore, PRO’s economic effectiveness as part of a triage system based on algorithms relies on two essential conditions to function properly. Firstly, reallocation of resources requires that resources de facto are moved from “green-patients” and are allotted to those most in need. Alternatively, it might turn into a money-saving exercise, economically enhancing the healthcare system but not necessarily benefiting the most vulnerable patients. Secondly, an increase in productivity rests on the condition that the time formerly spent in each patient-clinician consultation equals or is shorter than the current time spend even if the state of the examined patients’ health condition differentiates. In other words, even though a triage system logically results in a clinical practice with fewer “easy patients,” since only the most vulnerable individuals and complex patient cases are invited for consultation, healthcare professionals are still expected to spend the same amount or even less time on each patient compared to previous procedures. Therefore, even if PRO makes patient-clinician consultations more time effective by revealing relevant patient issues beforehand, changes in the type of patients showing up for consultation and additional subjects being discussed, which in the past might have been neglected, needs to be kept in mind when considering whether PRO is a time-saving tool.
Moreover, even though the normative ideals VBHC rests on seems attractive and might positively complement the volume-based reimbursement system, results from the UK shows that there are substantial annual variations in hospitals performances; thus, the authors state: “the hard statistical conclusion seems to be that even though there are some identifiably good and bad hospitals, most achieve pretty much the same levels of health gain for patients undergoing surgery” [87]. Therefore, it is questionable whether performance-based financing (PBF) and benchmarking systems are the right paths to take; however, if such tools are widely implemented, their infancy warrants that adequate indicators are developed, which is no simple task considering the multiple purposes of PRO and the complexity of current healthcare systems.

4.2. PRO—Information or Outcome Data?

Since PRO’s purpose has broadened, it is ambiguous to determine whether PRO is best thought of as information, outcome data or maybe a combination of both? Thus, it is noticeable that a single PRO questionnaire logically is unable to produce outcome data on its own. If a PRO is to provide outcome data, it requires comparison with a baseline measurement, either being individual health status progression or aggregated population data.
Moreover, even though there might be a correlation between a healthcare intervention and the subsequent outcome, their causality is quite uncertain as PROs are measuring possible effects in an uncontrolled environment consisting of a multitude of potential confounders. Arguably, it is not due to their enhancement of the internal validity concerning healthcare interventions and subsequent outcomes that PROs are attractive tools, but due to their ability to strengthen the ecological validity, thus, PROs provide a more authentic impression of patients’ disease situations as part of everyday settings.
Furthermore, in cases where PRO is considered an independent variable for example when used as an empowerment tool to increase patient participation, their actual potential is still relatively unclear; hence, further studies elucidating PROs capacity in this respect are demanded. Besides eliciting patient outcomes, PRO is also perceivable as an information tool, since it provides healthcare professionals with useful knowledge through the eyes of patients; subsequently, enabling improved patient management. Therefore, PRO may also be labeled as information regarding patients’ health status and HRQoL, which through comparison with baseline measures (formerly collected PRO data), and thorough interpretation elicits patients’ outcomes and current health situation [31]. Thus, it is no coincidence that researchers are dedicated to determining how to interpret PRO data, which is an imperative endeavor since inconsistent and inaccurate interpretations of the information PRO data provides might have counterproductive effects. In other words, turning the PRO data into clear and useful information, both on a general level but also as part of clinical practice is an important task to handle henceforth.

4.3. Directly from the Patient?

As emphasized in the above definitions, PROs are directly reported by patients; however, even though this might be the case, the initial patient perspective might still be different compared to the version entering the patient-clinician consultation. One issue, related to this topic is patients’ potential response shifts, which is an acknowledged challenge in clinical practice, made possible by the timeframe between the completion of a PRO questionnaire and the actual use of the PRO data. However, the point in this section is that the patient perspective change, but not necessarily due to changes within the patient. The idea that PRO answers are “directly reported” by patients are most often accurate; however, it leads to a connotation of PRO data as being completely unaffected before entering clinical practice, which is a focal feature, since it distinguishes PRO-based healthcare from traditional healthcare, based on traditional clinical data and healthcare professionals individual assessment [78]. Nonetheless, the version of ‘the unaffected PRO’ is modifiable, since interpretation and outcomes of PRO data are shaped by several factors.
Firstly, when developing a PRO questionnaire, the health-related areas within a specific subject field are identified and selected; therefore, at this initial development stage particular interpretations and perceptions of a condition or illness are promoted by those stakeholders constructing the instrument. Therefore, PRO is also perceivable as a socially constructed artifact, promoting specific understandings concerning a healthcare condition, which potentially constrains the individual patient perspective.
Secondly, the mediation of PRO questionnaires is essential, since it affects patients’ accessibility and ability to complete PRO questionnaires; therefore, inclusive and appropriate infrastructures and socio-technical setups are decisive if PROs are to provide patient perspectives across all patient groups.
Thirdly, both patients and healthcare professionals require intuitive and informative graphical presentations, if PRO data is to be intelligible and useful [47,88]. Similarly, considerate construction of algorithms is pivotal since their properties determine how patients are sorted into various health status categories, shaping possible interpretations of the PRO data; thus, transparent and judiciously configuration and validation of algorithms are imperative.
Fourthly, when applied in clinical practice PRO data is interpreted by healthcare professionals and applied with a specific purpose, e.g., screening, communication, or monitoring, which ought to improve the usefulness of PROs. Nonetheless, several studies show that healthcare professionals are unsure how to interpret PRO data [88,89,90] which means that they might refrain from using PRO data, neglect the importance of PRO answers, or use it in an unintended manner [88].
Fifthly, another attention point, taken into account in the PRO definition below, is that to obtain PRO answers patients might require assistance or an actual proxy. This is due to various reasons, such as low health literacy, language barriers, critical state of illness, etc., which prevents patients from completing the PRO questionnaires themselves [76,91]. Hence, in such scenarios assistance or a proxy might be necessary to ensure the completion of a PRO questionnaire, which likely affects the validity of the retrieved PRO data; conversely, it might increase response rates and ensure the inclusion of a wider array of patients.
These examples illustrate that even if patients are unaffected while completing the questionnaires, rigorously speaking it is debatable whether the same goes for the PRO data entering the patient-clinician consultation. This is because the PRO mediated patient perspective integrated into clinical practice is shaped and modified by human and technological actors along its way.

4.4. PRO as a Democratic or Political Tool?

As already mentioned, there are a number of reasons how PRO might be used as a political instrument considering the amount of information it provides. However, whether PRO is a democratic tool seems for a number of reasons doubtful.
Firstly, the way PRO instruments are developed and especially how it was done formerly, where merely healthcare professionals were involved in the process, means that PROs not necessarily are representative instruments. Secondly, since not every patient is able to answer the questionnaires, certain individuals and groups might not have any ‘voice’ via PROs; hence, another aspect negatively affecting the representativeness. Thirdly, not all patients are keen on completing PRO questionnaires; hence, PROs might act as a sort of chore and increase the patient burden, a third excluding factor.
Therefore, even though PRO as a democratic tool is an interesting ambition, optimizations regarding the development process of PRO questionnaires, the inclusion of broader patient segments, and the insurance that non-participating patients are giving “voice” through other channels is highly recommended.

4.5. An Interdisciplinary Redefinition of PRO

Considering the three definitions by FDA, ISOQOL, and ViBIS, the identified purposes of PRO, and the complexity of the challenges scrutinized in the discussion, it seems appropriate to introduce an alternative definition of PRO. The definition incorporates former aspects of PROs pertaining to research and drug testing while adding more recent clinical practice enabling facets, such as the digitalization of PROs and an alteration regarding who might act as a respondent. Thus, a PRO is defined as a: validated questionnaire; developed in collaboration between patients, clinicians, and other pertinent stakeholders; systematically applied; mediated digitally or paper-based; completed directly by the patient, with assistance or by a qualified proxy; composed of generic, disease-specific, condition-specific or preference-based measures; consisting of content pertaining to the patient’s physical and mental health condition, functioning, symptoms, well-being or health-related Quality of life (HRQoL); providing objective and/or subjective outcomes, and individual and/or population data.
Essentially, this definition portrays PRO as a multidimensional and interdisciplinary concept; hence, in this version, PRO is a holistic term consisting of several elements regarding specific types of questionnaires, applications, mediations, measures, content, data, and outcomes. Thus, the above interpretation of PRO consists of psychometric measures and/or economic measures and social constructs based on stakeholder perspectives, mediated by a specific technological setup. Therefore, the particular weight on the different aspects shaping a PRO determines its utility and functionality as part of clinical practice.
The broadness of the definition is required to ensure the bridging between purposes of PRO and the conceptualization of PRO. As a result, this version of PRO underscores its interdisciplinary character, which in combination with the presented purposes above, offers stakeholders on various levels a more nuanced understanding and approach to PRO; potentially, enhancing future healthcare policies and management initiatives based on PRO.
Regarding limitations, PRO is described in a general manner, meaning that nuances and contextual differences across disease areas and organizational levels are absent. Furthermore, the empirical materials the article is based on does not cover all literature on PRO; hence, some purposes might be missing. Lastly, since the article has a broad scope it limits how profound every theme can be analyszd and elaborated upon; therefore, we encourage future studies to examine issues concerning PRO’s different purposes, with a particular focus on the issues emphasized in the discussion section.

5. Conclusions

The article presents five different purposes of PRO concerning research and drug testing; quality and economy; patient-centered care; politicization and democratization; organization and culture. Hence, the purpose of PRO is currently multifaceted, partly due to PRO’s digitalization and integration into clinical practice. An increase in purposes, making it relevant to consider how to: interpret PRO data and turn it into useful information; ensure that PRO as an economic tool functions properly; instigate and maintain patient-centered care; facilitate patient participation via PROs, ensure that genuine patient perspectives enter consultations and development processes; and retain adequate response rates. Despite these challenges, the application and development of PRO tools persist and seem to increase; hence, the necessity to promote a contemporary interdisciplinary definition of PRO. Thus, the presentation of various purposes and the redefinition of PRO aims to create a stronger link between theory and practice; potentially, enhancing the realization of PRO’s purposes through enhanced application of PRO initiatives within clinical practice. As a starting point, the description and critical take on PRO’s purposes together with the interdisciplinary interpretation of PRO might instigate fruitful stakeholder discussions; subsequently, optimizing how clinical practice and in particular, the patients, benefits from the digitalization of PRO.

Author Contributions

Conceptualization, J.E.; methodology, J.E.; formal analysis, J.E.; investigation, J.E.; data curation, J.E.; writing—original draft preparation, J.E.; writing—review and editing, A.B. and P.B.; visualization, J.E.; supervision, A.B. and P.B.; project administration, J.E.; funding acquisition, P.B. All authors have read and agreed to the published version of the manuscript.

Funding

The first authors project is funded by the Danish Health Data Authority (SDS) 600,000 Dkr.; Danish Center for Health Informatics (DaCHI) 600,000 Dkr. and The Department of Planning, Aalborg University (AAU) 600,000 Dkr.

Acknowledgments

We would like to thank David O’Donnell for proofreading of the paper and for his intellectual inputs.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

HRQoLHealth-Related Quality of Life
ISOQOLInternational Society for Quality of Life Research
PBF Performance-Based Financing
PROPatient-reported outcome
PROMPatient-reported outcome measures
QoLQuality of Life
VBHCValue-Based Healthcare
ViBISThe Danish Knowledge Center for User Involvement in Health Care

References

  1. Glouberman, S. PROMs: A critical step, but only one of many. In New Models for the New Healthcare—The Case for Routine Patient-Reported Outcome Measurement; Leatt, P., Smith, T., Foster-Kent, D., Harrison, S., Bryant, S., Eds.; Healthcare Papers; Longwoods Publishing: Toronto, ON, Canada, 2012; Volume 11, pp. 29–33. [Google Scholar]
  2. Højgaard, B.; Kjellberg, J. Fem Megatrends der Udfordrer Fremtidens Sundhedsvæsen; Det Nationale Institut for Kommuners og Regioners Analyse og Forskning; KORA: København, Denmark; Available online: https://www.vive.dk/da/udgivelser/fem-megatrends-der-udfordrer-fremtidens-sundhedsvaesen-8760/ (accessed on 3 September 2020).
  3. Groen, W.G.; Kuijpers, W.; Oldenburg, H.S.A.; Wouters, M.W.J.M.; Aaronson, N.K.; Van Harten, W.H. Empowerment of cancer survivors through information technology: An integrative review. J. Med. Internet Res. 2015, 17, 1–17. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Danish Regions. Plan for Borgernes Sundhedsvæsen—Vores Sundhedsvæsen; Danish Regions; Region Hovedstaden: København, Denmark; Available online: https://www.regioner.dk/media/3047/borgernes-sundhedv-final-let.pdf (accessed on 3 September 2020).
  5. Ministry of Health (SUM); Danish Regions (DR); Local Government Denmark (KL). Nationale mål for Sunhedsvæsenet; SUM, DR and KL: Copenhagen, Denmark. Available online: https://www.sum.dk/~/media/Filer%20-%20Publikationer_i_pdf/2019/Nationale-maal-for-sundhedsvaesenet-2019/Nationale-Maal-2019-pub.pdf (accessed on 3 September 2020).
  6. The Danish Health Data Authority (SDS). Strategi 2020—Helhed, Sammenhæng, Tryghed. Available online: file:///C:/Users/je/AppData/Local/Temp/SDS%20Strategi%202020-1.pdf (accessed on 3 September 2020).
  7. The Danish Knowledge Center for User Involvement in Health Care (VibIS). Program PRO. Available online: https://danskepatienter.dk/vibis (accessed on 3 September 2020).
  8. The PRO Secretariat. PRO-Landskab. Available online: https://pro-danmark.dk/da/pro-landskab (accessed on 3 September 2020).
  9. Bland, J.; Khan, H.; Loder, J.; Westlake, S.; Symons, T. NHS in 2030 a People-Powered and Knowledge-Powered Health System; NESTA: London, UK; Available online: https://www.nesta.org.uk/report/the-nhs-in-2030-a-people-powered-and-knowledge-powered-health-system/ (accessed on 3 September 2020).
  10. Ministry of Health (SUM); Ministry of Finance (FM); Danish Regions (DR); Local Government Denmark (KL). A Coherent and Trustworthy Health Network for All: Digital Health Strategy 2018–2022. Available online: file:///C:/Users/je/AppData/Local/Temp/Digital%20Health%20Strategy%202018_2022.pdf (accessed on 3 September 2020).
  11. U.S. Department of Health and Human Services; Food and Drug Administration (FDA). Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Available online: https://www.fda.gov/media/77832/download (accessed on 3 September 2020).
  12. Tambuyzer, E.; Van Audenhove, C. Is perceived patient involvement in mental health care associated with satisfaction and empowerment? Health Expect. 2015, 18, 516–526. [Google Scholar] [CrossRef] [Green Version]
  13. Topp, C.W.; Østergaard, S.D.; Søndergaard, S.; Bech, P. The WHO-5 Well-Being Index: A Systematic Review of the Literature. Psychother. Psychosom. 2015, 84, 167–176. [Google Scholar] [CrossRef] [PubMed]
  14. Yarlas, A.; Bayliss, M.; Cappelleri, J.C.; Maher, S.; Bushmakin, A.G.; Chen, L.A.; Manuchehri, A.; Healey, P. Psychometric validation of the SF-36 Health Survey in Ulcerative Colitis: Results from a systematic literature review. Qual. Life Res. 2018, 27, 273–290. [Google Scholar] [CrossRef] [PubMed]
  15. Basch, E.; Spertus, J.; Dudley, R.A.; Wu, A.; Chuahan, C.; Cohen, P.; Smith, M.L.; Black, N.; Crawford, A.; Christensen, K.; et al. Methods for Developing Patient-Reported Outcome-Based Performance Measures (PRO-PMs). Value Health 2015, 18, 493–504. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Kane, P.M.; Ellis-Smith, C.; Daveson, B.A.; Ryan, K.; Mahon, N.G.; McAdam, B.; McQuillan, R.; Tracey, C.; Howley, C.; O’Gara, G.; et al. Understanding how a palliative-specific patient-reported outcome intervention works to facilitate patient-centred care in advanced heart failure: A qualitative study. Palliat. Med. 2018, 32, 143–155. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Santana, M.-J.; Feeny, D. Framework to assess the effects of using patient-reported outcome measures in chronic care management. Qual. Life Res. 2014, 23, 1505–1513. [Google Scholar] [CrossRef]
  18. Kaltoft, M.K.; Nielsen, J.B.; Salkeld, G.; Dowie, J. Enhancing healthcare provider feedback and personal health literacy: Dual use of a decision quality measure. In Studies in Health Technology and Informatics; Christian, N., Kuziemsky, C.E., Kushniruk, A.W., Borycki, E.M., Eds.; IOS Press: Amsterdam, The Netherlands, 2015; Volume 218, p. 74. ISBN 09269630. [Google Scholar]
  19. Eriksen, J.; Bygholm, A.; Bertelsen, P. The association between patient-reported outcomes (PROs) and patient participation in clinical practice: A scoping review. Patient Educ. Couns. 2020. (under review). [Google Scholar]
  20. Eriksen, J.; Bertelsen, P.; Bygholm, A. The Digital Transformation of Patient-Reported Outcomes’ (PROs’) Functionality within Healthcare. In Digital Personalized Health and Medicine, Proceedings of the MIE 2020, Medical Informatics Europe 2020, Geneve, Switzerland, 28 April–1 May 2020; Pape-Haugaard, L.P., Lovis, C., Madsen, I.C., Weber, P., Nielsen, P.H., Scott, P., Eds.; Studies in Health Technology and Informatics; IOS Press: Amsterdam, The Netherlands, 2020. [Google Scholar]
  21. Booth, A.; Sutton, A.; Papaioannou, D. Systematic Approaches to a Successful Literature Review, 2nd ed.; Sage: Los Angeles, CA, USA, 2016. [Google Scholar]
  22. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2008, 3, 77–101. [Google Scholar] [CrossRef] [Green Version]
  23. Antunes, B.; Rodrigues, P.P.; Higginson, I.J.; Ferreira, P.L. Outcome measurement—A scoping review of the literature and future developments in palliative care clinical practice. Ann. Palliat. Med. 2018, 8, 196–206. [Google Scholar] [CrossRef]
  24. Howell, D.; Liu, G. Can Routine Collection of Patient Reported Outcome Data Actually Improve Person-Centered Health? In New Models for the New Healthcare—The Case for Routine Patient-Reported Outcome Measurement; Leatt, P., Smith, T., Foster-Kent, D., Harrison, S., Bryant, S., Eds.; Healthcare Papers; Longwoods Publishing: Toronto, ON, Canada, 2012; Volume 11, pp. 42–47. [Google Scholar]
  25. Wang, M.C.; Bellows, J. Quality of Life and Patient-Centered Outcomes. In Chronic Illness Care: Principles and Practice; Daaleman, T.P., Helton, M.R., Eds.; Springer Science+Business Media: New York, NY, USA, 2018; pp. 95–107. ISBN 9783319718118. [Google Scholar]
  26. McHorney, C.A. Health status assessment methods for adults: Past accomplishments and future challenges. Annu. Rev. Public Health 1999, 20, 309–335. [Google Scholar] [CrossRef] [PubMed]
  27. Lipscomb, J.; Gotay, C.C.; Snyder, C.F. Patient-reported outcomes in cancer: A review of recent research and policy initiatives. CA Cancer J. Clin. 2007, 57, 278–300. [Google Scholar] [CrossRef] [PubMed]
  28. McKenna, S.P.; Wilburn, J. Patient value: Its nature, measurement, and role in real world evidence studies and outcomes-based reimbursement. J. Med. Econ. 2018, 21, 474–480. [Google Scholar] [CrossRef]
  29. Donabedian, A. An Introduction to Quality Assurance in Health Care; Oxford University Press Inc.: Oxford, UK, 2003; p. 200. [Google Scholar]
  30. Velikova, G.; Booth, L.; Smith, A.B.; Brown, P.M.; Lynch, P.; Brown, J.M.; Selby, P.J. Measuring quality of life in routine oncology practice improves communication and patient well-being: A randomized controlled trial. J. Clin. Oncol. 2004, 22, 714–724. [Google Scholar] [CrossRef]
  31. Black, N. Patient reported outcome measures could help transform healthcare. BMJ 2013, 346, f167. [Google Scholar] [CrossRef] [Green Version]
  32. Weldring, T.; Smith, S.M.S. Article Commentary: Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv. Insights 2013, 6, 61–68. [Google Scholar] [CrossRef] [PubMed]
  33. McAllister, M.; Dunn, G.; Todd, C. Empowerment: Qualitative underpinning of a new clinical genetics-specific patient-reported outcome. Eur. J. Hum. Genet. 2011, 19, 125–130. [Google Scholar] [CrossRef] [Green Version]
  34. Huebner, J.; Rosé, C.; Geissler, J.; Gleiter, C.H.; Prott, F.J.; Muenstedt, K.; Micke, O.; Muecke, R.; Buentzel, J.; Bottomley, A.; et al. Integrating cancer patients’ perspectives into treatment decisions and treatment evaluation using patient-reported outcomes—A concept paper. Eur. J. Cancer Care 2014, 23, 173–179. [Google Scholar] [CrossRef]
  35. Frost, M.H.; Bonomi, A.E.; Cappelleri, J.C.; Schünemann, H.J.; Moynihan, T.J.; Aaronson, N.K.; Cella, D.; Chassany, O.; Fairclough, D.L.; Ferrans, C.E.; et al. Applying quality-of-life data formally and systematically into clinical practice. Mayo Clin. Proc. 2007, 82, 1214–1228. [Google Scholar] [CrossRef] [Green Version]
  36. Dean, S.; Mathers, J.M.; Calvert, M.; Kyte, D.G.; Conroy, D.; Folkard, A.; Southworth, S.; Murray, P.I.; Denniston, A.K. “The patient is speaking”: Discovering the patient voice in ophthalmology. Br. J. Ophthalmol. 2017, 101, 700–708. [Google Scholar] [CrossRef]
  37. LeBlanc, T.W.; Abernethy, A.P. Patient-reported outcomes in cancer care-hearing the patient voice at greater volume. Nat. Rev. Clin. Oncol. 2017, 14, 763–772. [Google Scholar] [CrossRef]
  38. Marquis, P.; Arnould, B.; Acquadro, C.; Roberts, W.M. Patient-reported outcomes and health-related quality of life in effectiveness studies: Pros and cons. Drug Dev. Res. 2006, 67, 193–201. [Google Scholar] [CrossRef]
  39. Strong, L.E. The past, present, and future of patient-reported outcomes in oncology. Am. Soc. Clin. Oncol. Educ. Book 2015, 35, 616–620. [Google Scholar] [CrossRef] [PubMed]
  40. Bingham, C.O., III; Noonan, V.K.; Auger, C.; Feldman, D.E.; Ahmed, S.; Bartlett, S.J. Montreal Accord on Patient-Reported Outcomes (PROs) use series—Paper 4: Patient-reported outcomes can inform clinical decision making in chronic care. J. Clin. Epidemiol. 2017, 89, 136–141. [Google Scholar] [CrossRef]
  41. Boyce, M.B.; Browne, J.P.; Greenhalgh, J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: A systematic review of qualitative research. BMJ Qual. Saf. 2014, 23, 508–518. [Google Scholar] [CrossRef]
  42. Chang, S.; Newton, P.J.; Inglis, S.; Luckett, T.; Krum, H.; Macdonald, P.; Davidson, P.M. Are all outcomes in chronic heart failure rated equally? An argument for a patient-centred approach to outcome assessment. Heart Fail. Rev. 2014, 19, 153–162. [Google Scholar] [CrossRef] [PubMed]
  43. Ishaque, S.; Karnon, J.; Chen, G.; Nair, R.; Salter, A.B. A systematic review of randomised controlled trials evaluating the use of patient-reported outcome measures (PROMs). Qual. Life Res. 2018, 28, 567–592. [Google Scholar] [CrossRef]
  44. Lewis, S. Realizing the PROMise of PROMs. In New Models for the New Healthcare—The Case for Routine Patient-Reported Outcome Measurement; Healthcare Papers; Leatt, P., Smith, T., Foster-Kent, D., Harrison, S., Bryant, S., Eds.; Longwoods Publishing: Toronto, ON, Canada, 2012; Volume 11, pp. 20–23. [Google Scholar]
  45. Wiering, B.; de Boer, D.; Delnoij, D. Asking what matters: The relevance and use of patient-reported outcome measures that were developed without patient involvement. Wiley 2017, 20, 1330–1341. [Google Scholar] [CrossRef] [Green Version]
  46. Hostetter, M.; Klein, S. Using Patient-Reported Outcomes to Improve Health Care Quality. Available online: https://www.commonwealthfund.org/publications/newsletter-article/using-patient-reported-outcomes-improve-health-care-quality (accessed on 3 September 2020).
  47. Nelson, E.C.; Hvitfeldt, H.; Reid, R.; Grossman, D.; Lindblad, S.; Mastanduno, M.P. Using Patient-Reported Information to Improve Health Outcomes and Health Care Value: Case Studies from Dartmouth, Karolinska and Group Health; The Dartmouth Institute for Health Policy and Clinical Practice and Centre for Population Health: Darmount, NS, Canada, 2012; pp. 1–54. [Google Scholar]
  48. Porter, M.E. What is value in health care? N. Engl. J. Med. 2010, 363, 2477–2481. [Google Scholar] [CrossRef]
  49. Mejdahl, C.T.; Schougaard, L.M.V.; Hjollund, N.H.; Riiskjær, E.; Thorne, S.; Lomborg, K. PRO-based follow-up as a means of self-management support—An interpretive description of the patient perspective. JPRO 2018, 2, 38. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Zimlichman, E. Using patient-reported outcomes to drive patientcentered care. In Information Technology for Patient Empowerment in Healthcare; Grando, M.A., Rozenblum, R., Bates, D.W., Eds.; Walter de Gruyter GmbH: Berlin, Germany, 2015; pp. 241–256. ISBN 9781614514343. [Google Scholar]
  51. Ayers, D.C. Implementation of patient-reported outcome measures in total knee arthroplasty. J. Am. Acad. Orthop. Surg. 2017, 25, S48–S50. [Google Scholar] [CrossRef]
  52. Rademakers, J.; Delnoij, D.; De Boer, D. Structure, process or outcome: Which contributes most to patients’ overall assessment of healthcare quality? BMJ Qual. Saf. 2011, 20, 326–331. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. National Quality Forum (NQF). Patient Reported Outcomes (PROs) in Performance Measurement. Available online: https://www.qualityforum.org/Patient-Reported_Outcomes.aspx (accessed on 3 September 2020).
  54. Schwartz, C.E.; Sprangers, M.A.G. An introduction to quality of life asssessment in oncology: The value of measuring patient-reported outcomes. Am. J. Manag. Care 2002, 8, S550–S559. [Google Scholar] [PubMed]
  55. Hjollund, N.H.I. Fifteen years’ use of patient-reported outcome measures at the group and patient levels: Trend analysis. J. Med. Internet Res. 2019, 21, e15856. [Google Scholar] [CrossRef]
  56. Talib, T.L.; DeChant, P.; Kean, J.; Monahan, P.O.; Haggstrom, D.A.; Stout, M.E.; Kroenke, K. A qualitative study of patients’ perceptions of the utility of patient-reported outcome measures of symptoms in primary care clinics. Qual. Life Res. 2018, 27, 3157–3166. [Google Scholar] [CrossRef]
  57. Jayadevappa, R.; Chhatre, S. Patient centered care—A conceptual model and review of the state of the art. Open Health Serv. Policy J. 2011, 4, 15–25. [Google Scholar] [CrossRef] [Green Version]
  58. du Plessis, D.; Sake, J.-K.; Halling, K.; Morgan, J.; Georgieva, A.; Bertelsen, N. Patient Centricity and Pharmaceutical Companies: Is It Feasible? Ther. Innov. Regul. Sci. 2017, 51, 460–467. [Google Scholar] [CrossRef]
  59. Cook, D.J.; Manning, D.M.; Holland, D.E.; Prinsen, S.K.; Rudzik, S.D.; Roger, V.L.; Deschamps, C. Patient engagement and reported outcomes in surgical recovery: Effectiveness of an e-health platform. J. Am. Coll. Surg. 2013, 217, 648–655. [Google Scholar] [CrossRef]
  60. Fagerlind, H.; Ring, L.; Brülde, B.; Feltelius, N.; Lindblad, A.K. Patients’ understanding of the concepts of health and quality of life. Patient Educ. Couns. 2010, 78, 104–110. [Google Scholar] [CrossRef]
  61. Sartorius, N. Patient-reported outcomes in psychiatry. Dialogues Clin. Neurosci. 2014, 16, 123–124. [Google Scholar]
  62. Lavallee, D.C.; Chenok, K.E.; Love, R.M.; Petersen, C.; Holve, E.; Segal, C.D.; Franklin, P.D. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Aff. 2016, 35, 575–582. [Google Scholar] [CrossRef] [PubMed]
  63. Trillingsgaard, C.; Nielsen, B.K.; Hjøllund, N.H.; Lomborg, K. Use of patient-reported outcomes in outpatient settings as a means of patient involvement and self-management support—A qualitative study of the patient perspective. Eur. J. Pers. Cent. Healthc. 2016, 4, 359–367. [Google Scholar] [CrossRef]
  64. Marshall, S.; Haywood, K.; Fitzpatrick, R. Impact of patient-reported outcome measures on routine practice: A structured review. J. Eval. Clin. Pract. 2006, 12, 559–568. [Google Scholar] [CrossRef] [PubMed]
  65. Noonan, V.K.; Lyddiatt, A.; Ware, P.; Jaglal, S.B.; Riopelle, R.J.; Bingham, C.O., III; Figueiredo, S.; Sawatzky, R.; Santana, M.; Bartlett, S.J.; et al. Montreal Accord on Patient-Reported Outcomes (PROs) use series—Paper 3: Patient-reported outcomes can facilitate shared decision-making and guide self-management. J. Clin. Epidemiol. 2017, 89, 125–135. [Google Scholar] [CrossRef]
  66. Chen, J.; Ou, L.; Hollis, S.J. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv. Res. 2013, 13, 211. [Google Scholar] [CrossRef] [Green Version]
  67. Greenhalgh, J. The applications of PROs in clinical practice: What are they, do they work, and why? Qual. Life Res. 2009, 18, 115–123. [Google Scholar] [CrossRef] [PubMed]
  68. Liu, T.C.; Ohueri, C.W.; Schryver, E.; Bozic, K.J.; Koenig, K.M. Patient-identified Barriers and Facilitators to Pre-Visit Patient-Reported Outcomes Measures Completion in Patients with Hip and Knee Pain. J. Arthroplast. 2018, 33, 643–649.e1. [Google Scholar] [CrossRef]
  69. Fleischmann, M.; Vaughan, B. The challenges and opportunities of using patient reported outcome measures (PROMs) in clinical practice. Int. J. Osteopath. Med. 2018, 28, 56–61. [Google Scholar] [CrossRef]
  70. Schougaard, L.M.V.; Mejdahl, C.T.; Petersen, K.H.; Jessen, A.; De Thurah, A.; Sidenius, P.; Lomborg, K.; Hjollund, N.H. Effect of patient-initiated versus fixed-interval telePRO-based outpatient follow-up: Study protocol for a pragmatic randomised controlled study. BMC Health Serv. Res. 2017, 17, 83. [Google Scholar] [CrossRef] [Green Version]
  71. Cummings, G. The road to improving patient-reported outcomes: Measures or healthcare reform? In New Models for the New Healthcare—The Case for Routine Patient-Reported Outcome Measurement; Healthcare Papers; Leatt, P., Smith, T., Foster-Kent, D., Harrison, S., Bryant, S., Eds.; Longwoods Publishing: Toronto, ON, Canada, 2012; Volume 11, pp. 24–28. [Google Scholar] [CrossRef]
  72. Meadows, K.A. Patient-reported outcome measures: An overview. Br. J. Community Nurs. 2011, 16, 146–151. [Google Scholar] [CrossRef] [Green Version]
  73. Gensheimer, S.G.; Wu, A.W.; Snyder, C.F.; Basch, E.; Gerson, J.; Holve, E.; Hunt, D.R.; Smider, N.; Snyder, C.; Stiefel, M.; et al. Oh, the Places We’ll Go: Patient-Reported Outcomes and Electronic Health Record. Patient 2018, 11, 591–598. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. Mejdahl, C.T.; Schougaard, L.M.V.; Hjollund, N.H.; Riiskjær, E.; Lomborg, K. Exploring organisational mechanisms in PRO-based follow-up in routine outpatient care—An interpretive description of the clinician perspective. BMC Health Serv. Res. 2018, 18. [Google Scholar] [CrossRef] [PubMed]
  75. Prodinger, B.; Taylor, P. Improving quality of care through patient-reported outcome measures (PROMs): Expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples. BMC Health Serv. Res. 2018, 18, 87. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Rose, M.; Bezjak, A. Logistics of collecting patient-reported outcomes (PROs) in clinical practice: An overview and practical examples. Qual. Life Res. 2009, 18, 125–136. [Google Scholar] [CrossRef]
  77. Basch, E.; Iasonos, A.; Barz, A.; Culkin, A.; Kris, M.G.; Artz, D.; Fearn, P.; Speakman, J.; Farquhar, R.; Scher, H.I.; et al. Long-term toxicity monitoring via electronic patient-reported outcomes in patients receiving chemotherapy. J. Clin. Oncol. 2007, 25, 5374–5380. [Google Scholar] [CrossRef]
  78. Palfreyman, S. Patient-reported outcome measures and how they are used. Nurs. Older People 2011, 23, 31–36. [Google Scholar] [CrossRef]
  79. Cannella, L.; Efficace, F.; Giesinger, J. How should we assess patient-reported outcomes in the onco-hematology clinic? Curr. Opin. Support. Palliat. Care 2018, 12, 522–529. [Google Scholar] [CrossRef]
  80. Kelkar, A.A.; Spertus, J.; Pang, P.; Pierson, R.F.; Cody, R.J.; Pina, I.L.; Hernandez, A.; Butler, J. Utility of Patient-Reported Outcome Instruments in Heart Failure. JACC: Heart Fail. 2016, 4, 165–175. [Google Scholar] [CrossRef]
  81. Howell, D.; Molloy, S.; Wilkinson, K.; Green, E.; Orchard, K.; Wang, K.; Liberty, J. Patient-reported outcomes in routine cancer clinical practice: A scoping review of use, impact on health outcomes, and implementation factors. Ann. Oncol. 2015, 26, 1846–1858. [Google Scholar] [CrossRef]
  82. Schougaard, L.M.V.; Larsen, L.P.; Jessen, A.; Sidenius, P.; Dorflinger, L.; de Thurah, A.; Hjollund, N.H. AmbuFlex: Tele-patient-reported outcomes (telePRO) as the basis for follow-up in chronic and malignant diseases. Qual. Life Res. 2016, 25, 525–534. [Google Scholar] [CrossRef] [Green Version]
  83. Stover, A.; Irwin, D.E.; Chen, R.C.; Chera, B.S.; Mayer, D.K.; Muss, H.B.; Rosenstein, D.L.; Shea, T.C.; Wood, W.A.; Lyons, J.C.; et al. Integrating Patient-Reported Outcome Measures into Routine Cancer Care: Cancer Patients’ and Clinicians’ Perceptions of Acceptability and Value. eGEMS 2015, 3, 1169. [Google Scholar] [CrossRef] [PubMed]
  84. Engelhard, M.M.; Patek, S.D.; Sheridan, K.; Lach, J.C.; Goldman, M.D. Remotely engaged: Lessons from remote monitoring in multiple sclerosis. Int. J. Med. Inform. 2017, 100, 26–31. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  85. Chang, C.-H. Patient-reported outcomes measurement and management with innovative methodologies and technologies. Qual. Life Res. 2007, 16, 157–166. [Google Scholar] [CrossRef]
  86. Tevis, S.E.; James, T.A.; Kuerer, H.M.; Pusic, A.L.; Yao, K.A.; Merlino, J.; Dietz, J. Patient-reported outcomes for breast cancer. Ann. Surg. Oncol. 2018, 25, 2839–2845. [Google Scholar] [CrossRef]
  87. Appleby, J.; Devlin, N.; Parkin, D. Using Patient Reported Outcomes to Improve Health Care; John Wiley & Sons, Incorporated: Hoboken, NJ, USA, 2016; pp. 1–120. [Google Scholar]
  88. Brundage, M.D.; Smith, K.C.; Little, E.A.; Bantug, E.T.; Snyder, C.F. The PRO Data Presentation Stakeholder Advisory Board. Communicating patient-reported outcome scores using graphic formats: Results from a mixed-methods evaluation. Qual. Life Res. 2015, 24, 2457–2472. [Google Scholar] [CrossRef] [Green Version]
  89. Greenhalgh, J.; Abhyankar, P.; McCluskey, S.; Takeuchi, E.; Velikova, G. How do doctors refer to patient-reported outcome measures (PROMS) in oncology consultations? Qual. Life Res. 2013, 22, 939–950. [Google Scholar] [CrossRef]
  90. Snyder, C.; Smith, K.; Holzner, B.; Rivera, Y.M.; Bantug, E.; Brundage, M.; PRO Data Presentation Delphi Panel. Making a picture worth a thousand numbers: Recommendations for graphically displaying patient-reported outcomes data. Qual. Life Res. 2019, 28, 345–356. [Google Scholar] [CrossRef]
  91. Adams, J.; Chapman, J.; Bradley, S.; Ryan, S.J. Literacy levels required to complete routinely used patient reported outcome measures in rheumatology. Rheumatology 2013, 52, 460–464. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Identified purposes of Patient-Reported Outcome (PRO).
Figure 1. Identified purposes of Patient-Reported Outcome (PRO).
Applsci 10 07507 g001
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Eriksen, J.; Bygholm, A.; Bertelsen, P. The Purpose of Patient-Reported Outcome (PRO) Post Its Digitalization and Integration into Clinical Practice: An Interdisciplinary Redefinition Resembling PROs Theoretical and Practical Evolvement. Appl. Sci. 2020, 10, 7507. https://doi.org/10.3390/app10217507

AMA Style

Eriksen J, Bygholm A, Bertelsen P. The Purpose of Patient-Reported Outcome (PRO) Post Its Digitalization and Integration into Clinical Practice: An Interdisciplinary Redefinition Resembling PROs Theoretical and Practical Evolvement. Applied Sciences. 2020; 10(21):7507. https://doi.org/10.3390/app10217507

Chicago/Turabian Style

Eriksen, Jeppe, Ann Bygholm, and Pernille Bertelsen. 2020. "The Purpose of Patient-Reported Outcome (PRO) Post Its Digitalization and Integration into Clinical Practice: An Interdisciplinary Redefinition Resembling PROs Theoretical and Practical Evolvement" Applied Sciences 10, no. 21: 7507. https://doi.org/10.3390/app10217507

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop