Next Article in Journal
The Australian Feeding Infants and Toddler Study (OzFITS 2021): Breastfeeding and Early Feeding Practices
Previous Article in Journal
Extreme Birth Weight and Metabolic Syndrome in Children
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Testing the Accuracy of a Bedside Screening Tool Framework to Clinical Records for Identification of Patients at Risk of Malnutrition in a Rural Setting: An Exploratory Study

1
The Global Obesity Centre, Institute for Health Transformation, Deakin University, Geelong, VIC 3220, Australia
2
Research Unit, Colac Area Health, Colac, VIC 3250, Australia
3
Deakin Rural Health, School of Medicine Faculty of Health, Deakin University, Geelong, VIC 3220, Australia
4
School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW 2006, Australia
5
Engagement and Co-Design Hub, The University of Sydney, Camperdown, NSW 2006, Australia
6
Prevention Research Collaboration, Charles Perkins Centre, Sydney School Public Health, The University of Sydney, Sydney, NSW 2006, Australia
7
Institute for Physical Activity and Nutrition, Deakin University, Geelong, VIC 3220, Australia
8
Biostatistics Unit, Faculty of Health, Deakin University, Geelong, VIC 3220, Australia
*
Author to whom correspondence should be addressed.
Nutrients 2022, 14(1), 205; https://doi.org/10.3390/nu14010205
Submission received: 13 December 2021 / Revised: 30 December 2021 / Accepted: 31 December 2021 / Published: 2 January 2022
(This article belongs to the Section Clinical Nutrition)

Abstract

:
This study aimed to explore the diagnostic accuracy of the Patient-Generated Subjective Global Assessment (PG-SGA) malnutrition risk screening tool when used to score patients based on their electronic medical records (EMR), compared to bedside screening interviews. In-patients at a rural health service were screened at the bedside (n = 50) using the PG-SGA, generating a bedside score. Clinical notes within EMRs were then independently screened by blinded researchers. The accuracy of the EMR score was assessed against the bedside score using area under the receiver operating curve (AUC), sensitivity, and specificity. Participants were 62% female and 32% had conditions associated with malnutrition, with a mean age of 70.6 years (SD 14.9). The EMR score had moderate diagnostic accuracy relative to PG-SGA bedside screen, AUC 0.74 (95% CI: 0.59–0.89). The accuracy, specificity and sensitivity of the EMR score was highest for patients with a score of 7, indicating EMR screen is more likely to detect patients at risk of malnutrition. This exploratory study showed that applying the PG-SGA screening tool to EMRs had enough sensitivity and specificity for identifying patients at risk of malnutrition to warrant further exploration in low-resource settings.

1. Introduction

Malnutrition has been estimated to affect 20–60% of in-patients on acute hospital wards globally [1,2,3,4,5,6,7,8]. Screening for malnutrition is the first and critical step in identifying and treating patients who are at risk, as it often presents as an ‘invisible’ condition, affecting patients across the spectrum of weight status [9].
There are multiple validated tools to identify malnutrition risk at the patient’s bedside [5,9,10,11]. Existing tools are designed to be used and completed by healthcare staff who do not have nutrition-specific training to identify patients who are at risk and require further dietetic assessment, but uptake is not always optimal [3,9]. Low uptake of malnutrition screening has been hypothesized to be due to the already large administrative burden on nursing or other staff who are expected to undertake malnutrition screening on admission [2,3,12].
Electronic medical records (EMRs) are steadily replacing paper-based medical records in developed countries [13]. Since the 1990s, technology has rapidly advanced and become cheaper and therefore EMRs have been more widely integrated into hospitals [13]. Algorithms within EMRs have been used to flag issues to clinical staff (such as patient drug allergies), reducing errors and enhancing physician compliance with allergy prevention protocols [14]. Despite the potential for EMRs to improve care, there has been minimal research on how EMRs can be used to improve care in other fields, such as allied health [14], particularly for malnutrition.
Previous malnutrition risk screening research has utilised clinical dietitians to undertake paper-based record audits to extract data and make clinical judgements on the level of nutrition risk within an in-patient population [3,12,15,16]. Alston et al. in 2020, published the first study applying the Patient-Generated Subjective Global Assessment (PG-SGA) to EMRs as a screening framework to estimate the proportion of in-patients at risk of malnutrition in a rural setting [17]. EMR data is collected by a range of health professionals (including dietitians) during the hospital patient’s admission. These records were retrospectively screened to assign a malnutrition risk score, guided by the PG-SGA. The study found that most in-patients (77%) had indicators of malnutrition risk in their EMRs, a prevalence that could not be adequately addressed with the current level of dietetics resourcing available in rural settings [17].
In Australia, rural populations experience poorer health relative to metropolitan counterparts [18,19,20] with a lack of dietary interventions documented in these rural areas [21]. Malnutrition has been shown to follow a similar pattern to other health inequities, with a substantially higher risk documented in rural settings [17]. This is of particular concern due to the long-term healthcare workforce deficiencies in rural areas, even in developed countries such as Australia and Canada [16,17,22]. Given the higher risk in these rural areas, and poor uptake of malnutrition screening globally; more effective, less onerous, and potentially automated ways of screening patients for malnutrition need to be investigated.
The PG-SGA, a validated malnutrition screening tool which guides the triage of nutrition intervention, when used as a bed-side screening tool, it has been validated and shown to have high reliability [23]. It can also be used by health professionals other than dietitians to prioritise referrals for specialised review [23]. However, the accuracy of traditional bed-side tools, such as the PG-SGA, when used to guide review of the text in EMRs has not been investigated.
The aim of this exploratory study is to investigate the accuracy of a malnutrition risk score obtained by applying the PG-SGA screening instrument to the clinical text in EMRs, relative to the PG-SGA instrument applied at the bedside, in identifying rural in-patients at an increased risk of malnutrition.

2. Materials and Methods

2.1. Study Design

Ethics approval was granted by the Deakin University ethics committee and a letter of confirmation was received from the Barwon Health ethics committee. This pilot exploratory study was undertaken among in-patients on the acute admissions ward, at a rural hospital in Victoria, Australia. Over a 12-week period, a sample of eligible patients were screened for malnutrition risk at the bedside by a member of the research team, following standard protocols for the PG-SGA [23]. Eligible patients were identified from in-patient admissions lists. Patients were eligible if they were on day 2 or more of admission (to enable adequate detail in medical notes), over the age of 18 years, able to give informed consent and not pregnant or breastfeeding. Exclusion criteria included those who were pregnant/breastfeeding, paediatric patients (<18 years) or those who were deemed ineligible to provide consent by the patients’ medical team. The same patients’ EMRs were then independently screened by other members of the research team (who were blinded to the bed-side screen score), retrospectively, using the PG-SGA.
The PG-SGA malnutrition screening tool used in this study [24], is typically used at the bedside to identify whether or not patients are at risk of malnutrition and in need of assessment by a clinical dietitian [23]. The tool includes items regarding level of oral intake, recent weight loss, age, conditions, fever, steroid medications, nutrition impact symptoms (poor appetite, nausea, constipation, mouth sores, no taste/poor taste, swallowing difficulties, pain, vomiting, diarrhea, dry mouth, sensitivity to smells and early satiety), and level of activities and function [23]. The information collected is summarised in a score with range 0–36; and values >4 are considered ‘at risk’ of malnutrition indicating a need or high need for dietetic assessment to address malnutrition (>9 indicates a ‘critical need’) [24]. The PG-SGA was used to interview patients at the bedside following standardised protocols [23]. The researchers selected the PG-SGA tool to explore in this study due to the large amount of data the tool requires which allowed for scoring in the EMR. This was chosen over shorter screening tools, to allow for sufficient data collection from the electronic medical record and because it is already used in the setting the study was conducted in. The bed-side score was considered as the ‘gold standard’ for diagnosing ‘risk’ in this study, when compared with the EMR tool score. There are many other tools used for screening malnutrition risk that are also considered as highly valid, including the Malnutrition Screening Tool (MST) and Subjective Global Assessment (SGA) screening tool [3,9]. The PG-SGA guidelines suggest the level of need for further assessment according to scoring ranges: a score of 0–1 indicates that there’s ‘no nutrition intervention required at this time’, a score of 2–3 indicates that the ‘patient education potentially needed but no nutrition intervention’, while a score of 4–8, ‘requires intervention by dietitian to assess malnutrition in conjunction with nurse/physician as indicated by scored symptoms’, a score of >9 indicates a critical need [23]. Documentation in the EMR is both a combination of information verified with the patient, and information entered as a result of observation by health professionals, whereas the bed-side score is based only on the discussion with the patient.
The researchers scoring the EMR only considered that an item was “present” if EMR text indicated the patient had relevant symptoms with 100% certainty. No assumptions were made for symptoms that were not clearly described in the clinical notes (i.e., no documentation on loss of appetite meant this symptom was assumed not to be present, therefore no point was assigned under this criteria). A 10% sample of the EMR scores were cross-checked by a third researcher (LA) with 100% agreement. Demographic information as collected at admission was recorded, including sex, age (in years) and whether the patient lived in the larger rural township or smaller surrounding rural communities. Length of stay (LoS) in days was also collected.

2.2. Analysis

The sample size was determined pragmatically within the resource limitations of this exploratory pilot study. Statistical analysis was performed with Stata SE Version 15 (StataCorp LLC, College Station, TX, USA) [25]. The accuracy of the EMR score compared to the bedside score was assessed through area under the receiver operating characteristic (ROC, AUC), and sensitivity and specificity defined based on the cut-off recommended for the PG-SGA (score > 4) [24]. Estimates are presented along their 95% confidence intervals (CI). The optimal cut-off score based on the ROC was selected as the one with the largest Youden index (YI); i.e., the cut-off that maximises (sensitivity + specificity − 1) [26].

3. Results

Fifty in-patients that met the eligibility criteria were recruited in a rural hospital setting over a 12-week period (25% of eligible admissions in this service during the study timeframe). Table 1 shows the demographic and clinical characteristics of the sample. The mean age of the participants was 70.6 years (Standard Deviation (SD):14.9) and 62% were female. According to the EMR documentation, 32% of participants had one or more of the health conditions considered to increase malnutrition risk by the PG-SGA, along with 28% reporting loss of appetite during their admission. The mean bedside score was 8.0 (range 1–29) and the mean EMR score was 7.9 (0–22). Nearly three-in-four participants (74%) were rated at risk of malnutrition and needing further assessment by a dietitian (score ≥ 4) by the bedside screen and 80% were rated as at risk by the EMR score.
The EMR score showed a moderate accuracy compared to the usual bedside scoring method; indicated by an Area Under the Curve (AUC) of 0.74 (95% CI: 0.59–0.89; Figure 1).
Table 2 shows the sensitivity and specificity of the EMR score compared to the bed-side screen at different cut points. The sensitivity of the EMR score based on the cut-off proposed by the PG-SGA for the bedside score (>4) was 86.5% while the specificity was 38.5%. The Youden Index was maximized at cut point 7 with a sensitivity of 67.6 and a specificity of 76.9% and 70% of the patients correctly classified.

4. Discussion

This exploratory study aimed to understand whether the PG-SGA malnutrition screening tool when applied to EMRs, can accurately identify patients at risk of malnutrition, compared to screening methods at the patient bedside. This tool was chosen by the research team due to the the high scoring range which enabled enough data to be collected from the EMR to assess accuracy. As this study is one of the first to explore the accuracy of a bed-side tool when applied to the EMR, we acknowledge that research into other tools is also needed. This analysis showed that screening of clinical notes in the EMR had a good sensitivity and specificity for patients who are at risk of malnutrition. This suggests that EMR screening may be a promising approach for resource limited settings, where uptake of mandatory screening is low and where it is essential at risk patients are identified, prioritised, and assessed by a clinical dietitian. Our sample, commensurate with the rural hospital where the study was conducted, was 25% of all admissions over the timeframe, generating a representative sample in this context. For example, in data from all annual admissions, from the same setting, we identified a similar rate of patients at risk of malnutrition being 80% in this sample, compared to 77% in the larger sample from more than 500 admissions [17]. The large sample was also 60.2% female, with a mean age of 70.6 years, which is similar to the population presented in this study [17]. Our sample was also 70.6 years on average, with a LoS of 5 days. Our findings showed that the EMR screen was more likely to pick up patients at risk of malnutrition, which is ideal in the clinical setting. For example, for patients scoring 7 or higher, the EMR screen would detect 70% of patients at high risk with relatively high sensitivity and specificity. Although imperfect, studies in larger samples may provide more clarity on the accuracy of the tool and how patients scoring above 7 may be better identified. This is the first study to investigate the accuracy of traditional bed-side malnutrition screening when applied to EMRs, globally. There are large gaps in this area of research, likely due to the rapid and increasing change in the adoption of technology, especially in healthcare settings in developed countries such as Australia.
Health systems are increasingly transitioning to electronic record keeping due to the opportunities for technology to improve the care and coordination of patients, especially those with chronic and complex conditions [27]. This is despite the recognition that medical staff are frustrated by the level of administrative burden that electronic systems create, and the perspective that more time is spent entering data, than on patient interactions [28]. An explorative study published in 2021 showed that including a screening tool in-patient’s EMRs, with a prompt for nurses to complete it on admission, led to improved compliance to screening policy and referrals to dietitians [29]. Despite there being only minimal exploration of the use of EMRs in dietetic care, the more onerous method of paper-based medical record screening has been used previously in research to understand malnutrition risk [12].
The use of EMRs has previously been shown to improve dietetic care [30]. For example, an assessment of the impact on EMRs on dietetic service provision found that the proportion of nutrition diagnoses addressed and resolved during admission increased from 20.0% to 34.0% following EMR implementation, which is likely due to clearer documentation in comparison to previously handwritten notes [30]. Our study also offers further scope for exploration on how dietetics services can be improved through exploring potential uses of EMRs. As an example, automated text screening of EMRs, underpinned by validated tools (as shown here), could also enhance this process by flagging patients at risk of malnutrition, not only to hospital staff but their GP or private dietitian to enhance the continuum of care. Importantly, our study shows that there may also be potential problems with the use of EMRs to automatically screen in-patients. For example, there were a few ‘false’ positives in our sample, where patients were identified by the EMR score to be at risk, but the bed-side screen indicated that they were not at increased risk. This could potentially lead to inappropriate use of resources, and dietitians would still need to use clinical judgement when first approaching the patients to determine if a full nutrition assessment and treatment plan is needed. This could also be due to the difference between patient perceptions (that inform the bed-side score) versus the clinical documentation (which is based on both the patient’s report and health professional observations). It may be that patients answered questions at the bedside in a manner that meant they scored lower, whereas the clinical notes, documented by multiple different health professionals, may have provided more information leading to the EMR score. Other tools, that enable enough data collection from the EMR to generate a score, should also be explored to understand the applicability of other tools in this context.
The translation of clinical data to clinician knowledge to improve care is one of the current gaps of the transition to EMRs, and across the settings where an individual may receive care over any given time-frame [14]. For example, our study has shown that screening of EMRs has moderate sensitivity for picking up patients with higher scores, which would be useful in the clinical setting. Further research could seek to understand how simple programs that use auto-mated text recognition, could be used to automatically screen notes, scoring based on the PG-SGA and generate automated referrals to dietitians. This would reduce administrative burden on staff who would normally undertake the screening and ensure each patient receives a mandatory screen.

5. Strengths and Limitations

A strength of this study is that one trained researcher undertook the bed-side screening therefore ensuring diagnostic consistency and avoiding suspicion bias possibly caused by different interviewers, noted in other similar studies comparing specificity and sensitivity and clinical tools [26]. A limitation of this study is that it was undertaken in a small sample, although representative of the eligible population within the rural context. In further studies, different indexes of agreement could also be applied. A further limitation is that the ‘reason for admission’ and diagnosis were not entered in a standardised format into the EMRs by clinical staff in this setting, meaning this data was of poor quality and unable to be collected. We also did not compare documentation at the symptom level, between the EMR and the bedside, due to small numbers (e.g., only 1 patients had mouth sores documented in their file) A further limitation is that we did not measure and compare time taken to apply the bedside screen, versus the EMR screen, and this should be a focus in further research, although it can be assumed that collecting information from typed clinical notes that are entered into templates is quicker to collect than hand-written paper-based entries. It is highly likely that this process may have saved time as the researchers were able to screen EMRs at the desk, instead of travelling to the ward and discussing the screening questions with the patients, but the magnitude of this was not explored here. Further, patient weight and potentially other symptoms, were also frequently not documented in this sample, which meant that scoring of the EMR may have been under-estimated.

6. Conclusions

This exploratory study shows that applying the PG-SGA screening tool to the text in EMRs has moderate sensitivity and specificity for identifying patients at a risk of malnutrition. This provides evidence that the EMR screen has moderate accuracy in identifying patients at risk of malnutrition and that there is justification for further exploration into EMR screening to assist with identifying and triaging patients for dietetics referrals especially in rural settings where resources may be limited. This also warrants further exploration into how applying traditional bed-side screening tools perhaps through technology, to an EMR, could enable faster identification of high-risk patients. This could be an important strategy to address the low uptake of mandatory screening in hospitals, in Australia and around the world.

Author Contributions

Conceptualization L.A., M.G., M.N., L.O., V.L.V., S.A., K.A.B., A.B. and M.F.; methodology, L.O., S.R.P., M.N., L.A.; formal analysis, L.A., L.O., M.N., V.L.V.; investigation, L.A., S.R.P., M.F., A.B.; data curation, A.L. and A.J.L.; writing—original draft preparation, L.A., L.O., S.R.P. and A.B.; writing—review and editing, all authors. All authors have read and agreed to the published version of the manuscript.

Funding

This project was funded by Western Alliance Grants in aid research funding, grant number: WA-837181. L.A. is in in receipt of a Heart Foundation Postdoctoral Fellowship (102530) and the NHMRC Centre of Research Excellence in Food Retail Environments for Health (RE-FRESH APP1152968) along with L.O. and S.A. S.R.P. in in receipt of a National Health and Medical Research Council Australian Public Health and Health Services Early Career Fellowship and Heart Foundation Postdoctoral Fellowship (APP1157438). M.N. is funded by an Australian National Health and Medical Research Council (NHMRC) Ideas grant (GNT2002234).

Institutional Review Board Statement

Ethics was obtained from the Deakin University Human Research ethics committee and a letter of confirmation was received from the Barwon Health ethics committee (2019-058) and was conducted in accordance with the National Statement on Ethical Conduct in Human Research.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

We do not have ethics approval to share the data from this study.

Acknowledgments

The authors with to acknowledge the support from health information staff and the leadership of Colac Area Health for their support with this study.

Conflicts of Interest

There are no conflicts of interest to declare.

References

  1. Cederholm, T.; Bosaeus, I.; Barazzoni, R.; Bauer, J.; Van Gossum, A.; Klek, S.; Muscaritoli, M.; Nyulasi, I.; Ockenga, J.; Schneider, S.; et al. Diagnostic criteria for malnutrition—An ESPEN Consensus Statement. Clin. Nutr. 2015, 34, 335–340. [Google Scholar] [CrossRef] [PubMed]
  2. Geiker, N.R.W.; Larsen, S.M.H.; Stender, S.; Astrup, A. Poor performance of mandatory nutritional screening of in-hospital patients. Clin. Nutr. 2012, 31, 862–867. [Google Scholar] [CrossRef]
  3. Khalatbari-Soltani, S.; Marques-Vidal, P. Impact of nutritional risk screening in hospitalized patients on management, outcome and costs: A retrospective study. Clin. Nutr. 2016, 35, 1340–1346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Agarwal, E.; Ferguson, M.; Banks, M.; Batterham, M.; Bauer, J.; Capra, S.; Isenring, E. Malnutrition and poor food intake are associated with prolonged hospital stay, frequent readmissions, and greater in-hospital mortality: Results from the Nutrition Care Day Survey 2010. Clin. Nutr. 2013, 32, 737–745. [Google Scholar] [CrossRef] [Green Version]
  5. Barker, L.A.; Gout, B.S.; Crowe, T.C. Hospital Malnutrition: Prevalence, Identification and Impact on Patients and the Healthcare System. Int. J. Environ. Res. Public Health 2011, 8, 514–527. [Google Scholar] [CrossRef] [Green Version]
  6. Marco, J.; Barba, R.; Zapatero, A.; Matía, P.; Plaza, S.; Losa, J.E.; Canora, J.; De Casasola, G.G. Prevalence of the notification of malnutrition in the departments of internal medicine and its prognostic implications. Clin. Nutr. 2011, 30, 450–454. [Google Scholar] [CrossRef]
  7. Tappenden, K.A.; Quatrara, B.; Parkhurst, M.L.; Malone, A.M.; Fanjiang, G.; Ziegler, T.R. Critical role of nutrition in improving quality of care: An interdisciplinary call to action to address adult hospital malnutri-tion. J. Parenter. Enter. Nutr. 2013, 37, 482–497. [Google Scholar] [CrossRef]
  8. Bell, J.J.; Young, A.; Hill, J.; Banks, M.; Comans, T.; Barnes, R.; Keller, H.H. Rationale and developmental methodology for the SIMPLE approach: A Systematised, Interdisciplinary Malnutrition Pathway for impLementation and Evaluation in hospitals. Nutr. Diet. 2018, 75, 226–234. [Google Scholar] [CrossRef]
  9. Cederholm, T.; Jensen, G.L.; Correia, M.I.T.D.; Gonzalez, M.C.; Fukushima, R.; Higashiguchi, T.; Baptista, G.; Barazzoni, R.; Blaauw, R.; Coats, A.J.; et al. GLIM criteria for the diagnosis of malnutrition—A consensus report from the global clinical nutrition community. Clin. Nutr. 2019, 10, 207–217. [Google Scholar] [CrossRef] [Green Version]
  10. Elia, M.; Zellipour, L.; Stratton, R. To screen or not to screen for adult malnutrition? Clin. Nutr. 2005, 24, 867–884. [Google Scholar] [CrossRef] [PubMed]
  11. Bauer, J.; Capra, S.; Ferguson, M. Use of the scored Patient-Generated Subjective Global Assessment (PG-SGA) as a nutrition assessment tool in patients with cancer. Eur. J. Clin. Nutr. 2002, 56, 779–785. [Google Scholar] [CrossRef] [PubMed]
  12. Bohringer, E.; Brown, L. Nutrition Screening and Referrals in Two Rural Australian Oncology Clinics. Food Nutr. Sci. 2016, 7, 1070–1081. [Google Scholar] [CrossRef] [Green Version]
  13. Evans, R.S. Electronic Health Records: Then, Now, and in the Future. Yearb. Med. Inform. 2016, 25, S48–S61. [Google Scholar] [CrossRef]
  14. Litzelman, D.; Dittus, R.S.; Miller, M.E.; Tierney, W.M. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J. Gen. Intern. Med. 1993, 8, 311–317. [Google Scholar] [CrossRef] [PubMed]
  15. Woodward, T.; Josephson, C.; Ross, L.; Hill, J.; Hosking, B.; Naumann, F.; Stoney, R.; Palmer, M. A retrospective study of the incidence and characteristics of long-stay adult inpatients with hospital-acquired malnutrition across five Australian public hospitals. Eur. J. Clin. Nutr. 2020, 74, 1668–1676. [Google Scholar] [CrossRef]
  16. Larsen, B.M.; Luchak, M.; Prenoslo, L.; Wood, K.B.; Mazurak, V. Indicators of Pediatric Malnutrition in a Tertiary Care Hospital. Can. J. Diet. Pract. Res. 2014, 75, 157–159. [Google Scholar] [CrossRef] [PubMed]
  17. Alston, L.; Green, M.; Versace, V.L.; Bolton, K.A.; Widdicombe, K.; Buccheri, A.; Imran, D.; Allender, S.; Orellana, L.; Nichols, M. Profiling Malnutrition Prevalence among Australian Rural In-Patients Using a Retrospective Census of Electronic Medical Files over a 12-Month Period. Int. J. Environ. Res. Public Health 2020, 17, 5909. [Google Scholar] [CrossRef] [PubMed]
  18. Australian Institute of Health and Welfare. Rural & Remote Health Canberra, Australia: Australian Institute of Health and Welfare. 2018. Available online: https://www.aihw.gov.au/reports/australias-health/rural-and-remote-health (accessed on 3 April 2020).
  19. Bourke, L.; Humphreys, J.S.; Wakerman, J.; Taylor, J. Understanding drivers of rural and remote health outcomes: A conceptual framework in action. Aust. J. Rural Health 2012, 20, 318–323. [Google Scholar] [CrossRef]
  20. Alston, L.; Allender, S.; Peterson, K.; Jacobs, J.; Nichols, M. Rural Inequalities in the Australian Burden of Ischaemic Heart Disease: A Systematic Review. Hear. Lung Circ. 2017, 26, 122–133. [Google Scholar] [CrossRef] [Green Version]
  21. Alston, L.; Partridge, S.R. Limited dietary interventions in rural Australian communities: A systematic review. Nutr. Diet. 2020, 78, 57–68. [Google Scholar] [CrossRef]
  22. MacLeod, M.L.P.; Stewart, N.J.; Kulig, J.C.; Anguish, P.; Andrews, M.E.; Banner, D.; Garraway, L.; Hanlon, N.; Karunanayake, C.; Kilpatrick, K.; et al. Nurses who work in rural and remote communities in Canada: A national survey. Hum. Resour. Heal. 2017, 15, 34. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Pt Global. Patient-Generated Subjective Global Assessment (PG-SGA©) Pt Global. 2014. Available online: https://pt-global.org/pt-global (accessed on 11 March 2021).
  24. Ottery, F.D. Definition of standardized nutritional assessment and interventional pathways in oncology. Nutrition 1996, 12, S15–S19. [Google Scholar] [CrossRef]
  25. StataCorp. STATA Software 2019. Available online: https://www.stata.com/ (accessed on 12 December 2021).
  26. Gong, Y.; Zhou, H.; Zhang, Y.; Zhu, X.; Wang, X.; Shen, B.; Xian, J.; Ding, Y. Validation of the 7-item Generalized Anxiety Disorder scale (GAD-7) as a screening tool for anxiety among pregnant Chinese women. J. Affect. Disord. 2021, 282, 98–103. [Google Scholar] [CrossRef] [PubMed]
  27. Australian Digital Health Agency. Australia’s National Digital Health Strategy Australia: Australian Federal Government. 2021. Available online: https://www.digitalhealth.gov.au/sites/default/files/2020-11/Australia%27s%20National%20Digital%20Health%20Strategy%20-%20Safe%2C%20seamless%20and%20secure.pdf (accessed on 24 November 2021).
  28. Nature. The Future of Electronic Health Records: Nature. 2019. Available online: https://www.nature.com/articles/d41586-019-02876-y (accessed on 24 November 2021).
  29. Vivanti, A.; Lee, H.-C.; Palmer, M. Capitalising on opportunities: Malnutrition coding in hospital before and after the introduction of electronic health records with an embedded malnutrition screening tool. Clin. Nutr. ESPEN 2021, 41, 193–197. [Google Scholar] [CrossRef]
  30. McCamley, J.; Vivanti, A.; Edirippulige, S. Dietetics in the digital age: The impact of an electronic medical record on a tertiary hospital dietetic department. Nutr. Diet. 2019, 76, 480–485. [Google Scholar] [CrossRef]
Figure 1. Receiver Operating Characteristic (ROC) curve for the malnutrition PG-SGA score based on the EMR review compared to PG-SGA bed-side screen.
Figure 1. Receiver Operating Characteristic (ROC) curve for the malnutrition PG-SGA score based on the EMR review compared to PG-SGA bed-side screen.
Nutrients 14 00205 g001
Table 1. Demographics and clinical characteristics of the patients.
Table 1. Demographics and clinical characteristics of the patients.
Patient CharacteristicSample n = 50
Mean Age (SD) (years)70.6 (14.9)
Median LoS (range) (days)5.0 (3–19)
Female N (%)31 (62%)
Proportion residing in the main rural township N (%)39 (78%)
Nutrition symptoms documented in record N (%)
Presence of malnutrition risk conditions (cancer, AIDs, pulmonary cachexia, cardiac cachexia, open wound or trauma)16 (32%)
Loss of appetite14 (28%)
Early satiety1 (2%)
Poor taste1 (2%)
Mouth sores1 (2%)
Nausea8 (16%)
Constipation16 (32%)
Vomiting6 (12%)
Swallowing difficulties1 (2%)
Malnutrition screening results
Mean bedside score (range)8.0 (1–29)
Mean EMR score (range)7.9 (0–22)
At risk of malnutrition based on bedside score (95% CI) (PG SGA score >4)74% (59–84%)
At risk based on EMR score (95% CI) (PG SGA score >4)80% (66–89%)
‘SD’ standard deviation, ‘EMR’ electronic medical record, ‘PG SGA’ Patient Guided Subjective Global Assessment, ‘CI’ confidence interval.
Table 2. Sensitivity, specificity, Youden Index at different cut off points of the EMR-screen PG-SGA.
Table 2. Sensitivity, specificity, Youden Index at different cut off points of the EMR-screen PG-SGA.
Cutpoint (Ideal > 4)SensitivitySpecificityCorrectly ClassifiedYouden Index
(≥0)100.0%0.0%74.0%0.0
(≥1)100.0%7.7%76.0%0.08
(≥2)100.0%15.4%78.0%0.15
(≥3)94.6%23.1%76.0%0.18
(≥4)86.5%38.5%74.0%0.25
(≥5)83.8%46.2%74.0%0.30
(≥6)78.4%61.5%74.0%0.40
(≥7)67.6%76.9%70.0%0.45
(≥8)51.4%76.9%58.0%0.28
(≥9)51.4%84.6%60.0%0.36
(≥10)40.5%92.3%54.0%0.33
(≥11)35.1%100.0%52.0%0.35
(≥12)27.0%100.0%46.0%0.27
(≥14)18.9%100.0%40.0%0.19
(≥15)13.5%100.0%36.0%0.14
(≥16)10.8%100.0%34.0%0.11
(≥18)5.4%100.0%30.0%0.05
(≥22)2.7%100.0%28.0%0.03
(>22)0.0%100.0%26.0%0.0
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Alston, L.; Green, M.; Nichols, M.; Partridge, S.R.; Buccheri, A.; Bolton, K.A.; Versace, V.L.; Field, M.; Launder, A.J.; Lily, A.; et al. Testing the Accuracy of a Bedside Screening Tool Framework to Clinical Records for Identification of Patients at Risk of Malnutrition in a Rural Setting: An Exploratory Study. Nutrients 2022, 14, 205. https://doi.org/10.3390/nu14010205

AMA Style

Alston L, Green M, Nichols M, Partridge SR, Buccheri A, Bolton KA, Versace VL, Field M, Launder AJ, Lily A, et al. Testing the Accuracy of a Bedside Screening Tool Framework to Clinical Records for Identification of Patients at Risk of Malnutrition in a Rural Setting: An Exploratory Study. Nutrients. 2022; 14(1):205. https://doi.org/10.3390/nu14010205

Chicago/Turabian Style

Alston, Laura, Megan Green, Melanie Nichols, Stephanie R. Partridge, Alison Buccheri, Kristy A. Bolton, Vincent L. Versace, Michael Field, Ambrose J. Launder, Amy Lily, and et al. 2022. "Testing the Accuracy of a Bedside Screening Tool Framework to Clinical Records for Identification of Patients at Risk of Malnutrition in a Rural Setting: An Exploratory Study" Nutrients 14, no. 1: 205. https://doi.org/10.3390/nu14010205

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop