Next Article in Journal
Association between Empagliflozin Use and Electrocardiographic Changes
Previous Article in Journal
Association between Anemia and New-Onset Atrial Fibrillation in Critically Ill Patients in the Intensive Care Unit: A Retrospective Cohort Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quality in Clinical Consultations: A Cross-Sectional Study

1
Department of Endocrinology, University College London Hospitals NHS Foundation Trust, London NW1 2BU, UK
2
Department of Neurosurgery, University College London Hospitals NHS Foundation Trust, London WC1N 3BG, UK
3
Lorn and Islands Hospital, Oban PA34 4HH, UK
4
Centre for Obesity & Metabolism, Department of Experimental & Translational Medicine, Division of Medicine, University College London, London WC1E 6BT, UK
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Clin. Pract. 2022, 12(4), 545-556; https://doi.org/10.3390/clinpract12040058
Submission received: 24 May 2022 / Revised: 23 June 2022 / Accepted: 4 July 2022 / Published: 14 July 2022

Abstract

:
The coronavirus disease 2019 pandemic may have affected the quality of clinical consultations. The objective was to use 10 proposed quality indicator questions to assess outpatient consultation quality; to assess whether the recent shift to telemedicine during the pandemic has affected consultation quality; and to determine whether consultation quality is associated with satisfaction and consultation outcome. A cross-sectional study was used to survey clinicians and patients after outpatient consultations (1 February to 31 March 2021). The consultation quality score (CQS) was the sum of ‘yes’ responses to the survey questions. In total, 78% (538/690) of consultations conducted were assessed by a patient, clinician, or both. Patient survey response rate was 60% (415/690) and clinician 42% (291/690). Face-to-face consultations had a greater CQS than telephone (patients and clinicians < 0.001). A greater CQS was associated with higher overall satisfaction (clinicians log-odds: 0.77 ± 0.52, p = 0.004; patients log-odds: 1.35 ± 0.57, p < 0.001) and with definitive consultation outcomes (clinician log-odds: 0.44 ± 0.36, p = 0.03). In conclusion, consultation quality is assessable; the shift to telemedicine has negatively impacted consultation quality; and high-quality consultations are associated with greater satisfaction and definitive consultation outcome decisions.

1. Introduction

Clinical consultation skills are a core component of medical student training and postgraduate practice, and essential in the delivery of high-quality healthcare [1,2]. Some clinicians, however, feel the standard of modern-day clinical consultations is poor and have been advocating for improvement [3]. Dr Gordon Caldwell has proposed 10 indicators to improve the quality of clinical consultations, and thereby improve patient outcomes, patient experience, patient safety, and staff satisfaction (see Figure 1) [4].
The diversion of health care resources required to manage the virus throughout the COVID-19 pandemic has caused delays in the routine care of patients with chronic medical conditions [5]. Many health services rapidly adopted methods to conduct remote consultations to reduce the viral spread [6,7]. It has been suggested that the impact of the COVID-19 pandemic on both the frequency and method of clinical consultations has had an additional deleterious effect on the quality of clinical consultations.
The aims of our work were: firstly, to use these proposed indicators to assess the quality of consultations in outpatient clinics; secondly, to determine whether the shift toward telephone consultations throughout the COVID-19 pandemic has impacted the quality of consultations; and thirdly, to assess whether the quality of consultation was associated with patient satisfaction, clinician satisfaction, and outcome of the consultation.

2. Materials and Methods

We adopted a cross-sectional study design and the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement in the preparation of this manuscript.

2.1. Settings and Participants

This study was conducted at UCLH, a tertiary referral service. Participants were patients assessed in medical (endocrinology) and surgical (neurosurgery) outpatient clinics between the 1 February 2021 and the 31 March 2021, as well as the clinicians who reviewed them. The consultations were conducted by clinicians at a consultant or specialist registrar level under supervision.

2.2. Variables and Data Sources

Clinicians and patients were both surveyed after each outpatient appointment (see File S1 in Supplementary Materials). The survey questions generated were derived from the previously reported 10 indicators to improve the quality of clinical consultations (see Figure 1). In doing so, we took a consensus-based pragmatic approach balancing the rich detail of the clinical consultation with what we thought we could feasibly measure and analyze. The clinicians autonomously completed a survey immediately after each consultation either via paper copy or electronically. The clinicians were reminded via email at the beginning of each week to complete the surveys following clinical consultations. Patients were identified from clinic lists on electronic health records and were surveyed via telephone and called within one week of their consultation. A second call was attempted within 24 h if patients failed to answer initially. All patients were surveyed by one of three medical students (who had never met the patients).
In each survey, demographic details of the patient (age and sex) and the type of consultation (face-to-face vs. telephone, initial vs. review appointment) were recorded. Participants were asked the outcome of the consultation (further investigations, monitoring, treatment, or discharged). Participants were then asked a series of questions, aiming to assess different aspects of the quality of the clinical consultation. The sum of the number of ‘yes’ responses to the quality indicator survey questions provided a consultation quality score (CQS). This was a score out of 9 for patients and out of 10 for clinicians, given an extra clinician question about feeling refreshed and having the opportunity for adequate breaks.
Finally, clinicians and patients were asked if overall they were satisfied with the consultation and if they had any further comments to share. The patient group was also asked two extra follow up questions. Patients were asked if they would like the option of a telephone consultation after the COVID-19 pandemic ends. If the patient reported a negative response to question 10, i.e., that their relative or friend had not been invited to participate in the consultation, they were asked if they would have liked this to have occurred.

2.3. Study Size and Statistical Methods

No formal power calculation was performed. Instead, the sample size was determined by a pragmatic approach, with a minimum of 500 consultation assessments thought to be meaningful for analysis and an achievable target over the two-month study period.
Survey data was recorded using Microsoft Excel on a secure hospital server and fully anonymized datasets were generated and exported for further analysis in line with our institutional information governance framework. Statistical analysis was conducted using R statistical programming [8]. Graphs were plotted using the package ggplot2 [9]. Dichotomous dependent variables were analyzed using logistic regressions. Continuous dependent variables with binary independent variables were analyzed using a two-tailed t-test with Welch’s correction. The threshold for statistical significance was set at α < 0.05. Adjustments for multiple comparisons were made at the level of each analysis, using Benjamini–Hochberg’s method to control for false discovery rates [10]. The data is presented as mean and 95% confidence intervals.

3. Results

Over the two-month study period 14 clinicians conducted 690 consultations.
Survey response:
Of the 690 consultations conducted, 538 were assessed using either a patient survey, a clinician survey, or both (538/690, 78%). Overall, 706 surveys were completed. Patient surveys were completed after 415 of the consultations (415/690, a survey response rate of 60%) and clinicians surveys were completed after 291 of the consultations (291/690, a survey response rate of 42%). There were 168 consultations that were assessed by both a clinician and a patient survey. No surveys were partially completed.
Of the 275 patients phoned who did not complete a survey (275/690, 40%), 184 did not answer the phone call, 52 declined to participate, 27 were unable to complete the phone survey due to a language barrier, or 12 for another reason. The 399 consultations that were not assessed by clinicians (399/690, 58%) were the result of surveys not being returned to the researchers.
Survey results:
The patients attending the consultations had a mean age of 49 years (range 16–88 years) and 60% were female (322/538). The details of the consultation setting, type, method, and outcome are outlined in Table 1. Most consultations were in the setting of a medical clinic (444/538, 83%), and were review appointments (483/538, 90%). More telephone consultations (370/538, 69%) were conducted, compared to face-to-face consultations (168/538, 31%). Regarding the outcome of the consultation, a decision was made (i.e., treatment or discharge) after 12% (67/538) of the consultations whilst the decision was pending (i.e., further investigations or monitoring) after 87% (471/538) of consultations.

3.1. Quality of Consultation

The number of yes vs. no responses to the quality indicator survey questions for both the clinician and patient surveys are outlined in Table 2. For the majority of survey questions (Question [Q] 1–2, 4–6, and 8), the response was ‘yes’ greater than 90% of the time. Clinicians were refreshed and took adequate breaks (Q9) 87% of the time. Enquiry about a patient’s occupation or interests was variable (Q3—answered yes on the clinician survey (C) 70%, answered yes on the patient survey (p) 49%). Clinicians reported that the information needed for the consultation was frequently missing (Q7—C 47%, p 90%) and relatives or friends were most often not invited to participate (Q10—C 23%, p 10%). Of the 372 patients surveyed who had not been offered the option of a family or friend attending the consultation, 28 (28/372, 8%) reported that they would have liked this to have occurred.
For the 168 consultations that were assessed by both the clinician and patient, the number of surveys with a difference in the yes vs. no response to the quality indicator survey questions is outlined in Table 3. Patients reported more frequently that clinicians did not take the time to ask about hobbies or interests (clinician and patient survey discordance 30%). Clinicians reported more frequently that the required information was missing (clinician and patient survey discordance 52%).

3.2. Quality of Consultation and Consultation Method

Both patients and clinicians assessed face-to-face consultations to be of a significantly higher overall quality (indicated by a higher CQS) than telephone consultations (p < 0.001 for both clinicians and patients). Both were significantly more likely to feel that occupation was elicited during face-to-face consultations (p = 0.004 for both clinicians and patients). Patients were more likely to report that a relative or friend was invited to be present during face-to-face consultations (p = 0.03), although clinicians reported no significant difference (p = 0.77). Despite the higher satisfaction with face-to-face consultations, 73% of patients reported that they would like to have the option of a telephone a consultation after the pandemic ends (303/415, 73%).

3.3. Quality of Consultation and Satisfaction

Both clinicians (285/291) and patients (406/415) reported 98% satisfaction with the consultations (see Table 2). For the consultations assessed by both parties (n = 168), there was only 2% discordance between clinicians and patients regarding overall consultation satisfaction (3/168 patients reported overall dissatisfaction with the consultation, whilst 168/168 clinicians reported overall satisfaction) (see Table 3).
A greater clinician-assessed CQS was significantly associated with greater likelihood of clinician satisfaction (log-odds: 0.77 ± 0.52; p = 0.004; n = 291). A greater patient-assessed CQS was significantly associated with a greater likelihood of patient satisfaction (log-odds: 1.35 ± 0.57; p < 0.001; n = 415).
In a subset of 168 consultations assessed by both the patient and the clinician, we found no association between clinician-assessed CQS and patient satisfaction (p = 0.75). We could not assess whether patient-assessed CQS had any impact on clinician satisfaction, as no clinicians indicated dissatisfaction in this subset.
The best predictors of patient satisfaction are outlined in Table 4. By univariable analysis, these were: an unhurried consultation (Q4, log-odds: 2.99 ± 1.52, p < 0.001), knowledge of the reason for the consultation (Q1, log-odds: 2.80 ± 1.50; p = 0.001), clinicians knowing the details of their case (Q2, log-odds: 2.38 ± 1.46, p = 0.004), and all the required information being available for the consultation (Q7, log-odds: 2.05 ± 1.36, p = 0.006). In multivariable logistic regression, an unhurried consultation (Q4, log-odds: 2.83 ± 1.86, p = 0.003), knowledge of the reason for the consultation (Q1, log-odds: 1.93 ± 1.73, p = 0.03), and the required information being available for the consultation (Q7 2.41 ± 1.56, p = 0.002), were also found to be significant predictors of patient satisfaction.
The best predictors of clinician satisfaction are also outlined in Table 4. By univariable analysis, these were: knowledge of the reason for consultation (Q1, log-odds: 4.25 ± 1.88, p < 0.001), the consultation being distraction free (Q6, log-odds: 2.76 ± 1.67, p = 0.005), an unhurried consultation (Q4, log-odds: 2.27 ± 1.78, p = 0.04), and confidentially and dignity being maintained (Q8, log-odds:2.64 ± 2.36, p = 0.06). In multivariable logistic regression, knowledge of the reason for the consultation (Q1, log-odds: 4.08 ± 2.13, p = <0.001) and the consultation being distraction free (Q6, log-odds: 2.56 ± 2.03, p = 0.01), were also found to be significant predictors of clinician satisfaction.

3.4. Quality of Consultation and Consultation Outcome

The outcomes were dichotomized into discharged or treated (decision made) versus further investigation or monitoring (decision pending). There was a significant association between clinician assessed CQS and decision made (log-odds: 0.44 ± 0.36; p = 0.03). Of the individual components of the CQS, sufficient information was the sole significant predictor of treatment decision being made (log-odds: 1.69 ± 0.86; p = 0.002). There were no significant associations between overall patient assessed CQS or individual quality components, with decision outcome.

3.5. Other Survey Results

When comparing the setting of medical and surgical clinics, there was no significant difference in patient-assessed CQS (p = 0.94). The clinician-assessed CQS was greater in the surgical clinic setting (p = 0.01).
In the free comment section (answered by 35 patients), a common theme related to difficulties organizing blood tests (reported by 7 patients). Patients also requested to see the same clinician at each appointment (reported by 6 patients).

4. Discussion

4.1. Principal Findings

This study demonstrated the following: firstly, it is possible to assess the quality of consultation; secondly that the shift from face-to-face to telephone clinic has impacted on this quality; and thirdly, that high quality consultations are associated with greater patient satisfaction, greater clinician satisfaction, and more definitive decisions (see Figure 2). This has important ramifications, suggesting quality of consultation is a measurable and important facet of patient care.
Overall, the quality of the consultations was high with a positive response reported for the majority of the clinical consultation quality indicators. Most patients knew why they were attending, the clinicians were prepared, and there was adequate time for the consultation. Consultations were generally free of interruptions or distractions and confidentially was maintained. Breaks were taken by most clinicians.
There were three quality indicators where improvement could be made. The clinicians often did not ask about the patient’s occupation or interests, reported by patients in approximately half of the consultations. In many of the consultations a friend or relative was not invited to participate. Clinicians reported in half of the consultations that they did not have the required information.
For both clinicians and patients, face-to-face consultations were felt to be of a higher overall quality than remote consultations. Despite this, most patients would like the option of a telephone consultation after the COVID-19 pandemic ends.
Both clinicians and patients reported high satisfaction with the clinical consultations. There was high concordance between clinician and patient overall consultation satisfaction when the same consultation was assessed by both parties. A higher consultation quality score (the overall sum of the positive responses to the quality indicator survey questions) was significantly associated with greater satisfaction with the consultation. For both clinicians and patients, patients knowing the reason for the consultation and an unhurried consultation were predictors of overall satisfaction. Other predictors for patient satisfaction were the clinician knowing the details of their case and the required information being available. Predictors of clinician satisfaction were the consultations being distraction free, where confidentially and dignity was maintained.
When the outcome of the consultation was a definitive decision (i.e., treatment or discharge), the clinicians rated the consultation to be of higher quality. The required information being available for the consultation was the sole predictor of a definitive decision being made regarding the outcome of the consultation.

4.2. Comparison to Other Studies

Previous work has aimed to develop tools to measure the quality of consultations, although differing aspects of the consultation were assessed [11,12]. Two thirds of consultations were conducted via telephone, aligning with the trend to increase delivery of digital health care going forward [13,14]. We found face-to-face consultations were of higher quality compared to telephone consultations, consistent with research conducted in primary care prior to the pandemic [15]. Despite this finding, overall high satisfaction was still reported, in keeping with other literature reporting high satisfaction with telephone consultations throughout the pandemic [16,17,18,19].
Improving the quality of consultations is more challenging when consulting remotely. Previous research has suggested less rapport building is undertaken during telephone consultations compared to face-to face [20] and loss of non-verbal communication is a challenge when consulting remotely [21]. Primary care professions interviewed about their experience consulting during the pandemic, reported feeling that remote consultations created emotional distance between themselves and patients [22]. Video consultations may be superior to telephone in enabling rapport to be built [23].
Eight percent of patients who were not offered the option of a support person would have liked this to have occurred, highlighting a missed opportunity. Literature has reported the beneficial role a companion can play in a clinical consultation [24,25]. Examining ways to involve family or friends in remote consultations is particularly important for older individuals, a group that may be less familiar with digital technology and who are thought to be disproportionately affected by the pandemic [26].
The required information was frequently missing. Delays to investigations have been a common occurrence throughout the pandemic [5] and increased difficulties obtaining pathology results when using telehealth has been reported [27]. Methods to ensure results are available efficiently and reliably when consulting remotely remains a key area of focus going forward. The availability of the necessary information was also associated with a definite decision being made regarding the consultation outcome. Maximizing efficiency is important given the long-lasting impact the COVID-19 pandemic is predicted to have on already stretched health care resources [28].
Reassuringly, clinicians reported having time to take adequate breaks, although improvement can be made in 13% of consultations. Previous studies have explored the link between clinician fatigue and altered decision making [29,30,31], of particular importance currently given increased clinician burnout induced by the pressures of the COVID-19 pandemic [32,33].
Pat McBride, head of patient and family services at The Pituitary Foundation, a patient support organization, provided a valuable insight from a patient perspective. One area not considered by the proposed consultation quality indicators is the frustration for patients when there is a delay for a consultation to start. The increased use of remote consulting may provide an opportunity to examine and implement methods to better address this issue, given patients no longer have to be physically waiting in a reception area.

4.3. Strengths and Limitations

A strength of this study was that multiple perspective and dimensions of the consultation (patient and clinician satisfaction, as well as consultation outcome) were examined. A large number of patients were surveyed across both medical and surgical clinics. To minimize recall bias, clinicians completed surveys on the day of the consultation and patients were surveyed within one week.
A limitation of this study was that 184 of patients identified did not complete the survey given they were uncontactable via phone after two attempts. A further 27 were unable to complete the phone survey due to a language barrier. It is possible that this group of patients may have reported more problems and lower satisfaction with telephone consultations. Clinicians completed the surveys after 42% of consultations. The reason clinician surveys were not returned to researchers is unknown. Unfortunately, we were not able to follow up missing clinician surveys as we had not routinely collected data identifying individual clinicians on the survey forms. It possible that clinicians were unable to complete surveys due to time pressure, meaning our survey failed to capture those who were unable to take adequate breaks. This is a single-center study at a large London referral hospital; thus, the findings of this survey may not be representative of other services, including smaller hospitals, who were more stretched for resources during the pandemic. Given this was an observational study, the stability of a patient’s condition may have influenced the choice of a face-to-face or remote consultation and therefore the findings.

5. Conclusions

We demonstrated that assessing the quality of clinical consultations is possible and established that the shift from face-to-face to telephone clinics during the COVID-19 pandemic has impacted on this quality. In addition, high quality consultations are associated with greater patient satisfaction, greater clinician satisfaction, and more definitive decisions being made regarding the consultation outcome. To further improve the quality of consultations, clinicians should make steps to better understand their patients as people, for example, knowing their occupations and interests and more consistently offering to involve a patient’s family or friends in their healthcare. Improved methods should be implemented to ensure that all relevant information is available at the time of the consultation. Consideration should be given to the patient group most suitable for telephone consultations, given the challenges of maintaining quality when consulting remotely. It is important that these areas of improvement are considered as we start to look towards a healthcare model that comprises increasing levels of remote consultations and deal with the backlog of the impact of the COVID-19 pandemic.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/clinpract12040058/s1, File S1: Clinician and patient surveys.

Author Contributions

Conceptualization, A.G., G.C., J.G., H.J.M. and S.E.B.; data curation, A.G. and C.H.K.; formal analysis, A.G., C.H.K., H.J.M. and S.E.B.; investigation, A.G., M.T., J.H. and K.B.; methodology, A.G., H.J.M. and S.E.B.; supervision, H.J.M. and S.E.B.; writing—original draft, A.G., C.H.K., H.J.M. and S.E.B.; writing—review and editing, G.C., J.G. and M.T. All authors have read and agreed to the published version of the manuscript.

Funding

HJM is supported by the Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) (grant numbers WEISS 203145Z/16/Z; EPSRC EP/P027938/1 and EP/R004080/1). We would like to thank them for funding the publication fees of this manuscript; however, no role was played in the design of the study; in the collection, analyses, or interpretation of data, in the writing of the manuscript, or in the decision to publish the results. This research did not receive any other specific funding or grants. HJM is also supported by University College London (UCL) Biomedical Research Centre (BRC) and the National Institute of Health Research (NIHR).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and registered as a service evaluation study with the University College London Hospital NHS Foundation Trust Clinical Audit Committee (date of approval 28 May 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Datasets generated and analyzed during the study are available from the corresponding author on reasonable request.

Acknowledgments

We would like to acknowledge Pat McBride from the Pituitary Foundation, for her valuable insights regarding the patient perspective of the clinical consultation. We would also like to thank all clinicians and patients who took the time to complete the surveys.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. General Medical Council. Outcomes for Graduates; General Medical Council: London, UK, 2019; Available online: https://www.gmc-uk.org/education/standards-guidance-and-curricula/standards-and-outcomes/outcomes-for-graduates/outcomes-for-graduates/outcomes-2---professional-skills (accessed on 25 October 2021).
  2. General Medical Council. Good Medical Practice; General Medical Council: London, UK, 2013; Available online: https://www.gmc-uk.org/ethical-guidance/ethical-guidance-for-doctors/good-medical-practice (accessed on 25 October 2021).
  3. Launer, J. Is there a crisis in clinical consultations? Postgrad. Med. J. 2017, 93, 58. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Caldwell, G. The process of clinical consultation is crucial to patient outcomes and safety: 10 quality indicators. Clin. Med. 2019, 19, 503–506. [Google Scholar] [CrossRef] [PubMed]
  5. Graf, A.; Marcus, H.J.; Baldeweg, S.E. The direct and indirect impact of the COVID-19 pandemic on the care of patients with pituitary disease: A cross sectional study. Pituitary 2021, 24, 262–268. [Google Scholar] [CrossRef] [PubMed]
  6. Hutchings, R. The Impact of COVID-19 on the Use of Digital Technology in the NHS; Nuffield Trust: London, UK, 2020; Available online: https://www.nuffieldtrust.org.uk/research/the-impact-of-COVID-19-on-the-use-of-digital-technology-in-the-nhs (accessed on 25 October 2021).
  7. Murphy, M.; Scott, L.J.; Salisbury, C.; Turner, A.; Scott, A.; Denholm, R.; Lewis, R.; Iyer, G.; Macleod, J.; Horwood, J. Implementation of remote consulting in UK primary care following the COVID-19 pandemic: A mixed-methods longitudinal study. Br. J. Gen. Pract. 2021, 71, e166–e177. [Google Scholar] [CrossRef]
  8. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2018; Available online: https://www.R-project.org/ (accessed on 9 June 2021).
  9. Wickham, H. Ggplot2: Elegant Graphics for Data Analysis; Springer: New York, NY, USA, 2016. [Google Scholar]
  10. Benjamini, Y.; Hochberg, Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 1995, 57, 289–300. [Google Scholar] [CrossRef]
  11. Howie, J.G.; Heaney, D.J.; Maxwell, M.; Walker, J.J.; Freeman, G.K. Developing a ‘consultation quality index’ (CQI) for use in general practice. Fam. Pract. 2000, 17, 455–461. [Google Scholar] [CrossRef] [Green Version]
  12. Burt, J.; Abel, G.; Elmore, N.; Campbell, J.; Roland, M.; Benson, J.; Silverman, J. Assessing communication quality of consultations in primary care: Initial reliability of the Global Consultation Rating Scale, based on the Calgary-Cambridge Guide to the Medical Interview. BMJ Open 2014, 4, e004339. [Google Scholar] [CrossRef] [Green Version]
  13. NHS England. The NHS Long Term Plan; NHS England: England, UK, 2019; Available online: https://www.longtermplan.nhs.uk (accessed on 17 August 2021).
  14. World Health Organisation. Global Strategy on Digital Health 2020–2025; World Health Organization: Geneva, Switzerland, 2021; Available online: https://www.who.int/docs/default-source/documents/gs4dhdaa2a9f352b0445bafbc79ca799dce4d.pdf (accessed on 25 October 2021).
  15. Hammersley, V.; Donaghy, E.; Parker, R.; McNeilly, H.; Atherton, H.; Bikker, A.; Campbell, J.; McKinstry, B. Comparing the content and quality of video, telephone, and face-to-face consultations: A non-randomised, quasi-experimental, exploratory study in UK primary care. Br. J. Gen. Pract. 2019, 69, e595–e604. [Google Scholar] [CrossRef] [Green Version]
  16. Efthymiadis, A.; Hart, E.J.; Guy, A.M.; Harry, R.; Mahesan, T.; Chedid, W.A.; Uribe-Lewis, S.; Perry, M.J. Are telephone consultations the future of the NHS? The outcomes and experiences of an NHS urological service in moving to telemedicine. Future Healthc. J. 2021, 8, e15–e20. [Google Scholar] [CrossRef]
  17. Martos-Pérez, F.; Martín-Escalante, M.D.; Olalla-Sierra, J.; Prada-Pardal, J.L.; García-De-Lucas, M.D.; González-Vega, R.; Jiménez-Puente, A.; García-Alegría, J. The value of telephone consultations during COVID-19 pandemic. An observational study. QJM Int. J. Med. 2021, 114, 715–720. [Google Scholar] [CrossRef]
  18. Holtz, B.E. Patients Perceptions of Telemedicine Visits before and after the Coronavirus Disease 2019 Pandemic. Telemed. e-Health 2021, 27, 107–112. [Google Scholar] [CrossRef]
  19. Kludacz-Alessandri, M.; Hawrysz, L.; Korneta, P.; Gierszewska, G.; Pomaranik, W.; Walczak, R. The impact of medical teleconsultations on general practitioner-patient communication during COVID-19: A case study from Poland. PLoS ONE 2021, 16, e0254960. [Google Scholar] [CrossRef] [PubMed]
  20. McKinstry, B.; Hammersley, V.S.; Burton, C.; Pinnock, H.; Elton, R.; Dowell, J.; Sawdon, N.; Heaney, D.; Elwyn, G.; Sheikh, A. The quality, safety and content of telephone and face-to-face consultations: A comparative study. Qual. Saf. Health Care 2010, 19, 298–303. [Google Scholar] [CrossRef] [PubMed]
  21. Verma, P.; Kerrison, R. Patients’ and physicians’ experiences with remote consultations in primary care during the COVID-19 pandemic: A multi-method rapid review of the literature. BJGP Open 2022, BJGPO.2021.0192. [Google Scholar] [CrossRef] [PubMed]
  22. Wanat, M.; Hoste, M.E.; Gobat, N.H.; Anastasaki, M.; Böhmer, F.; Chlabicz, S.; Colliers, A.; Farrell, K.; Hollerbach, S.; Karkana, M.-N.; et al. Patients’ and clinicians’ perspectives on the primary care consultations for acute respiratory infections during the first wave of the COVID-19 pandemic: An eight-country qualitative study in Europe. BJGP Open 2022, BJGPO.2021.0172. [Google Scholar] [CrossRef]
  23. Donaghy, E.; Atherton, H.; Hammersley, V.; McNeilly, H.; Bikker, A.; Robbins, L.; Campbell, J.; McKinstry, B. Acceptability, benefits, and challenges of video consulting: A qualitative study in primary care. Br. J. Gen. Pract. 2019, 69, e586–e594. [Google Scholar] [CrossRef]
  24. Andrades, M.; Kausar, S.; Ambreen, A. Role and Influence of the Patient’s Companion in Family Medicine Consultations: “The Patient’s Perspective”. J. Fam. Med. Prim. Care 2013, 2, 283–287. [Google Scholar]
  25. Sharp, R.J.; Hobson, J. Patient and physician views of accompanied consultations in occupational health. Occup. Med. 2016, 66, 643–648. [Google Scholar] [CrossRef] [Green Version]
  26. Propper, C.; Stoye, G.; Zaranko, B. The Wider Impacts of the Coronavirus Pandemic on the NHS. Fisc. Stud. 2020, 4, 345–356. [Google Scholar] [CrossRef]
  27. Isautier, J.M.; Copp, T.; Ayre, J.; Cvejic, E.; Meyerowitz-Katz, G.; Batcup, C.; Bonner, C.; Dodd, R.; Nickel, B.; Pickles, K.; et al. People’s Experiences and Satisfaction With Telehealth During the COVID-19 Pandemic in Australia: Cross-Sectional Survey Study. J. Med. Internet Res. 2020, 22, e24531. [Google Scholar] [CrossRef]
  28. Rimmer, A. COVID-19: NHS will take at least a year and a half to recover, doctors warn. BMJ 2021, 373, n999. [Google Scholar] [CrossRef] [PubMed]
  29. Allan, J.L.; Johnston, D.W.; Powell, D.J.H.; Farquharson, B.; Jones, M.C.; Leckie, G.; Johnston, M. Clinical decisions and time since rest break: An analysis of decision fatigue in nurses. Health Psychol. 2019, 38, 318–324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Hsiang, E.Y.; Mehta, S.J.; Small, D.S.; Rareshide, C.A.L.; Snider, C.K.; Day, S.C.; Patel, M.S. Association of Primary Care Clinic Appointment Time With Clinician Ordering and Patient Completion of Breast and Colorectal Cancer Screening. JAMA Netw. Open 2019, 2, e193403. [Google Scholar] [CrossRef]
  31. Kim, R.H.; Day, S.C.; Small, D.S.; Snider, C.K.; Rareshide, C.A.L.; Patel, M.S. Variations in Influenza Vaccination by Clinic Appointment Time and an Active Choice Intervention in the Electronic Health Record to Increase Influenza Vaccination. JAMA Netw. Open. 2018, 1, e181770. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Khan, N.; Palepu, A.; Dodek, P.; Salmon, A.; Leitch, H.; Ruzycki, S.; Townson, A.; Lacaille, D. Cross-sectional survey on physician burnout during the COVID-19 pandemic in Vancouver, Canada: The role of gender, ethnicity and sexual orientation. BMJ Open 2021, 11, e050380. [Google Scholar] [CrossRef]
  33. Hlubocky, F.J.; Back, A.L.; Shanafelt, T.D.; Gallagher, C.M.; Burke, J.M.; Kamal, A.H.; Paice, J.A.; Page, R.D.; Spence, R.; McGinnis, M.; et al. Occupational and Personal Consequences of the COVID-19 Pandemic on US Oncologist Burnout and Well-Being: A Study From the ASCO Clinician Well-Being Task Force. JCO Oncol. Pract. 2021, 17, e427–e438. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Ten quality indicators for clinical consultation [3,4].
Figure 1. Ten quality indicators for clinical consultation [3,4].
Clinpract 12 00058 g001
Figure 2. Key study findings.
Figure 2. Key study findings.
Clinpract 12 00058 g002
Table 1. Details of the consultation setting, type, method, and outcome.
Table 1. Details of the consultation setting, type, method, and outcome.
Consultation Details
n = 538
SettingMedical clinic: 444 (83%)
Surgical clinic: 94 (17%)
TypeInitial consultation: 55 (10%)
Review consultation: 483 (90%)
MethodFace-to-face consultation: 168 (31%)
Telephone consultation: 370 (69%)
OutcomeDecision pending: 471 (88%)
  • Further investigations: 196
  • Monitoring: 275
Decision made: 67 (12%)
  • Treatment: 46
  • Discharged: 21
Table 2. Clinician and patient survey results.
Table 2. Clinician and patient survey results.
Question (Q) NumberClinician Survey Questionn = 291Patient Survey Questionn = 415
Q1Did the patient know why they were attending the consultation?yes: 284 (98%)
no: 7 (2%)
Did you know why you were attending the consultation?yes: 400 (96%)
no: 15 (4%)
Q2Did you have the opportunity to review the case before the consultation?yes: 289 (99%)
no: 2 (1%)
Did the clinician know the details of your case? yes: 394 (95%)
no: 21 (5%)
Q3Did you ask and document the patient’s occupation and/or interests?yes: 203 (70%)
no: 88 (30%)
Did the clinician ask about your occupation and/or interests?yes: 203 (49%)
no: 212 (51%)
Q4Did the consultation time feel adequate and unhurried?yes: 275 (95%)
no: 16 (5%)
Did the consultation time feel adequate and unhurried? yes: 402 (97%)
no: 13 (3%)
Q5Was the consultation free of interruptions? E.g., being called by a colleague during the consultation.yes: 274 (94%)
no: 17 (6%)
Of those who answered no:
  • Staff interrupting: 11
  • IT issues: 2
  • Other: 4
Was the consultation free of interruptions? E.g., you or the clinician received other calls during the consultation.yes: 409 (99%)
no: 6 (1%)
Of those who answered no:
  • Staff interrupting: 1
  • IT issues: 1
  • Other: 4
Q6Was the consultation free of distractions? E.g., nearby building works.yes: 272 (93%)
no: 19 (7%)
Of those who answered no:
  • Construction: 11
  • Other noise: 4
  • Patient at work: 2
  • Patient driving: 1
  • Other: 1
Was the consultation free of distractions? E.g., nearby building works.yes: 412 (99%)
no: 3 (1%)
Of those who answered no:
  • Construction: 1
  • Other noise: 2
Q7Did you have all the information needed to conduct the consultation?yes: 137 (47%)
no: 154 (53%)
Of those who answered no:
  • Results: 150 *
  • Scans: 8
  • Information: 3
  • Other: 2
Did the clinician have the information needed to conduct the consultation? yes: 374 (90%)
no: 41 (10%)
Of those who answered no:
  • Results: 19
  • Scans: 6
  • Information: 10
  • Other: 6
Q8Were confidentiality and dignity maintained throughout the consultation? E.g., was the telephone consultation able to be conducted in a confidential setting?yes: 286 (98%)
no: 5 (2%)
Of those who answered no:
  • Patient outside home: 5
Were confidentiality and dignity maintained throughout the consultation? E.g., was the telephone consultation able to be conducted in a confidential setting?yes: 414 (100%)
no: 1 (<1%)
Q9Were breaks taken as needed throughout the clinic and, if an afternoon clinic, did you have a lunch break?yes: 253 (87%)
no: 38 (13%)
No survey question
Q10Was the patient’s friend or relative invited to participate in the consultation? E.g., via speaker phone or sitting next to the patient throughout the consultation.yes: 68 (23%)
no: 223 (77%)
Was your friend or relative invited to participate in the consultation? E.g., via speaker phone or sitting next to you throughout the consultation.yes: 43 (10%)
no 372 (90%)
Q11Overall, were you satisfied with the consultation?yes: 285 (98%)
no: 6 (2%)
Overall, were you satisfied with the consultation?yes: 406 (98%)
no: 9 (2%)
* 8 patients missing > 1 information sources.
Table 3. Differences between clinician and patient survey responses when assessing the same consultation.
Table 3. Differences between clinician and patient survey responses when assessing the same consultation.
Question (Q) NumberClinician Survey Question
n = 168
Patient Survey Question
n = 168
Number of Surveys with a Difference in y/n Survey Response for Patient and Clinician Assessing Same Consultation
n = 168
Q1Did the patient know why they were attending the consultation?Did you know why you were attending the consultation?8 (5%)
Q2Did you have the opportunity to review the case before the consultation?Did the clinician know the details of your case?9 (5%)
Q3Did you ask and document the patient’s occupation and/or interests?Did the clinician ask about your occupation and/or interests?47 (30%)
Q4Did the consultation time feel adequate and unhurried?Did the consultation time feel adequate and unhurried?11 (7%)
Q5Was the consultation free of interruptions? E.g., being called by a colleague during the consultation.Was the consultation free of interruptions? E.g., you or the clinician received other calls during the consultation.13 (8%)
Q6Was the consultation free of distractions? E.g., nearby building works.Was the consultation free of distractions? E.g., nearby building works.9 (5%)
Q7Did you have all the information needed to conduct the consultation? Did the clinician have the information needed to conduct the consultation? 88 (52%)
Q8Were confidentiality and dignity maintained throughout the consultation? E.g., was the telephone consultation able to be conducted in a confidential setting?Were confidentiality and dignity maintained throughout the consultation? E.g., was the telephone consultation able to be conducted in a confidential setting?3 (2%)
Q10Was the patient’s friend or relative invited to participate in the consultation? E.g., via speaker phone or sitting next to the patient throughout the consultation.Was your friend or relative invited to participate in the consultation? E.g., via speaker phone or sitting next to you throughout the consultation.18 (11%)
Q11Overall, were you satisfied with the consultation?Overall, were you satisfied with the consultation?3 (2%)
Table 4. Predictors of clinician and patient satisfaction.
Table 4. Predictors of clinician and patient satisfaction.
Univariate Logistic Regression AnalysisMultivariate Logistic Regression Analysis
ClinicianPatientClinicianPatient
Survey Question (Q)Log-OddspLog-OddspLog-OddspLog-Oddsp
Q14.25 ± 1.88<0.0012.80 ± 1.500.0014.08 ± 2.13<0.0011.93 ± 1.730.03
Q2na *na *2.38 ± 1.460.004
Q30.13 ± 1.720.992.07 ± 2.090.08
Q42.27 ± 1.780.042.99 ± 1.52<0.001 2.83 ± 1.860.003
Q51.21 ± 2.210.42−13.77± 3165.60>0.99
Q62.76 ± 1.670.005−12.76 ± 2715.34>0.992.56 ± 2.030.01
Q71.52 ± 2.160.302.05 ± 1.360.006 2.41 ± 1.560.002
Q82.64 ± 2.360.06na *na *
Q9−15.85 ± 3419.28>0.99No survey question
Q10−0.55 ± 1.720.69−0.08 ± 2.10 >0.99
* variable not analyzed as ≤2 people in the group agreed or disagreed.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Graf, A.; Koh, C.H.; Caldwell, G.; Grieve, J.; Tan, M.; Hassan, J.; Bakaya, K.; Marcus, H.J.; Baldeweg, S.E. Quality in Clinical Consultations: A Cross-Sectional Study. Clin. Pract. 2022, 12, 545-556. https://doi.org/10.3390/clinpract12040058

AMA Style

Graf A, Koh CH, Caldwell G, Grieve J, Tan M, Hassan J, Bakaya K, Marcus HJ, Baldeweg SE. Quality in Clinical Consultations: A Cross-Sectional Study. Clinics and Practice. 2022; 12(4):545-556. https://doi.org/10.3390/clinpract12040058

Chicago/Turabian Style

Graf, Anneke, Chan Hee Koh, Gordon Caldwell, Joan Grieve, Melissa Tan, Jasmine Hassan, Kaushiki Bakaya, Hani J. Marcus, and Stephanie E. Baldeweg. 2022. "Quality in Clinical Consultations: A Cross-Sectional Study" Clinics and Practice 12, no. 4: 545-556. https://doi.org/10.3390/clinpract12040058

APA Style

Graf, A., Koh, C. H., Caldwell, G., Grieve, J., Tan, M., Hassan, J., Bakaya, K., Marcus, H. J., & Baldeweg, S. E. (2022). Quality in Clinical Consultations: A Cross-Sectional Study. Clinics and Practice, 12(4), 545-556. https://doi.org/10.3390/clinpract12040058

Article Metrics

Back to TopTop