Next Article in Journal
Artificial Intelligence System for Predicting Prostate Cancer Lesions from Shear Wave Elastography Measurements
Previous Article in Journal
Current and Future Biomarkers for Immune Checkpoint Inhibitors in Head and Neck Squamous Cell Carcinoma
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Current Oncology
Volume 29
Issue 6
10.3390/curroncol29060335
curroncol-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cancer Patients’ Experiences with Telehealth before and during the COVID-19 Pandemic in British Columbia

by
Sara Izadi-Najafabadi
1,2,*,
Lisa McQuarrie
1,2,
Stuart Peacock
1,2,3,
Ross Halperin
4,
Leah Lambert
5,6,
Craig Mitton
7,8 and
Helen McTaggart-Cowan
1,2,3
1
Department of Cancer Control Research, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
2
Canadian Centre for Applied Research in Cancer Control, Vancouver, BC V5Z 1L3, Canada
3
Faculty of Health Sciences, Simon Fraser University, Burnaby, BC V5A 1S6, Canada
4
BC Cancer—Kelowna, Kelowna, BC V1Y 5L3, Canada
5
Department of Nursing and Allied Health Research and Knowledge Translation, BC Cancer, Vancouver, BC V5Z 1G1, Canada
6
School of Nursing, University of British Columbia, Vancouver, BC V6T 2B5, Canada
7
Centre for Clinical Epidemiology and Evaluation, Vancouver Coastal Health Research Institute, Vancouver, BC V5Z 1M9, Canada
8
School of Population and Public Health, University of British Columbia, Vancouver, BC V6T 1Z3, Canada
*
Author to whom correspondence should be addressed.
Curr. Oncol. 2022, 29(6), 4199-4211; https://doi.org/10.3390/curroncol29060335
Submission received: 30 April 2022 / Revised: 26 May 2022 / Accepted: 3 June 2022 / Published: 10 June 2022
Review Reports Versions Notes

Abstract

:
Background: Patients have had their cancer care either postponed or changed to telehealth visits to reduce exposure to COVID-19. However, it is unclear how these changes may have affected their experiences. We aim to identify patient characteristics that affect telehealth experiences and evaluate their preferences for using telehealth in the future. Methods: Patients who completed the Outpatient Cancer Care (OCC) Patient Experience Survey were invited to participate. They comepleted the modified OCC Survey, which focused on telehealth during the pandemic. Linear and logistic regression analyses were used to identify patient characteristics that influenced telehealth experiences and preferences for future telehealth use. Results: Perceived ease of participation in telehealth is a significant predictor of the change in patients’ ratings of their telehealth experience. We found that cancer patients had lower preferences for using telehealth in the future if they were older, female, or non-white; resided in an urban area; had no previous telehealth experience; had lower education; and had poorer mental health. Conclusions: To optimize cancer care and improve equitable access to high-quality telehealth care during the pandemic and beyond, clinicians and policymakers will need to consider patients’ self-reported experiences and their personal characteristics.

1. Introduction

During the COVID-19 pandemic, health care systems have been overwhelmed by the number of COVID-19 cases and by shortages of medical supplies and personnel [1,2,3]. The pandemic posed a major risk of compromising treatment for cancer patients around the world [4]. Cancer patients may have modified treatments, canceled screening and surveillance tests, delayed surgical procedures, and increased uncertainty in mapping out future care [5,6].
To ensure care continuity and quality while reducing the risk of COVID-19 exposure, the structure and delivery of care were rapidly redesigned at the start of the pandemic in many jurisdictions in Canada and beyond. Many in-person interactions were transitioned to telehealth, which is the provision of health care remotely by means of telecommunications technology (e.g., telephone, video) [7,8]. Increases in telehealth visits were observed across Canada at the start of the pandemic [9,10,11].
Globally, telehealth appointments have been well received by patients, with high rates of satisfaction among patients [9,10,12,13,14,15,16,17,18,19,20,21]. Benefits of telehealth identified by patients included reduced exposure to COVID-19 [15,22] and convenience (e.g., time and money saved by avoiding travel to in-person appointments) [10,16,17,20,22,23,24]. However, this rapid shift into telehealth has substantial negative consequences in terms of clinician-patient relationships, cybersecurity and technical aspects, and health care accessibility [25]. Cancer patients have expressed difficulty with cultivating a clinician-patient relationship, and clinicians have had concerns regarding the ability to conduct physical examinations and read physical cues in the patient’s body language [12,16,20,23,24,26,27]. Moreover, cancer patients preferred in-person appointments for receiving difficult news [18,20,24]. A small proportion of patients also reported technical issues during telehealth appointments [12,17,22,23].
In this study, we were presented with a unique opportunity to conduct a natural experiment to compare cancer patients’ experiences with telehealth before and during the pandemic in BC. We build on previous work conducted by the BC Ministry of Health (MoH) [28], whose responsibility is to ensure quality, appropriate, cost-effective, and timely health services for individuals in the province. Specifically, the aims of this study were to: (1) identify patient characteristics that affect changes in their telehealth experiences (before and during the pandemic) and (2) evaluate patients’ preferences for using telehealth in the future.

2. Materials and Methods

2.1. Study Design and Survey

The MoH developed a 126-item Outpatient Cancer Care (OCC) Patient Experience Survey [29] to inquire about cancer patients’ experiences with treatment, care providers, and telehealth in the previous six months. Additional items asked patients about their diagnosis, treatment, and health-related quality of life (HRQL) (i.e., the Veterans RAND 12 Item Health Survey (VR-12)) [30]. The OCC Survey was administered in two waves to BC patients receiving active cancer treatment at a BC Cancer Centre and/or at a Community Oncology Network (CON) site. Wave 1 was administered October–December 2019 and collected data from patients who received cancer treatment between April and June 2019. Wave 2 was administered January–May 2020 and collected data from patients who received cancer treatment between July and October 2019. Responses to Wave 1 and 2 surveys captured patients’ experiences before the pandemic, but for the purposes of this study, we focused on Wave 2 for pre-pandemic data.
For the current study, patients who completed the OCC Survey Wave 2 were invited to participate in this study between 1 May and 30 July 2021. They completed a modified OCC Patient Experience Survey, hereafter referred to as Wave 3. This modified 62-item survey included sociodemographic and treatment questions, as well as the VR-12. We included additional items designed by the BC Office of Patient-Centred Measurement (BCPCM) [31] to focus on patient experiences with telehealth and their cancer care providers during the COVID-19 pandemic. The responses to Wave 3 described patients’ experiences during the pandemic. Specifically, patient’s experience with telehealth was measured on an 11-point response scale, ranging from 0 (very poor experience) to 10 (very good experience), and the patient’s strength of preference for using telehealth after the pandemic was categorized on a 4-level response scale (i.e., definitely yes, probably yes, probably no, and definitely no). Cancer patients’ experiences and responses to Wave 2 (before the pandemic) and Wave 3 (during the pandemic) are the focus of this study. A copy of the survey is available upon request.

2.2. Study Participants

To be eligible for this study, patients needed to self-report having received cancer care during the pandemic. For the purpose of this study, the start of the pandemic is defined as 16 March 2020, the date on which BC Cancer shifted in-person cancer care to virtual care as a result of the pandemic. Patients had the option of completing the Wave 3 survey either online or on paper. The survey was available in English and, upon request, in Punjabi and in traditional and simplified Chinese.

2.3. Analysis

2.3.1. Study Sample Description

Using the responses to Wave 3, the study sample was characterized in terms of current age, sex, education, race, health authority, region of residence, previous experience with telehealth, and tumor type. If information was missing, the values reported in Wave 2 were used. Categorical variables were summarized as the proportion of the sample within each group, and continuous variables that were normally distributed were summarized as means and standard deviations (SDs).
Responses to the VR-12 were used to generate each patient’s physical component score (PCS) and mental component score (MCS), where higher scores represent better physical and mental health, respectively [30]. A paired t-test was used to compare the PCS and MCS scores between Waves 2 and 3. The types of resources patients used to seek medical advice before and during the pandemic were collated and compared using a McNemar’s test. The Bonferroni method was used to correct for multiple testing.

2.3.2. Multiple Imputation for Missing Data

Missing information was present for all variables of interest. Missingness ranged from 0.4 to 18%, with the question “Was the care advice you received during your Virtual Health/Telehealth visit(s) helpful to you?” accounting for the most missing values. The results from Little’s missing completely at random (MCAR) test [32] showed that the data were missing completely at random (X2 = 31727.6, df = 33032, p = 1.0). As such, multiple imputation models were established for each variable with missing values; binary variables were imputed using logistic regression, and continuous variables were imputed with predictive mean matching. The number of imputed data sets was 30. The imputations were conducted separately for the two outcome measures (i.e., the change in the ratings of patients’ experience with telehealth and patients’ preferences for the future use of telehealth) because the outcomes applied to different subgroups.

2.3.3. Experiences with Telehealth

The ordinal variables of telehealth ratings for Waves 2 and 3 were summarized as medians, and a Wilcoxon signed-rank test was used to assess whether patients’ experiences differed between the two time points. The following independent variables were used in a multivariate linear regression as they were anticipated to influence a change in patients’ telehealth ratings: current age, sex, race, region of residence, health authority where care was received, education level, perceived ease of participating in a telehealth consult, and VR-12 score (i.e., PCS and MCS).

2.3.4. Preference to Use Telehealth in the Future

Patient responses to preferences for using telehealth in the future were collapsed to “yes” (i.e., definitely yes and probably yes) and “no” (i.e., definitely no and probably no) to improve interpretation and to manage any quasi-complete separation in the logistic regression. The same independent variables used in the multivariate linear regression plus previous experience with telehealth were included in this logistic regression to determine factors affecting patients’ preferences to use telehealth when the COVID-19 pandemic is over.
Statistical tests of associations were completed using SAS Software, version 9.4 (SAS Institute Inc., Cary, NC, USA). Multiple imputation and regression analyses were conducted in R, version 4.1.2, using the MICE package, version 3.14.0 [33]. Statistical significance was defined at p ≤ 0.05.

3. Results

3.1. Study Participants

Of the cancer patients who completed Wave 2 (n = 5347), n = 614 were not sampled because they were deceased as of 30 April 2021 (n = 284) or they were deemed ineligible to participate (e.g., who received care from a health authority that did not grant permission to re-contact their patients or who were identified to be receiving end-of-life care) (n = 330). Therefore, n = 4733 participants were invited to participate in this study.
A total of 2623 cancer patients completed the Wave 3 survey, for a response rate of 0.55. Of those patients completing Wave 3, the following were excluded because they self-reported not receiving care for their cancer during the pandemic (n = 631) or did not provide any information regarding their receipt of cancer care during the pandemic (n = 21): Two patients completed the survey twice; the duplicate responses were removed randomly. The final analysis set included 1958 cancer patients (Table 1). The mean (±SD) age of the patients was 69.4 (±10.9) years. The majority of the sample were female (assigned at birth; n = 1074, 55%) and white (n = 1533, 78%).
The patients’ mean (±SD) MCS significantly increased during the pandemic (53.02 (±10.79)) compared with before the pandemic (50.78 (±9.99)) (t = 10.13, df = 1886, p < 0.0001). The mean (±SD) PCS of the study patients significantly decreased during the pandemic (41.20 (±11.85)) compared with before the pandemic (42.86 (±10.83)) (t = −7.9, df = 1895, p < 0.0001).

3.2. Medical Resources Utilized by Patients

More patients reported participating in at least one virtual health visit during the pandemic (n = 1382, 71%) than before the pandemic (n = 789, 40%). The frequency of patients who attended at least one phone visit (X2 = 282.83, df = 1, p < 0.0001) or video visit (X2 = 14.94, df = 1, p < 0.0001) changed significantly during the pandemic compared with before the pandemic (Table 2).
Regardless of the survey wave, patients reported more often having phone visits with their regular oncologist whom they consulted with most often and their family doctor (Supplementary Figure S1a). However, phone visits with regular oncologists decreased between the survey waves (before pandemic: n = 548, 40%; during pandemic: n = 947, 36%), whereas the proportion of phone visits with family doctors increased (before the pandemic: n = 353, 25%; during the pandemic: n = 760, 29%). The proportion of patients with at least one phone visit with their family doctor was significantly different (X2 = 32.6, df = 1, p = 0.0001), even after Bonferroni correction (p < 0.0025), during the pandemic compared with before the pandemic.
Patients reported having video visits with their regular oncologists (n = 90, 41%) or another oncologist (n = 36, 17%) before the pandemic (Supplementary Figure S1b). Although the proportion of video visits with their regular oncologists decreased during the pandemic (n = 103, 33%), the proportion of video visits with their family doctors increased (n = 65, 21%). However, the proportion of video visits with other types of health care professionals did not change from before to during the pandemic.

3.3. Patient Experiences with Telehealth

Of patients who had at least one telehealth visit during the pandemic, most reported positive experiences with telehealth. In particular, the majority found telehealth visits easy or very easy to use (n = 927, 80%) and helpful or very helpful (n = 891, 79%), and most would probably or definitely recommend telehealth to other patients (n = 1032, 87%) (Table 3 and Table 4).
Despite the favorable experiences reported by the patients, a relatively large proportion of patients, with and without telehealth visit experiences during the pandemic, reported that telehealth was not a good alternative to in-person visits (n = 657, 36%) and that they would not use telehealth if offered after the COVID-19 pandemic (n = 678, 37%).

3.4. Patient Characteristics Affecting Telehealth Experiences

Not surprisingly, an increase in the number of patients using telehealth was observed during the pandemic (n = 1382) compared with before the pandemic (n = 463). Patients’ ratings of their telehealth experiences changed (W = −1780, p < 0.0001) during the pandemic (median = 9) compared with before the pandemic (median = 10).
Using responses from patients reporting telehealth experience ratings at both time points (n = 331), patients’ perceived ease of participation and patients’ education level were identified as significant predictors (Table 5). Patients who perceived participating in telehealth during the pandemic as being at least “neither easy nor difficult” had greater changes in their ratings of telehealth experience from before to during the pandemic compared to patients who perceived participating in telehealth as “difficult or very difficult”. Moreover, patients with higher education levels had smaller changes in their ratings of telehealth experience.

3.5. Patient Characteristics Affecting Preferences to Use Telehealth in the Future

Of patients who reported having used telehealth during the pandemic (n = 1382), age, sex, previous experience with telehealth, region of residence, education, ease of participation in telehealth visits, and MCS were significant predictors of their preference to use telehealth in the future (Table 6). Specifically, older female patients with an education level of high school or less who live in urban areas, have lower MCS, and perceive telehealth as difficult or very difficult to use had lower preferences for using telehealth if it is offered after the COVID-19 pandemic is over. The results show that patients with previous experience with telehealth are 1.5 times more likely to indicate that they would use telehealth in the future compared with those without this experience. Additionally, patients who perceived participation in telehealth visits as “neither easy nor difficult” and as “easy” are approximately 11.4 and 29.7 times, respectively, more likely to prefer to use telehealth in the future compared with those who reported participating in telehealth to be difficult.

4. Discussion

The study findings demonstrated that the proportion of telehealth visits increased during the COVID-19 pandemic; this is consistent with other reports [34]. We found a higher proportion of telehealth visits with oncologists and family doctors compared with other health care professionals (e.g., nurse, psychiatrist, psychologist); this may be a result of a few factors. First, the higher proportion of virtual oncology visits may be a result of a BC pilot project launched in 2018 to deliver follow-up cancer care virtually by oncologists [35]. Second, the College of Family Physicians of Canada developed a framework to improve patients’ cancer care experiences during the pandemic. Specifically, family doctors were encouraged to transition to telehealth, provide supportive care, and collaborate with the cancer care team to ensure the continuity of care [36]. The recommended responsibilities of family doctors may explain the increased frequency in phone visits during the pandemic. Third, telehealth visits with family doctors were covered under public health insurance even before the COVID-19 pandemic, making it easier for patients to access this service [35]. Immediately after the start of the pandemic, public health insurance approved the use of phone visits, which enabled physicians to provide health care via the phone to reduce the risk of COVID-19 exposure while increasing health care accessibility to patients who do not have access to video communication [37].
Similar to the results in Canada and elsewhere [18], we found that phone visits were more commonly used than video visits. This may be a result of different factors, such as organizations’ telehealth infrastructures, patient and clinician preferences, and patients’ demographics (i.e., age, race) including access to technology (e.g., phone vs computer) [27,38]. Phone visits do not require high digital literacy or internet accessibility, whereas video visits may require more IT support and higher network bandwidth, thus making the phone a more equitable and accessible option [39]. The type of telehealth visit (i.e., phone vs video) is not associated with social vulnerability (i.e., socioeconomic status, transportation, disability, unemployment) [27], or patients’ satisfaction with their care [40,41]. Previous studies have stated that both patients and health care providers prefer video over the phone as it allows for better nonverbal communication and clinician-patient relationships [10,16,17,18,42] To support these preferences, health organizations can improve their patients’ digital literacy by offering training sessions or a telehealth patient navigator.
Cancer patients in this study found telehealth visits to be easy to participate in (80%) and helpful (79%); they would recommend telehealth visits to other patients (87%). However, a relatively large proportion of them do not think telehealth is a good alternative to in-person visits (36%) and would not use telehealth if it were offered to them after the COVID-19 pandemic is over (37%). This mixed result aligns with previous work in this area. Some studies found that patients’ overall satisfaction with telehealth is high [9,10,12,13,14,15,16,17,18,19,20,21]. Reducing exposure to COVID-19 [15,22], including the time- and money-saving benefits of telehealth, promotes telehealth visits as a favorable option during the pandemic [10,16,17,20,22,23,24,43,44]. Despite its benefits, some patients felt that telehealth is not a good alternative to in-person visits because it does not optimize patients’ experience (e.g., no physical examinations) (43,44), and may compromise clinician-patient relationship, cybersecurity, and health care accessibility [12,25]. Moreover, the lack of emotional support, the varying levels of involvement of family and friends in care, the lack of resources and referrals, and being on active treatment have been shown to negatively affect patients’ satisfaction with telehealth [10,45].
Our results demonstrated that patients’ ratings of their experiences with telehealth reduced slightly during the COVID-19 pandemic. Before the pandemic, telehealth was perceived to be an add-on to their regular, in-person care. Patients were provided with the option of telehealth visits, resulting in a higher satisfaction with telehealth visits. The timing of our Wave 3 survey coincided with the third wave of the pandemic, when telehealth visits were more readily being offered to patients. The patients’ worse experiences with telehealth may be a result of not being provided the choice of in-person versus remote visits.
The findings from our study further add to the evidence that telehealth may disproportionately benefit more advantaged populations. We found that patients with lower education levels and those who perceived telehealth to be difficult or very difficult had larger changes in their ratings of their telehealth experience. These findings are critical for future policy making and for developing health care infrastructure that ensures access to high-quality, person-centered care. Other sociodemographic factors such as race, age, culture, and immigration status have been shown to influence patients’ ability to have successful telehealth appointments, which in turn can worsen patients’ access to health services [9,25,27,46]. Previous studies have shown that during the pandemic, patients who were older, had shorter treatment duration, identified as a visible minority, were foreign born, were in linguistic isolation, or had recently immigrated had lower preferences for receiving telehealth for their cancer care [9,13,15,18,24,26].
In our study, females indicated lower preferences to use telehealth in the future; this is contrary to other reports that demonstrated that female cancer patients had greater satisfaction with telehealth during the COVID-19 pandemic [9,47]. These studies, however, did not focus on patients’ preferences for telehealth when provided with a choice between in-person and virtual visits in the future. This finding highlights that the possible sex and gender differences in the future uptake of telehealth visits need to be explored further using qualitative methodology to gain a richer understanding in intersectionality between the concepts of sex and gender.
Our findings support the reduction of the rural-urban disparities in cancer care through the use of telehealth by improving health care access in rural communities [48,49]. Cancer-related symptoms (e.g., pain and discomfort) impose mental and physical hardship to patients, which may make traveling to access cancer care challenging. Patients from rural areas of BC have indicated high satisfaction with telehealth. They have a preference for video over phone visits and for telehealth as a supplement to rather than a replacement for in-person visits [50].
Our results showed that the mental health of cancer patients significantly increased during the pandemic. In line with our results, another longitudinal study found that HRQL of cancer patients was not affected as a result of the pandemic [51]. Given that COVID-19 restrictions applied to everyone with and without cancer, cancer patients did not feel they were missing out on anything by staying at home [52]. Moreover, they did not have to face difficult social interactions that required disclosing and explaining their diagnosis, which gave them a sense of relief and control [52]. Despite the anxiety, depression, and isolation following the COVID-19 pandemic, data suggest that some cancer patients appreciated the opportunity to stay at home and spend time with their families during the pandemic [52,53].

5. Limitations

This study contains a large number of patient responses regarding their telehealth experiences before and during the pandemic. However, patients providing survey responses may be subjected to selection bias, which may influence the overall generalizability of the results. Our data may not include populations that face a disproportionate burden of health and social inequities (e.g., unstable housing, food insecurity, mental health, and substance use challenges); therefore, their experiences of cancer care during the pandemic may not be captured as they may not have attended a telehealth visit or may not have participated in our survey. Our survey was only available in English or the three most commonly spoken non-English languages in BC. As such, it is possible that important and divergent perspectives of patients who could not complete the survey may have been missed. Furthermore, we did not verify the patients’ self-reported responses regarding whether they attended a telehealth visit during the pandemic; as a result, we have plans to link survey responses with BC Cancer health care utilization data. Wave 2 survey responses were collected between January and May 2020 for those patients receiving active treatment between July and October 2019; as such, patient responses to the Wave 2 survey may have been confounded by their experiences during the start of the pandemic. Our future work will include accessing survey responses from Wave 1 to have an unbiased before-pandemic sample. Further, conducting a longitudinal analysis will provide us with a better understanding of the evolution of patient experiences with telehealth. The study patients were also given the opportunity to provide written feedback regarding their experiences with telehealth in the survey, which we will analyze to gain a richer picture of cancer patients’ experiences.

6. Conclusions

The increased use of telehealth during the pandemic allowed cancer patients access to their health care team while reducing their risk of exposure to COVID-19. While telehealth is associated with benefits, we found that patients’ experiences with telehealth were not equitable. The need to optimize cancer care and enhance equitable access to high-quality telehealth care is important as we navigate into post-pandemic cancer care.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/curroncol29060335/s1, Figure S1: Proportion of phone (1a) and video (1b) visits with various health care professionals before and during the COVID-19 pandemic.

Author Contributions

Conceptualization, H.M.-C. and S.P; methodology, H.M.-C. and S.P.; formal analysis, S.I.-N., L.M. and H.M.-C.; writing—original draft preparation, S.I.-N., L.M. and H.M.-C.; writing—review and editing, R.H., S.I.-N., L.L., L.M., H.M.-C., C.M. and S.P.; supervision, H.M.-C. and S.P.; project administration, H.M.-C., S.I.-N. and S.P.; funding acquisition, S.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Canadian Centre for Applied Research in Cancer Control (ARCC). ARCC is funded through a Canadian Cancer Society grant (2015-703549).

Institutional Review Board Statement

The study was approved by the Research Ethics Board at BC Cancer (H20-01836 on 23 September 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The de-identified data supporting the findings of this article will be made available by the authors upon reasonable request.

Acknowledgments

The authors would like to thank the cancer patients who shared their experiences through the survey study. We would also like to thank Lena Cuthbertson, Jonathan Simkin, and Cindy Stock for supporting the data access for the analysis.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liang, W.; Guan, W.; Chen, R.; Wang, W.; Li, J.; Xu, K.; Li, C.; Ai, Q.; Lu, W.; Liang, H.; et al. Cancer patients in SARS-CoV-2 infection: A nationwide analysis in China. Lancet Oncol. 2020, 21, 335–337. [Google Scholar] [CrossRef]
  2. Wang, H.; Zhang, L. Risk of COVID-19 for patients with cancer. Lancet Oncol. 2020, 21, e181. [Google Scholar] [CrossRef]
  3. Al-Quteimat, O.M.; Amer, A.M. The impact of the COVID-19 pandemic on cancer patients. Am. J. Clin. Oncol. 2020, 43, 452–455. [Google Scholar] [CrossRef]
  4. Harky, A.; Chiu, C.M.; Yau, T.H.L.; Lai, S.H.D. Cancer patient care during COVID-19. Cancer Cell 2020, 37, 749–750. [Google Scholar] [CrossRef]
  5. Hanna, T.P.; Evans, G.A.; Booth, C.M. Cancer, COVID-19 and the precautionary principle: Prioritizing treatment during a global pandemic. Nat. Rev. Clin. Oncol. 2020, 17, 268–270. [Google Scholar] [CrossRef]
  6. Yashavantha Rao, H.C.; Siddeeqh, S.; Taqui, S.N. Caring for cancer patients during COVID-19 global pandemic: Risk factors and precautionary principle. Int. J. Clin. Pract. 2021, 75, e14141. [Google Scholar] [CrossRef]
  7. Mehrotra, A.; Ray, K.; Brockmeyer, D.M.; Barnett, M.L.; Bender, J.A. Rapidly converting to “virtual practices”: Outpatient care in the era of Covid-19. NEJM Catal. Innov. Care Deliv. 2020, 1. [Google Scholar]
  8. Shirke, M.M.; Shaikh, S.A.; Harky, A. Tele-oncology in the COVID-19 era: The way forward? Trends Cancer 2020, 6, 547–549. [Google Scholar] [CrossRef]
  9. Berlin, A.; Lovas, M.; Truong, T.; Melwani, S.; Liu, J.; Liu, Z.A.; Badzynski, A.; Carpenter, M.B.; Virtanen, C.; Morley, L.; et al. Implementation and outcomes of virtual care across a tertiary cancer center during COVID-19. JAMA Oncol. 2021, 7, 597–602. [Google Scholar] [CrossRef]
  10. Watson, L.; Qi, S.; Delure, A.; Link, C.; Photitai, E.; Chmielewski, L.; Hildebrand, A.; Ruether, D.; Rawson, K. Virtual cancer care during the COVID-19 pandemic in Alberta: Evidence from a mixed methods evaluation and key learnings. JCO Oncol. Pract. 2021, 17, e1354–e1361. [Google Scholar] [CrossRef]
  11. BC Cancer. BC Cancer Embraces Virtual Health during COVID-19. 2020. Available online: http://www.bccancer.bc.ca/about/news-stories/stories/bc-cancer-embraces-virtual-health-during-covid-19 (accessed on 5 March 2022).
  12. Ambrosini, F.; Di Stasio, A.; Mantica, G.; Cavallone, B.; Serao, A. COVID-19 pandemic and uro-oncology follow-up: A “virtual” multidisciplinary team strategy and patients’ satisfaction assessment. Arch. Ital. Urol. Androl. 2020, 92. [Google Scholar] [CrossRef] [PubMed]
  13. Cadili, L.; DeGirolamo, K.; Ma, C.S.-Y.; Chen, L.; McKevitt, E.; Pao, J.-S.; Dingee, C.; Bazzarelli, A.; Warburton, R. The breast cancer patient experience of telemedicine during COVID-19. Ann. Surg. Oncol. 2022, 29, 2244–2252. [Google Scholar] [CrossRef] [PubMed]
  14. Di Lalla, V.; Patrick, H.; Siriani-Ayoub, N.; Kildea, J.; Hijal, T.; Alfieri, J. Satisfaction among cancer patients undergoing radiotherapy during the COVID-19 pandemic: An institutional experience. Curr. Oncol. 2021, 28, 1507–1517. [Google Scholar] [CrossRef] [PubMed]
  15. Hasson, S.P.; Waissengrin, B.; Shachar, E.; Hodruj, M.; Fayngor, R.; Brezis, M.; Nikolaevski-Berlin, A.; Pelles, S.; Safra, T.; Geva, R.; et al. Rapid implementation of telemedicine during the COVID-19 pandemic: Perspectives and preferences of patients with cancer. Oncologist 2021, 26, e679–e685. [Google Scholar] [CrossRef] [PubMed]
  16. Howden, K.; Glidden, C.; Romanescu, R.G.; Hatala, A.; Scott, I.; Deleemans, J.; Chalifour, K.; Eaton, G.; Gupta, A.A.; Bolton, J.M.; et al. A cross-sectional survey exploring the impact of the COVID-19 pandemic on the cancer care of adolescents and young adults. Curr. Oncol. 2021, 28, 3201–3213. [Google Scholar] [CrossRef]
  17. Lopez, C.J.; Edwards, B.; Langelier, D.M.; Chang, E.K.; Chafranskaia, A.; Jones, J.M. Delivering virtual cancer rehabilitation programming during the first 90 days of the COVID-19 pandemic: A multimethod study. Arch. Phys. Med. Rehabil. 2021, 102, 1283–1293. [Google Scholar] [CrossRef]
  18. Loree, J.M.; Dau, H.; Rebić, N.; Howren, A.; Gastonguay, L.; McTaggart-Cowan, H.; Gill, S.; Raghav, K.; De Vera, M.A. Virtual oncology appointments during the initial wave of the COVID-19 pandemic: An international survey of patient perspectives. Curr. Oncol. 2021, 28, 671–677. [Google Scholar] [CrossRef]
  19. Mullally, W.J.; Greene, J.; Jordan, E.; Horgan, A.; Calvert, P.; O’Connor, M. Cancer patients’ satisfaction with virtual clinics in Ireland during COVID-19. Res. Square 2020. [Google Scholar] [CrossRef]
  20. Smrke, A.; Younger, E.; Wilson, R.; Husson, O.; Farag, S.; Merry, E.; Macklin-Doherty, A.; Cojocaru, E.; Arthur, A.; Benson, C. Telemedicine during the COVID-19 pandemic: Impact on care for rare cancers. JCO Glob. Oncol. 2020, 6, 1046–1051. [Google Scholar] [CrossRef]
  21. Tashkandi, E.; BaAbdullah, M.; Zeeneldin, A.; AlAbdulwahab, A.; Elemam, O.; Elsamany, S.; Alfayez, M.; Dabash, Y.; Khayat, E.; Hassanin, F.; et al. Optimizing the communication with cancer patients during the COVID-19 pandemic: Patient perspectives. Patient Prefer. Adherence 2020, 14, 1205–1212. [Google Scholar] [CrossRef]
  22. Chang, P.J.; Jay, G.M.; Kalpakjian, C.; Andrews, C.; Smith, S. Patient and provide-reported satisfaction of cancer rehabilitation telemedicine visits during the COVID -19 pandemic. PM&R 2021, 13, 1362–1368. [Google Scholar] [CrossRef]
  23. Arem, H.; Moses, J.; Cisneros, C.; Blondeau, B.; Nekhlyudov, L.; Killackey, M.; Pratt-Chapman, M.L. Cancer provider and survivor experiences with telehealth during the COVID-19 pandemic. JCO Oncol. Pract. 2021, 18, e452–e461. [Google Scholar] [CrossRef] [PubMed]
  24. Gotlib Conn, L.; Tahmasebi, H.; Meti, N.; Wright, F.C.; Thawer, A.; Cheung, M.; Singh, S. Cancer treatment during COVID-19: A qualitative analysis of patient-perceived risks and experiences with virtual care. J. Patient Exp. 2021, 8. [Google Scholar] [CrossRef] [PubMed]
  25. Broom, A.; Kenny, K.; Page, A.; Cort, N.; Lipp, E.S.; Tan, A.C.; Ashley, D.M.; Walsh, K.M.; Khasraw, M. The paradoxical effects of COVID-19 on cancer care: Current context and potential lasting impacts. Clin. Cancer Res. 2020, 26, 5809–5813. [Google Scholar] [CrossRef] [PubMed]
  26. Kilgour, H.M.; Galica, J.; Oliffe, J.L.; Haase, K.R. The needs of older adult cancer survivors during COVID-19: Implications for oncology nursing. Semin. Oncol. Nurs. 2021, 37, 151229. [Google Scholar] [CrossRef]
  27. McAlarnen, L.A.; Tsaih, S.W.; Aliani, R.; Simske, N.M.; Hopp, E.E. Virtual visits among gynecologic oncology patients during the COVID-19 pandemic are accessible across the social vulnerability spectrum. Gynecol. Oncol. 2021, 162, 4–11. [Google Scholar] [CrossRef]
  28. BC Ministry of Health. BC Gov. Available online: https://www2.gov.bc.ca/gov/content/governments/organizational-structure/ministries-organizations/ministries/health (accessed on 5 March 2022).
  29. Outpatient Cancer Care Survey. Prov. Health Serv. Auth. 2020. Available online: http://www.phsa.ca/about/accountability/patient-experience/outpatient-cancer-care-survey (accessed on 5 March 2022).
  30. Selim, A.; Rogers, W.; Qian, S.; Rothendler, J.A.; Kent, E.E.; Kazis, L.E. A new algorithm to build bridges between two patient-reported health outcome instruments: The MOS SF-36® and the VR-12 Health Survey. Qual. Life Res. 2018, 27, 2195–2206. [Google Scholar] [CrossRef]
  31. Surveys. BC Off. Patient-Centred Meas. BCPCM. 2022. Available online: https://www.bcpcm.ca/surveys (accessed on 5 March 2022).
  32. Little, R.J.A. A test of missing completely at random for multivariate data with missing values. J. Am. Stat. Assoc. 1988, 83, 1198–1202. [Google Scholar] [CrossRef]
  33. RStudio Team. RStudio: Integrated Development for R. RStudio; PBC: Boston, MA, USA, 2020; Available online: http://www.rstudio.com/ (accessed on 5 March 2022).
  34. Ugas, M.A.; Samoil, D.; Avery, L.; Berlin, A.; Giuliani, M.E.; Papadakos, T.J.; Quartey, N.K.; Papadakos, J.K. COVID-19 and patients with cancer: Investigating treatment impact, information sources, and COVID-19–related knowledge, attitudes, and practices. Cancer 2022, 128, 746–761. [Google Scholar] [CrossRef]
  35. Canadian Partnership Against Cancer. Virtual Care in Canada: Environmental Scan; Canadian Partnership Against Cancer: Toronto, ON, Canada, 2019. [Google Scholar]
  36. McCabe, J.; Vellani, K. Helping your patient navigate their cancer care during COVID-19: A guide for primary care providers. Can. Fam. Physician 2022. [Google Scholar]
  37. Doctors Technology Office. Virtual Care Toolkit. 2021. Available online: https://www.doctorsofbc.ca/sites/default/files/dto_virtual_care_toolkit.pdf (accessed on 5 March 2022).
  38. Rodriguez, J.A.; Betancourt, J.R.; Sequist, T.D.; Ganguli, I. Differences in the use of telephone and video telemedicine visits during the COVID-19 pandemic. Am. J. Manag. Care 2021, 27, 21–26. [Google Scholar] [PubMed]
  39. Falk, W. The State of Virtual Care in Canada as of Wave Three of the COVID-19 Pandemic: An Early Diagnostique and Policy Recommendations. Health Canada. 2021. Available online: https://www.canada.ca/content/dam/hc-sc/documents/corporate/transparency_229055456/health-agreements/bilateral-agreement-pan-canadian-virtual-care-priorities-covid-19/template-wf-report-eng.pdf (accessed on 5 March 2022).
  40. Allen, A.Z.; Zhu, D.; Shin, C.; Glassman, D.T.; Abraham, N.; Watts, K.L. Patient satisfaction with telephone versus video-televisits: A cross-sectional survey of an Urban, Multiethnic Population. Urology 2021, 156, 110–116. [Google Scholar] [CrossRef] [PubMed]
  41. Buchanan, A.H.; Datta, S.K.; Skinner, C.S.; Hollowell, G.P.; Beresford, H.F.; Freeland, T.; Rogers, B.; Boling, J.; Marcom, P.K.; Adams, M.B. Randomized trial of telegenetics vs. in-person cancer genetic counseling: Cost, patient satisfaction and attendance. J. Genet. Couns. 2015, 24, 961–970. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Barsom, E.Z.; Van Dalen, A.S.H.; van Oud-Alblas, M.B.; Buskens, C.J.; Van De Ven, A.W.; Tanis, P.J.; Schijven, M.P.; Bemelman, W.A. Comparing video consultation and telephone consultation at the outpatient clinic of a tertiary referral centre: Patient and provider benefits. BMJ Innov. 2021, 7, 95–102. [Google Scholar] [CrossRef]
  43. Layfield, E.; Triantafillou, V.; Prasad, A.; Deng, J.; Shanti, R.M.; Newman, J.G.; Rajasekaran, K. Telemedicine for head and neck ambulatory visits during COVID-19: Evaluating usability and patient satisfaction. Head Neck 2020, 42, 1681–1689. [Google Scholar] [CrossRef]
  44. Triantafillou, V.; Layfield, E.; Prasad, A.; Deng, J.; Shanti, R.M.; Newman, J.G.; Rajasekaran, K. Patient perceptions of head and neck ambulatory telemedicine visits: A qualitative study. Otolaryngol. Neck Surg. 2021, 164, 923–931. [Google Scholar] [CrossRef]
  45. Bultz, B.D.; Watson, L. Lessons learned about virtual cancer care and distress screening in the time of COVID-19. Support. Care Cancer 2021, 29, 7535–7540. [Google Scholar] [CrossRef]
  46. Veinot, T.C.; Mitchell, H.; Ancker, J.S. Good intentions are not enough: How informatics interventions can worsen inequality. J. Am. Med. Inform. Assoc. 2018, 25, 1080–1088. [Google Scholar] [CrossRef] [Green Version]
  47. Shao, C.C.; McLeod, M.C.; Gleason, L.T.; Dos Santos Marques, I.C.; Chu, D.I.; Wallace, E.L.; Fouad, M.N.; Reddy, S. Inequity in telemedicine use among patients with cancer in the Deep South during the COVID-19 pandemic. Oncologist 2022. [Google Scholar] [CrossRef]
  48. Heifetz, L.J.; Koppel, A.B.; Kaime, E.M.; Palmer, D.; Semrad, T.J.; Lara, P.; Bold, R.J. Addressing rural disparities in cancer care via telehealth. J. Clin. Oncol. 2020, 38, e19090. [Google Scholar] [CrossRef]
  49. Doolittle, G.C.; Spaulding, A.O. Providing access to oncology care for rural patients via telemedicine. J. Oncol. Pract. 2006, 2, 228. [Google Scholar] [CrossRef] [PubMed]
  50. Rush, K.L.; Seaton, C.; Li, E.; Oelke, N.D.; Pesut, B. Rural use of health service and telemedicine during COVID-19: The role of access and eHealth literacy. Health Inform. J. 2021, 27. [Google Scholar] [CrossRef] [PubMed]
  51. Koinig, K.A.; Arnold, C.; Lehmann, J.; Giesinger, J.; Köck, S.; Willenbacher, W.; Weger, R.; Holzner, B.; Ganswindt, U.; Wolf, D.; et al. The cancer patient’s perspective of COVID-19-induced distress—a cross-sectional study and a longitudinal comparison of HRQOL assessed before and during the pandemic. Cancer Med. 2021, 10, 3928–3937. [Google Scholar] [CrossRef] [PubMed]
  52. Drury, A.; Eicher, M.; Dowling, M. Experiences of cancer care during COVID-19: Phase 1 results of a longitudinal qualitative study. Int. J. Nurs. Stud. Adv. 2021, 3, 100030. [Google Scholar] [CrossRef]
  53. Seven, M.; Bagcivan, G.; Pasalak, S.I.; Oz, G.; Aydin, Y.; Selcukbiricik, F. Experiences of breast cancer survivors during the COVID-19 pandemic: A qualitative study. Support. Care Cancer 2021, 29, 6481–6493. [Google Scholar] [CrossRef]
Table
Table 1. The characteristics of the study patients.
Table 1. The characteristics of the study patients.
Demographics *N (%)
All1958 (100%)
Age (years)
Mean (SD)69.40 (10.98)
Min-Max27–98
Mental Component Summary
Mean (SD)53.06 (10.81)
Min-Max11.40–75.84
Physical Component Summary
Mean (SD)41.24 (11.85)
Min-Max6.35–66.60
Sex Assigned at Birth
Female 1074 (55%)
Male 884 (45%)
Education
8th grade or less65 (3%)
Some high school, but did not graduate144 (4%)
High school or high school equivalency certificate426 (22%)
College, CEGEP or other non-university certificate or diploma553 (28%)
Post-graduate degree or professional designation400 (20%)
Undergraduate degree or some university358 (18%)
Missing12 (1%)
Race
White1533 (78%)
East/Southeast Asian237 (12%)
Mixed 38 (2%)
South Asian24 (1%)
Middle Eastern16 (1%)
Latino 15 (1%)
Indigenous (First Nations, Métis, Inuk/Inuit)14 (1%)
Black 8 (0.4)
Other 31 (2%)
Prefer not to answer36 (2%)
Missing 6 (0.3%)
Health Authority
Fraser Health589 (30%)
Vancouver Island Health530 (27%)
Vancouver Coastal Health420 (21%)
Interior Health355 (18%)
Northern Health64 (3%)
Region of Residence **
Urban1806 (92%)
Rural152 (8%)
Previous Experience with Telehealth
Yes630 (32%)
No1278 (65%)
Missing50 (3%)
Tumor Type
Breast 612 (31%)
Prostate 365 (19%)
Leukemia 117 (6%)
Multiple Myeloma 85 (4%)
Lung 75 (4%)
Other blood disorder 62 (3%)
Non-Hodgkin Lymphoma 52 (3%)
Bladder 50 (3%)
Cervix/uterine/ovarian/vulvar 40 (2%)
Colorectal 38 (2%)
Melanoma 19 (1%)
Kidney 17 (0.9%)
Liver 14 (0.7%)
Thyroid 14 (0.7%)
Non-invasive tumour 13 (0.7%)
Brain or central nervous system10 (0.5%)
Pancreas 9 (0.5%)
Sarcoma 8 (0.4%)
Stomach 8 (0.4%)
Esophagus 7 (0.4%)
Oral 5 (0.3%)
Hodgkin Lymphoma 3 (0.2%)
Eye 2 (0.1%)
Testis 2 (0.1%)
Other 109 (6%)
Missing 222 (11%)
* If the value of a sociodemographic variable was missing from the Wave 3 data set, we took the value reported in Wave 2. ** If the second digit of patients’ postal code was a 0, then it was coded as rural; otherwise it was coded as urban.
Table
Table 2. The changes in the frequencies of phone and video visits before and during the COVID-19 pandemic.
Table 2. The changes in the frequencies of phone and video visits before and during the COVID-19 pandemic.
Frequency before COVID-19Frequency during COVID-19
None1 Visit or MoreTotal
Phone visits *None308 (18%)665 (39%)973
1 visit or more177 (10%)555 (33%)732
Total48512201705
Video visits **None1469 (82%)146 (8%)1615
1 visit or more87 (5%)85 (5%)172
Total15562311798
* Frequency missing = 253; ** Frequency missing = 171.
Table
Table 3. The patients’ experiences with telehealth visits during the COVID-19 pandemic.
Table 3. The patients’ experiences with telehealth visits during the COVID-19 pandemic.
How Easy or Difficult Was It for You to Participate in This Virtual Health/Telehealth Visit? *N (%)Was the Care Advice You Received during Your Virtual Health/Telehealth Visit(s) Helpful? *N (%)
Very difficult17 (1%)Very unhelpful81 (7%)
Difficult32 (3%)Unhelpful25 (2%)
Neither easy nor difficult188 (16%)Somewhat helpful141 (12%)
Easy390 (33%)Helpful509 (45%)
Very easy537 (46%)Very helpful382 (34%)
Missing222Missing244
* Only patients who had telehealth visits were asked to answer these questions (n = 1382).
Table
Table 4. The patients’ preferences for using telehealth.
Table 4. The patients’ preferences for using telehealth.
Do You Think Virtual Health/Telehealth Visits Could Be a Good Alternative to In-Person Visits for You in the Future?Would You Use Virtual Health/Telehealth If Offered to You Your Care Providers When the COVID-19 Pandemic Is Over?Would You Recommend Virtual Health/Telehealth to Other Patients? *
N (%)N (%)N (%)
Definitely no252 (14%)225 (12%)44 (4%)
Probably no405 (22%)453 (25%)101 (9%)
Probably yes761 (42%)742 (41%)545 (46%)
Definitely yes391 (22%)399 (22%)487 (41%)
Missing149139205
* Only patients who had telehealth visits were asked to answer this question (n = 1382).
Table
Table 5. Patient characteristics affecting changes in telehealth experience ratings.
Table 5. Patient characteristics affecting changes in telehealth experience ratings.
ßSEStatisticDF
Intercept−2.7591.611−1.713184.270
Age−0.0110.015−0.725165.699
Female−0.0820.288−0.285229.413
Urban−0.1680.387−0.435210.625
White−0.0830.443−0.188233.269
College or more **−0.6160.304−2.030213.659
Report of neither easy nor difficult participation *2.0101.0211.96976.195
Report of easy participation ***3.7170.9274.01190.480
Interior Health0.5350.5201.030130.482
Fraser Health−0.2440.611−0.400164.625
Vancouver Island−0.0120.356−0.035200.265
Northern Health−0.5650.539−1.048184.819
MCS in wave 2−0.0040.017−0.247171.569
PCS in wave 20.0140.0150.992216.332
Change in MCS from wave 2 to 30.0070.0160.456191.044
Change in PCS from wave 2 to 30.0020.0170.106205.422
Abbreviations: DF, degree of freedom; MCS, Mental Component Score; PCS, Physical Component Score; SE, standard error. Referent categories for categorical variables: Sex, male; Region of residence, rural; Race, non-white; Education, high school or less; Perceived ease of participation, difficult participation; Health authority, Vancouver Coastal Health. * 0.05 < p < 0.1; ** 0.01< p < 0.05; *** p < 0.01.
Table
Table 6. Patient characteristics affecting preference to use telehealth in the future.
Table 6. Patient characteristics affecting preference to use telehealth in the future.
ßSEOdds Ratio
(95% CI)
Intercept−0.8450.9250.429 (0.069–2.644)
Age ***−0.0260.0070.973 (0.961–0.987)
Previous experience with telehealth ***0.3750.1351.456 (1.116–1.898)
Female **−0.2910.1440.748 (0.564–0.992)
Urban *−0.5710.2970.565 (0.315–1.012)
White *0.3170.1741.373 (0.977–1.930)
College or more **0.3290.1491.391 (1.036–1.867)
Report of neither easy nor difficult participation ***2.4300.60111.359 (3.483–37.052)
Report of easy participation ***3.3930.58829.751 (9.344–94.732)
Interior Health−0.0460.2050.955 (0.639–1.429)
Fraser Health−0.0270.2230.973 (0.628–1.508)
Vancouver Island−0.0550.2070.947 (0.630–1.422)
Northern Health−0.0800.4110.923 (0.412–2.069)
MCS in wave 3 **0.01300.0061.013 (1.001–1.025)
PCS in wave 3−0.0070.0060.993 (0.982–1.005)
Abbreviations: CI, confidence interval; DF, degree of freedom; MCS, Mental Component Score; PCS, Physical Component Score; SE, standard error. Referent categories for the categorical variables: Previous experience, no; Sex, male; Region of residence, rural; Race, non-white; Education, high school or less; Perceived ease of participation, difficult; Health authority, Vancouver Coastal Health. * 0.05 < p < 0.1; ** 0.01 < p < 0.05; *** p < 0.01.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Izadi-Najafabadi, S.; McQuarrie, L.; Peacock, S.; Halperin, R.; Lambert, L.; Mitton, C.; McTaggart-Cowan, H. Cancer Patients’ Experiences with Telehealth before and during the COVID-19 Pandemic in British Columbia. Curr. Oncol. 2022, 29, 4199-4211. https://doi.org/10.3390/curroncol29060335

AMA Style

Izadi-Najafabadi S, McQuarrie L, Peacock S, Halperin R, Lambert L, Mitton C, McTaggart-Cowan H. Cancer Patients’ Experiences with Telehealth before and during the COVID-19 Pandemic in British Columbia. Current Oncology. 2022; 29(6):4199-4211. https://doi.org/10.3390/curroncol29060335

Chicago/Turabian Style

Izadi-Najafabadi, Sara, Lisa McQuarrie, Stuart Peacock, Ross Halperin, Leah Lambert, Craig Mitton, and Helen McTaggart-Cowan. 2022. "Cancer Patients’ Experiences with Telehealth before and during the COVID-19 Pandemic in British Columbia" Current Oncology 29, no. 6: 4199-4211. https://doi.org/10.3390/curroncol29060335

Article Metrics

Back to TopTop