Next Article in Journal
The Biological and Clinical Significance of Glutaminase in Luminal Breast Cancer
Next Article in Special Issue
Predictors of Sentinel Lymph Node Metastasis in Postoperatively Upgraded Invasive Breast Carcinoma Patients
Previous Article in Journal
ELOVL5-Mediated Long Chain Fatty Acid Elongation Contributes to Enzalutamide Resistance of Prostate Cancer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Preferences of Treatment Strategies among Women with Low-Risk DCIS and Oncologists

1
Division of Psychosocial Research and Epidemiology, The Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital, 1066 CX Amsterdam, The Netherlands
2
Department of Health Technology and Services Research, Technical Medical Centre, University of Twente, 7522 NB Enschede, The Netherlands
3
Division of Molecular Pathology, The Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital, 1066 CX Amsterdam, The Netherlands
4
Division of Surgical Oncology, The Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital, 1066 CX Amsterdam, The Netherlands
5
Department of Pathology, Leiden University Medical Center, 2333 ZA Leiden, The Netherlands
6
Department of Clinical Genetics, Leiden University Medical Center, 2333 ZA Leiden, The Netherlands
*
Author to whom correspondence should be addressed.
Membership of the Grand Challenge Precision Consortium is provided in the Acknowledgments section of the manuscript.
Cancers 2021, 13(16), 3962; https://doi.org/10.3390/cancers13163962
Submission received: 10 July 2021 / Revised: 29 July 2021 / Accepted: 2 August 2021 / Published: 6 August 2021

Abstract

:

Simple Summary

Preferences for treatment strategies for low-risk ductal carcinoma in situ (DCIS), a potential precursor of invasive breast cancer (IBC) including a new active surveillance strategy, were elicited with a discrete choice experiment among recently-diagnosed women and oncologists involved in the care of women with DCIS. Patients exhibited strong preferences for active surveillance and seemed prepared to accept much higher levels of 10-year risk of developing ipsilateral invasive breast cancer than oncologists. Both patients and oncologists showed a strong aversion toward more extensive locoregional treatments (i.e., breast conserving surgery followed by radiotherapy, and mastectomy), while both groups demonstrated a strong preference toward shorter follow-up intervals.

Abstract

As ongoing trials study the safety of an active surveillance strategy for low-risk ductal carcinoma in situ (DCIS), there is a need to explain why particular choices regarding treatment strategies are made by eligible women as well as their oncologists, what factors enter the decision process, and how much each factor affects their choice. To measure preferences for treatment and surveillance strategies, women with newly-diagnosed, primary low-risk DCIS enrolled in the Dutch CONTROL DCIS Registration and LORD trial, and oncologists participating in the Dutch Health Professionals Study were invited to complete a discrete choice experiment (DCE). The relative importance of treatment strategy-related attributes (locoregional intervention, 10-year risk of ipsilateral invasive breast cancer (iIBC), and follow-up interval) were discerned using conditional logit models. A total of n = 172 patients and n = 30 oncologists completed the DCE. Patient respondents had very strong preferences for an active surveillance strategy with no surgery, irrespective of the 10-year risk of iIBC. Extensiveness of the locoregional treatment was consistently shown to be an important factor for patients and oncologists in deciding upon treatment strategies. Risk of iIBC was least important to patients and most important to oncologists. There was a stronger inclination toward a twice-yearly follow-up for both groups compared to annual follow-up.

1. Introduction

An active surveillance strategy has been proposed as a new treatment strategy for women with grade I or II primary ductal carcinoma in situ (DCIS), considered a potential precursor of invasive breast cancer (IBC). Between 2014 and 2017, three international, multicenter prospective randomized controlled trials (RCT) evaluating the safety and feasibility of an active surveillance strategy as an alternative to surgical intervention for low-risk DCIS began. Women recruited to the LORD trial in the Netherlands (NCT02492607) [1], the LORIS trial in the United Kingdom (NCT02766881) [2,3], and the COMET trial in the United States (NCT02926911) [4,5] are allocated evenly between the active surveillance arm, and the surgical intervention arm. Women in both arms are followed in the same fashion, with annual mammography (bi-annual in COMET) for a period of up to 10-years post-diagnosis, with ipsilateral invasive breast cancer (iIBC)-free rate as the primary endpoint. All trials have a non-inferiority design, which specifies a clinically meaningful margin for which active surveillance can be considered safe, in terms of the iIBC-free rate, compared to surgical intervention.
Enrolment into these trials was difficult due to strong treatment preferences among eligible woman. Despite public awareness and communication workshops to tackle informational asymmetries in the target population and improve enrolment into the LORIS trial, by the date of the study’s closing in March 2020, only 181 of the targeted 932 women were recruited [6]. Women eligible for the LORD trial demonstrated strong treatment preferences, declining enrolment when randomized to their non-preferred arm. This phenomenon is widely reported for trials with randomization; a systematic review and meta-analysis of partially randomized patient preference trials revealed that more than 50% of refusal of randomization was due to patient preference [7]. This challenge to recruitment may be especially true when no novel treatment option is being offered that potentially improves survival such as in the context of de-escalation trials. If active surveillance is the novel strategy, eligible patients can always de-escalate their own treatment on their own accord and in agreement with their treating oncologists. It is not necessary to enroll into a trial to gain access to the desired treatment and follow-up strategy, unless selecting a de-escalation strategy is informed by risk-stratification using biomarkers not available outside a trial.
The active surveillance trials for DCIS are part of a growing trend toward de-escalation of locoregional and systemic treatment for early breast cancer and DCIS [8]. Given the context of already excellent long-term survival for treated DCIS, numerous studies have evaluated the role and added benefit of radiotherapy and endocrine therapy following surgery [9,10,11,12,13,14,15]. While all studies have reported a reduction of local recurrence following use of radiotherapy or adjuvant endocrine therapy, not one has demonstrated survival benefits from these treatments. Unlike the ongoing active surveillance trials, these previous studies have focused on DCIS without differentiating groups by future risk of iIBC, with the exception of the randomized RTOG 9804 trial. This is the only trial that was restricted to low-risk DCIS, defined by lesion size ≤ 2.5 cm, low or intermediate grade, and negative margins ≥ 3 mm, and aimed to estimate the effect of omitting radiotherapy [10,16]. This trial was open for recruitment between July 1996 and July 2006 and was closed with less than 40% of the originally planned 1790 women accrued.
To tackle difficulties recruiting women, the LORD trial changed from a RCT design to a preference-based design in July 2020. In the COMET trial, the study design allows for ‘crossover’ if a patient randomized to one arm opts for the other (e.g., if a patient randomized to active surveillance opts for surgery in the absence of invasive breast cancer, or vice versa). Rate of crossover is included as a study endpoint [4].
Within the context of low-risk DCIS and apart from trial enrollment, there is a need to explain why particular treatment choices are made and what factors enter into the decision process to better inform shared decision-making processes between patients and physicians. Furthermore, if an active surveillance strategy is deemed safe and effective based on the findings of these studies in the future, incorporating the patients’ preferences in treatment decision making will serve to improve treatment compliance and satisfaction. A woman’s preference for treatment strategy may not only be informed by the extensiveness of the procedure itself, but also what happens afterward: the follow-up regimen and possible outcomes including risk of progression of disease or other impacts on self-image.
In light of the challenges posed by strong preferences that women with recently-diagnosed low-risk DCIS seem to have regarding their treatment strategy, a discrete choice experiment (DCE) was designed to discern their preferences for treatment and follow-up strategies, while capturing the relative importance of treatment characteristics and the acceptable trade-offs that they make between them. An active surveillance strategy may only be deemed acceptable to bring into clinical practice if it can be demonstrated in prospective trials that low-risk DCIS can safely be monitored without causing excess iIBC rates compared to conventional treatment. Therefore, part of this aim was to measure how women weigh the importance of risk of iIBC, relative to other aspects of a treatment strategy. By having health care professionals involved in the care of these women also complete the DCE, a comparison of preferences can also be made between patients and oncologists.

2. Materials and Methods

2.1. Study Population: Patients and Oncologists

Between June 2019 and June 2020, women with low-risk DCIS who declined enrolment into the LORD trial due to strong preferences for either study arm were invited to participate in the Dutch prospective CONTROL DCIS Registration study. As part of the study, participating women completed a baseline questionnaire including DCE within one month of their enrollment, before possible active treatment. In January 2021, the CONTROL DCIS Registration study was subsequently closed because the LORD trial initially randomizing between active surveillance and conventional treatment was amended to a patient-preference design, similar to the CONTROL study. At closing, 28 (78%) of the women registered to the CONTROL study had selected an active surveillance strategy instead of surgical intervention. From July 2020 onward, newly recruited women to the amended LORD trial have been invited to complete the new version of the baseline questionnaire including the same DCE used for the CONTROL DCIS Registration. Women with completed baseline questionnaires up to February 2021 were included in this analysis.
All eligible women were over 45 years old, diagnosed with primary low or intermediate grade DCIS detected on screening mammography, residing in the Netherlands. At the time of completion of the questionnaire, the women would have chosen either an active surveillance strategy or surgical intervention, but may not yet have undergone the full procedure in the latter option at the time of the baseline questionnaire. The patient respondents included in this study were recruited from 30 hospitals across the Netherlands.
Between October 2019 and December 2020, health care professionals involved in the care of women with DCIS in the Netherlands were invited to participate in the online Health Care Professionals Study questionnaire.

2.2. Questionnaire Design for Patients and Health Care Professionals

Patients completing the baseline questionnaire of the CONTROL DCIS Registration and LORD trial (preference-based design) were offered a paper or digital copy of the questionnaire (in Dutch) that comprises questions about socio-demographic characteristics, DCE questions, and health-related quality of life (HRQoL) items. An information letter was also included, outlining the purpose of the study and procedures.
Health care professionals involved in the LORD trial received a personal invitation email to participate in the online Health Professionals Study, and to recruit those not involved in the LORD trial, an email invitation was distributed via the Dutch society for surgical oncology, the Dutch society for radiation oncology and all regional breast cancer working groups affiliated with the Netherlands Comprehensive Cancer Organization. The questionnaire investigated the participants’ own preference for treatment, the impact of clinical characteristics on treatment preference, and need for decision support tools. Surgical oncologists and radiation oncologists completing the online questionnaire were invited to complete the same DCE as the patients.
Approval for the CONTROL DCIS study and Health Care Professionals study was obtained from the Netherlands Cancer Institute’s institutional review board. The Medical Ethics Committee of the Netherlands Cancer Institute approved the LORD patient preference trial.

2.3. Intolerance of Uncertainty

In the questionnaire presented to patients, a series of socio-demographic and health-related quality of life (HRQoL) items were included. The responses to the Dutch version of the 12-item Intolerance of Uncertainty Scale (IUS-12) were used for this analysis [17,18]. The IUS-12 assesses self-reported responses to uncertainty, ambiguous situations, and future events. Twelve items are rated on a 5-point Likert scale ranging from 1 (not at all characteristic of me) to 5 (entirely characteristic of me), summing a total score with a maximum of 60 (higher scores indicate greater uncertainty). Intolerance of uncertainty represents a predisposition toward overestimating the chance of possible (but unlikely) undesirable outcomes in uncertain circumstances, while also finding this chance threatening [19]. A threshold to demarcate women with “low” and “high” uncertainty based on the total score was set at the median value resulting from the respondent population in order to compare responses between women with “low” and “high” uncertainty.

2.4. Design of the Discrete Choice Experiment

DCEs provide a format to elicit choices in a structured way, making it possible to statistically model binary (“either-or”) choices. They are one of many stated-preference methods in which respondents choose between alternatives in a repeated series of choice tasks. Within each choice, a selection of attributes (e.g., features of the treatment) where varying possible “levels” are provided. The DCE uses an experimental design that determines the presentation of specific attribute-level combinations, out of many possible combinations. This makes it possible to compute the influence of changes in attribute-levels on choice for a treatment strategy [20].
Attributes and their associated levels that capture relevant features of treatment strategies were identified through a review of the literature and expert elicitation. Experts (psychosocial oncology experts (EB, EGE); oncology nurse (VS); pathologist (JW); DCE experts (CGMGO, JAVT)) were asked to comment on and complete the list of attributes and possible levels. The final selection was confirmed via a series of interviews with health care professionals [21]. Treatment attributes included locoregional treatment (levels: no surgery, breast conserving surgery ± radiotherapy, mastectomy), interval between follow-up mammography screening appointments (levels: two years, one year, six months), and chance of ipsilateral invasive breast cancer at 10 years (levels: 5%, 10%, 15%) (Table 1).
For each DCE question (i.e., “choice task”), respondents would choose between two hypothetical treatment strategy alternatives (“Option 1” and “Option 2”) that consist of a unique combination of different attribute levels, determined through an experimental design. All participants were provided educational content on the purpose of the DCE, emphasizing that the treatment strategies and outcomes presented were hypothetical situations. The combination of the strategy alternatives, attributes, and their levels resulted in 90 hypothetical scenarios, derived from a fractional main effects experimental design. Unrealistic combinations of different attribute levels were removed from the experimental design. Presenting all scenarios to respondents would be too burdensome, so a subset of scenarios was used. The R package AlgDesign version 1.2.0 was used to generate a D-efficient design consisting of 36 hypothetical scenarios, divided into three versions of the DCE consisting of 12 choice tasks each. Participants were randomized to receive one of the three versions. An example of a choice task has been provided in the online Supplementary Materials (Methods S1); design restrictions are described in Methods S2.
The minimum required sample size was determined to be n = 84, based on the rule of thumb for conditional logit models proposed by Johnson and Orme, taking into consideration the number of choice tasks, alternatives, and analysis cells [22,23].

2.5. Conditional Logit Model and Comparing Patient and Oncologist Preferences

To estimate the relative importance of treatment-related features across all respondents, separate conditional logit models for binary choice were built for patients and oncologists. This technique is informed by random utility theory, where a regression model is used to relate choice (i.e., choice of treatment strategy) as a function of the features of the choice (i.e., the attributes and respective levels) [24]. The attributes locoregional treatment, follow-up interval, and risk of subsequent iIBC were included in the model as covariates using dummy coding. Resulting co-efficients (β) were exponentialized to derive odds ratios. p-values < 0.05 are considered as statistically significant. In a model with pooled data, an interaction term for respondent type was included for all dummy-coded attribute-levels to determine where preferences differed between patients and oncologists. To test the significance of the overall interaction between different attributes and respondent type, the likelihood ratio test was conducted comparing models with and without the interaction terms, with two degrees of freedom.
To understand the relative contribution of the attribute-level to the utility that the respondent assigns to an alternative, importance weights were calculated separately for patients and oncologists. Utility can be understood as the measure of value or importance, and consequently important weights represent the relative importance of each level. These importance weights are the resulting coefficients (β) of the conditional logit models. The overall importance weight (OIW) of each attribute ( i ) was calculated by dividing the range in regression coefficients of each attribute i (i.e., the difference between the least and most preferred attribute levels, m a x C i m i n C i ), by the sum of the coefficient ranges of the three attributes ( m a x C j m i n C j ).
O I W A t t r i b u t e   i = m a x C i m i n C i Σ k ( m a x C j m i n C j )
Scaled overall importance weights (as a fraction of 100) were then derived for each attribute, together summing 100. Overall importance weights were calculated separately for oncologists, patients, and for patient subgroups (women with “high” and “low” uncertainty intolerance, as determined by the IUS-12 cohort median value, patients undergoing active surveillance, patients undergoing conventional treatment, and women with “high” and “low/intermediate” educational attainment). A description of an effect-modifier analysis to study the extent to which certain patient characteristics impacted the preferences of respondents is described in the online Supplementary Materials (Methods S3).
Maximum acceptable risk was calculated for patients based on the resulting coefficients from the conditional logit model. This can be understood as what extra risk of ipsilateral invasive breast cancer at 10 years patients are willing to take for getting no treatment compared to breast conserving surgery. This is calculated by dividing coefficients to determine the change in risk of ipsilateral invasive breast cancer that would offset the utility gain of the most preferred locoregional treatment strategy.
All statistical analyses were performed with R version 3.6.1 (R Foundation for Statistical Computing, Vienna, Austria). The R package mlogit version 1.1-1 was used for the conditional logit models.

3. Results

3.1. Respondents

A total of 202 individuals completed the questionnaire including DCE by March 2021; 37 patients from the CONTROL DCIS registration, 135 patients from the LORD trial, and 30 radiation and surgical oncologists from the Health Professionals Study (Table 2). Patients had a mean age of 59 (range 45–77), and 95 (55.2%) were engaged in paid labor (part-time or full-time). A total of 76.7% opted for no surgical intervention for their primary low-risk DCIS. Responses on the IUS-12 uncertainty intolerance scale ranged between 20 and 51, with the median value at 30. A total of 70% of the oncologist respondents were female. More than 50% treated more than 15 women with DCIS per year. Twenty oncologists (67%) specialized in surgical oncology and the remaining in radiation oncology; all were employed at a range of hospitals across the Netherlands (Table 2).

3.2. Importance of Treatment Characteristics

Table 3 shows the aggregate results of the discrete choice experiment for patients and oncologists separately based on the conditional logit models. Model coefficients are also plotted in Figure 1. The preferred locoregional treatment option for patients and oncologists was no surgery, then breast conserving surgery, followed by breast conserving surgery and radiotherapy. The least preferred option was mastectomy. A follow-up interval of six months was preferred by all respondents. Patients did not assign large relative importance to any of the possible levels of iIBC risk whereas for oncologists, iIBC risk was a very important factor. There was a statistically significant difference between the oncologists and patients in their preference of attributes (likelihood ratio test on interaction between respondent type and attribute, p < 0.001) (Table 3). The test of interaction between respondent type and the attribute-level 15% risk of iIBC was also statistically significant (p = 0.02). Oncologists and patients were not statistically significantly different in their preference for the other attribute-levels for follow-up interval or locoregional treatment.
We determined what extra risk of ipsilateral invasive breast cancer at 10 years patients were willing to take for getting no surgery compared to breast conserving surgery. This calculation of maximum acceptable risk found that the additional increase in risk (from the reference level of 5%) that exactly offsets the increase in utility of having no surgery (i.e., not experiencing the side-effects) would be 11.2%.

3.3. Influence of the Attributes on Patients’ and Oncologists’ Preference

Scaled overall importance weights for each attribute are shown in Figure 2. These weights represent the relative influence of an attribute on the respondents’ preference for a treatment strategy. For patients, 10-year risk of iIBC was the least important attribute dictating preference, whereas this was the most important for oncologists (representing 14% vs. 50% of importance). For patients, the locoregional treatment was the most important attribute dictating preference, followed by follow-up interval. Heterogeneity in preferences exists among patient subgroups. Women who chose a conventional treatment strategy in real life assigned a higher overall importance weight to 10-year risk of iIBC compared to women who chose active surveillance (38% vs. 11%). Models were built separately for women split by their scores in the bottom and top half of the intolerance of uncertainty scale. Women with higher uncertainty intolerance scores seemed to attach higher importance to follow-up interval slightly more than their counterparts on the other side of the scale (20% vs. 17%). The relative importance of iIBC risk was the same for both groups. When inspecting relative importance of attributes by education level, the importance of locoregional treatment and follow-up interval was shown to be nearly equal.

4. Discussion

The extensiveness of the locoregional treatment was consistently shown to be an important factor for patients and their care providers in deciding upon treatment strategies for low-risk primary DCIS. In our analyses, risk of ipsilateral invasive breast cancer was least important to patients and most important to oncologists. There was a stronger inclination toward a twice-yearly follow-up for both oncologists and patients compared to annual follow-up.
We found that women in the Netherlands had very strong preferences for an active surveillance strategy with no surgery, irrespective of the 10-year risk of iIBC. This was also the case for our respondents who scored higher than the cohort’s average score (30) on the IUS-12 uncertainty intolerance scale. These women, known to have a higher intolerance of uncertainty, were not dissimilar to their counterparts with lower intolerance in assigning a comparatively small overall importance weight to the risk of iIBC. For these women, the locoregional treatment, followed by the interval between follow-up mammograms, were more important. It is possible that the IUS-12 uncertainty intolerance scale does not capture future breast cancer risk tolerance in comparison to tolerance of risk attributed to other attributes (e.g., risk of infection or post-operative complications) [25,26]. Furthermore, the risk of iIBC already remains rather low among these women with good-prognosis DCIS, and they are being asked to evaluate a risk far in the future at 10 years. The women in our study not only attached lower importance to future risk of breast cancer, but also attached higher importance to breast conservation through having no surgery. This can be aligned with prospect theory, popularized by Kahneman and Tversky, which posits that “people underweigh outcomes that are merely probable in comparison with outcomes that are obtained with certainty” [27]. It is not yet understood how the dimension of temporal distance to the risk in question factors into decision making and preferences measured in DCEs, particularly for DCIS [28]. A study of intolerance of uncertainty among men undergoing active surveillance for prostate cancer found that intolerance of uncertainty had a significant relationship with the experience of cancer-related symptoms [29]. The women in our study were asymptomatic and their DCIS was detected through the national breast cancer screening program, so they remain physically unaffected by their diagnosis.
An important related consideration that likely factors into a patient’s choice is the understanding of one’s personal risk of upstaging to invasive breast cancer; this was not explicitly captured in the DCE design. Uncertainty still remains over the proportion of patients with a core needle biopsy showing DCIS with “low-risk” clinicopathological characteristics who actually have concurrent invasive carcinoma in the breast. This uncertainty is now understood to have an impact on participation in trials studying active surveillance. A retrospective series based on a small sample of women who would have met eligibility criteria for active surveillance trials found low upstaging rates (6–10%) [30]. All upstaged cases were good-prognosis invasive carcinomas: all were node negative and HER2 negative. Furthermore, a proportion of women with DCIS will have complete removal of the lesion at biopsy, and subsequently experience a low upgrade rate (8.2%) [31]. A study in the Netherlands addressed the issue of the reliability of preoperative biopsy, and identified several factors that can aid in further risk stratification of women being considered for non-operative management [32]. An important takeaway from these studies is that even with possible upstaging, overall survival should not be significantly compromised. Access to high-quality annual mammography is readily available, and invasive carcinomas can be treated on time. Nevertheless, the prediction of upstaging of DCIS to invasive disease remains an important area of ongoing research, and will serve to identify the lowest achievable upstaging rate among women eligible for clinical trials of active surveillance. This may in turn address some of the challenges with trial accrual, and better inform the understanding of risk of upstaging.
We used a discrete choice experiment as a “stated preference” method where respondents were asked to choose between alternatives from among a set of hypothetical scenarios generated from an experimental design [33]. This can be contrasted with the concept of “revealed preference” in which we observe actual choices made by respondents in real life. The women included in our study were participants in studies (the CONTROL DCIS Registration and LORD trial) that had a preference-based design. Sixty-eight percent of our patient respondents selected active surveillance as an alternative to surgical intervention in real life. Active surveillance is not yet an accepted treatment strategy according to European clinical guidelines. Conventional treatment for DCIS mimics that of early breast cancer, with breast conserving surgery being the preferred local treatment option [34]. Results from the ongoing prospective clinical trials for active surveillance will not be available for at least five to 10 years, and recruitment into these trials remains challenging. However, in the Dutch context, our study demonstrated that women diagnosed with low- and intermediate-grade DCIS have already established strong preference and desire to undergo active surveillance ahead of the results about safety and 10-year risk of ipsilateral invasive breast cancer.
The non-inferiority design of the Dutch LORD trial is based on the assumption that the 10-year iIBC-free rate is 95% in the surgery group. The non-inferiority margin was chosen at 3.168 on the hazard-ratio scale, corresponding to a 10-year iiBC-free probability of 85% in the active surveillance group [35]. As DCE scenarios presenting active surveillance were always associated with an increased risk of 5% or 10% compared to the surgical treatment option, we found that these differences were deemed acceptable by the patient respondents. Even when two surgical treatment options were compared, patients had much stronger preferences for strategies with less extensive procedures, irrespective of an associated increased risk. This pattern was not seen among oncologist respondents; a difference of 10% in risk was not deemed acceptable by oncologists on average.
This DCE is the first published study evaluating treatment preferences in women with a recent diagnosis of DCIS. A DCE evaluating patient preferences for outcomes following DCIS treatment was conducted in a healthy cohort of women in the United States attending a comprehensive cancer screening mammography clinic [36]. These women were not diagnosed with DCIS, nor did they have a personal history of breast cancer. That study found that respondents weighed breast cancer risk as the most important factor, but this was closely followed by chronic pain and infection. Again, this is in contrast with the patient respondents in our study who demonstrated that 10-year iIBC risk was the least important factor. The extent to which women without the experience of the disease in question respond similarly to women with the disease is known to be affected by scale heterogeneity, explained by differences between groups due to familiarity with the disease [37]. In the online Supplementary Materials (Methods S4, Figure S1), we provide an evaluation of scale heterogeneity between the patients and oncologists in our sample to understand how similarly these groups respond. We also note that differences in sample size between patients and oncologists may have impacted the difference observed between these two groups. These considerations are necessary to draw comparisons between preferences of any two groups of individuals including women who have been diagnosed with DCIS and those not, to understand the influence of psychological distance on accepting treatment strategies with possible higher risk of a future iIBC event [38].

5. Conclusions

This study provided insights into the treatment strategy preferences of a large cohort of women participating in a preference-based prospective study for low-risk DCIS. These women, recently diagnosed with DCIS, assigned the greatest importance to extensiveness of locoregional treatment and surveillance follow-up interval. In stark contrast, risk of iIBC was the most important factor for oncologists involved in the care of DCIS. The responses to the DCEs are reflected in the women’s actual treatment choices: the vast majority (68%) chose an active surveillance strategy to manage their low-risk DCIS. The insights gained through this study about the concordant and discordant preferences for treatment strategies between women and their oncologist may help to inform treatment decision making processes as prospective trials aim to recruit more women. Finally, if an active surveillance strategy is found to be a safe alternative to surgery, incorporating patients’ preferences in treatment decision making will serve to improve strategy compliance, satisfaction, and shared-decision making processes.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/cancers13163962/s1, Methods S1: Example of a choice task, Methods S2: Design restrictions, Methods S3: Assessing patient heterogeneity with effect-modifier analyses, Methods S4: Analysis of the scale factor, Figure S1: Swait and Louviere plot of coefficients derived from conditional logit models for patients and oncologists.

Author Contributions

Conceptualization, D.B. and V.P.R.; methodology, D.B., V.P.R., J.A.v.T. and C.G.M.G.-O.; formal Analysis, D.B. and C.G.M.G.-O.; data curation, E.G.E. and R.S.J.M.S.; writing—original draft preparation, D.B.; writing—review & editing, All authors; supervision, V.P.R., E.G.E., E.B. and W.H.v.H.; funding acquisition, V.P.R., F.v.D., J.W. and E.B. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Cancer Research UK and by KWF Kankerbestrijding (ref. C38317/A24043).

Institutional Review Board Statement

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Approval for the CONTROL DCIS study and Health Care Professionals study was obtained from the Netherlands Cancer Institute’s institutional review board (IRBd19003). The Medical Ethics Committee of the Netherlands Cancer Institute approved the LORD patient preference trial (METC20.0642/M18LORD).

Informed Consent Statement

Women recruited to the CONTROL DCIS study and LORD patient preference trial provided written consent to participate.

Data Availability Statement

Data may be available on request due to privacy restrictions, from the corresponding author.

Acknowledgments

This analysis continues the research conducted by Christel Geerts for her Master’s thesis (University of Twente, 2016). This work would not have been possible without the study coordination support provided by Miranda Gerritsma, to whom we give our thanks. We also thank oncology nurse Victoria Skinner and patient advocates Marja van Oirsouw and Ellen Verschuur for reviewing the DCE and final questionnaires. Grand Challenge PRECISION Consortium Steering Group: Jelle Wesseling (Netherlands Cancer Institute, Amsterdam, The Netherlands), Alastair Thompson (Baylor College of Medicine, Houston, TX, USA), Serena Nik-Zainal (University of Cambridge, Cambridge, UK), Elinor J. Sawyer (King’s College London, London, UK), Helen Davies (University of Cambridge, Cambridge, UK), Andrew Futreal (MD Anderson Cancer Center, Houston, USA), Nicholas Navin (MD Anderson Cancer Center, Houston, TX, USA), E. Shelley Hwang (Duke University School of Medicine, Durham, NC, USA), Jos Jonkers (Netherlands Cancer Institute, Amsterdam, The Netherlands), Jacco van Rheenen (Netherlands Cancer Institute, Amsterdam, The Netherlands), Fariba Behbod (Kansas University Medical Center, Kansas, USA), Esther H. Lips (Netherlands Cancer Institute, Amsterdam, The Netherlands), Marjanka Schmidt (Netherlands Cancer Institute, Amsterdam, The Netherlands), Lodewyk F.A. Wessels (Netherlands Cancer Institute, Amsterdam, The Netherlands), Daniel Rea (University of Birmingham, Birmingham, UK), Proteeti Bhattacharjee (Netherlands Cancer Institute, Amsterdam, The Netherlands), Hilary Stobart (Independent Cancer Patients’ Voice, UK), Deborah Collyar (Patient Advocates in Research, USA), Donna Pinto (dcis411, USA), Ellen Verschuur (Borstkanker Vereniging Nederland, The Netherlands), Marja van Oirsouw (Borstkanker Vereniging Nederland, The Netherlands).

Conflicts of Interest

The authors declare no conflict of interest regarding the publication of this article.

References

  1. Elshof, L.E.; Tryfonidis, K.; Slaets, L.; van Leeuwen-Stok, A.E.; Skinner, V.P.; Dif, N.; Pijnappel, R.M.; Bijker, N.; Rutgers, E.J.; Wesseling, J. Feasibility of a prospective, randomised, open-label, international multicentre, phase III, non-inferiority trial to assess the safety of active surveillance for low risk ductal carcinoma in situ—The LORD study. Eur. J. Cancer 2015, 51, 1497–1510. [Google Scholar] [CrossRef] [Green Version]
  2. Francis, A.; Thomas, J.; Fallowfield, L.; Wallis, M.; Bartlett, J.M.; Brookes, C.; Roberts, T.; Pirrie, S.; Gaunt, C.; Young, J.; et al. Addressing overtreatment of screen detected DCIS; the LORIS trial. Eur. J. Cancer 2015, 51, 2296–2303. [Google Scholar] [CrossRef] [Green Version]
  3. Wallis, M.; Bartlett, J.; Billingham, L.; Bowden, S.; Brookes, C.; Dodwell, D.; Evans, A.; Fairbrother, P.; Fallowfield, L.; Gaunt, C.; et al. The LORIS trial: Randomising patients with lowor low intermediate-grade ductal carcinoma in situ (DCIS) to surgery or active monitoring. Breast Cancer Res. Treat. 2018, 167, 325–326. [Google Scholar]
  4. Hwang, E.S.; Hyslop, T.; Lynch, T.; Frank, E.; Pinto, D.; Basila, D.; Collyar, D.; Bennett, A.; Kaplan, C.; Rosenberg, S.; et al. The COMET (comparison of operative versus monitoring and endocrine therapy) trial: A phase III randomised controlled clinical trial for low-risk ductal carcinoma in situ (DCIS). BMJ Open 2019, 9, e026797. [Google Scholar] [CrossRef] [Green Version]
  5. Youngwirth, L.M.; Boughey, J.C.; Hwang, E.S. Surgery versus monitoring and endocrine therapy for low-risk DCIS: The COMET trial. Bull. Am. Coll. Surg. 2017, 102, 62–63. [Google Scholar] [PubMed]
  6. Cuzick, J.; Sestak, I.; Forbes, J.F.; Dowsett, M.; Cawthorn, S.; Mansel, R.E.; Loibl, S.; Bonanni, B.; Howell, A. UK Interdisciplinary Breast Cancer Symposium 2020. Breast Cancer Res. Treat. 2020, 180, 527–596. [Google Scholar]
  7. Wasmann, K.A.; Wijsman, P.; van Dieren, S.; Bemelman, W.; Buskens, C. Partially randomised patient preference trials as an alternative design to randomised controlled trials: Systematic review and meta-analyses. BMJ Open 2019, 9, e031151. [Google Scholar] [CrossRef]
  8. Piccart, M.J.; Hilbers, F.S.; Bliss, J.M.; Caballero, C.; Frank, E.S.; Renault, P.; Naït Kaoudjt, R.; Schumacher, E.; Spears, P.A.; Regan, M.M. Road map to safe and well-designed de-escalation trials of systemic adjuvant therapy for solid tumors. J. Clin. Oncol. 2020, 38, 4120–4129. [Google Scholar] [CrossRef] [PubMed]
  9. Correa, C.; McGale, P.; Taylor, C.; Wang, Y.; Clarke, M.; Davies, C.; Peto, R.; Bijker, N.; Solin, L.; Darby, S. Overview of the randomized trials of radiotherapy in ductal carcinoma in situ of the breast. J. Natl. Cancer Inst. Monogr. 2010, 2010, 162–177. [Google Scholar] [PubMed]
  10. McCormick, B.; Winter, K.; Hudis, C.; Kuerer, H.M.; Rakovitch, E.; Smith, B.L.; Sneige, N.; Moughan, J.; Shah, A.; Germain, I.; et al. Rtog 9804: A prospective randomized trial for good-risk ductal carcinoma in situ comparing radiotherapy with observation. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2015, 33, 709–715. [Google Scholar] [CrossRef] [Green Version]
  11. Wapnir, I.L.; Dignam, J.J.; Fisher, B.; Mamounas, E.P.; Anderson, S.J.; Julian, T.B.; Land, S.R.; Margolese, R.G.; Swain, S.M.; Costantino, J.P.; et al. Long-term outcomes of invasive ipsilateral breast tumor recurrences after lumpectomy in NSABP B-17 and B-24 randomized clinical trials for DCIS. J. Natl. Cancer Inst. 2011, 103, 478–488. [Google Scholar] [CrossRef] [PubMed]
  12. Wärnberg, F.; Garmo, H.; Emdin, S.; Hedberg, V.; Adwall, L.; Sandelin, K.; Ringberg, A.; Karlsson, P.; Arnesson, L.G.; Anderson, H.; et al. Effect of radiotherapy after breast-conserving surgery for ductal carcinoma in situ: 20 years follow-up in the randomized swedcis trial. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2014, 32, 3613–3618. [Google Scholar] [CrossRef] [PubMed]
  13. Allred, D.C.; Anderson, S.J.; Paik, S.; Wickerham, D.L.; Nagtegaal, I.D.; Swain, S.M.; Mamounas, E.P.; Julian, T.B.; Geyer, C.E., Jr.; Costantino, J.P.; et al. Adjuvant tamoxifen reduces subsequent breast cancer in women with estrogen receptor-positive ductal carcinoma in situ: A study based on nsabp protocol b-24. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2012, 30, 1268–1273. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Forbes, J.F.; Sestak, I.; Howell, A.; Bonanni, B.; Bundred, N.; Levy, C.; von Minckwitz, G.; Eiermann, W.; Neven, P.; Stierer, M.; et al. Anastrozole versus tamoxifen for the prevention of locoregional and contralateral breast cancer in postmenopausal women with locally excised ductal carcinoma in situ (ibis-ii dcis): A double-blind, randomised controlled trial. Lancet 2016, 387, 866–873. [Google Scholar] [CrossRef] [Green Version]
  15. Margolese, R.G.; Cecchini, R.S.; Julian, T.B.; Ganz, P.A.; Costantino, J.P.; Vallow, L.A.; Albain, K.S.; Whitworth, P.W.; Cianfrocca, M.E.; Brufsky, A.M.; et al. Anastrozole versus tamoxifen in postmenopausal women with ductal carcinoma in situ undergoing lumpectomy plus radiotherapy (NSABP B-35): A randomised, double-blind, phase 3 clinical trial. Lancet 2016, 387, 849–856. [Google Scholar] [CrossRef] [Green Version]
  16. McCormick, B. Randomized trial evaluating radiation following surgical excision for “good risk” DCIS: 12-year report from NRG/RTOG 9804. Int. J. Radiat. Oncol. Biol. Phys. 2018, 102, 1603. [Google Scholar] [CrossRef]
  17. Carleton, R.N.; Norton, M.A.; Asmundson, G.J. Fearing the unknown: A short version of the intolerance of uncertainty scale. J. Anxiety Disord. 2007, 21, 105–117. [Google Scholar] [CrossRef]
  18. Helsen, K.; Van den Bussche, E.; Vlaeyen, J.W.; Goubert, L. Confirmatory factor analysis of the Dutch intolerance of uncertainty scale: Comparison of the full and short version. J. Behav. Ther. Exp. Psychiatry 2013, 44, 21–29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Boswell, J.F.; Thompson-Hollands, J.; Farchione, T.J.; Barlow, D.H. Intolerance of uncertainty: A common factor in the treatment of emotional disorders. J. Clin. Psychol. 2013, 69, 630–645. [Google Scholar] [CrossRef] [PubMed]
  20. Hauber, A.B.; González, J.M.; Groothuis-Oudshoorn, C.G.; Prior, T.; Marshall, D.A.; Cunningham, C.; MJ, I.J.; Bridges, J.F. Statistical methods for the analysis of discrete choice experiments: A report of the ISPOR conjoint analysis good research practices task force. Value Health J. Int. Soc. Pharm. Outcomes Res. 2016, 19, 300–315. [Google Scholar] [CrossRef] [Green Version]
  21. Engelhardt, E.; Byng, D.; Klaver, K.; Gerritsma, M.; Verschuur, E.; van Oirsouw, M.; Wesseling, J.; van Duijnhoven, F.; Retèl, V.; Bleiker, E. Women diagnosed with ductal carcinoma in situ (DCIS) and healthcare providers’ views on active surveillance for DCIS. Results from focus groups and in-depth interviews. Eur. J. Cancer 2020, 138, S36. [Google Scholar] [CrossRef]
  22. Johnson, R.; Orme, B. Getting the Most from CBC; Sawtooth Software Research Paper Series; Sawtooth Software: Sequim, WA, USA, 2003. [Google Scholar]
  23. Orme, B. Sample Size Issues for Conjoint Analysis Studies; Sawtooth Software Technical Paper; Sawtooth Software: Sequim, WA, USA, 1998. [Google Scholar]
  24. McFadden, D. Conditional Logit Analysis of Qualitative Choice Behavior. In Frontiers in Econometrics; Zarembka, P., Ed.; Academic Press: New York, NY, USA, 1973; pp. 105–142. [Google Scholar]
  25. Jonczyk, M.M.; Fisher, C.S.; Babbitt, R.; Paulus, J.K.; Freund, K.M.; Czerniecki, B.; Margenthaler, J.A.; Losken, A.; Chatterjee, A. Surgical predictive model for breast cancer patients assessing acute postoperative complications: The breast cancer surgery risk calculator. Ann. Surg. Oncol. 2021, 1–11. [Google Scholar] [CrossRef]
  26. Rose, M.; Manjer, J.; Ringberg, A.; Svensson, H. Surgical strategy, methods of reconstruction, surgical margins and postoperative complications in oncoplastic breast surgery. Eur. J. Plast. Surg. 2014, 37, 205–214. [Google Scholar] [CrossRef] [Green Version]
  27. Kahneman, D.; Tversky, A. Prospect theory: An analysis of decision under risk. In Handbook of the Fundamentals of Financial Decision Making: Part I; World Scientific: Singapore, 2013; pp. 99–127. [Google Scholar]
  28. Lloyd, A.J. Threats to the estimation of benefit: Are preference elicitation methods accurate? Health Econ. 2003, 12, 393–402. [Google Scholar] [CrossRef]
  29. Tan, H.-J.; Marks, L.S.; Hoyt, M.A.; Kwan, L.; Filson, C.P.; Macairan, M.; Lieu, P.; Litwin, M.S.; Stanton, A.L. The relationship between intolerance of uncertainty and anxiety in men on active surveillance for prostate cancer. J. Urol. 2016, 195, 1724–1730. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Grimm, L.J.; Ryser, M.D.; Partridge, A.H.; Thompson, A.M.; Thomas, J.S.; Wesseling, J.; Hwang, E.S. Surgical Upstaging Rates for Vacuum Assisted Biopsy Proven DCIS: Implications for Active Surveillance Trials. Ann. Surg. Oncol. 2017, 12, 3534–3540. [Google Scholar] [CrossRef] [PubMed]
  31. Nicosia, L.; di Giulio, G.; Bozzini, A.C.; Fanizza, M.; Ballati, F.; Rotili, A.; Lazzeroni, M.; Latronico, A.; Abbate, F.; Renne, G.; et al. Complete Removal of the Lesion as a Guidance in the Management of Patients with Breast Ductal Carcinoma In Situ. Cancers 2021, 13, 868. [Google Scholar] [CrossRef] [PubMed]
  32. Mannu, G.S.; Groen, E.J.; Wang, Z.; Schaapveld, M.; Lips, E.H.; Chung, M.; Joore, I.; van Leeuwen, F.E.; Teertstra, H.J.; Winter-Warnars, G.A.O.; et al. Reliability of preoperative breast biopsies showing ductal carcinoma in situ and implications for non-operative treatment: A cohort study. Breast Cancer Res. Treat. 2019, 178, 409–418. [Google Scholar] [CrossRef] [Green Version]
  33. Bridges, J.F.; Hauber, A.B.; Marshall, D.; Lloyd, A.; Prosser, L.A.; Regier, D.A.; Johnson, F.R.; Mauskopf, J. Conjoint analysis applications in health—A checklist: A report of the ISPOR good research practices for conjoint analysis task force. Value Health 2011, 14, 403–413. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Cardoso, F.; Kyriakides, S.; Ohno, S.; Penault-Llorca, F.; Poortmans, P.; Rubio, I.T.; Zackrisson, S.; Senkus, E. Early breast cancer: ESMO clinical practice guidelines for diagnosis, treatment and follow-up. Ann. Oncol. Off. J. Eur. Soc. Med Oncol. 2019, 30, 1194–1220. [Google Scholar] [CrossRef] [Green Version]
  35. Available online: https://clinicaltrials.gov/ct2/show/NCT02492607 (accessed on 14 February 2021).
  36. Chapman, B.M.; Yang, J.C.; Gonzalez, J.M.; Havrilesky, L.; Reed, S.D.; Hwang, E.S. Patient preferences for outcomes following DCIS management strategies: A discrete choice experiment. JCO Oncol. Pract. 2021, OP2000614. [Google Scholar] [CrossRef] [PubMed]
  37. Vass, C.M.; Wright, S.; Burton, M.; Payne, K. Scale heterogeneity in healthcare discrete choice experiments: A primer. Patient 2018, 11, 167–173. [Google Scholar] [CrossRef] [PubMed]
  38. Raue, M.; Streicher, B.; Lermer, E.; Frey, D. How far does it feel? Construal level and decisions under risk. J. Appl. Res. Mem. Cogn. 2015, 4, 256–264. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Importance weights derived from the conditional logit model. Standard error bars shown are an indication uncertainty in respondents’ preferences. Importance weights for each attribute-level shown are a measure of relative preference. Moving from one attribute-level to an adjacent attribute-level is an indication of the relative gain or loss in utility, where utility is a representation of the strength of preferences. BCS: breast conserving surgery; iIBC: ipsilateral invasive breast cancer; RT: radiotherapy.
Figure 1. Importance weights derived from the conditional logit model. Standard error bars shown are an indication uncertainty in respondents’ preferences. Importance weights for each attribute-level shown are a measure of relative preference. Moving from one attribute-level to an adjacent attribute-level is an indication of the relative gain or loss in utility, where utility is a representation of the strength of preferences. BCS: breast conserving surgery; iIBC: ipsilateral invasive breast cancer; RT: radiotherapy.
Cancers 13 03962 g001
Figure 2. Overall relative importance weights for attributes (features) of treatment strategy. Exploration of further patient subgroup stratifications are described in the online Supplementary Materials (Methods S3). iIBC: ipsilateral invasive breast cancer.
Figure 2. Overall relative importance weights for attributes (features) of treatment strategy. Exploration of further patient subgroup stratifications are described in the online Supplementary Materials (Methods S3). iIBC: ipsilateral invasive breast cancer.
Cancers 13 03962 g002
Table 1. Attributes and their respective levels in the discrete choice experiment.
Table 1. Attributes and their respective levels in the discrete choice experiment.
AttributesLevels
Locoregional treatment strategyNo surgery; breast conserving surgery; breast conserving surgery followed by radiotherapy; mastectomy
10-year risk of ipsilateral invasive breast cancer (iIBC)5%; 10%; 15%
Surveillance mammography follow-up interval6 months; 1 year; 2 years
Table 2. Patient and oncologist characteristics.
Table 2. Patient and oncologist characteristics.
CharacteristicsPatients (n = 172)
N (%)
Oncologists (n = 30)
N (%)
Age, years (median, range)59 (45–77)N.A.
Sex
Female172 (100%)21 (70.0%)
Male09 (30.0%)
Actual treatment selected
Active surveillance132 (76.7%)N.A.
Conventional treatment38 (22.1%)N.A.
Unknown2 (1.2%)N.A.
Educational level
Low37 (21.5%)0
Intermediate78 (45.3%)0
High57 (33.1%)30 (100%)
Employment status
Employed (part-time or full-time)95 (55.2%)30 (100%)
Unemployed/pension77 (44.8%)0
Hospital type
Academic medical center3 (1.7%)8 (26.7%)
General teaching hospital105 (61.0%)14 (46.7%)
Specialized oncology hospital25 (14.5%)5 (16.7%)
General hospital39 (22.7%)3 (10.0%)
Region of the Netherlands
North3 (1.7%)3 (10.0%)
East60 (34.9%)5 (16.7%)
West98 (57.0%)17 (56.7%)
South11 (6.4%)5 (16.7%)
Subspecialty
Surgical oncologyN.A.20 (66.7%)
Radiation oncologyN.A.10 (33.3%)
Number of patients with DCIS treated per year
2–5 patientsN.A.1 (3.3%)
6–10 patientsN.A.7 (23.3%)
11–15 patientsN.A.3 (10.0%)
16–20 patientsN.A.11 (36.7%)
>20 patientsN.A.8 (26.7%)
Years’ experience treating patients with DCIS
2–5 yearsN.A.1 (3.3%)
6–10 yearsN.A.9 (30.0%)
>10 yearsN.A.20 (66.7%)
Table 3. Stated preferences across all respondents based on the conditional logit model with dummy coding.
Table 3. Stated preferences across all respondents based on the conditional logit model with dummy coding.
Attribute LevelsPatientsOncologists
Coefficient (β)SEExp (β)Coefficient (β)SEExp (β)
Locoregional treatment
Breast conserving surgery(ref.) (ref.)
No surgery0.513 *0.1111.670.1000.2511.11
Breast conserving surgery + radiotherapy−0.551 *0.1020.58−0.632 *0.2290.53
Mastectomy−1.239 *0.1850.29−1.743 *0.3710.18
10-year risk of ipsilateral invasive breast cancer
5%(ref.) (ref.)
10%−0.2290.1220.79−0.962 *0.2900.38
15%−0.350 *0.1740.70−2.219 *0.3990.11
Interval surveillance follow-up
1 year(ref.) (ref.)
6 months0.448 *0.1101.560.4030.2181.50
2 years−0.429 *0.1030.65−0.1750.2350.84
Interaction Terms aCoefficient (β)SEExp (β)p-Value
Attribute: Locoregional treatment * respondent type<0.001 b
Level: No surgery
Patient(ref.)
Oncologist−0.4130.2750.660.13
Level: Breast conserving surgery + radiotherapy
Patient(ref.)
Oncologist−0.0820.2510.920.75
Level: Mastectomy
Patient(ref.)
Oncologist−0.5040.4140.600.22
Attribute: 10-year risk of ipsilateral invasive breast cancer * respondent type<0.001 b
Level: 10% risk of iIBC
Patient(ref.)
Oncologist−0.7340.3140.480.02
Level: 15% risk of iIBC
Patient(ref.)
Oncologist−1.8700.4350.15<0.001
Attribute: follow-up interval * respondent type <0.001 b
Level: 6mo follow-up interval
Patient(ref.)
Physician−0.0450.2450.960.85
Level: 2 year follow-up interval
Patient(ref.)
Oncologist0.2540.2581.290.32
iIBC: ipsilateral invasive breast cancer; ref.: reference level; * Statistically significant p-value < 0.05; a Computed from model using pooled data from all respondents, with interaction term for respondent type. b Based on the likelihood ratio test comparing models with and without the interaction terms, with 2 degrees of freedom.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Byng, D.; Retèl, V.P.; Engelhardt, E.G.; Groothuis-Oudshoorn, C.G.M.; van Til, J.A.; Schmitz, R.S.J.M.; van Duijnhoven, F.; Wesseling, J.; Bleiker, E.; van Harten, W.H.; et al. Preferences of Treatment Strategies among Women with Low-Risk DCIS and Oncologists. Cancers 2021, 13, 3962. https://doi.org/10.3390/cancers13163962

AMA Style

Byng D, Retèl VP, Engelhardt EG, Groothuis-Oudshoorn CGM, van Til JA, Schmitz RSJM, van Duijnhoven F, Wesseling J, Bleiker E, van Harten WH, et al. Preferences of Treatment Strategies among Women with Low-Risk DCIS and Oncologists. Cancers. 2021; 13(16):3962. https://doi.org/10.3390/cancers13163962

Chicago/Turabian Style

Byng, Danalyn, Valesca P. Retèl, Ellen G. Engelhardt, Catharina G. M. Groothuis-Oudshoorn, Janine A. van Til, Renée S. J. M. Schmitz, Frederieke van Duijnhoven, Jelle Wesseling, Eveline Bleiker, Wim H. van Harten, and et al. 2021. "Preferences of Treatment Strategies among Women with Low-Risk DCIS and Oncologists" Cancers 13, no. 16: 3962. https://doi.org/10.3390/cancers13163962

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop