Next Article in Journal
Intraoperative Monitoring of Sensory Evoked Potentials in Neurosurgery: A Personalized Approach
Previous Article in Journal
Assessing the TNM Classification for Periprosthetic Joint Infections of the Knee: Predictive Validity for Functional and Subjective Outcomes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Health Professionals’ Preferences for Next-Generation Sequencing in the Diagnosis of Suspected Genetic Disorders in the Paediatric Population

by
Mario Cesare Nurchis
1,2,*,
Gerardo Altamura
2,
Gian Marco Raspolini
2,
Enrico Capobianco
3,
Luca Salmasi
4 and
Gianfranco Damiani
2,5
1
Department of Life Science, Health and Health Professions, Università degli Studi Link, 00165 Rome, Italy
2
Section of Hygiene, Department of Health Science and Public Health, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
3
The Jackson Laboratory, Department of Computational Science, Farmington, CT 06032, USA
4
Department of Economics and Finance, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
5
Department of Woman and Child Health and Public Health, Fondazione Policlinico Universitario A. Gemelli IRCCS, 00168 Rome, Italy
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2025, 15(1), 25; https://doi.org/10.3390/jpm15010025
Submission received: 16 November 2024 / Revised: 2 January 2025 / Accepted: 7 January 2025 / Published: 10 January 2025
(This article belongs to the Section Omics/Informatics)

Highlights

What are the main findings?
  • The use of NGS techniques is primarily driven by the reduction in diagnostic odyssey.
What is the implication of the main finding?
  • Health professionals’ preferences help in the application of new genetic techniques, steering the formulation of evidence-based sounding genetic health policies.

Abstract

:
Background/Objectives: Next-generation sequencing (NGS) can explain how genetics influence morbidity and mortality in children. However, it is unclear whether health providers will perceive and use such treatments. We conducted a discrete choice experiment (DCE) to understand Italian health professionals’ preferences for NGS to improve the diagnosis of paediatric genetic diseases. Methods: The DCE was administered online to 125 health professionals in Italy. We documented attributes influencing professionals’ decisions of NGS, including higher diagnostic yield, shorter counselling periods, cost, turnaround time, and the identification of fewer variants of unknown significance. Results: Results show that factors such as higher diagnostic yield, shorter counselling periods, lower costs, and faster turnaround times positively influenced the adoption of NGS tests. Willingness to pay (WTP) estimates varied from EUR 387 (95% CI, 271.8–502.9) for 7% increase in the diagnostic yield to EUR 469 (95% CI, 287.2–744.9) for a decrease of one week in the turnaround time. Responders would reduce diagnostic yield by 7% to decrease the turnaround time by one week in both the preference and the willingness to trade (WTT) spaces. Respondents prioritised diagnostic yield (RI = 50.36%; 95% CI 40.2–67.2%) compared to other attributes. Conclusions: therefore, health professionals value NGS for allowing earlier, more accurate genetic diagnoses.

1. Introduction

Clinical genetics is an evolving speciality influenced by the availability of increasingly sophisticated investigational techniques [1]. Due to technological development, genetic counselling is gaining importance with further applications of genetic testing for diagnosis and clinical treatment [2]. More than 77,000 genetic tests [3] were estimated to be in use in 2022, with many others being developed and focused on detecting mutations in genes, chromosomes, or proteins. Over the past 50 years, DNA-based tests have shown an exponential increase in the number of disorders for which genetic testing has become available (biochemical, chromosomal, etc.) [4]. DNA and RNA sequencing and variant/mutation detection [5] via next-generation sequencing (NGS) have been integrated into molecular pathology and significantly increased the breadth of genomic information through the profiling of hundreds of genes [6,7], especially in the oncological field [8].
It is possible to distinguish three typologies of NGS testing: whole exome sequencing (WES), whole genome sequencing (WGS), and targeted NGS sequencing or panel NGS sequencing [9]. Targeted NGS is the most employed sequencing approach for molecular analysis in clinical practice [10]. Conversely, the widely used WES and WGS have limited clinical applications due to their low coverage depth and relatively high cost [11,12]. Studies demonstrate that these procedures can shorten the differential diagnosis process, targeted treatment timing, and genetic and prognostic counselling [10]. Genetic diseases (as per single-gene disorders, genomic structural defects, and copy number variants) are a leading cause of death in children under ten years old [11,12,13,14,15]. The application of NGS testing to neonatal care for early diagnosis of congenital diseases is a promising field of application. The goal is to reduce the disease burden for neonatal conditions with significant clinical impact by identifying all genetic disorders to allow for the timely implementation of appropriate therapies, apart from symptoms [16].
Neonatal intensive care units (NICU) are a pivotal service for critically ill neonates experiencing high morbidity and mortality rates, with significant diagnostic errors accounting for up to 20% of autopsied deaths. Newborns with undiagnosed or rare congenital disorders may mimic severely ill ones with more commonly acquired conditions, meaning that the diagnostic evaluation context can generate unique biases leading to diagnostic errors [17]. However, NGS testing might partially solve misdiagnosed clinical status hindrances. Assessing the preferences of the professionals involved could play an essential role in determining which method should be introduced in clinical practice. Indeed, specialised healthcare teams in many countries had stringent control over patient access to such NGS tests [18]. The preferences and insights of these professionals may play a multifaceted role in shaping the future of genomics in healthcare. Health professionals possess a deep understanding of the clinical context, ensuring that any new genomic method aligns with the practical needs of patient care. Furthermore, their input is invaluable for strategies successfully implementing new methods and helping identify barriers and facilitators to adopting the NGS techniques. Ethical considerations, resource allocation, and public trust in genomics heavily rely on their expertise. By fostering collaboration, ensuring regulatory compliance, and promoting continuous improvement, the engagement of health professionals is essential for the responsible integration of genomics into public health practice.
Surveys are a high-quality, efficient, and viable tool for exploring healthcare professionals’ preferences and opinions about a specific topic [19]. To elicit preferences that can be used in the absence of revealed preference data, the most valid survey design is a discrete choice experiment (DCE). This method detects the stakeholders’ propensities towards different attributes of hypothetical alternative scenarios. At the same time, the responses are employed to determine whether the preferences are significantly influenced by the attributes and their associated relevance [20].
The DCE methodology and especially the willingness to pay (WTP) elicitation are well-established approaches within the clinical field. In the realm of genetic testing, Buchanan et al. determined the attributes encouraging or discouraging the uptake of genomic tests in the context of inherited cardiovascular disease in the UK. Findings show that healthcare professionals predominantly emphasise the importance of diagnostic yield and the capacity to discover fewer variants of unknown clinical relevance in contrast to the duration of counselling, which received comparatively less emphasis [21]. Ries et al. documented results concerning the WTP for genetic testing. In this study, individuals from the general population demonstrated a readiness to allocate more than CAD 500 towards genetic diagnostic services. Meanwhile, Dhanda et al. indicated that payer-preferred genetic tests, with a focus on enhancing quality of life, exhibited substantial consensus among health professionals for effecting modifications in medical care and extending life expectancy through precisely tailored treatments [22]. Albeit in a different research context, Leigh et al. elicited preferences and WTP estimates from health professionals about the adoption of mobile health services in the UK [23]. Similarly, Tarekegn et al. measured preferences of health professionals for human papilloma virus vaccines through the WTP approach, helping policy makers setting priorities among alternative cervical cancer prevention methods in poor countries [24].
This paper tried to fill a gap in favour of understanding attributes related to NGS techniques implementation in a health system (i.e., Italy) where there is very little prior evidence. This paper elicits individual preferences, the WTP, and the willingness to trade (WTT) for NGS techniques. Being that health professionals are the key decision makers in the diagnostic workflow, stated preferences and the analysis of their WTTs contribute to steering NGS techniques adoption within the clinical practice by prioritising specific steps within the whole diagnostic process. Furthermore, from a policy perspective, given that our WTP estimates were elicited in the absence of NGS techniques regulations, they may represent shadow prices and thus are of paramount relevance for policymaking in defining tailored reimbursement tariffs that may be subsequently adopted for ad hoc economic analyses by decision makers.
This study aims to assess health professionals’ preferences regarding the attributes of NGS techniques for the diagnosis of suspected genetic disorders by using a DCE approach.

2. Materials and Methods

DCEs elicit individuals’ stated preference parameters between two alternative treatments. According to the Lancasterian theory of demand, treatments are defined by their characterising attributes [25], while the alternatives are generated by changing the values taken by a set of attributes. Generally, each individual is asked to choose the option from a list of choice sets, thus obtaining multiple observations [26]. Moreover, the inclusion of continuous variables, such as cost or waiting time, allows researchers to compute the willingness to pay (WTP) [27,28] or willingness to trade (WTT) [29,30,31,32] for variations in attribute levels.
Considering the abovementioned measures as important preference parameters useful in interpreting DCE results, our focus was on identifying a set of attributes and their importance levels according to health professionals. Then, both the relative importance of the attributes and the WTP/WTT were estimated by asking health professionals to choose between two NGS techniques with different test attributes in multiple-choice tasks. As a note, institutional review board approval for this study was obtained from the Ethics Committee of the Fondazione Policlinico Universitario Agostino Gemelli IRCCS (protocol code 4952; date of approval: 19 May 2022). The study adopted anonymous data only, which guaranteed full adherence to the Helsinki Declaration of Ethical Principles and with Italian (Law 2003/196) and international (EC/2016/679) data protection regulations. Written informed consent was obtained from all participants prior to their inclusion in the study. Participants were informed about the purpose of the research, the voluntary nature of their participation, and the measures in place to ensure the confidentiality and anonymity of their responses.

2.1. Sample Population

The sampling population selected for this experiment was composed of health professionals working in highly specialised centres in Italy and with expertise in using NGS techniques to diagnose the paediatric population with suspected genetic disorders. The DCE survey was circulated among the health professionals of twelve Italian hospitals with expertise in medical management and/or genetic counselling of genetic diseases to guarantee that the sampling population reflected standard characteristics (e.g., age, gender) and preferences.
The sample size was calculated according to the formula proposed by Johnson and Orme [33,34]:
N = 500 × c t × a .
This rule of thumb suggests that the sample size depends on the number of choice tasks ( t ), the number of alternatives ( a ), and the largest number of levels for any of the attributes ( c ). A more analytic approach by de Bekker-Grob et al. [35] was adopted to look for the minimum sample size for testing the significance of the various parameters with a desired power level. The following formula was applied:
N k > Z 1 a + Z 1 b s e β ¯ k β ¯ k 2
where s e β ¯ k is the asymptotic standard error of the parameter β k ^ ,  a is the significance level (i.e., 95%), and b is the power level (i.e., 80%), while Z 1 a and Z 1 b represent the 100 (1 − a)th and 100 (1 − b)th quantiles of the standard normal distribution, respectively.

2.2. Selection of Attributes and Levels for Each Testing Alternative

Attributes and levels in Table 1 were defined by adopting the approaches suggested by Regier et al. [36].
Literature was extensively reviewed by querying the primary scientific databases (i.e., PubMed, Scopus, EMBASE, and Web of Science) to identify the studies providing information on NGS-related factors that health professionals consider relevant to the diagnosis of suspected genetic disorders (see Supplementary Text S1 for additional details). Then, 12 potential attributes were chosen and brought to interviews with health professionals such as paediatricians, medical geneticists, biologists, and laboratory scientists, who rated the importance of each attribute (i.e., diagnostic yield, turnaround time, counselling time, ability of the test to identify variants of unknown significance, test cost, ease of interpretation for clinicians, follow-up testing requirements, ease of interpretation, security measures, sample requirement, reanalysis option, and clinical actionability). Five attributes were selected based on the rank assigned, the clinical and scientific plausibility, and the ability to capture the key characteristics of the testing practice. Finally, levels were defined for each attribute following the results of the interviews and the literature review.

2.3. Experimental Design

A full factorial design adopting the attributes and levels hitherto defined resulted in 675 potential choice sets (given by the multiplication of the attributes with five and three levels, 52 × 33), which are excessive for a DCE being too time-consuming to be completed. According to McFadden and Train [37], completeness, monotonicity, and transitivity of preferences are essential conditions for interpreting the DCE parameters’ estimates. When full factorial design is not feasible, D-optimality is the standard metric for design construction [38]. Therefore, the design was restricted to 10 choice tasks adopting a D-efficient algorithm appointed to identify a list of choice sets in which dominant alternatives are absent, and choice sets are not repeated. The D-optimal designs approach was adopted to maximise the determinant of the information matrix. These designs consider factors such as main effects, interactions, and curvature to achieve the highest efficiency level. Only the main-effects design was used to avoid the complexity of the design, and the estimation of interaction effects among attributes was denied at the design stage. Python programming language was used to generate the D-optimal designs. Each participant was faced with 10 choice tasks.

2.4. DCE Survey Design

In each choice set, respondents were presented with the same hypothetical scenario. This scenario described a situation in which a newborn came to the specialist’s attention with muscular hypotonia and a negative muscular spinal atrophy test. Once brought to the neonatal intensive care unit for not feeding and irregular breathing, routine controls confirmed low control of the head and hypotonic arms, leading the health professional to a potential genetic origin of the clinical condition. Respondents were asked to choose the two alternatives (genetic test A or genetic test B) they would prefer in each set. The DCE was set up in an unlabelled and forced choice format. Supplementary Text S2, in the Supplementary Materials, shows a hypothetical choice set presented to respondents and a description of each attribute. Similar evidence already available in the scientific literature [37,38,39] showed that an opt-out alternative was excluded since individuals were asked which option they would prefer rather than which one they would have chosen. Moreover, given the clinical complexity of the investigated population, healthcare professionals cannot avoid the conduct of an NGS test. Particularly, the decision to exclude an opt-out option in this DCE is grounded in the realistic simulation of clinical decision-making scenarios at tertiary care facilities involved in the survey. In this context, children presenting with a suspected genetic disorder are offered one of the two advanced genomic tests. The choice does not typically include traditional genetic testing or the option to forego testing altogether. The final DCE survey was organised as follows: (a) the welcome page provided respondents with instructions on how to complete the survey, the legal statements about personal data confidentiality, and the declaration of informed consent; (b) the respondents completed the 10 choice tasks; and (c) the DCE survey ended with multiple choice questions regarding the respondents’ demographic and background information.

2.5. Data Collection

A pilot survey was conducted among the study team and local collaborators. A few presentational changes were made, and some survey text was edited for clarity. No concerns were raised about the experimental design. Data were collected through an online survey using Qualtrics (Qualtrics, Provo, UT, USA) from 1 June 2022 to 31 August 2022 (92 days). Respondents were contacted electronically via email to invite them to complete the DCE.
Missing data and straight-lining responses were systematically addressed to ensure the reliability of the study findings. Missing data, defined as unanswered choice sets, were addressed through listwise deletion. Straight-lining responses, identified as instances where a respondent consistently selected the same alternative across all choice sets, were excluded from the analysis as these likely reflect disengagement or lack of understanding of the task.

2.6. Econometric Analysis

2.6.1. Utility Function

A random utility function approach was used to predict choices and compute preference weights from the data collected through the DCE survey design. According to this framework [39], the utility that a respondent assigns to each alternative can be written as U n t k = V n t k + ε n t k , where V n t k is the deterministic part of the utility obtained by the respondent n choosing the alternative t in the choice set k. Given two scenarios (i.e., genetic tests A and B), the assumption is that a respondent will choose alternative A if U n A k > U n B k . Under this framework, we can assume that respondents make trade-offs among attribute levels to maximise their utility. The utility function can be written as follows:
U n t k = k = 1 5 β n k A n t k + ε n t k
where β n k are the preference weights of each attribute level, A n t k are the attributes, and ε n t k is the error term.

2.6.2. Model

A mixed logit regression analysis was implemented to estimate the model of choice behaviour [40]. This approach allows consideration of preference heterogeneity among respondents by permitting one or more model parameters to be randomly distributed [41,42]. Furthermore, the mixed logit model allows for within-person correlation across choice tasks. When variables are random, it is necessary to specify a distribution function. In the present analysis, a log-normal distribution was attached to random parameters. Variables are considered fixed when they are not assumed to be random. We first estimate a model with all variables included as random, then, by looking at those with a non-significant standard deviation, we identify fixed variables and use this information to specify our final model. We assumed a linear relationship between attributes and choices and considered all attributes as continuous (the presence of non-linearity was tested by estimating a model with attributes expressed as dichotomous variables. We did not find evidence of a non-linear relationship between attributes and the outcome, and for this reason, we decided to consider attributes as continuous variables) variables. Including a variable measuring costs allowed the estimation of the WTP both in preference and WTP space [42]. WTP assigns monetary values to attributes (i.e., how much money respondents are willing to pay for a one-unit improvement in one of the attribute levels [43]). Estimates for WTP in the preference space can be computed as follows:
W T P n k = d U d A n k d U d c o s t n = β n k β n , c o s t
where β n k is the coefficient of the attribute, while β n , c o s t is the coefficient of the cost attribute (i.e., test cost). The previous formula produces valid WTP estimates assuming the price variable as fixed. This is an obvious limitation because the price could have a random distribution in many cases.
To assess the robustness of the findings, a sensitivity analysis was conducted by handling straight-lining respondents.

2.6.3. Re-Parametrised Model

Generally, the log-normal distribution describes a random price variable, although this would lead to unrealistic WTP values and heavily skewed distributions [42]. Therefore, we estimated the mixed logit model in the WTP space after performing the following re-parametrisation:
U n t k = β n c o s t c o s t n t k 1 β n c o s t k = 1 4 β n k A n t k + ε n t k = β n c o s t c o s t n t k k = 1 4 W T P n k A n t k + ε n t k
In this framework, the coefficients of the attributes are re-parametrised by taking the ratio between each attribute parameter and the attribute price (see Train and Weeks [37,44]). This transformation allows us to assume a distribution directly for W T P n k and not for the original coefficients. We assume each W T P n k to be normally distributed and β n c o s t to be log-normally distributed. Preference heterogeneity related to observable characteristics such as experience and occupation was assessed only in the preference space, while the assessment in the WTP space was not possible due to convergence issues. Following the same methodology, WTT was estimated both in preference and in WTT space, allowing interestingly for elicit trade-off preferences using a non-monetary variable (i.e., diagnostic yield) as a benchmark attribute.
Additionally, the mixed logit model was used to estimate the distributions of individual-level coefficients for each attribute following the approach proposed by Revelt and Train [45]:
β n ^ = 1 R r = 1 R β n r t = 1 T j = 1 J exp x n j t β n r j = 1 J x n j t β n r y n j t 1 R r = 1 R t = 1 T j = 1 J exp x n j t β n r j = 1 J x n j t β n r y n j t
where β n r is the r-th draw for individual n from the estimated distribution of β.
In conclusion, part-worth utility values were computed by estimating a random effects multinomial logit model [46], which allows for obtaining the probability P t of a health professional choosing an alternative t, among a set of possible alternative Ts in the choice task, with the βs representing the estimated part-worth utilities.
P t = e x p β , X t j = 1 T e x p β , X j
A positive part-worth utility suggests that the given attribute level is preferred over levels of the same attribute. In contrast, larger part-worth utilities, with respect to smaller ones, indicated a higher degree of preference for one level over another. The computed part-worth utilities were then standardised to have a mean value of zero and used to calculate the attribute relative attribute importance (RI). Accordingly, RI was computed as:
R I = ( o v e r a l l   u t i l i t y   f o r   e a c h   a t t r i b u t e ) / ( t o t a l   u t i l i t y )
The overall utility for each attribute was given by the range of part-worth utilities within each attribute, whilst the total utility equalled the sum of the overall utility values among all the DCE attributes. The RI was expressed as a percentage. All statistical analyses were performed in STATA 17 (StataCorp LP, College Station, TX, USA).

3. Results

3.1. Respondents’ Characteristics

Overall, 200 surveys were sent out. A total of 125 eligible participants provided informed consent and finished the DCE survey. Thirty participants did not respond to multiple questions, and 14 straight-lined their responses. Hence, these participants were excluded from the analyses, resulting in a final sample with 81 respondents. Demographic characteristics are reported in Table 2. Women represented 55.8% of the sample, while most respondents were between 25 and 34 years old (39.7%).

3.2. Model of Choice Behaviour

Each respondent answered 10 choice tasks, so 810 choice tasks were completed. Table 3 illustrates the results of the mixed logit model.
The estimated coefficients show that NGS tests are preferred when they provide a higher diagnostic yield, require shorter counselling periods, lower costs, lower turnaround time, and identify fewer variants of unknown significance. All the estimated coefficients were of the expected sign and were statistically significant. Among the parameters, diagnostic yield generated the highest utility (coef. = 0.205). The coefficients of counselling time, test cost, turnaround time, and ability to identify variances of unknown significance were negative, implying a decrease in utility as the number of minutes of counselling, the cost, the number of weeks, and the probability of identifying variances of unknown significance increase, respectively.
Since the coefficients associated with the standard deviations are significant for attributes such as counselling time, diagnostic yield, turnaround time, and the ability to identify variants of unknown significance, this means that there is considerable heterogeneity around these parameters, and for this reason, we considered them as random.
With regard to heterogeneous effects, respondents with higher experience (i.e., >20 years) assigned lower levels of utility to the diagnostic yield attribute, i.e., 38% lower (i.e., –0.090/0.234) (Supplementary Text S3, Table S1, panel A) as per the average respondent. Regarding the job occupation, the coefficient associated with being a paediatrician is not statistically significant, implying no difference between being a medical geneticist and a paediatrician in terms of perceived utility of diagnostic yield. Conversely, biologists assigned higher levels of utility to the diagnostic yield attribute. Concerning medical geneticists, the utility assigned to the attribute is 100% more (i.e., 0.204/0.204) (Supplementary Text S3, Table S1, panel B).
Supplementary Text S4, in the Supplementary Materials, shows the distribution of individual-level coefficients for each attribute and provides a visual description of the parameters’ dispersion due to heterogeneous preferences. Of note are a few observations: (a) all the attributes manifested a heterogenous distribution; (b) diagnostic yield coefficients showed a right-skewed bimodal distribution; (c) the density curve of the turnaround time coefficients was concentrated around the mean having no skew; and (d) the remaining attributes’ coefficient density curves depicted unimodal right-skewed distributions.
Sensitivity analysis showed that coefficients and their significance level were largely consistent with the original estimates, with minor variations in the magnitude of preferences.

3.3. Willingness to Pay and Willingness to Trade Estimates

Table 4 reports the WTP estimates in preference and the WTP space. All attributes were assumed to be independent. Diagnostic yield, counselling time, and test cost were assumed to be fixed, while turnaround time and the ability to identify variances of unknown significance were random and log-normally distributed.
The WTP results in the preference space differed notably from those computed in the WTP space, with the latter showing larger values. Overall, the relevance of the proposed analysis to obtain unbiased estimates of the WTP appears justified.
In the preference space, the WTP estimates varied from EUR 387 (95% CI, 271.8–502.9) for a 7% increase in the diagnostic yield to EUR 469 (95% CI, 287.2–744.9) for a decrease of one week in the turnaround time. Furthermore, individuals with higher professional experience showed a WTP of 43% (i.e., −EUR 203/EUR 471) lower than those with less experience. Regarding the job occupation, biologists highlighted a WTP 76% (i.e., EUR 357/EUR 471) higher, with respect to medical geneticists, for a 7% increase in diagnostic yield (Supplementary Text S3, Table S2). In the WTP space, the WTP estimates varied from EUR 710 (95% CI, 427.5–992.1) for a 7% increase in the diagnostic yield to EUR 777 (95% CI, 752.4–802.2) and for a one-week decrease in the turnaround time.
Overall, the WTP for respondents was more significant for the investigation process and the waiting time, whereas the WTP for health professionals spending enough time in consultation was smaller.
Table 5 outlines the WTT estimates in preference and the WTT space.
Contrary to the WTP, the WTT results in the preference space were similar to those in the WTT space. In both the preference and the WTT spaces, turnaround time is associated with the highest coefficient. Responders were willing to reduce diagnostic yield by 1.2 or 1.1 units (corresponding to a 7% reduction) to decrease the turnaround time by one week in both the preference and the WTT spaces, respectively. They were willing to reduce diagnostic yield by 0.07 and 0.06 percentage points to increase counselling time by one hour. Finally, they were willing to reduce the diagnostic yield by 0.08 and 0.05 percentage points to increase the ability to detect variances of unknown significance by one percentage point.

3.4. Relative Importance of Attributes

The relative importance demonstrated that, among the attributes, respondents valued diagnostic yield as the most important (RI = 50.36%; 95% CI 40.2–67.2%), preferring tests with higher values of this attribute. In the context of this study, the second-most important attribute was the turnaround time (RI = 18.92%; 95% CI 14.4–25.9%). Participants valued a lower turnaround time over a larger one. Other attributes, in order of relative importance, were test cost (RI = 10.93%, 95% CI 7–16.3%), the probability of detecting variances of unknown significance (RI = 10.37%; 95% CI 6.5–15.6%), and the counselling time (RI = 9.42%; 95% CI 6.2–13.9%). Part-worth utilities were in the expected direction for the levels within each of the above-reported attributes, with more extensive preferences for higher counselling time, lower probability of detecting variances of unknown significance, and lower costs. Part-worth utilities are depicted in Figure 1.

4. Discussion

We evaluated the attributes’ burden to detect specialists’ preferences in the process of deciding on a testing strategy. We submitted to responders a hypothetical scenario in which a newborn infant presented a clinical picture compatible with a genetic disease. Referring to the previous case, we asked health specialists to provide their preferences regarding WTP, diagnostic accuracy, waiting time, counselling time, and VUS identification. The resulting responses suggest that uptake for NGS tests was positively affected by a higher diagnostic yield, shorter periods of counselling, lower costs, shorter turnaround time, and identifying fewer variants of unknown significance.
Our findings show that the most important attribute was the diagnostic yield, for which responders were willing to spend up to EUR 387 for a 7% increase in accuracy. This result is relevant since the test accuracy is fundamental for diagnosing genetic disorders. Based on its diagnostic yield, the genetic test choice could directly support the diagnosis process, affecting health professionals and their clinical management decisions [47]. Moreover, a genetic disease, disorder, or phenotype can be challenging to define, considering the possible technical error derived from an outdated instrument [48]. Indeed, an uncertain result might require an additional exam, resulting in higher costs and time loss [49].
A further remarkable finding was the importance of a shorter turnaround time. This likely reflects that rapid identification of genetic diseases may provide information to direct clinical and public health interventions to shorten or end the diagnostic odyssey [50]. As is known, the impact of rapid genomic testing on morbidity and mortality through immediate access to provisional diagnosis, for which a specific treatment might eventually be available, has already been widely described in the literature [50].
The DCE methodology is not a novelty in the clinical field as well. Indeed, its application involved different scenarios of the care process [43,51,52]. This study proposes a novel application of the DCE methodology to the fast-growing genomic diagnostic technology field, considering that further investigation is needed in this context. Our estimates match previous findings in other DCE studies evaluating the preferences of all the actors involved in the diagnosis process (e.g., patients, health professionals, and payers). In the genetic testing context, Buchanan et al. supported the findings that health professionals mostly valued the diagnostic yield and the ability to identify fewer variances of unknown significance compared to counselling time, which instead has been less prioritised [21]. In addition, a systematic review of the literature strengthened this result [53].
Our study aligns with a common finding establishing the greater preference of health professionals for outcome attributes (i.e., diagnostic yield and identification of variances of unknown significance) with respect to process outcomes (i.e., counselling time). Ries et al. [54] reported similar findings regarding WTP for genetic testing, albeit from a different point of view. Here, respondents from the general population were willing to invest more than CAD 500 for genetic diagnostic services. Additionally, a literature review summarising median WTP values for different diagnostic technologies identified a median WTP ranging from USD 100 to USD 1000 for genetic testing [55]. With reference to the assumed importance of adopting NGS tests for an early diagnosis and treatment, evidence in the scientific literature reinforces this hypothesis even from a payer perspective. Dhanda et al. stated that payer-preferred genetic tests improving the quality of life had high expert agreement on changing medical care and increased life expectancy through targeted treatments [22].
The study finding that health professionals with over 20 years of experience placed less emphasis on diagnostic yield aligns with patterns observed in the broader literature [56,57]. This perspective is supported by studies examining the interplay between clinical experience and decision making. Nalliah et al. has shown that intuition-based decision making, under certain conditions, can be as effective or even superior to evidence-based processes. These conditions include the presence of domain expertise, typically requiring several years of practice beyond initial qualification, as well as scenarios with time constraints, complex and ambiguous problems, or limited scientific evidence. In such cases, intuition allows experts to rapidly access subconsciously stored knowledge, enabling quick and effective decision making [58]. In addition, the balance between experience-based and evidence-based approaches is increasingly recognised in clinical practice. Wattiez et al. emphasised that experience-based management can complement evidence-based guidelines by integrating tacit knowledge and insights gained from real-world practice into decision-making processes. This integration is particularly valuable in addressing complex or multifaceted conditions, where guidelines may not account for every clinical scenario [59]. In the context of genomic diagnostics, experienced clinicians may develop a more nuanced perspective on the diagnostic process, recognising that diagnostic yield, while an important metric, does not always guarantee better patient outcomes. These individuals might prioritise other factors such as clinical judgement and patient context as well as on long-term clinical outcomes, resource utilisation, or broader implications of diagnostic decisions, viewing diagnostic yield as just one component of overall care quality [60].
Considering the elicited preferences from health professionals, our findings may steer decision making toward the choice of NGS tests, which should ensure a higher diagnostic yield and a shorter turnaround time. The joint reading of our findings allows for some practical main implications. The strong preference for shorter turnaround times underscores the importance of policies promoting process optimisation in genomic diagnostic workflows. Healthcare policies should prioritise investments in infrastructure and technology that expedite the analysis and interpretation of genomic data, potentially integrating automated pipelines and artificial intelligence tools. For instance, Australia’s Medicare Benefits Scheme introduced reimbursement policies for genomic testing in rare diseases and cancer, enabling faster access to testing and improving patient outcomes. Similarly, the UK’s National Health Service Genomic Medicine Service implemented a centralised approach to genomic diagnostics, providing equity of access to high-quality NGS services while streamlining turnaround times. Furthermore, the significant role of test cost in shaping clinician preferences highlights the necessity of establishing economically sustainable policies focused on implementing reimbursement systems for genomic diagnostics technologies. For example, Germany introduced statutory health insurance coverage for specific NGS panels, reducing financial barriers and fostering adoption among clinicians. Moreover, the differences in preferences between experienced and less experienced professionals suggest that training programs should be tailored to address specific knowledge gaps. The emphasis on diagnostic yield across all respondents highlights the potential for genomic diagnostics to reduce inequities in healthcare. Policymakers should aim to integrate these technologies within underserved and resource-limited settings, ensuring that vulnerable populations can benefit from precision medicine advancements. A more conceptual implication may be derived from comparing our findings with those obtained in different contexts as reported by the scientific literature. Indeed, it is paramount to give accountability to all the actors engaged in the diagnostic workup when developing sounding genomic policies, especially by weighing health professionals’ preferences with patients’ and payers’. This may address two issues about empowerment. Firstly, it may guarantee to overcome the shattering relationship [61,62] among the stakeholders involved at the different levels (i.e., macro-, meso-, and micro-level) of the decision-making process in the healthcare system. Secondly, it might optimise the health system performance by pursuing the Triple Aim framework [63], which embodies the core principles of public health, by simultaneously improving population health experience of care, and decreasing the burden of healthcare costs for national health services.
The present study should be considered considering its main strengths and limitations. Given the online nature of the experiment, participation and non-response biases are potential caveats to data collection [64]. Moreover, the personal experience may influence the attitude of the responder towards the items. Nevertheless, the web survey was addressed only to sector specialists, thus increasing the likelihood of obtaining coherent answers. Additionally, the time needed to complete the questionnaire might have discouraged some recipients, potentially reducing the sample size. In addition, the observed considerable heterogeneity was not explored in depth due to the study’s sample size. However, proper methodology [33,34] was adopted to address this issue by computing the needed sample to yield reliable estimates of the attributes’ coefficients. It has been noted that a sample size of at least 20 is sufficient to correctly compute a DCE model since each participant provides multiple observations [65]. A further limit was that a reduction in the amount of counselling time positively affected the uptake of genetic tests. Nonetheless, this may be an artefact of the design of the DCE, even though the relative size of the coefficients for the counselling attribute in the regression model may imply that this attribute likely only had a negligible impact on the individuals’ choices. A further caveat is the presence of missing data that can significantly affect the study findings by introducing bias, reducing statistical power, and impairing the validity of preference estimates. Notwithstanding, a sensitivity analysis confirmed that the exclusion of missing data did not materially affect the parameter estimates, ensuring the robustness of the results. An additional limitation is the exclusion of an opt-out option, which might have introduced some bias on preference estimation, realism, behavioural responses, and generalisability.
Excluding an opt-out option forces respondents to select one of the available alternatives. This can increase the precision of utility estimates for the attributes under consideration, as all responses contribute information about preferences. It may also lead to biased estimates if respondents would have preferred not to choose either option in a real-world scenario, thus artificially inflating the importance of certain attributes.
As the study is based on a real-world setting where clinicians must choose between two genomic tests, excluding the opt-out option increases the contextual realism of the study. Notwithstanding, without an opt-out option, respondents might make choices they would not make in practice, leading to hypothetical bias.
Forcing respondents to choose between two alternatives in every choice set can lead to decision fatigue, resulting in lower engagement, random answering, or reduced reliability of responses. Therefore, the increased variability in responses might reduce the precision of the estimated preferences.
The absence of an opt-out option may limit the generalisability of the findings to settings with different clinical workflows.
Notwithstanding, the study did not adopt an experimental design with alternative-specific attribute levels nor a labelled design, allowing it to achieve the level balance for all attributes and to improve response efficiency [66]. Furthermore, including an opt-out option could misrepresent the actual clinical workflow, potentially leading to responses that deviate from such real-world practice. Finally, in the present DCE, responders answered several choice tasks while assessing a hypothetical scenario. Alternative scenarios might originate different patterns of results.
The observed differences between preference space and WTP space estimates can be attributed to several factors inherent to the modelling approaches. First, preference space models estimate utility coefficients directly for each attribute, while WTP space models reformulate utility functions to estimate WTP by dividing attribute coefficients by the marginal utility of cost. This transformation introduces additional assumptions about the distribution of the cost parameter, which can differ between the two approaches. Variability or non-linear scaling in the cost parameter, such as declining marginal utility with increasing cost, may further amplify disparities. Additionally, WTP space estimates are more sensitive to unobserved heterogeneity in cost sensitivity, as variability in the cost parameter directly affects WTP estimates for all non-monetary attributes.
Further research is required to investigate the drivers of preference heterogeneity among health professionals about genomic testing through revealed preference studies.
Additional research should aim to include a more diverse range of professional backgrounds, such as genetic counsellors and other specialised healthcare providers, to enable more granular comparisons of preferences across subgroups.

5. Conclusions

The highly shared preference for the diagnostic yield and turnaround time draws attention to the need to invest in more accurate and faster instruments to tackle the diagnostic odyssey of ill paediatric patients. Study findings have implications for the design of future genomic policies and the implementation of genomic testing services. These preferences may also impact the translation of NGS techniques into clinical practice for diagnosing suspected genetic disorders in the medium-to-long term. Investigating NGS application to diagnose suspected genetic disorders through sector specialists’ perspectives may generate room for accurate and early genetic diagnosis, ultimately reducing the diagnostic odyssey [67,68]. However, sustainable allocation of healthcare resources should become a focal point in discussing economic investments in the genetic field to ensure the most suitable and cost-effective care for the fragile paediatric population.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jpm15010025/s1, Supplementary Text S1: Literature review; Supplementary Text S2: DCE attributes and hypothetical choice situation presented; Supplementary Text S3: Model of choice behaviour and WTP estimates considering heterogeneous effects; Table S1: Mixed logit regression estimates for heterogenous effects; Table S2: WTP estimates in preference space for heterogenous effects; Supplementary Text S4: Distributions of individual-level coefficients; Figure S1: Density function—individual-level coefficients for the “Diagnostic yield” attribute; Figure S2: Density function—individual-level coefficients for the “Turnaround time” attribute; Figure S3: Density function—individual-level coefficients for the “Counselling time” attribute; Figure S4: Density function—individual-level coefficients for the “Ability of the test to identify variants of unknown significance” attribute; Figure S5: Density function–individual-level coefficients for the “Test cost” attribute.

Author Contributions

M.C.N.: conceptualisation, methodology, formal analysis, investigation, resources, data curation, writing—original draft preparation, writing—reviewing and editing, visualisation, project administration. G.A.: resources, data curation, writing—reviewing and editing, visualisation. G.M.R.: resources, data curation, writing—reviewing and editing, visualisation. E.C.: methodology, writing—reviewing and editing. L.S.: methodology, formal analysis, investigation, writing—reviewing and editing. G.D.: validation, writing—reviewing and editing, visualisation, supervision, project administration. All authors have read and agreed to the published version of the manuscript.

Funding

No funding was received to assist with the preparation of this manuscript.

Institutional Review Board Statement

Ethical approval (protocol code 4952; date of approval: 19 May 2022) for this study was obtained from the Ethics Committee of the Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Italy.

Informed Consent Statement

Informed consent was obtained from all participants included in the study. The participants have consented to the submission of the present study to the journal.

Data Availability Statement

The datasets generated during and/or analysed during the current study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors have no financial or proprietary interests in any material discussed in this article.

References

  1. Fennell, A.P.; Hunter, M.F.; Corboy, G.P. The Changing Face of Clinical Genetics Service Delivery in the Era of Genomics: A Framework for Monitoring Service Delivery and Data from a Comprehensive Metropolitan General Genetics Service. Genet. Med. 2020, 22, 210–218. [Google Scholar] [CrossRef] [PubMed]
  2. Gschmeidler, B.; Flatscher-Thoeni, M. Ethical and Professional Challenges of Genetic Counseling—The Case of Austria. J. Genet. Couns. 2013, 22, 741–752. [Google Scholar] [CrossRef]
  3. Rubinstein, W.S.; Maglott, D.R.; Lee, J.M.; Kattman, B.L.; Malheiro, A.J.; Ovetsky, M.; Hem, V.; Gorelenkov, V.; Song, G.; Wallin, C.; et al. The NIH Genetic Testing Registry: A New, Centralized Database of Genetic Tests to Enable Access to Comprehensive Information and Improve Transparency. Nucleic Acids Res. 2012, 41, D925–D935. [Google Scholar] [CrossRef]
  4. McPherson, E. Genetic Diagnosis and Testing in Clinical Practice. Clin. Med. Res. 2006, 4, 123–129. [Google Scholar] [CrossRef]
  5. Dahui, Q. Next-Generation Sequencing and Its Clinical Application. Cancer Biol. Med. 2019, 16, 4–10. [Google Scholar] [CrossRef] [PubMed]
  6. Goodwin, S.; McPherson, J.D.; McCombie, W.R. Coming of Age: Ten Years of next-Generation Sequencing Technologies. Nat. Rev. Genet. 2016, 17, 333–351. [Google Scholar] [CrossRef] [PubMed]
  7. Metzker, M.L. Sequencing Technologies—The next Generation. Nat. Rev. Genet. 2010, 11, 31–46. [Google Scholar] [CrossRef]
  8. Strom, S.P. Current Practices and Guidelines for Clinical Next-Generation Sequencing Oncology Testing. Cancer Biol. Med. 2016, 13, 3–11. [Google Scholar] [CrossRef] [PubMed]
  9. Ferlini, A.; Gennarelli, M.; Genuardi, M.; Grammatico, P.; Seri, M.; Torricelli, F.; Zollino, M.; Zuffardi, O.; Nigro, V.; Tartaglia, M. Il Sequenziamento Del. DNA Di Nuova Generazione: Indicazioni per L’impiego Clinico; The Italian Society of Human Genetics (SIGU): Milan, Italy, 2016. [Google Scholar]
  10. Saunders, C.J.; Miller, N.A.; Soden, S.E.; Dinwiddie, D.L.; Noll, A.; Alnadi, N.A.; Andraws, N.; Patterson, M.L.; Krivohlavek, L.A.; Fellis, J.; et al. Rapid Whole-Genome Sequencing for Genetic Disease Diagnosis in Neonatal Intensive Care Units. Sci. Transl. Med. 2012, 4, 154ra135. [Google Scholar] [CrossRef] [PubMed]
  11. Wojcik, M.H.; Stadelmaier, R.; Heinke, D.; Holm, I.A.; Tan, W.-H.; Agrawal, P.B. The Unrecognized Mortality Burden of Genetic Disorders in Infancy. Am. J. Public. Health 2021, 111, S156–S162. [Google Scholar] [CrossRef] [PubMed]
  12. Bainbridge, M.N.; Wiszniewski, W.; Murdock, D.R.; Friedman, J.; Gonzaga-Jauregui, C.; Newsham, I.; Reid, J.G.; Fink, J.K.; Morgan, M.B.; Gingras, M.-C.; et al. Whole-Genome Sequencing for Optimized Patient Management. Sci. Transl. Med. 2011, 3, 87re3. [Google Scholar] [CrossRef] [PubMed]
  13. Bagnall, R.D.; Ingles, J.; Dinger, M.E.; Cowley, M.J.; Ross, S.B.; Minoche, A.E.; Lal, S.; Turner, C.; Colley, A.; Rajagopalan, S.; et al. Whole Genome Sequencing Improves Outcomes of Genetic Testing in Patients with Hypertrophic Cardiomyopathy. J. Am. Coll. Cardiol. 2018, 72, 419–429. [Google Scholar] [CrossRef]
  14. Akter, H.; Hossain, M.S.; Dity, N.J.; Rahaman, M.A.; Furkan Uddin, K.M.; Nassir, N.; Begum, G.; Hameid, R.A.; Islam, M.S.; Tusty, T.A.; et al. Whole Exome Sequencing Uncovered Highly Penetrant Recessive Mutations for a Spectrum of Rare Genetic Pediatric Diseases in Bangladesh. NPJ Genom. Med. 2021, 6, 14. [Google Scholar] [CrossRef] [PubMed]
  15. Li, C.; Wang, Y.; Zeng, C.; Huang, B.; Chen, Y.; Xue, C.; Liu, L.; Rong, S.; Lin, Y. Trio-Whole Exome Sequencing Reveals the Importance of de Novo Variants in Children with Intellectual Disability and Developmental Delay. Sci. Rep. 2024, 14, 27590. [Google Scholar] [CrossRef]
  16. Woerner, A.C.; Gallagher, R.C.; Vockley, J.; Adhikari, A.N. The Use of Whole Genome and Exome Sequencing for Newborn Screening: Challenges and Opportunities for Population Health. Front. Pediatr. 2021, 9, 663752. [Google Scholar] [CrossRef]
  17. Bordini, B.J.; Kliegman, R.M.; Basel, D.; Nocton, J.J. Undiagnosed and Rare Diseases in Perinatal Medicine: Lessons in Context and Cognitive Diagnostic Error. Clin. Perinatol. 2020, 47, 1–14. [Google Scholar] [CrossRef]
  18. Mazur, D.J.; Hickam, D.H.; Mazur, M.D.; Mazur, M.D. The Role of Doctor’s Opinion in Shared Decision Making: What Does Shared Decision Making Really Mean When Considering Invasive Medical Procedures? Health Expect. 2005, 8, 97–102. [Google Scholar] [CrossRef] [PubMed]
  19. McLeod, C.C.; Klabunde, C.N.; Willis, G.B.; Stark, D. Health Care Provider Surveys in the United States, 2000–2010. Eval. Health Prof. 2013, 36, 106–126. [Google Scholar] [CrossRef]
  20. Hamoonga, T.E.; Mutale, W.; Igumbor, J.; Bosomprah, S.; Arije, O.; Chi, B.H. Preferences for Pre-Exposure Prophylaxis Delivery among HIV-Negative Pregnant and Breastfeeding Women in Zambia: Evidence from a Discrete Choice Experiment. Front. Reprod. Health 2024, 6, 1350661. [Google Scholar] [CrossRef] [PubMed]
  21. Buchanan, J.; Blair, E.; Thomson, K.L.; Ormondroyd, E.; Watkins, H.; Taylor, J.C.; Wordsworth, S. Do Health Professionals Value Genomic Testing? A Discrete Choice Experiment in Inherited Cardiovascular Disease. Eur. J. Hum. Genet. 2019, 27, 1639–1648. [Google Scholar] [CrossRef] [PubMed]
  22. Dhanda, D.S.; Veenstra, D.L.; Regier, D.A.; Basu, A.; Carlson, J.J. Payer Preferences and Willingness to Pay for Genomic Precision Medicine: A Discrete Choice Experiment. J. Manag. Care Spec. Pharm. 2020, 26, 529–537. [Google Scholar] [CrossRef] [PubMed]
  23. Leigh, S.; Ashall-Payne, L.; Andrews, T. Barriers and Facilitators to the Adoption of Mobile Health Among Health Care Professionals From the United Kingdom: Discrete Choice Experiment. JMIR Mhealth Uhealth 2020, 8, e17704. [Google Scholar] [CrossRef]
  24. Tarekegn, A.A.; Yismaw, A.E. Health Professionals’ Willingness to Pay and Associated Factors for Human Papilloma Virus Vaccination to Prevent Cervical Cancer at College of Medicine and Health Sciences University of Gondar, Northwest Ethiopia. BMC Res. Notes 2019, 12, 58. [Google Scholar] [CrossRef]
  25. Lancaster, K.J. A New Approach to Consumer Theory. J. Political Econ. 1966, 74, 132–157. [Google Scholar] [CrossRef]
  26. Lancsar, E.; Fiebig, D.G.; Hole, A.R. Discrete Choice Experiments: A Guide to Model Specification, Estimation and Software. Pharmacoeconomics 2017, 35, 697–716. [Google Scholar] [CrossRef] [PubMed]
  27. Hole, A.R. Modelling Heterogeneity in Patients’ Preferences for the Attributes of a General Practitioner Appointment. J. Health Econ. 2008, 27, 1078–1094. [Google Scholar] [CrossRef] [PubMed]
  28. Nieboer, A.P.; Koolman, X.; Stolk, E.A. Preferences for Long-Term Care Services: Willingness to Pay Estimates Derived from a Discrete Choice Experiment. Soc. Sci. Med. 2010, 70, 1317–1325. [Google Scholar] [CrossRef] [PubMed]
  29. Brown, P.; Panattoni, L.; Cameron, L.; Knox, S.; Ashton, T.; Tenbensel, T.; Windsor, J. Hospital Sector Choice and Support for Public Hospital Care in New Zealand: Results from a Labeled Discrete Choice Survey. J. Health Econ. 2015, 43, 118–127. [Google Scholar] [CrossRef] [PubMed]
  30. Rousseau, S.; Rousseau, R. Interactions between Journal Attributes and Authors’ Willingness to Wait for Editorial Decisions. J. Am. Soc. Inf. Sci. Technol. 2012, 63, 1213–1225. [Google Scholar] [CrossRef]
  31. Hagemi, A.; Plumpton, C.; Hughes, D.A. Renal Transplant Patients’ Preference for the Supply and Delivery of Immunosuppressants in Wales: A Discrete Choice Experiment. BMC Nephrol. 2017, 18, 305. [Google Scholar] [CrossRef]
  32. Marshall, D.A.; Deal, K.; Conner-Spady, B.; Bohm, E.; Hawker, G.; Loucks, L.; MacDonald, K.V.; Noseworthy, T. How Do Patients Trade-off Surgeon Choice and Waiting Times for Total Joint Replacement: A Discrete Choice Experiment. Osteoarthr. Cartil. 2018, 26, 522–530. [Google Scholar] [CrossRef]
  33. Johnson, R.; Orme, B. Getting the Most from CBC; Research Paper Series; Sawtooth Software, Inc.: Sequim, WA, USA, 2003. [Google Scholar]
  34. Orme, B. Sample Size Issues for Conjoint Analysis Studies; Sawtooth Software, Inc.: Sequim, WA, USA, 1998. [Google Scholar]
  35. de Bekker-Grob, E.W.; Donkers, B.; Jonker, M.F.; Stolk, E.A. Sample Size Requirements for Discrete-Choice Experiments in Healthcare: A Practical Guide. The Patient—Patient-Centered Outcomes Res. 2015, 8, 373–384. [Google Scholar] [CrossRef] [PubMed]
  36. Regier, D.A.; Veenstra, D.L.; Basu, A.; Carlson, J.J. Demand for Precision Medicine: A Discrete-Choice Experiment and External Validation Study. Pharmacoeconomics 2020, 38, 57–68. [Google Scholar] [CrossRef] [PubMed]
  37. McFadden, D.; Train, K. Mixed MNL Models for Discrete Response. J. Appl. Econom. 2000, 15, 447–470. [Google Scholar] [CrossRef]
  38. Reed Johnson, F.; Lancsar, E.; Marshall, D.; Kilambi, V.; Mühlbacher, A.; Regier, D.A.; Bresnahan, B.W.; Kanninen, B.; Bridges, J.F.P. Constructing Experimental Designs for Discrete-Choice Experiments: Report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. Value Health 2013, 16, 3–13. [Google Scholar] [CrossRef] [PubMed]
  39. McFadden, D. Conditional Logit Analysis of Qualitative Choice Behaviour. In Frontiers in Econometrics; Zarembka, P., Ed.; Academic Press: New York, NY, USA, 1973; pp. 105–142. [Google Scholar]
  40. Hole, A.R. Fitting Mixed Logit Models by Using Maximum Simulated Likelihood. Stata J. Promot. Commun. Stat. Stata 2007, 7, 388–401. [Google Scholar] [CrossRef]
  41. Hensher, D.A.; Greene, W.H. The Mixed Logit Model: The State of Practice and Warnings for the Unwary; Institute of Transport Studies, the University of Sydney and Monash University: Sydney, NSW, Australia, 2022. [Google Scholar]
  42. Hole, A.R.; Kolstad, J.R. Mixed Logit Estimation of Willingness to Pay Distributions: A Comparison of Models in Preference and WTP Space Using Data from a Health-Related Choice Experiment. Empir. Econ. 2012, 42, 445–469. [Google Scholar] [CrossRef]
  43. Brito Fernandes, Ó.; Péntek, M.; Kringos, D.; Klazinga, N.; Gulácsi, L.; Baji, P. Eliciting Preferences for Outpatient Care Experiences in Hungary: A Discrete Choice Experiment with a National Representative Sample. PLoS ONE 2020, 15, e0235165. [Google Scholar] [CrossRef] [PubMed]
  44. Revelt, D.; Train, K.; Allenby, G.; Huber, J.; Johnson, R.; McFadden, D.; Rossi, P. Customer-Specific Taste Parameters and Mixed Logit; University of California: Berkeley, CA, USA, 1999; Available online: http://elsa.berkeley.edu/~train (accessed on 12 April 2024).
  45. Revelt, D.; Train, K. Customer-Specific Taste Parameters and Mixed Logit: Households’ Choice of Electricity Supplier; Economics Working Papers; University of California: Berkeley, CA, USA, 2000; Available online: https://EconPapers.repec.org/RePEc:ucb:calbwp:e00-274 (accessed on 12 April 2024).
  46. Hartzel, J.; Agresti, A.; Caffo, B. Multinomial Logit Random Effects Models. Stat. Model. 2001, 1, 81–102. [Google Scholar] [CrossRef]
  47. National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Health Care Services; Board on the Health of Select Populations; Committee on the Evidence Base for Genetic Testing. An Evidence Framework for Genetic Testing; National Academies Press: Washington, DC, USA, 2017. [Google Scholar] [CrossRef]
  48. Mahon, S. Errors in Genetic Testing: Common Causes and Strategies for Prevention. Clin. J. Oncol. Nurs. 2017, 21, 673–676. [Google Scholar] [CrossRef]
  49. Kroese, M.; Zimmern, R.L.; Sanderson, S. Genetic Tests and Their Evaluation: Can We Answer the Key Questions? Genet. Med. 2004, 6, 475–480. [Google Scholar] [CrossRef] [PubMed]
  50. Kingsmore, S.F.; Cakici, J.A.; Clark, M.M.; Gaughran, M.; Feddock, M.; Batalov, S.; Bainbridge, M.N.; Carroll, J.; Caylor, S.A.; Clarke, C.; et al. A Randomized, Controlled Trial of the Analytic and Diagnostic Performance of Singleton and Trio, Rapid Genome and Exome Sequencing in Ill Infants. Am. J. Human. Genet. 2019, 105, 719–733. [Google Scholar] [CrossRef] [PubMed]
  51. Ng-Mak, D.; Poon, J.-L.; Roberts, L.; Kleinman, L.; Revicki, D.A.; Rajagopalan, K. Patient Preferences for Important Attributes of Bipolar Depression Treatments: A Discrete Choice Experiment. Patient Prefer. Adherence 2018, 12, 35–44. [Google Scholar] [CrossRef]
  52. Genie, M.G.; Nicoló, A.; Pasini, G. The Role of Heterogeneity of Patients’ Preferences in Kidney Transplantation. J. Health Econ. 2020, 72, 102331. [Google Scholar] [CrossRef]
  53. Harrison, M.; Milbers, K.; Hudson, M.; Bansback, N. Do Patients and Health Care Providers Have Discordant Preferences about Which Aspects of Treatments Matter Most? Evidence from a Systematic Review of Discrete Choice Experiments. BMJ Open 2017, 7, e014719. [Google Scholar] [CrossRef] [PubMed]
  54. Ries, N.M.; Hyde-Lay, R.; Caulfield, T. Willingness to Pay for Genetic Testing: A Study of Attitudes in a Canadian Population. Public Health Genom. 2010, 13, 292–300. [Google Scholar] [CrossRef]
  55. Lin, P.-J.; Cangelosi, M.J.; Lee, D.W.; Neumann, P.J. Willingness to Pay for Diagnostic Technologies: A Review of the Contingent Valuation Literature. Value Health 2013, 16, 797–805. [Google Scholar] [CrossRef] [PubMed]
  56. Agha, L.; Skinner, J.; Chan, D. Improving Efficiency in Medical Diagnosis. JAMA 2022, 327, 2189. [Google Scholar] [CrossRef]
  57. Berner, E.S.; Graber, M.L. Overconfidence as a Cause of Diagnostic Error in Medicine. Am. J. Med. 2008, 121, S2–S23. [Google Scholar] [CrossRef] [PubMed]
  58. Nalliah, R.P. Clinical Decision Making—Choosing between Intuition, Experience and Scientific Evidence. Br. Dent. J. 2016, 221, 752–754. [Google Scholar] [CrossRef]
  59. Wattiez, A.; Schindler, L.; Ussia, A.; Campo, R.; Keckstein, J.; Grimbizis, G.; Exacoustos, C.; Kondo, W.; Nezhat, C.; Canis, M.; et al. A Proof of Concept That Experience-Based Management of Endometriosis Can Complement Evidence-Based Guidelines. Facts Views Vis. Obgyn 2023, 15, 197–214. [Google Scholar] [CrossRef] [PubMed]
  60. Dewitt, B.; Persson, J.; Wallin, A. Perceptions of Clinical Experience and Scientific Evidence in Medical Decision Making: A Survey of a Stratified Random Sample of Swedish Health Care Professionals. Med. Decis. Mak. 2024, 44, 335–345. [Google Scholar] [CrossRef]
  61. Schuldt, J.; Doktor, A.; Lichters, M.; Vogt, B.; Robra, B.-P. Insurees’ Preferences in Hospital Choice—A Population-Based Study. Health Policy 2017, 121, 1040–1046. [Google Scholar] [CrossRef] [PubMed]
  62. Mühlbacher, A.C.; Juhnke, C. Patient Preferences versus Physicians’ Judgement: Does It Make a Difference in Healthcare Decision Making? Appl. Health Econ. Health Policy 2013, 11, 163–180. [Google Scholar] [CrossRef] [PubMed]
  63. Berwick, D.M.; Nolan, T.W.; Whittington, J. The Triple Aim: Care, Health, and Cost. Health Aff. 2008, 27, 759–769. [Google Scholar] [CrossRef] [PubMed]
  64. Cascini, F.; Altamura, G.; Failla, G.; Gentili, A.; Puleo, V.; Melnyk, A.; Causio, F.A.; Ricciardi, W. Approaches to Priority Identification in Digital Health in Ten Countries of the Global Digital Health Partnership. Front. Digit. Health 2022, 4, 968953. [Google Scholar] [CrossRef]
  65. Lancsar, E.; Louviere, J. Conducting Discrete Choice Experiments to Inform Healthcare Decision Making: A User’s Guide. Pharmacoeconomics 2008, 26, 661–677. [Google Scholar] [CrossRef]
  66. Adams, J.; Bateman, B.; Becker, F.; Cresswell, T.; Flynn, D.; McNaughton, R.; Oluboyede, Y.; Robalino, S.; Ternent, L.; Sood, B.G.; et al. Effectiveness and Acceptability of Parental Financial Incentives and Quasi-Mandatory Schemes for Increasing Uptake of Vaccinations in Preschool Children: Systematic Review, Qualitative Study and Discrete Choice Experiment. Health Technol. Assess. 2015, 19, 1–176. [Google Scholar] [CrossRef] [PubMed]
  67. Abolhassani, H.; Aghamohammadi, A.; Fang, M.; Rezaei, N.; Jiang, C.; Liu, X.; Pan-Hammarström, Q.; Hammarström, L. Clinical Implications of Systematic Phenotyping and Exome Sequencing in Patients with Primary Antibody Deficiency. Genet. Med. 2019, 21, 243–251. [Google Scholar] [CrossRef]
  68. Berberich, A.J.; Ho, R.; Hegele, R.A. Whole Genome Sequencing in the Clinic: Empowerment or Too Much Information? Can. Med. Assoc. J. 2018, 190, E124–E125. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Part-worth utility values for each attribute level alongside their 95% confidence intervals. The bars represent the estimated utilities, while the error bars indicate the uncertainty around these estimates. Abbreviation: VUS, variants of unknown significance. Artwork created with STATA 17 (StataCorp LP, College Station, TX, USA).
Figure 1. Part-worth utility values for each attribute level alongside their 95% confidence intervals. The bars represent the estimated utilities, while the error bars indicate the uncertainty around these estimates. Abbreviation: VUS, variants of unknown significance. Artwork created with STATA 17 (StataCorp LP, College Station, TX, USA).
Jpm 15 00025 g001
Table 1. Summary of attributes and levels adopted in the final DCE survey.
Table 1. Summary of attributes and levels adopted in the final DCE survey.
Test AttributePossible Levels for Each Testing Alternative
Genetic Test AGenetic Test B
Diagnostic yieldPathogenic variation identified in 32 out of 100 cases
Pathogenic variation identified in 39 out of 100 cases
Pathogenic variation identified in 46 out of 100 cases
Turnaround time8 weeks, 10 weeks, 12 weeks
Counselling time40 min, 50 min, 60 min
Ability of the test to identify variants of unknown significance Variants of unknown significance identified in 5 out of 100 cases
Variants of unknown significance identified in 10 out of 100 cases
Variants of unknown significance identified in 15 out of 100 cases
Variants of unknown significance identified in 20 out of 100 cases
Variants of unknown significance identified in 25 out of 100 cases
Test costEUR 1000, EUR 1500, EUR 2000, EUR 2500, EUR 3000
Table 2. Demographic characteristics of DCE survey participants.
Table 2. Demographic characteristics of DCE survey participants.
VariableValueSD
Gender
Female55.8%0.51
Male41.7%0.49
Prefer not to say2.5%0.16
Age of respondent
24 years and under2.5%0.16
25–34 years39.7%0.49
35–44 years13.7%0.34
45–54 years8.7%0.28
55–6419.9%0.39
65 years and over15.5%0.36
Respondent occupation
Clinical geneticist34.8%0.48
Paediatrician45.3%0.49
Biologist17.4%0.38
Laboratory scientist 1.25%0.11
Other1.25%0.11
Respondent’s experience in the genomic field
Less than 1 year 37.4%0.48
1–9 years33.5%0.47
10–20 years18.1%0.39
20 years and over11%0.31
Education/research activities on NGS testing approaches
Yes44.6%0.49
No55.4%0.49
Use of NGS testing approaches
Yes44.8%0.49
No55.2%0.49
Survey details
Median time to complete the survey, minutes12.13.16
Survey response rate62.2%0.03
Abbreviation: NGS, next-generation sequencing.
Table 3. Mixed logit regression estimates.
Table 3. Mixed logit regression estimates.
AttributeB-CoefficientSDLower CIUpper CIp
Fixed parameters
Diagnostic yield0.205 ***0.6590.1780.232<0.001
Counselling time−0.015 *0.326−0.028−0.001<0.071
Test cost−0.001 ***0.039−0.0007−0.0004<0.001
Random parameters
Turnaround time−0.248 ***2.050−0.339−0.173<0.001
Variance of unknown significance−0.016 ***0.511−0.0370.004<0.001
AIC782.29
Log-likelihood−384.15
Abbreviations: AIC, Akaike Information Criterion; CI, 90% confidence interval; p, p-value; and SD, standard deviation. Notes: significant levels: *** p < 0.01, and * p < 0.1.
Table 4. Comparison of willingness to pay estimates in preference and WTP space.
Table 4. Comparison of willingness to pay estimates in preference and WTP space.
AttributePreference SpaceWTP Space
Estimate (CI 95%)Estimate (CI 95%)
Diagnostic yieldEUR 387.3 (271.8–502.9)EUR 709.8 (427.5–992.1)
Turnaround timeEUR 468.7 (287.2–744.9)EUR 777.3 (752.4–802.2)
Counselling timeEUR 27.8 (2.5–58.8)EUR 44.9 (12.3–77.6)
Variance of unknown significanceEUR 31.2 (8.6–77.3)EUR 42.4 (39.01–45.8)
Abbreviation: CI, confidence interval. Notes: Those attributes for which increasing values correspond to undesired situations by the health professional (i.e., turnaround time, counselling time, and ability to detect variance of unknown significance) are associated with negative coefficients in the mixed logit model providing negative WTP values. However, to ease the interpretability of the results, WTP estimates related to the abovementioned attributes were multiplied by −1 and converted into positive values. Narrow CIs indicate greater precision in the estimate, suggesting a high degree of agreement among respondents regarding the value of the attribute. Wider CIs reflect higher uncertainty, which may result from variability in respondents’ preferences. Preference space estimates assume a fixed cost coefficient, providing stable and narrower confidence intervals for WTP by dividing attribute coefficients by the cost coefficient. In contrast, WTP space estimates model the cost coefficient as random, accounting for variation in cost sensitivity across respondents. While WTP space estimates reflect heterogeneity more realistically, they often exhibit wider confidence intervals and greater variability. Differences between the two approaches highlight the extent of heterogeneity in cost preferences among respondents and should be interpreted accordingly.
Table 5. Comparison of willingness to trade estimates in preference and WTT space.
Table 5. Comparison of willingness to trade estimates in preference and WTT space.
AttributePreference SpaceWTT Space
Estimate (CI 90%)Estimate (CI 90%)
Turnaround time1.21 (0.786–1.677)1.09 (1.022–1.158)
Counselling time0.07 (0.006–0.138)0.06 (0.009–0.117)
Variance of unknown significance0.08 (−0.021–0.186)0.05 (0.022–0.094)
Abbreviation: CI, confidence interval. Notes: Those attributes for which increasing values correspond to undesired situations by the health professional (i.e., turnaround time, counselling time, and ability to detect variance of unknown significance) are associated with negative coefficients in the mixed logit model providing negative WTP values. However, to ease the interpretability of the results, WTP estimates related to the abovementioned attributes were multiplied by −1 and converted into positive values.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nurchis, M.C.; Altamura, G.; Raspolini, G.M.; Capobianco, E.; Salmasi, L.; Damiani, G. Health Professionals’ Preferences for Next-Generation Sequencing in the Diagnosis of Suspected Genetic Disorders in the Paediatric Population. J. Pers. Med. 2025, 15, 25. https://doi.org/10.3390/jpm15010025

AMA Style

Nurchis MC, Altamura G, Raspolini GM, Capobianco E, Salmasi L, Damiani G. Health Professionals’ Preferences for Next-Generation Sequencing in the Diagnosis of Suspected Genetic Disorders in the Paediatric Population. Journal of Personalized Medicine. 2025; 15(1):25. https://doi.org/10.3390/jpm15010025

Chicago/Turabian Style

Nurchis, Mario Cesare, Gerardo Altamura, Gian Marco Raspolini, Enrico Capobianco, Luca Salmasi, and Gianfranco Damiani. 2025. "Health Professionals’ Preferences for Next-Generation Sequencing in the Diagnosis of Suspected Genetic Disorders in the Paediatric Population" Journal of Personalized Medicine 15, no. 1: 25. https://doi.org/10.3390/jpm15010025

APA Style

Nurchis, M. C., Altamura, G., Raspolini, G. M., Capobianco, E., Salmasi, L., & Damiani, G. (2025). Health Professionals’ Preferences for Next-Generation Sequencing in the Diagnosis of Suspected Genetic Disorders in the Paediatric Population. Journal of Personalized Medicine, 15(1), 25. https://doi.org/10.3390/jpm15010025

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop