Next Article in Journal
Respiratory Muscle Strengths and Their Association with Lean Mass and Handgrip Strengths in Older Institutionalized Individuals
Next Article in Special Issue
Deep Brain Stimulation Is Effective for Treatment-Resistant Depression: A Meta-Analysis and Meta-Regression
Previous Article in Journal
Evaluation of the Reliability, Reproducibility and Validity of Digital Orthodontic Measurements Based on Various Digital Models among Young Patients
Previous Article in Special Issue
Effectiveness, Timing and Procedural Aspects of Cognitive Behavioral Therapy after Deep Brain Stimulation for Therapy-Resistant Obsessive Compulsive Disorder: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Deep Brain Stimulation for Treatment-Resistant Depression: Towards a More Personalized Treatment Approach

1
Department of Neurosurgery, Maastricht University Medical Center, P. Debyelaan 25, 6202 AZ Maastricht, The Netherlands
2
European Graduate School of Neuroscience (EURON); 6229 ER Maastricht, The Netherlands
3
Department of Neurology, Istanbul Faculty of Medicine, Istanbul University Capa, Istanbul 34093, Turkey
4
Department of Psychiatry and Psychology, Maastricht University Medical Center, P. Debyelaan 25, 6202 AZ Maastricht, The Netherlands
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(9), 2729; https://doi.org/10.3390/jcm9092729
Submission received: 23 July 2020 / Revised: 18 August 2020 / Accepted: 19 August 2020 / Published: 24 August 2020
(This article belongs to the Special Issue Trends in Clinical Deep Brain Stimulation)

Abstract

:
Major depressive disorder (MDD) affects approximately 4.4% of the world’s population. One third of MDD patients do not respond to routine psychotherapeutic and pharmacotherapeutic treatment and are said to suffer from treatment-resistant depression (TRD). Deep brain stimulation (DBS) is increasingly being investigated as a treatment modality for TRD. Although early case studies showed promising results of DBS, open-label trials and placebo-controlled studies have reported inconsistent outcomes. This has raised discussion about the correct interpretation of trial results as well as the criteria for patient selection, the choice of stimulation target, and the optimal stimulation parameters. In this narrative review, we summarize recent studies of the effectiveness of DBS in TRD and address the relation between the targeted brain structures and clinical outcomes. Elaborating upon that, we hypothesize that the effectiveness of DBS in TRD can be increased by a more personalized and symptom-based approach. This may be achieved by using resting-state connectivity mapping for neurophysiological subtyping of TRD, by using individualized tractography to help decisions about stimulation target and electrode placement, and by using a more detailed registration of symptomatic improvements during DBS, for instance by using ‘experience sampling’ methods.

1. Introduction

Major depressive disorder (MDD) is a common mood disorder that affects one’s feelings, thoughts, and behavior. According to the DSM-5, for a diagnosis of MDD, five of the following symptoms need to be present for at least two weeks: depressed mood, reduced interest or pleasure, weight loss or reduced appetite, insomnia or hypersomnia, psychomotor agitation or retardation, fatigue or loss of energy, worthlessness or excessive guilt, impaired concentration or indecisiveness, and recurrent thoughts of death or suicidal ideation or attempts. Either ‘depressed mood’ or ‘loss of interest or pleasure’ is essential for a diagnosis [1]. The total number of people suffering from MDD worldwide was estimated to be 322 million in 2015 and its prevalence increased by 18.4% between 2005 and 2015 [2]. Therefore, effective treatment of MDD merits intense consideration.
Whereas psychotherapy and antidepressant medication are effective in the majority of patients, approximately one third of patients do not respond to these therapies. In the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) trial, the cumulative remission rate of MDD patients after four successive treatments was 67% [3]. In line with this, a meta-analysis of 92 studies of the effectiveness of psychotherapy showed that 62% of patients no longer met the criteria of depression after treatment [4]. Failure to respond to a treatment algorithm of several steps is commonly referred to as treatment resistance, although there is still discussion about the exact definition of treatment refractoriness [5]. Treatment-resistant depression (TRD) is associated with more (comorbid) mental health disorders, a higher number of hospitalizations, and more suicide attempts, leading to higher treatment costs compared to non-TRD [6]. In addition, patients with TRD show a higher demand of healthcare resources and costs of health care compared to non-TRD patients [7]. Various alternative treatment options for TRD are currently being investigated, including vagal nerve stimulation [8], repetitive transcranial magnetic stimulation (rTMS) [9], and deep brain stimulation (DBS) [10].
The aim of this narrative review is to provide an overview of recent studies of the effectiveness of DBS in TRD with a special focus on the relationship between the targeted brain structures and clinical outcomes. Based on these findings, we discuss the importance of distinguishing between different clinical phenotypes of depression that would allow for more personalized symptom-based treatment approaches, which may be a key factor in improving treatment outcomes.

2. Recent Insights on the Pathophysiology of Depression

It is hypothesized that in depression, there is an imbalance in the limbic cortico-striatal-thalamo-cortical (CSTC) mood circuits [11,12], yet many aspects of circuitopathy in MDD remain largely unknown. Based on different models [11,12], three main components of the CSTC mood circuits have been proposed (Figure 1). First, the ventral component is essential for recognizing emotions and initiating an adequate emotional and behavioral response. In this circuit, the amygdala, ventral striatum, ventral part of the anterior cingulate cortex, orbitofrontal cortex, ventrolateral prefrontal cortex, and downstream structures such as the hypothalamus and locus coeruleus are involved. Second, the dorsal component that regulates the emotional responses and requires cognitive processing. Here, the dorsolateral and dorsomedial prefrontal cortex, the dorsal part of the anterior cingulate cortex, and the hippocampus are involved. Third, a modulating region is present, although no consensus has been made about its precise anatomical organization and function. Some have suggested that this component consists of the thalamus and the rostral part of the anterior cingulate cortex [11,12,13]. As implied by Mayberg et al., the model of depression indicates that depression is associated with a decreased activity in dorsal limbic and neocortical regions and a relative increase in ventral paralimbic regions. Treatment of depression therefore requires the inhibition of the overactive ventral regions, resulting in the disinhibition of the underactive dorsal regions. To mediate this process, proper functioning of the rostral cingulate cortex is required [12]. These mood circuits overlap with the circuitry involved in compulsive traits; DBS of the ventral capsule/ventral striatum (VC/VS) in treatment resistant obsessive-compulsive disorder (OCD) patients has led to improvements in mood which prompted studying the application of DBS in TRD patients [14,15].

Expanding the Cortico-Striatal-Thalamo-Cortical Mood Circuits

One region that is not included in the CSTC mood circuits and yet has been a region of interest for DBS targeting in depression for over a decade is the subgenual cingulate gyrus/cortex (SCG/SCC) [10]. This region has shown hyperactivity in untreated depressed patients [17], is part of the ventral component, and has projections to the amygdala, hippocampus, superior and medial temporal gyri, ventral striatum, mid- and posterior cingulate cortex, thalamus, hypothalamus, periaqueductal gray, and lateral habenula [18,19]. Furthermore, in recent years, it has become known that several other brain areas all belonging to the ventral component play a role in the pathophysiology of depression. Among these are the thalamic peduncles (THp) that interconnects with the prefrontal cortex including the orbitofrontal cortex (OFC) [20], the medial forebrain bundle (MFB) that projects to the frontal cortex, the NAcc and ventral striatum [21], and the ventral part of the anterior limb of the internal capsule (vALIC) which forms a homeostatic system with the MFB and the bed nucleus of the stria terminalis (BNST) [22] (Figure 2).

3. Deep Brain Stimulation for Treatment-Resistant Depression

DBS is an invasive neuromodulation technique that is effective in managing clinical symptoms of neurological and psychiatric disorders, such as Parkinson’s disease (PD) [23,24] and OCD [25]. At stimulation settings commonly used in clinical practice, DBS decreases the spontaneous firing of neuronal populations and activates axonal projections near the electrode [26]. This modulates pathological activity and replaces it with regular patterns of discharge with intervals of burst activity [27,28]. More recent theories suggest that DBS destabilizes abnormal synchronous oscillatory activity within the basal ganglia circuitry improving hyperkinetic symptomology [24]. However, the exact mechanism(s) by which DBS normalizes electrical activity in the basal ganglia and exerts beneficial effects on PD symptoms remain unknown. In DBS for TRD, target selection has mostly been based on either neuroimaging studies or clinical observations of mood improvement following DBS in OCD [10,15,29]. For these reasons, the underlying mechanisms of action are poorly studied. DBS studies for TRD (Table 1) and the outcomes for selected brain targets (Table 2) are described below.

3.1. Subgenual Cingulate Gyrus/Cortex

The first clinical trial of DBS of the SCG for TRD was performed in 2005 and included six patients with MDD [10]. The severity of depression was measured using the Hamilton Depression Rating Scale (HDRS) and the Montgomory Asberg Depression Rating Scale (MADRS). The HDRS has been the gold standard for the assessment of depression for years [51]. A clinical response is commonly defined as a decrease in the HDRS score of more than 50% compared to baseline, and clinical remission is defined as a decrease in the HDRS score to eight or less. After one month, two out of six patients met the criteria for response. At the end of the sixth month, a response was seen in four out of six patients, with three of the patients reaching remission or near remission. Preliminary observations with positron emission tomography (PET) showed a metabolic hyperactive SCG (Brodmann area 25, Cg 25) during depressive states. It was speculated that DBS would reduce this hyperactivity [17] (Table 2). The improvement in depression scores after DBS was thought to be due to effectively disrupting focal pathological activity in limbic-cortical circuits. After 3 months of stimulation of the subgenual cingulate region (CG25) in patients suffering from TRD, local cerebral blood flow (CBF) was decreased in CG25 and the adjacent orbitofrontal cortex (Brodmann area 11). Moreover, after three and six months of stimulation, CBF was decreased in the hypothalamus, anterior insula, and medial frontal cortex of long-term responders, while CBF increased in the dorsolateral prefrontal cortex (dlPFC), dorsal anterior, posterior cingulate, and premotor and parietal regions (Table 2) [10]. In the different open-label trials, response rates varied from 20 to 57% after 1 month, 33.3 to 87.5% after 6 months, and 29 to 62.5% after 12 months (Table 1) [10,33,49,52,53,54,55,56,57,58,59,60,61]. In a long term follow-up, Kennedy et al. (2011) reported response rates at 1, 2, and 3 years after DBS implantation in the SCC of TRD patients of 62.5%, 46,2%, and 75%, respectively [52] (Table 1). In a case series of DBS of the SCG in five TRD patients, a decrease in the score of the depression rating scale was only found in one of the five TRD patients. This patient turned out to be stimulated in the posterior gyrus rectus (PGR) based on single subject tractography results rather than the initially targeted CG25 [62]. A recent exploratory meta-analysis of four observational studies investigating DBS for TRD (Holtzheimer et al. 2012, Lozano et al. 2012, Puigdemont et al. 2012, and Kennedy et al. 2011) reported relatively large response and remission rates following DBS treatment: the twelve-month response and remission rates were 39.9% (95% CI = 28.4% to 52.8%) and 26.3% (95% CI = 13% to 45.9%). The included studies reported a significant decrease in depression scores between 3 and 6 months (Hedges’ g = −0.27, p = 0.003), while no additional decrease was found between 6 and 12 months, suggesting that maximal antidepressant effects occur mostly within the first 6 months of treatment [63]. However, adverse events can occur, including worsening of depression, suicidal ideation, and seizures (Table 1). A study consisting of a double-blind active vs. sham stimulation phase of four weeks, followed by an open-label stimulation for up to 24 months, reported no significant differences between the active and sham stimulation of the SCG and no reduction in HDRS scores in the first four weeks. In the open-label phase, response rates were 37.5%, 43% and 23% after 6, 12 and 28 months, respectively. Remission rates were 12.5% and 14.2% at 6 and 12 months, respectively, and 33.3% at 24 and 28 months [64].
A randomized controlled trial (RCT) investigating DBS of the subcallosal cingulate, known as the BROADEN trial, was aborted prematurely. The study lasted six months, during which all patients should have received SCC implantation surgery. After six months, blinding would have been uncovered and both groups would have been offered open-label DBS for another six months. At the end of the first six months, responses of the treatment group and control group were predicted to be 40% and 18.5%, respectively. In this trial, the response rate was defined as more than or equal to a 40% decrease in MADRS scores from baseline. However, after six months, only 20% of patients (n = 12) in the treatment group showed a response versus 17% of patients (n = 5) in the control group. At that time, a futility analysis predicted the probability of a successful study outcome to be 17% or less leading to the funding for DBS electrodes for this study to be discontinued. The actual study was never published, but results were published and mentioned in Morishita et al. (2014) [65,66]. It has been postulated that the patients enrolled in the BROADEN trial had extreme and chronic depression with a mean duration of the current depressive episode of 12 years, nearly twice that of previous open-label studies. Therefore, these patients could have required a longer treatment period before significant results emerge. Long-term outcomes of SCG DBS in TRD patients for up to 8 years show that most patients have a sustained antidepressant response [60]. However, these results need to be interpreted carefully as the patient group consisted of both MDD and bipolar type-II disorder patients. Further comparison between high- and low frequency DBS in the SCG in TRD showed no significant difference in effectiveness between the two groups and a 44.44% response rate at 13 months of stimulation [67].

3.2. Nucleus Accumbens

Another brain region involved in MDD is the nucleus accumbens (NAcc), part of the mesolimbic dopaminergic circuit involved in different cognitive functions such as motivation and reward [33] (Table 2). DBS of the NAcc exerts immediate and long-term positive clinical effects in TRD and has been shown to significantly improve depression scores within one week [33]. Visualized with PET–computed tomography (PET-CT or PET/CT), NAcc-DBS increased metabolic activity in the ventral striatum, dlPFC, dorsomedial PFC (dmPFC), cingulate cortex, and the amygdala. Furthermore, metabolic activity in the vmPFC, ventrolateral prefrontal cortex (vlPFC), dorsal caudate nucleus, and part of the thalamus were decreased. Targeting the NAcc was essential for the effect of DBS on anhedonia (i.e., the inability to feel pleasure) in patients suffering from TRD. However, when Schlaepfer et al. (2008) looked at single items of depression rating scales, capturing aspects of anhedonia such as ‘work and activities’, ‘apparent sadness’, and the ‘inability to feel’, no significant improvements were found following NAcc-DBS. A follow-up study showed a 50% response rate in 10 patients suffering from TRD undergoing NAcc-DBS after 10 months [53]. In a more recent study reporting the long term effects of NAcc-DBS, 45% of TRD patients (n = 11) were classified as responders with a 50% reduction in HDRS scores after 12 months of stimulation, which remained until the last follow-up of 4 years [54] (Table 1). Several side effects were reported, such as seizure, agitation, and a transient increase in anxiety. In addition, one attempted suicide and one completed suicide were reported, for which the relation with the DBS treatment is uncertain.

3.3. Ventral Capsule/Ventral Striatum

The ventral capsule/ventral striatum (VC/VS) is thought to be hyperactive in MDD [36] (Table 2). Capsulotomy (i.e., lesioning) of the VC/VS improved not only OCD symptoms but also depressive symptoms, inspiring stimulation of the VC/VS for TRD [15]. In an open-label trial that stimulated the VC/VS in 15 TRD patients, responder rates at three months, six months, and 12 months were 53.3%, 46.7%, and 53.3%, respectively, using the MADRS as an outcome measure, and were 46.7%, 40%, and 53.3%, respectively, using the HDRS as an outcome measure [55]. Adverse events ranged from pain or discomfort at the incision site, to hypomania, mixed bipolar state, and increased depression due to battery depletion.
The first RCT of DBS of the VC/VS for TRD was performed by Dougherty et al. (2015) who stimulated 30 patients for 16 weeks. There were no significant differences in response rates between the intervention and sham group in the double-blind phase [68,69]. Another RCT of VC/VS DBS in eight TRD patients was discontinued after an interim futility analysis of active vs. sham stimulation showed no difference in effects between the two groups after 16 weeks. These results were never published but were discussed by Rezai et al. [70].

3.4. The Ventral Part of the Anterior Limb of the Internal Capsule

The anterior limb of the internal capsule (ALIC) is another brain region that was initially studied for DBS in OCD. One study aimed at stimulating the NAcc discovered that most treated OCD patients (9 out of 16) actually received DBS in the ventral part of the ALIC (vALIC), which improved obsessive compulsive scale scores, showed anti-depressive effects, and led to the clinical implementation of vALIC-DBS in TRD [29]. DBS of the vALIC has also been associated with a decreased metabolism in the OFC, subgenual anterior cingulate cortex, and right dlPFC [71,72,73] (Table 2).
The first RCT of DBS of the vALIC for TRD was conducted by Bergfeld et al. (2016), investigating 25 TRD patients during a 52 week open-label trial, which resulted in a significant decrease in HDRS scores in the whole group during the optimization phase, although overall HDRS scores were still in the depression range (22.2 at baseline vs. 15.9 after optimization phase). Ten of the 25 patients could be classified as responders, with a more than 50% decrease on the HDRS. After the optimization phase, a RCT with a cross-over design including nine responders and seven non-responders ensued and showed a significantly lower score in the active DBS phase compared with the sham DBS phase (mean HDRS score of 13.6 (95% CI; 9.8–17.4 vs. 23.1 (95% CI; 20.6–25.6)) (HDRS < 0.001). However, the scores on the HDRS in the active treatment group were still within the mild to moderate depression range [74]. Both crossover phases lasted approximately 21 and 18 days, respectively.

3.5. Lateral Habenula

The activity of the lateral habenula (LHb) is negatively associated with reward, meaning its neurons increase their firing rate in a non-reward situation or in the omission of a reward. LHb hyperactivity could therefore explain the lower reward-seeking behavior in TRD [75] (Table 2). Speculation that DBS of the LHb could lead to the inhibition of hyperactivity prompted the first case study of LHb-DBS in TRD, which notably led to full remission of the patients’ depressive symptoms [44]. A clinical non-randomized study in six patients suffering from TRD is currently being held, investigating the safety, tolerability, and benefit of LHb DBS in TRD. Patients that respond at 12 months of stimulation will enter a randomized, staggered withdrawal phase. During this phase, a double-blind discontinuation will be attempted at month 12 or 13, decreasing the stimulation by 50% and then completely discontinuing it during the following two weeks. Evaluation will take place at 15 months, where, in the meantime, escape criteria are included, and if met, will stop the blinded phase in continuing with an open treatment [76].

3.6. Thalamic Peduncles

The inferior thalamic peduncle (ITP) is a bundle of fibers connecting the OFC to the thalamus. The OFC is thought to play a role in the non-reward tractor theory of depression, where the orbitofrontal non-reward system is more easily triggered in depression, causing negative emotional states [77] (Table 2). Stimulating the ITP could disrupt this enhanced triggering and lead to less depressive symptoms. ITP stimulation for OCD has already shown improvements of the score on the Yale-Brown Obsessive-Compulsive scale in five OCD patients [45]. A case study in one TRD patient reported that DBS of the ITP decreased depressive symptoms [78]. However, within this study, two brain regions were investigated, the second being the BNST.

3.7. Bed Nucleus of the Stria Terminalis

The BNST is involved in a range of behaviors, such as stress response, social behavior, and extended duration of fear states. This nucleus assesses sensory information from the environment, coupled together with the subjects current mood and arousal, integrating a proper response to environmental and social setting changes [22] (Table 2). Raymaekers et al. (2017) indicated that both BNST and ITP stimulation could alleviate depressive symptoms; however, due to a small sample size, no statistical analyses were conducted [78].

3.8. Medial Forebrain Bundle

The medial forebrain bundle (MFB) is a fiber tract connected to various parts of the limbic system thought to play a role in reward-seeking systems [21] (Table 2). In one trial, DBS of the superolateral branch of the MFB resulted in more than a 50% decrease in depressive symptoms in six out of seven TRD patients within seven days [47]. An additional interim analysis of MFB-DBS in TRD confirmed these findings, showing more than a 50% decrease in depressive symptoms in three out of four patients within seven days of stimulation. At 26 weeks follow-up, two patients showed more than an 80% decrease in depression rating scales [49] (Table 1).
Taken together, the results of the aforementioned studies of DBS for TRD imply that stimulation at a number of different brain areas can alleviate depressive symptoms, which is in line with the view that MDD is a circuitopathy involving various brain regions and networks mainly within the limbic CSTC mood circuits [12,79]. However, how DBS of those targets improves the depressive symptoms is not completely clear. Moreover, stimulation parameters vary between studies due to a need to adjust and balance therapeutic effects to side effects.
MDD is a circuitopathy that involves a wide range of brain structures and exhibits diverse clinical manifestations. Therefore, a one-size-fits-all approach to the DBS targeting may not be beneficial in all patients, whereas a patient-centric selection based on individually disrupted neurocircuits could improve therapeutic outcomes. In evaluating the effects of DBS, one needs to focus on overall improvement on depression rating scales as well as individual scores and symptom-specific improvements. This will enhance the understanding of the effects of DBS and eventually contribute to the development of more personalized treatment approaches. Seemingly, this also applies in other psychiatric disorders such as OCD, where personalized approaches with content-specific DBS targets have already proven to be beneficial [80].

4. Towards a More Personalized DBS Treatment Approach for Treatment-Resistant Depression

Since open-label trials and RCT data on DBS in TRD show inconsistent results, this gives rise to discussion about the chosen study designs, the correct interpretation of results, and the best target(s) for neuromodulation. Depression entails different clinical subtypes and looking at homogenous subgroups of depressed patients may lead to a personalized DBS approach. This would be superior to looking at primary outcomes across all participants. Importantly, a prerequisite to this approach is the ability to determine pathoanatomical substrates of specific subtypes. How to implement such a more personalized approach to DBS treatment for TRD is discussed below.

4.1. Clinical and Neurophysiological Subtypes of Depression

Most response rates in depression treatments to date have been measured with changes in average levels among all patients treated. However, depressive symptomatology varies highly among individuals, making the standardization of positive outcomes challenging. Mood, sleep rhythm, concentration, psychomotor, and cognitive domains can all be disturbed in depression, while treating one selected brain structure within the mood circuit may not have an effect on all aforementioned symptoms nor have an effect on the main symptomatology of all depressed patients.
Subdividing TRD into different subtypes, involving distinct clinical symptoms as well as distinct patterns of dysfunctional connectivity in limbic and frontal striatal networks, may reveal different subtype-related outcomes for each investigated brain region, and if so, patient selection for a given brain target could enhance treatment effectiveness [81]. Analysis of resting-state connectivity biomarkers previously revealed four connectivity-based biotypes of depression characterized by either anxiety, increased anhedonia, psychomotor retardation, and/or increased anergia and fatigue. Moreover, patients could not be differentiated into a particular subtype based on clinical features alone and clustering them based on functional connectivity was needed [82]. Therefore, imaging procedures as well as featured symptoms should be taken into account when treating TRD with DBS. It is conceivable that subdividing TRD patients according to connectivity-based biotypes will shed new light on the interpretation of previous DBS study results, and that the integration of functional connectivity in future DBS studies will reveal clinically relevant subgroups that might respond to DBS of a specific target within the mood circuit. Altogether, it can be suggested that better assessment of therapeutic outcomes at symptom level might be accomplished when TRD patients with dominant anergia/fatigue symptoms (biotype 2) are stimulated within the CG 25; and patients characterized by more anxiety (biotype 4) are stimulated within the thalamic region, as suggested by Drysdale and coworkers [82]. Likewise, SCG stimulation could alleviate sleep disturbances and NAcc stimulation could improve anhedonia (Table 2).

4.2. Individual Tractography

Another way in which DBS efficiency can be improved is to ameliorate the implantation of electrodes with the usage of individualized, patient-specific, deterministic tractography targeting. Riva-Posse et al. (2018) used individualized patient-specific tractography targeting for SCC-DBS surgeries in TRD patients, aiming at the convergence of the four white matter bundles: the forceps minor, uncinate fasciculus, cingulum, and fronto-striatal fibers. This resulted in a response rate of 81.8% and a remission rate of 54% after a one year trial period, which proved greater than the previous open-label trials [83]. In a recent study, diffusion tensor imaging (DTI) tractography was used to target SCC-DBS more optimally, and the authors examined the impact of tract activation on clinical response at 6 and 12 months. Stimulation of vmPFC pathways by SCC-DBS was associated with a positive response and stimulation of the cingulum was associated with a 6 month, but not a 12 months DBS response. Monopolar stimulation of 130 Hz was applied with either pulse width (90–450 µs) or amplitude (4–8 V) progressively increased every month, based on response status. Patients were changed to bipolar settings if monopolar stimulation caused adverse effects. It was speculated that targeting more ventral, rather than the dorsal mPFC projections, might improve the response [84].

4.3. Combining Deep Brain Stimulation with Cognitive-Behavioral Therapy

It is plausible that better therapeutic outcomes could be achieved if DBS is applied in combination with concurrent treatments, such as pharmacotherapy with antidepressants or cognitive-behavioral therapy (CBT) in TRD. Studies focusing on the added effect of concurrent treatments to DBS have not been conducted in patients with TRD. The results from studies in OCD patients treated with DBS show that adding CBT to DBS has added beneficial effects [85]. Studies targeted at revealing the added effects of concomitant treatments after DBS for TRD would also provide information that may facilitate establishing a treatment algorithm to determine the place of these treatments in DBS patients.

4.4. Biomarkers

Biomarkers are quantifiable characteristics of biological processes, which could prove helpful in improving diagnostic objectivity of MDD and TRD as well as help in personalizing its treatment. For MDD, no specific biomarkers have yet been found, though several markers have been shown to be potential candidates, such as brain-derived neurotrophic factor (BDNF), interleukins (IL) 1 and 6, tumor necrosis factor (TNF), malondialdehyde (MDA), hypothalamic-pituitary-adrenal (HPA) activity, and cortisol responses [86,87]. Every biomarker as a standalone shows a low sensitivity and specificity, partly explained by the heterogeneity of MDD. To overcome this shortcoming, either examining a biological panel of several markers [88] or phenotyping MDD and TRD into distinct subtypes could be considered. However, a recent meta-analysis showed that only cortisol has a predictive effect on onset/relapse and recurrence of MDD making the integration of biomarkers for personalizing TRD treatment a futuristic milestone yet to be discovered [89].

4.5. Insights into Symptomatic Improvement after Deep Brain Stimulation

For TRD, different regions in the mood circuit can be stimulated with DBS (Table 2), although it is still unclear which depressive-symptoms respond to the stimulation of a specific target. More research into the mood circuit is needed to untangle which emotions arise from specific brain regions. This may vary from basic animal research, disentangling neuronal function per brain region, and ultra-high field MR studies in humans, all of which could shed light on the dysfunctional brain circuits in TRD. In contrast to the motor system that is studied thoroughly [90,91], emotional circuitry is far less understood. One reason for this is that animal research into mood circuitry remains complicated as there is considerable heterogeneity between species [92]. Modeling depression in animals is complex as there are several depressive-like behavior models, such as the chronic unpredictable stress paradigm (CUS), which give insight into depression pathology [93]. DBS is investigated within these models to unravel behavioral and cellular changes following DBS [94].
Alongside the standard clinical rating scales, the use of momentary assessment techniques, such as the experience sampling method (ESM), could enhance the documentation of the momentary mood states [95]. The ESM includes short repeated assessments of experiences and behaviors, as well as moment-to-moment changes in mental states in the context of daily life. Research has shown that depressed patients can improve their depressive symptomology while using weekly ESM for six weeks, and add-on ESM derived feedback resulted in a significant decrease in HDRS scores compared to controls (p < 0.01; −5.5 point reduction in HDRS at 6 months) [96]. In add-on-derived feedback, a psychologist or psychiatrist gives feedback on the association between the participants momentary affective states and specific daily life contexts [97]. ESM-derived feedback could further improve treatment by showing within-subject changes in a heterogeneous TRD population and contribute to clinical decision-making [97]. In the case of DBS, the use of ESM may reveal specific response patterns depending on the brain region that is stimulated, which can provide valuable information about emotional circuitry. This can be done using well-evaluated day-to-day scores, including questionnaires that go into detail on current mood and adaptive functioning.

5. Conclusions

More personalized treatment approaches hold the potential to increase the overall efficacy of DBS for TRD. Precise evaluations of symptoms, biomarkers, and resting-state connectivity patterns are essential when distinguishing clinical subtypes of TRD. Moreover, subtyping may provide more insight into the working mechanisms of DBS and help in selecting optimal targets in patients. Monitoring of biomarkers at multiple time points during treatment along with evaluation of ESM data, in parallel with clinical assessments of mood using standardized depression-rating scales, will lead to a better understanding of symptom changes when stimulating specific brain regions. Such considerations could further lead to optimal adjustments of stimulation parameters as long-term effects of DBS on mood occur.

Author Contributions

M.R. and E.S. prepared the first draft. J.B., A.E.P.M., A.F.G.L. and A.J. provided inputs and revised the manuscript. A.J. supervised the process. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Uher, R.; Payne, J.L.; Pavlova, B.; Perlis, R.H. Major depressive disorder in DSM-5: Implications for clinical practice and research of changes from DSM-IV. Depress. Anxiety 2014, 31, 459–471. [Google Scholar] [CrossRef] [PubMed]
  2. WHO. Depression and Other Common Mental Disorders Global Health Estimates; World Health Organization: Geneva, Switzerland, 2017.
  3. Rush, A. Acute and Longer-Term Outcomes in Depressed Outpatients Requiring One or Several Treatment Steps: A STAR*D Report. Am. J. Psychiatry 2006, 163, 1905. [Google Scholar] [CrossRef] [PubMed]
  4. Cuijpers, P.; Karyotaki, E.; Weitz, E.; Andersson, G.; Hollon, S.D.; van Straten, A. The effects of psychotherapies for major depression in adults on remission, recovery and improvement: A meta-analysis. J. Affect. Disord. 2014, 159, 118–126. [Google Scholar] [CrossRef] [PubMed]
  5. Gaynes, B.N.; Asher, G.; Gartlehner, G.; Hoffman, V.; Green, J.; Boland, E.; Lux, L.; Weber, R.P.; Randolph, C.; Bann, C.; et al. Definition of Treatment-Resistant Depression in the Medicare Population; Agency for Healthcare Research and Quality: Rockville, MD, USA, 2018.
  6. Amital, D.; Fostick, L.; Silberman, A.; Beckman, M.; Spivak, B. Serious life events among resistant and non-resistant MDD patients. J. Affect. Disord. 2008, 110, 260–264. [Google Scholar] [CrossRef]
  7. Ivanova, J.I.; Birnbaum, H.G.; Kidolezi, Y.; Subramanian, G.; Khan, S.A.; Stensland, M.D. Direct and indirect costs of employees with treatment-resistant and non-treatment-resistant major depressive disorder. Curr. Med. Res. Opin. 2010, 26, 2475–2484. [Google Scholar] [CrossRef]
  8. Johnson, R.L.; Wilson, C.G. A review of vagus nerve stimulation as a therapeutic intervention. J. Inflamm. Res. 2018, 11, 203–213. [Google Scholar] [CrossRef] [Green Version]
  9. George, M.S.; Taylor, J.J.; Short, E.B. The expanding evidence base for rTMS treatment of depression. Curr. Opin. Psychiatry 2013, 26, 13–18. [Google Scholar] [CrossRef] [Green Version]
  10. Mayberg, H.S.; Lozano, A.M.; Voon, V.; McNeely, H.E.; Seminowicz, D.; Hamani, C.; Schwalb, J.M.; Kennedy, S.H. Deep brain stimulation for treatment-resistant depression. Neuron 2005, 45, 651–660. [Google Scholar] [CrossRef] [Green Version]
  11. Alexander, G.E.; DeLong, M.R.; Strick, P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 1986, 9, 357–381. [Google Scholar] [CrossRef]
  12. Mayberg, H.S. Limbic-cortical dysregulation: A proposed model of depression. J. Neuropsychiatry Clin. Neurosci. 1997, 9, 471–481. [Google Scholar]
  13. Temel, Y.; Leentjens, A.F.G.; de Bie, R.M.A. Handboek Diepe Hersenstimulatie Bij Neurologische En Psychiatrische Aandoeningen; Bohn Stafleu van Loghum: Houten, The Netherlands, 2016; pp. 137–142. [Google Scholar]
  14. Gabriels, L.; Cosyns, P.; Nuttin, B.; Demeulemeester, H.; Gybels, J. Deep brain stimulation for treatment-refractory obsessive-compulsive disorder: Psychopathological and neuropsychological outcome in three cases. Acta Psychiatry Scand. 2003, 107, 275–282. [Google Scholar] [CrossRef]
  15. Greenberg, B.D.; Malone, D.A.; Friehs, G.M.; Rezai, A.R.; Kubu, C.S.; Malloy, P.F.; Salloway, S.P.; Okun, M.S.; Goodman, W.K.; Rasmussen, S.A. Three-year outcomes in deep brain stimulation for highly resistant obsessive-compulsive disorder. Neuropsychopharmacology 2006, 31, 2384–2393. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Moonen, A.J.H.; Wijers, A.; Dujardin, K.; Leentjens, A.F.G. Neurobiological correlates of emotional processing in Parkinson’s disease: A systematic review of experimental studies. J. Psychosom. Res. 2017, 100, 65–76. [Google Scholar] [CrossRef]
  17. Mayberg, H.S.; Liotti, M.; Brannan, S.K.; McGinnis, S.; Mahurin, R.K.; Jerabek, P.A.; Silva, J.A.; Tekell, J.L.; Martin, C.C.; Lancaster, J.L.; et al. Reciprocal limbic-cortical function and negative mood: Converging PET findings in depression and normal sadness. Am. J. Psychiatry 1999, 156, 675–682. [Google Scholar] [PubMed]
  18. Drevets, W.C.; Savitz, J.; Trimble, M. The subgenual anterior cingulate cortex in mood disorders. CNS Spectr. 2008, 13, 663–681. [Google Scholar] [CrossRef]
  19. Ongur, D.; Ferry, A.T.; Price, J.L. Architectonic subdivision of the human orbital and medial prefrontal cortex. J. Comp. Neurol. 2003, 460, 425–449. [Google Scholar] [CrossRef]
  20. Sun, C.; Wang, Y.; Cui, R.; Wu, C.; Li, X.; Bao, Y.; Wang, Y. Human Thalamic-Prefrontal Peduncle Connectivity Revealed by Diffusion Spectrum Imaging Fiber Tracking. Front. Neuroanat. 2018, 12, 24. [Google Scholar] [CrossRef] [Green Version]
  21. Coenen, V.A.; Panksepp, J.; Hurwitz, T.A.; Urbach, H.; Madler, B. Human medial forebrain bundle (MFB) and anterior thalamic radiation (ATR): Imaging of two major subcortical pathways and the dynamic balance of opposite affects in understanding depression. J. Neuropsychiatry Clin. Neurosci. 2012, 24, 223–236. [Google Scholar] [CrossRef]
  22. Lebow, M.A.; Chen, A. Overshadowed by the amygdala: The bed nucleus of the stria terminalis emerges as key to psychiatric disorders. Mol. Psychiatry 2016, 21, 450–463. [Google Scholar] [CrossRef]
  23. Lozano, A.M.; Lipsman, N.; Bergman, H.; Brown, P.; Chabardes, S.; Chang, J.W.; Matthews, K.; McIntyre, C.C.; Schlaepfer, T.E.; Schulder, M.; et al. Deep brain stimulation: Current challenges and future directions. Nat. Rev. Neurol. 2019, 15, 148–160. [Google Scholar] [CrossRef]
  24. Daneshzand, M.; Faezipour, M.; Barkana, B.D. Robust desynchronization of Parkinson’s disease pathological oscillations by frequency modulation of delayed feedback deep brain stimulation. PLoS ONE 2018, 13, e0207761. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Vicheva, P.; Butler, M.; Shotbolt, P. Deep brain stimulation for obsessive-compulsive disorder: A systematic review of randomised controlled trials. Neurosci. Biobehav. Rev. 2020, 109, 129–138. [Google Scholar] [CrossRef] [PubMed]
  26. Agnesi, F.; Johnson, M.D.; Vitek, J.L. Deep brain stimulation: How does it work? Handb. Clin. Neurol. 2013, 116, 39–54. [Google Scholar] [PubMed]
  27. Cheney, P.D.; Griffin, D.M.; Van Acker, G.M., III. Neural hijacking: Action of high-frequency electrical stimulation on cortical circuits. Neuroscientist 2013, 19, 434–441. [Google Scholar] [CrossRef] [Green Version]
  28. Ashkan, K.; Rogers, P.; Bergman, H.; Ughratdar, I. Insights into the mechanisms of deep brain stimulation. Nat. Rev. Neurol. 2017, 13, 548–554. [Google Scholar] [CrossRef]
  29. Van den Munckhof, P.; Bosch, D.A.; Mantione, M.H.; Figee, M.; Denys, D.A.; Schuurman, P.R. Active stimulation site of nucleus accumbens deep brain stimulation in obsessive-compulsive disorder is localized in the ventral internal capsule. Acta Neurochir. Suppl. 2013, 117, 53–59. [Google Scholar]
  30. Drobisz, D.; Damborska, A. Deep brain stimulation targets for treating depression. Behav. Brain Res. 2019, 359, 266–273. [Google Scholar] [CrossRef]
  31. Hamani, C.; Mayberg, H.; Stone, S.; Laxton, A.; Haber, S.; Lozano, A.M. The subcallosal cingulate gyrus in the context of major depression. Biol. Psychiatry 2011, 69, 301–308. [Google Scholar] [CrossRef]
  32. Coryell, W.; Nopoulos, P.; Drevets, W.; Wilson, T.; Andreasen, N.C. Subgenual prefrontal cortex volumes in major depressive disorder and schizophrenia: Diagnostic specificity and prognostic implications. Am. J. Psychiatry 2005, 162, 1706–1712. [Google Scholar] [CrossRef]
  33. Schlaepfer, T.E.; Cohen, M.X.; Frick, C.; Kosel, M.; Brodesser, D.; Axmacher, N.; Joe, A.Y.; Kreft, M.; Lenartz, D.; Sturm, V. Deep brain stimulation to reward circuitry alleviates anhedonia in refractory major depression. Neuropsychopharmacology 2008, 33, 368–377. [Google Scholar] [CrossRef]
  34. Wacker, J.; Dillon, D.G.; Pizzagalli, D.A. The role of the nucleus accumbens and rostral anterior cingulate cortex in anhedonia: Integration of resting EEG, fMRI, and volumetric techniques. Neuroimage 2009, 46, 327–337. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Makris, N.; Rathi, Y.; Mouradian, P.; Bonmassar, G.; Papadimitriou, G.; Ing, W.I.; Yeterian, E.H.; Kubicki, M.; Eskandar, E.N.; Wald, L.L.; et al. Variability and anatomical specificity of the orbitofrontothalamic fibers of passage in the ventral capsule/ventral striatum (VC/VS): Precision care for patient-specific tractography-guided targeting of deep brain stimulation (DBS) in obsessive compulsive disorder (OCD). Brain Imaging Behav. 2016, 10, 1054–1067. [Google Scholar]
  36. Quevedo, K.; Ng, R.; Scott, H.; Kodavaganti, S.; Smyda, G.; Diwadkar, V.; Phillips, M. Ventral Striatum Functional Connectivity during Rewards and Losses and Symptomatology in Depressed Patients. Biol. Psychol. 2017, 123, 62–73. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Hwang, J.W.; Xin, S.C.; Ou, Y.M.; Zhang, W.Y.; Liang, Y.L.; Chen, J.; Yang, X.Q.; Chen, X.Y.; Guo, T.W.; Yang, X.J.; et al. Enhanced default mode network connectivity with ventral striatum in subthreshold depression individuals. J. Psychiatry Res. 2016, 76, 111–120. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Zhang, A.; Ajilore, O.; Zhan, L.; Gadelkarim, J.; Korthauer, L.; Yang, S.; Leow, A.; Kumar, A. White matter tract integrity of anterior limb of internal capsule in major depression and type 2 diabetes. Neuropsychopharmacology 2013, 38, 1451–1459. [Google Scholar] [CrossRef] [Green Version]
  39. Alonso, P.; Cuadras, D.; Gabriels, L.; Denys, D.; Goodman, W.; Greenberg, B.D.; Jimenez-Ponce, F.; Kuhn, J.; Lenartz, D.; Mallet, L.; et al. Deep Brain Stimulation for Obsessive-Compulsive Disorder: A Meta-Analysis of Treatment Outcome and Predictors of Response. PLoS ONE 2015, 10, e0133591. [Google Scholar] [CrossRef] [Green Version]
  40. Matsumoto, M.; Hikosaka, O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 2007, 447, 1111–1115. [Google Scholar] [CrossRef] [Green Version]
  41. Meng, H.; Wang, Y.; Huang, M.; Lin, W.; Wang, S.; Zhang, B. Chronic deep brain stimulation of the lateral habenula nucleus in a rat model of depression. Brain Res. 2011, 1422, 32–38. [Google Scholar] [CrossRef]
  42. Sartorius, A.; Henn, F.A. Deep brain stimulation of the lateral habenula in treatment resistant major depression. Med. Hypotheses 2007, 69, 1305–1308. [Google Scholar] [CrossRef]
  43. Ranft, K.; Dobrowolny, H.; Krell, D.; Bielau, H.; Bogerts, B.; Bernstein, H.G. Evidence for structural abnormalities of the human habenular complex in affective disorders but not in schizophrenia. Psychol. Med. 2010, 40, 557–567. [Google Scholar] [CrossRef]
  44. Sartorius, A.; Kiening, K.L.; Kirsch, P.; von Gall, C.C.; Haberkorn, U.; Unterberg, A.W.; Henn, F.A.; Meyer-Lindenberg, A. Remission of major depression under deep brain stimulation of the lateral habenula in a therapy-refractory patient. Biol. Psychiatry 2010, 67, e9–e11. [Google Scholar] [CrossRef] [PubMed]
  45. Lee, D.J.; Dallapiazza, R.F.; De Vloo, P.; Elias, G.J.B.; Fomenko, A.; Boutet, A.; Giacobbe, P.; Lozano, A.M. Inferior thalamic peduncle deep brain stimulation for treatment-refractory obsessive-compulsive disorder: A phase 1 pilot trial. Brain Stimul. 2019, 12, 344–352. [Google Scholar] [CrossRef] [PubMed]
  46. Velasco, F.; Velasco, M.; Jimenez, F.; Velasco, A.L.; Salin-Pascual, R. Neurobiological background for performing surgical intervention in the inferior thalamic peduncle for treatment of major depression disorders. Neurosurgery 2005, 57, 439–448, Discussion 439–448. [Google Scholar] [CrossRef] [PubMed]
  47. Schlaepfer, T.E.; Bewernick, B.H.; Kayser, S.; Madler, B.; Coenen, V.A. Rapid effects of deep brain stimulation for treatment-resistant major depression. Biol. Psychiatry 2013, 73, 1204–1212. [Google Scholar] [CrossRef]
  48. Schoene-Bake, J.C.; Parpaley, Y.; Weber, B.; Panksepp, J.; Hurwitz, T.A.; Coenen, V.A. Tractographic analysis of historical lesion surgery for depression. Neuropsychopharmacology 2010, 35, 2553–2563. [Google Scholar] [CrossRef] [Green Version]
  49. Fenoy, A.J.; Schulz, P.; Selvaraj, S.; Burrows, C.; Spiker, D.; Cao, B.; Zunta-Soares, G.; Gajwani, P.; Quevedo, J.; Soares, J. Deep brain stimulation of the medial forebrain bundle: Distinctive responses in resistant depression. J. Affect. Disord. 2016, 203, 143–151. [Google Scholar] [CrossRef]
  50. Neumann, W.J.; Huebl, J.; Brucke, C.; Gabriels, L.; Bajbouj, M.; Merkl, A.; Schneider, G.H.; Nuttin, B.; Brown, P.; Kuhn, A.A. Different patterns of local field potentials from limbic DBS targets in patients with major depressive and obsessive compulsive disorder. Mol. Psychiatry 2014, 19, 1186–1192. [Google Scholar] [CrossRef] [Green Version]
  51. Bagby, R.M.; Ryder, A.G.; Schuller, D.R.; Marshall, M.B. The Hamilton Depression Rating Scale: Has the gold standard become a lead weight? Am. J. Psychiatry 2004, 161, 2163–2177. [Google Scholar] [CrossRef]
  52. Kennedy, S.H.; Giacobbe, P.; Rizvi, S.J.; Placenza, F.M.; Nishikawa, Y.; Mayberg, H.S.; Lozano, A.M. Deep brain stimulation for treatment-resistant depression: Follow-up after 3 to 6 years. Am. J. Psychiatry 2011, 168, 502–510. [Google Scholar] [CrossRef]
  53. Bewernick, B.H.; Hurlemann, R.; Matusch, A.; Kayser, S.; Grubert, C.; Hadrysiewicz, B.; Axmacher, N.; Lemke, M.; Cooper-Mahkorn, D.; Cohen, M.X.; et al. Nucleus accumbens deep brain stimulation decreases ratings of depression and anxiety in treatment-resistant depression. Biol. Psychiatry 2010, 67, 110–116. [Google Scholar] [CrossRef]
  54. Bewernick, B.H.; Kayser, S.; Sturm, V.; Schlaepfer, T.E. Long-term effects of nucleus accumbens deep brain stimulation in treatment-resistant depression: Evidence for sustained efficacy. Neuropsychopharmacology 2012, 37, 1975–1985. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Malone, D.A., Jr.; Dougherty, D.D.; Rezai, A.R.; Carpenter, L.L.; Friehs, G.M.; Eskandar, E.N.; Rauch, S.L.; Rasmussen, S.A.; Machado, A.G.; Kubu, C.S.; et al. Deep brain stimulation of the ventral capsule/ventral striatum for treatment-resistant depression. Biol. Psychiatry 2009, 65, 267–275. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Lozano, A.M.; Mayberg, H.S.; Giacobbe, P.; Hamani, C.; Craddock, R.C.; Kennedy, S.H. Subcallosal cingulate gyrus deep brain stimulation for treatment-resistant depression. Biol. Psychiatry 2008, 64, 461–467. [Google Scholar] [CrossRef] [PubMed]
  57. Puigdemont, D.; Perez-Egea, R.; Portella, M.J.; Molet, J.; de Diego-Adelino, J.; Gironell, A.; Radua, J.; Gomez-Anson, B.; Rodriguez, R.; Serra, M.; et al. Deep brain stimulation of the subcallosal cingulate gyrus: Further evidence in treatment-resistant major depression. Int. J. Neuropsychopharmacol. 2012, 15, 121–133. [Google Scholar] [CrossRef] [Green Version]
  58. Lozano, A.M.; Giacobbe, P.; Hamani, C.; Rizvi, S.J.; Kennedy, S.H.; Kolivakis, T.T.; Debonnel, G.; Sadikot, A.F.; Lam, R.W.; Howard, A.K.; et al. A multicenter pilot study of subcallosal cingulate area deep brain stimulation for treatment-resistant depression. J. Neurosurg. 2012, 116, 315–322. [Google Scholar] [CrossRef]
  59. Holtzheimer, P.E.; Kelley, M.E.; Gross, R.E.; Filkowski, M.M.; Garlow, S.J.; Barrocas, A.; Wint, D.; Craighead, M.C.; Kozarsky, J.; Chismar, R.; et al. Subcallosal cingulate deep brain stimulation for treatment-resistant unipolar and bipolar depression. Arch. Gen. Psychiatry 2012, 69, 150–158. [Google Scholar] [CrossRef]
  60. Crowell, A.L.; Riva-Posse, P.; Holtzheimer, P.E.; Garlow, S.J.; Kelley, M.E.; Gross, R.E.; Denison, L.; Quinn, S.; Mayberg, H.S. Long-Term Outcomes of Subcallosal Cingulate Deep Brain Stimulation for Treatment-Resistant Depression. Am. J. Psychiatry 2019, 176, 949–956. [Google Scholar] [CrossRef]
  61. Merkl, A.; Schneider, G.H.; Schonecker, T.; Aust, S.; Kuhl, K.P.; Kupsch, A.; Kuhn, A.A.; Bajbouj, M. Antidepressant effects after short-term and chronic stimulation of the subgenual cingulate gyrus in treatment-resistant depression. Exp. Neurol. 2013, 249, 160–168. [Google Scholar] [CrossRef]
  62. Accolla, E.A.; Aust, S.; Merkl, A.; Schneider, G.H.; Kuhn, A.A.; Bajbouj, M.; Draganski, B. Deep brain stimulation of the posterior gyrus rectus region for treatment resistant depression. J. Affect. Disord. 2016, 194, 33–37. [Google Scholar] [CrossRef] [Green Version]
  63. Berlim, M.T.; McGirr, A.; Van den Eynde, F.; Fleck, M.P.; Giacobbe, P. Effectiveness and acceptability of deep brain stimulation (DBS) of the subgenual cingulate cortex for treatment-resistant depression: A systematic review and exploratory meta-analysis. J. Affect. Disord. 2014, 159, 31–38. [Google Scholar] [CrossRef]
  64. Merkl, A.; Aust, S.; Schneider, G.H.; Visser-Vandewalle, V.; Horn, A.; Kuhn, A.A.; Kuhn, J.; Bajbouj, M. Deep brain stimulation of the subcallosal cingulate gyrus in patients with treatment-resistant depression: A double-blinded randomized controlled study and long-term follow-up in eight patients. J. Affect. Disord. 2018, 227, 521–529. [Google Scholar] [CrossRef] [PubMed]
  65. Holtzheimer, P.E.; Husain, M.M.; Lisanby, S.H.; Taylor, S.F.; Whitworth, L.A.; McClintock, S.; Slavin, K.V.; Berman, J.; McKhann, G.M.; Patil, P.G.; et al. Subcallosal cingulate deep brain stimulation for treatment-resistant depression: A multisite, randomised, sham-controlled trial. Lancet Psychiatry 2017, 4, 839–849. [Google Scholar] [CrossRef] [Green Version]
  66. Morishita, T.; Fayad, S.M.; Higuchi, M.A.; Nestor, K.A.; Foote, K.D. Deep brain stimulation for treatment-resistant depression: Systematic review of clinical outcomes. Neurotherapeutics 2014, 11, 475–484. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Eitan, R.; Fontaine, D.; Benoit, M.; Giordana, C.; Darmon, N.; Israel, Z.; Linesky, E.; Arkadir, D.; Ben-Naim, S.; Iserlles, M.; et al. One year double blind study of high vs low frequency subcallosal cingulate stimulation for depression. J. Psychiatry Res. 2018, 96, 124–134. [Google Scholar] [CrossRef] [Green Version]
  68. Dougherty, D.D.; Rezai, A.R.; Carpenter, L.L.; Howland, R.H.; Bhati, M.T.; O’Reardon, J.P.; Eskandar, E.N.; Baltuch, G.H.; Machado, A.D.; Kondziolka, D.; et al. A Randomized Sham-Controlled Trial of Deep Brain Stimulation of the Ventral Capsule/Ventral Striatum for Chronic Treatment-Resistant Depression. Biol. Psychiatry 2015, 78, 240–248. [Google Scholar] [CrossRef] [PubMed]
  69. Peichel, D. A Clinical Evaluation of Different Device Parameters for the Management of Patients with Treatment Resistant Major Depressive Disorder, Single or Recurrent Episode, with Deep Brain Stimulation. Available online: https://clinicaltrials.gov/ct2/show/NCT01331330 (accessed on 24 August 2020).
  70. Rezai, A. Feasibility, Safety and Efficacy of Deep Brain Stimulation of the Internal Capsule for Severe and Medically Refractory Major Depression. Available online: https://clinicaltrials.gov/ct2/show/NCT00555698 (accessed on 24 August 2020).
  71. Nuttin, B.J.; Gabriels, L.A.; Cosyns, P.R.; Meyerson, B.A.; Andreewitch, S.; Sunaert, S.G.; Maes, A.F.; Dupont, P.J.; Gybels, J.M.; Gielen, F.; et al. Long-term electrical capsular stimulation in patients with obsessive-compulsive disorder. Neurosurgery 2003, 52, 1263–1272, Discussion 1264–1272. [Google Scholar] [CrossRef]
  72. Abelson, J.L.; Curtis, G.C.; Sagher, O.; Albucher, R.C.; Harrigan, M.; Taylor, S.F.; Martis, B.; Giordani, B. Deep brain stimulation for refractory obsessive-compulsive disorder. Biol. Psychiatry 2005, 57, 510–516. [Google Scholar] [CrossRef]
  73. Van Laere, K.; Nuttin, B.; Gabriels, L.; Dupont, P.; Rasmussen, S.; Greenberg, B.D.; Cosyns, P. Metabolic imaging of anterior capsular stimulation in refractory obsessive-compulsive disorder: A key role for the subgenual anterior cingulate and ventral striatum. J. Nucl. Med. 2006, 47, 740–747. [Google Scholar]
  74. Bergfeld, I.O.; Mantione, M.; Hoogendoorn, M.L.; Ruhe, H.G.; Notten, P.; van Laarhoven, J.; Visser, I.; Figee, M.; de Kwaasteniet, B.P.; Horst, F.; et al. Deep Brain Stimulation of the Ventral Anterior Limb of the Internal Capsule for Treatment-Resistant Depression: A Randomized Clinical Trial. JAMA Psychiatry 2016, 73, 456–464. [Google Scholar] [CrossRef]
  75. Loonen, A.J.; Ivanova, S.A. Circuits Regulating Pleasure and Happiness-Mechanisms of Depression. Front. Hum. Neurosci. 2016, 10, 571. [Google Scholar] [CrossRef] [Green Version]
  76. Goodman, W. A Clinical Pilot Study Examining Bilateral Inhibition of the Lateral Habenula as a Target for Deep Brain Stimulation in Intractable Depression. Available online: https://clinicaltrials.gov/ct2/show/NCT01798407 (accessed on 24 August 2020).
  77. Rolls, E.T. A non-reward attractor theory of depression. Neurosci. Biobehav. Rev. 2016, 68, 47–58. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Raymaekers, S.; Luyten, L.; Bervoets, C.; Gabriels, L.; Nuttin, B. Deep brain stimulation for treatment-resistant major depressive disorder: A comparison of two targets and long-term follow-up. Transl. Psychiatry 2017, 7, e1251. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  79. Price, J.L.; Drevets, W.C. Neural circuits underlying the pathophysiology of mood disorders. Trends Cogn. Sci. 2012, 16, 61–71. [Google Scholar] [CrossRef]
  80. Barcia, J.A.; Avecillas-Chasin, J.M.; Nombela, C.; Arza, R.; Garcia-Albea, J.; Pineda-Pardo, J.A.; Reneses, B.; Strange, B.A. Personalized striatal targets for deep brain stimulation in obsessive-compulsive disorder. Brain Stimul. 2019, 12, 724–734. [Google Scholar] [CrossRef] [PubMed]
  81. Beijers, L.; Wardenaar, K.J.; van Loo, H.M.; Schoevers, R.A. Data-driven biological subtypes of depression: Systematic review of biological approaches to depression subtyping. Mol. Psychiatry 2019, 24, 888–900. [Google Scholar] [CrossRef]
  82. Drysdale, A.T.; Grosenick, L.; Downar, J.; Dunlop, K.; Mansouri, F.; Meng, Y.; Fetcho, R.N.; Zebley, B.; Oathes, D.J.; Etkin, A.; et al. Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat. Med. 2017, 23, 28–38. [Google Scholar] [CrossRef] [Green Version]
  83. Riva-Posse, P.; Choi, K.S.; Holtzheimer, P.E.; Crowell, A.L.; Garlow, S.J.; Rajendra, J.K.; McIntyre, C.C.; Gross, R.E.; Mayberg, H.S. A connectomic approach for subcallosal cingulate deep brain stimulation surgery: Prospective targeting in treatment-resistant depression. Mol. Psychiatry 2018, 23, 843–849. [Google Scholar] [CrossRef] [Green Version]
  84. Clark, D.L.; Johnson, K.A.; Butson, C.R.; Lebel, C.; Gobbi, D.; Ramasubbu, R.; Kiss, Z.H.T. Tract-based analysis of target engagement by subcallosal cingulate deep brain stimulation for treatment resistant depression. Brain Stimul. 2020, 13, 1094–1101. [Google Scholar] [CrossRef] [Green Version]
  85. Gormezoglu, M.; van der Vlis, T.B.; Schruers, K.; Ackermans, L.; Polosan, M.; Leentjens, A.F.G. Effectiveness, Timing and Procedural Aspects of Cognitive Behavioral Therapy after Deep Brain Stimulation for Therapy-Resistant Obsessive Compulsive Disorder: A Systematic Review. J. Clin. Med. 2020, 9, 2383. [Google Scholar] [CrossRef]
  86. Hacimusalar, Y.; Esel, E. Suggested Biomarkers for Major Depressive Disorder. Noro Psikiyatr Ars 2018, 55, 280–290. [Google Scholar] [CrossRef]
  87. MacDonald, K.; Krishnan, A.; Cervenka, E.; Hu, G.; Guadagno, E.; Trakadis, Y. Biomarkers for major depressive and bipolar disorders using metabolomics: A systematic review. Am. J. Med. Genet. B Neuropsychiatr. Genet. 2019, 180, 122–137. [Google Scholar] [CrossRef] [PubMed]
  88. Schmidt, H.D.; Shelton, R.C.; Duman, R.S. Functional biomarkers of depression: Diagnosis, treatment, and pathophysiology. Neuropsychopharmacology 2011, 36, 2375–2394. [Google Scholar] [CrossRef] [PubMed]
  89. Kennis, M.; Gerritsen, L.; van Dalen, M.; Williams, A.; Cuijpers, P.; Bockting, C. Prospective biomarkers of major depressive disorder: A systematic review and meta-analysis. Mol. Psychiatry 2020, 25, 321–338. [Google Scholar] [CrossRef] [Green Version]
  90. Rosin, B.; Nevet, A.; Elias, S.; Rivlin-Etzion, M.; Israel, Z.; Bergman, H. Physiology and pathophysiology of the basal ganglia-thalamo-cortical networks. Parkinsonism Relat. Disord. 2007, 13 (Suppl. S3), S437–S439. [Google Scholar] [CrossRef]
  91. Redgrave, P.; Rodriguez, M.; Smith, Y.; Rodriguez-Oroz, M.C.; Lehericy, S.; Bergman, H.; Agid, Y.; DeLong, M.R.; Obeso, J.A. Goal-directed and habitual control in the basal ganglia: Implications for Parkinson’s disease. Nat. Rev. Neurosci. 2010, 11, 760–772. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  92. Panksepp, J. The basic emotional circuits of mammalian brains: Do animals have affective lives? Neurosci. Biobehav. Rev. 2011, 35, 1791–1804. [Google Scholar] [CrossRef] [PubMed]
  93. Abelaira, H.M.; Reus, G.Z.; Quevedo, J. Animal models as tools to study the pathophysiology of depression. Braz. J. Psychiatry 2013, 35 (Suppl. S2), S112–S120. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  94. Lim, L.W.; Prickaerts, J.; Huguet, G.; Kadar, E.; Hartung, H.; Sharp, T.; Temel, Y. Electrical stimulation alleviates depressive-like behaviors of rats: Investigation of brain targets and potential mechanisms. Transl. Psychiatry 2015, 5, e535. [Google Scholar] [CrossRef] [Green Version]
  95. Verhagen, S.J.; Hasmi, L.; Drukker, M.; van Os, J.; Delespaul, P.A. Use of the experience sampling method in the context of clinical trials. Evid. Based Ment. Health 2016, 19, 86–89. [Google Scholar] [CrossRef] [Green Version]
  96. Kramer, I.; Simons, C.J.; Hartmann, J.A.; Menne-Lothmann, C.; Viechtbauer, W.; Peeters, F.; Schruers, K.; van Bemmel, A.L.; Myin-Germeys, I.; Delespaul, P.; et al. A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial. World Psychiatry 2014, 13, 68–77. [Google Scholar] [CrossRef]
  97. Davidson, K.W.; Peacock, J.; Kronish, I.M.; Edmondson, D. Personalizing Behavioral Interventions Through Single-Patient (N-of-1) Trials. Soc. Pers. Psychol. Compass 2014, 8, 408–421. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic representation of emotional processing and its neurobiological base. Figure from Moonen et al. (2017) [16] with permission.
Figure 1. Schematic representation of emotional processing and its neurobiological base. Figure from Moonen et al. (2017) [16] with permission.
Jcm 09 02729 g001
Figure 2. Cortico-striatal-thalamic-cortico mood circuits divided in a dorsal, ventral, and modulating compartment based on Alexander et al. [11], Mayberg et al. [12], and Moonen et al. [16] expanded with regions researched with deep brain stimulation (DBS) for treatment-resistant depression (TRD). DLPFC; dorsolateral prefrontal cortex, DMPFC; dorsomedial prefrontal cortex, ACC; anterior cingulate cortex, THp; thalamic peduncles, OFC; orbitofrontal cortex, VLPFC; ventrolateral prefrontal cortex, MFB; medial forebrain bundle, vALIC, ventral part of the anterior limb of the internal capsule, BNST; bed nucleus of the stria terminalis, SCG; subgenual cingulate gyrus, HPA axis; hypothalamic pituitary adrenal axis.
Figure 2. Cortico-striatal-thalamic-cortico mood circuits divided in a dorsal, ventral, and modulating compartment based on Alexander et al. [11], Mayberg et al. [12], and Moonen et al. [16] expanded with regions researched with deep brain stimulation (DBS) for treatment-resistant depression (TRD). DLPFC; dorsolateral prefrontal cortex, DMPFC; dorsomedial prefrontal cortex, ACC; anterior cingulate cortex, THp; thalamic peduncles, OFC; orbitofrontal cortex, VLPFC; ventrolateral prefrontal cortex, MFB; medial forebrain bundle, vALIC, ventral part of the anterior limb of the internal capsule, BNST; bed nucleus of the stria terminalis, SCG; subgenual cingulate gyrus, HPA axis; hypothalamic pituitary adrenal axis.
Jcm 09 02729 g002
Table 1. DBS in treatment-resistant depression (TRD); published open-label and randomized clinical trials.
Table 1. DBS in treatment-resistant depression (TRD); published open-label and randomized clinical trials.
Region (DBS)StudyOpen-Labeled, RCT or Case-ReportNFollow-UpAge (Mean)Length of Current Depressive Episode, Years (Mean)Response Rate (%) in HDRS or MADRS ScoresRemission Rate (%)Serious Adverse Events (N)
SCGMayberg et al., 2005Open-label66 months465.5833.3 (1 month), #
83 (2 months), #
66.6
(6 months), #
0 (1 month) 33.3
(3 months) 33.3
(6 months)
Suicidal ideation: 2
Syncope: 1
Lead problem: 1
Lozano et al., 2008Open-label2012 months47.46.960 (6 months), #
55 (12 months), #
35 (6 months)
35 (12 months)
Seizure: 1
Lead problem: 3
Kennedy et al., 2011Open-label201, 2 and 3 years, last follow-up (3–6 years)47.46.962.5 (1 year), #
46.2 (2 years), #
75 (3 years), #
64.3 (last follow-up), #
18.8 (1 year)
15.4 (2 years)
50 (3 years)
Worsening depression:3
Suicidal ideation:3
Puigdemont et al., 2012Open-label812 months47.46.387.5 (1 week), #
37.5 (1 month), #
87.5 (6 months), #
62.5 (12 months), #
50 (1 week)
37.5 (6 months)
50 (12 months)
Suicide attempt: 1
Lozano et al., 2012Open-label2112 months47.35.057 (1 month), #
48 (6 months), #
29 (12 months), #
-Suicide: 1
Suicide attempt: 1
Holtzheimer et al., 2012Open-label1724 months425.3441 (6 months), #
36 (12 months), #
92 (24 months), #
18 (6 months)
36 (12 months)
58 (24 months)
Suicidal ideation: 1
Suicide attempt: 2
Merkl et al., 2013Open-label624 h
Last follow up (24–36 weeks)
50.662.1333.33
(36 weeks), #
33.33
(36 weeks)
Headaches: 6
Tenseness in neck region: 1
Holtzheimer et al., 2017RCT60 (52)6 months
(24 months)
50.5312.6222 (6 months), ‡
54 (12 months), ‡
48 (24 months), ‡
10 (6 months)
17 (12 months)
25 (24 months)
Suicide attempt: 2
Suicidal ideation: 2
Seizure: 2
Eitan et al., 2018RCT HF vs. LF DBS913 months46-44.44 (13 months), ‡--
Merkl et al., 2018RCT828 months (n = 6)
4 years (n = 2)
48.25237.5 (6 months), #
43.0 (12 months), #
23.0 (28 months), #
12.5 (6 months)
14.2 (12 months)
33.0 (24 months)
33.3 (28 months)
Manic episode: 1
Crowell et al., 2019Open-label284 (n = 14)
8 (n = 11) years
44.9 (45.9)45.1 (46.6)18 #21Suicide attempt: 6
Suicidal ideation: 8
Anxiety: 6
Worsening depression: 2
PGRAccolla et al., 2016Open-label5 (1)6 months
(24 months)
45.20----
NAccSchlaepfer et al., 2008Open-label36–24 weeks46.77.2--None
Bewernick et al., 2010Open-label1010 months48.610.850 (1 month), #
50 (6 months), #
50 (12 months), #
30 (1 month)Suicide: 1
Suicide attempt: 1
Bewernick et al., 2012Open-label1112 months
24 months
Last follow up (max 4 years)
48.369.2645 (12 months), #9.1 (24 months)Pain: 4
Seizure: 1
Agitation: 3
Suicide:1
Suicide attempt: 1
VC/VSMalone et al., 2009Open-label156 months (n = 15)
12 months (n = 11)
46.32120 (1 month), #
40 (6 months), #
53.3 (last follow-up) #
20 (6 months)
40 (last follow-up)
Suicidal ideation: 2
Syncope: 1
Lead problem: 1
Dougherty et al., 2015RCT3024 months47.711.420 (16 weeks), ¥
20 (12 months), ¥
23.3 (24 months), ¥
13 (12 months)
20 (24 months)
Suicide: 1 (stimulation off)
Suicide attempt: 4
Suicidal ideation: 5
Lead revision: 3
vALICVan der Wal et al., 2020 (follow-up of the RCT Bergfeld et al. 2016)Open-label252 years52.57.4232.0 (2 years, ITT) #20.0 (2 years, ITT)Pain: 1
Agitation: 3
Suicidal ideation: 6
Fatigue: 4
Bergfeld et al., 2016RCT2552 weeks53.26.9840 (after optimization of DBS settings (T2)) #20 (T2)Suicide attempt: 4
Suicidal ideation: 3
Automutilation: 1
LHbSartorius et al., 2009Case-report160 weeks64.09.0---
MFBSchlaepfer et al., 2013Open-label712–33 weeks42.67.686, ¥57Cranial bleeding: 1
Fenoy et al., 2016 (interim analysis)Open-label452 weeks--75 (7 days) ¥66 (26 weeks, OC) ¥--
“-”: has not been mentioned in this article, RCT; response criteria; #; 50% or greater reduction in Hamilton Depression Rating Scale (HDRS) (17 or 28) scores, ¥; 50% or greater reduction in MADRS scores, ‡; 40% or greater reduction in MADRS scores, RCT; randomized controlled trial, ITT; intention to treat, OC; observed case.
Table 2. Targets for DBS in treatment resistant depression (TRD), functions, pathophysiology and the effect of DBS.
Table 2. Targets for DBS in treatment resistant depression (TRD), functions, pathophysiology and the effect of DBS.
Brain RegionFunctionPathological Activity in MDDHF-DBS Effect
SCGContains three white matter bundles; forceps minor + uncinate fasciculus connecting to the medial frontal cortex, cingulum connecting to the rostral and dorsal ACC and fronto-striatal fibers connecting to the NAcc, CN, Pt and anterior Th
Connects higher ‘top-down’ cortical regions with subcortical modulatory regions
Involvement in brain DMN [30]
Increased activity [31]
Reduced volume in familial depression [32]
Projections to:
(1) NAcc may play a role in lack of interest, disruption in reward and underlie anhedonia
(2) Hth and brainstem may play a role in circadian and sleep disturbances, problems with appetite and an abnormal stress responds and cortisol metabolism [31].
Disruption of pathological activity
Modulation of multiple regions connected to the SCG [31]
NAccReceives projections from VTA, AG, OFC, mPFC, dCN, GP and Hip and projects to Cg25, mPFC, VP, Th, AG and Hth.
Transmits information from emotion centers to motor control regions, causing motivational behavior to obtain rewards [33]
Processes reward and pleasure information
In severe anhedonia; smaller size and less activation to reward [34] Acute: Increase in exploratory motivation
Chronic: reduction in anhedonia
PET Imaging:
↑ activity in VS, bilateral dlPFC and dmPFC, cingulate cortex and bilateral AG.
↓ activity in vmPFC and vlPFC, dCN and Th [33]
VC/VSContains fibers connecting the dPFC, dACC, OFC and vmPFC with THAL, AG, Hth and brainstem (SN, VTA, RN and PTN) [35] Increased activity [36]
Activation of the connection from left vs. to left caudate has been associated with anhedonia
Increased connectivity of vs. to DMN is positively correlated to higher depression scores in the CES-D score [37]
-
vALICContains two fiber bundles: the anterior thalamic radiation and the supero-lateral branch of the MFB connecting the PFC to different subcortical structures such as the Th, NAcc, VTA and VS.
Decreased integrity of the right vALIC in depressed patients [38]
-Decreased metabolism in OFC, subgenual ACC and right DLPFC in patients with OCD [39]
LHbActivity corresponds negatively to anticipation and reception of a reward [40]Increased activity [41]
Possible down regulation of serotonergic, noradrenergic and dopaminergic systems [42], volume reduction [43]
Localized metabolic increase in one patient with FDG-PET, presumably due to functional inhibition [44]
ITPInterconnects the intralaminar nucleus and TRN with the OFC [30,45]Hyperactivation in both TRN and OFC [46]Cortical desynchronization
Disruption of adrenergic and serotonergic malfunction [46]
MFBInterconnects the Nacc, VTA, vmHth, lHth and AG ventromedial and lateral nuclei of the Hth and AG with convergence onto the PFC [47,48]
Plays a crucial role in the reward pathway;
Dysfunctional reward system.
Responders showed a strong connectivity between the active electrode contact and the mPFC pre-operatively using individual DTI [49]
Insignificant changes in metabolism in 3 patients with PET measurements pre-operatively, 6 and 12 months post-operatively [49]
BNSTMayor output pathway of the AG
Regulates stress response
Integrates information from multiple brain areas to perform ‘valence surveillance’ [22,30]
Oscillatory activity with high a-power [50]-
“-“: not investigated; (d) ACC; (dorsal) anterior cingulate cortex, AG; amygdala, CES-D score; center for epidemiologic studies depression score, (d) CN; (dorsal) caudate nucleus, DMN; default mode network, DTI; deterministic diffusion tensor imaging, GP; globus pallidus, Hip; hippocampus, Hth; hypothalamus, MFB; medial forebrain bundle, OFC; Orbitofrontal cortex, (m/dl/dm/vm/vl) PFC (medial/dorsolateral/dorsomedial/ventromedial/ventrolateral) Prefrontal cortex, PGR; posterior gyrus rectus, PTN; pedunculopontine tegmental nucleus, Pt: putamen, RN; raphe nuclei, SN; substantia nigra, Th; thalamus, TRN; thalamic reticular nucleus, VP; ventral pallidum, VS; ventral striatum, VTA; ventral tegmental area.

Share and Cite

MDPI and ACS Style

Roet, M.; Boonstra, J.; Sahin, E.; Mulders, A.E.P.; Leentjens, A.F.G.; Jahanshahi, A. Deep Brain Stimulation for Treatment-Resistant Depression: Towards a More Personalized Treatment Approach. J. Clin. Med. 2020, 9, 2729. https://doi.org/10.3390/jcm9092729

AMA Style

Roet M, Boonstra J, Sahin E, Mulders AEP, Leentjens AFG, Jahanshahi A. Deep Brain Stimulation for Treatment-Resistant Depression: Towards a More Personalized Treatment Approach. Journal of Clinical Medicine. 2020; 9(9):2729. https://doi.org/10.3390/jcm9092729

Chicago/Turabian Style

Roet, Milaine, Jackson Boonstra, Erdi Sahin, Anne E.P. Mulders, Albert F.G. Leentjens, and Ali Jahanshahi. 2020. "Deep Brain Stimulation for Treatment-Resistant Depression: Towards a More Personalized Treatment Approach" Journal of Clinical Medicine 9, no. 9: 2729. https://doi.org/10.3390/jcm9092729

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop