- freely available
Brain Sci. 2015, 5(3), 369-386; doi:10.3390/brainsci5030369
Abstract: Although attention-deficit hyperactivity disorder (ADHD) has been linked to emotion dysregulation, few studies have experimentally investigated this whilst controlling for the effects of comorbid conduct disorder (CD). Economic decision-making games that assess how individuals respond to offers varying in fairness have been used to study emotion regulation. The present study compared adolescent boys with ADHD (n = 90), ADHD + CD (n = 94) and typical controls (n = 47) on the Ultimatum Game and examined the contribution of ADHD and CD symptom scores and callous and unemotional traits to acceptance levels of unfair offers. There were no significant differences in acceptance rates of fair and highly unfair offers between groups, and only boys with ADHD did not significantly differ from the controls. However, the subgroup of boys with ADHD and additional high levels of aggressive CD symptoms rejected significantly more ambiguous (i.e., moderately unfair) offers than any other subgroup, suggesting impaired emotion regulation in those with ADHD and aggressive CD. Correlations within the CD group showed that the rejection rate to moderately unfair offers was predicted by aggressive CD symptom severity, but not callous and unemotional traits. These findings highlight the fact that ADHD is a heterogeneous condition from an emotion regulation point of view.
It has long been recognized that children with attention deficit hyperactivity disorder (ADHD) have difficulty regulating their emotions. In particular, research has shown that children with this disorder exhibit greater emotional reactivity , higher levels of negative affect  and lower levels of emotional awareness . Emotion regulation is defined as an individual’s ability to modify an emotional state so as to promote adaptive, goal-oriented behaviours . Emotion dysregulation arises when these adaptive processes are impaired, leading to behaviour that defeats the individual’s interests . Although prevalence rates of emotion dysregulation in ADHD are high , the clinical significance of these findings and how specific they are to ADHD remain unclear. It has not yet been established, for example, whether deficits in emotion regulation are evident in all children with ADHD or perhaps only in a subgroup of children with this disorder.
In the early conceptualisation of ADHD, emotion dysregulation was considered a cardinal symptom . It was only with the introduction of the DSM-III  that emotion regulation became an associated feature rather than a diagnostic criterion. The current conceptualization of ADHD is made up of two age-inappropriate behavioural dimensions, these being inattention and hyperactivity-impulsivity (ADHD; DSM 5; ). However, many argue that emotion dysregulation should take more of a consideration in the assessment of ADHD due to its impact on psychological, physical and social outcomes [10,11]. Now, conceptual theories of emotion regulation and ADHD can generally be characterised by three separate models; emotion dysregulation as a core feature of ADHD, emotion dysregulation as a distinct, but correlated dimension to ADHD or the addition of emotion dysregulation and ADHD as a distinct entity .
Barkley  argues that emotion dysregulation is a core feature of ADHD and stems from executive functioning difficulties at the neurological level. Specifically, the inability to inhibit responses causes difficulties with selective attention, hyperactivity and impulsivity inherent in ADHD, as well as an impaired ability to inhibit strong emotional responses. However, emotion dysregulation is a dimensional trait that undercuts the traditional divide between internalizing and externalizing diagnoses, and it is not unique to ADHD . Regulation of emotions is compromised in children with disruptive behavioural disorders (DBDs), like conduct disorder (CD) and oppositional defiant disorder (ODD), as well as mood disorders. A recent study by Factor et al.  suggests that ADHD alone is not sufficient for children to display significantly impaired emotional regulation, but it is only in the presence of a comorbid disorder that this pattern of deficiency begins to emerge.
Between 30% and 50% of children with ADHD meet the criteria for conduct disorder , and this subgroup shows greater ADHD symptom severity than those with ADHD alone and worse outcomes . This group also appears to have higher familial and genetic loading for ADHD [17,18], especially those with aggressive CD symptoms . However, previous research on emotion regulation in children with ADHD has often not considered the effects of comorbid CD [20,21,22]. It is difficult therefore to know whether it is the core features of ADHD that are linked to emotion dysregulation or whether the relationship is explained by associated CD.
Studies on emotion regulation have primarily used retrospective, self-report questionnaires. Experimental studies (e.g., [23,24]) have often used frustration eliciting tasks to assess emotion regulation; for example, by asking participants to hide their emotions from a confederate competitor. In this type of paradigm, however, the participants have no real motive to regulate their emotion apart from complying with the experimenter’s demands. Economic decision-making games, such as the Ultimatum Game (UG), provide another way of measuring emotion regulation by assessing effects on decision making [25,26,27,28]. These paradigms involve two players interacting to decide how to divide a sum of money. One player (the proposer) offers a portion of the money to the second player (the responder). The responder can either accept the offer (in which case, both players split the money as proposed) or reject the offer (in which case, both players get nothing). Traditional economic theories, which view decision-making as a rational, cognitive process (e.g., ) state that all offers, regardless of their fairness, should be accepted. Previous studies, however, have found that offers made to the responder that are comparatively small, and therefore deemed as unfair (20% of the total), have a 50% chance of being rejected by most individuals [25,30].
Most individuals experience a negative emotional response and increased arousal when receiving unfair offers , and a number of studies provide evidence that emotion regulation processes are a critical component in the UG. Negative emotions, such as anger and frustration, provoke participants to penalise their opponent rather than to make a utilitarian choice [32,33], and the rejection of unfair offers increases when feelings of sadness are induced . The percentage of accepted unfair offers is influenced by the use of specific emotion regulation strategies, such as reappraisal [35,36], and when participants are asked to “stay calm”, they accept more unfair offers , suggesting that the ability to regulate negative emotions is necessary for the (rational) acceptance of unfair offers.
The rejection of unfair offers has been found to be associated with activity in neural substrates involved in negative emotions, such as the amygdala  and anterior insula . Ventromedial prefrontal cortex (VMPC) damage is reliably associated with poorly-controlled emotional responses. In response to relatively minor provocation or frustration, patients with such damage are often irritable, angry, argumentative and even abusive [40,41,42,43], yet generally show shallow affect. Similarities have been observed between patients with VMPC damage and patients with psychopathy [26,44,45,46], and Koenigs et al.  found similarly high rejection rates to the UG in VMPC damage patients and prisoners with low-anxiety psychopathy. In a community sample, Viera  showed that the rejection rate of unfair offers was associated with VMPC activity in those with high psychopathy scores compared to those with low psychopathy scores; they interpreted this as reflecting an angry reaction to the frustration of not obtaining the desired outcome.
The results of studies in children and adults assessing emotion regulation suggest that age is an important factor. It is consistently found that adolescents reject more unfair offers than younger children and adults [48,49,50], suggesting that there is a U-shaped developmental trajectory. This is consistent with the conceptualization of a peak in emotional reactivity during adolescence . However, until now no studies have examined emotion regulation using the UG in a clinical sample of adolescents with ADHD.
When assessing the contributory effects of comorbid externalizing disorders, it is important to consider the clinical and aetiological heterogeneity of disorders, such as CD and ODD ; not all children who engage in antisocial behaviour will display emotion regulation problems. Frick and Morris  argue deficits in emotion regulation are likely to underlie conduct problems that involve the angry and overt confrontation of others (e.g., fighting and assault), but are less likely to be associated with conduct problems that are not associated with confrontation or negative affect (e.g., stealing, vandalism). Burt and Donnellan  also argue that there are unique personality correlates of different forms of antisocial behaviour. They found that aggression was uniquely predicted by high stress reaction (e.g., easily upset, has unaccountable mood changes), but this was not related to non-aggressive rulebreaking behaviour. This suggests that adolescents who display high aggressive CD symptoms might have more difficulty regulating their negative emotions during the UG and reject more unfair offers.
Callous-unemotional traits (CU) are another potentially important source of heterogeneity when looking at externalizing disorders. Such personality traits identify those at greater risk for severe antisocial behaviour  and reduced responsiveness to treatment . The importance of such traits has been acknowledged by including limited prosocial emotions as a specifier for CD in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association; [9,56]). CU traits are characterised by low prosocial emotions and behaviours, including shallow or blunted affect, lack of guilt or remorse, physiological under arousal and low empathy. Individuals who lack empathy and are not concerned about the emotions of others may be less likely to be driven by anger and the motivation to punish the proposer. This was supported in a non-clinical sample, which found that students scoring high on psychopathic traits rejected fewer unfair offers, interpreted as favouring self-interest . However, this contradicts Koenigs et al.’s  study of psychopathic inmates and also contrasts the results of more recent studies, which found no differences in rejection rates between high and low psychopathy scorers in community adults  and adolescents  or between healthy and (high psychopathy scoring) incarcerated individuals .
Only a few studies have examined emotion regulation using the UG in adolescents [48,49,50,58], and we are not aware of any study that has done so in a clinical sample of adolescents with ADHD. This study compared the decision-making of those with ADHD against those with ADHD and CD; with respect to the latter group, we distinguished between those with low aggressive CD symptoms and high aggressive CD symptoms. Within these groups, we also looked at the effect of additional CU traits. We included a sample of typically-developing adolescent males for comparison.
2. Experimental Section
Participants were recruited from the Child and Adolescent Mental Health Services and Community Child Health Clinics in Wales. Children in the sample were of British Caucasian origin and met research criteria for a lifetime diagnosis of ADHD. Children with any known clinical or research diagnosis of schizophrenia, bipolar disorder, autistic spectrum disorder (ASD), Tourette’s syndrome or with an IQ < 70, epilepsy, brain damage or any other neurological or genetic disorder were excluded from the study. In total, 204 adolescent males with ADHD (mean age = 13.95 years, SD = 1.82; age range 10–17 years) took part in the present study. No participants were stimulant naive, but participants who were currently being prescribed stimulant medication were asked to come off their medication at least 24 h prior to testing.
Male control participants (NCs), aged 13–18 (mean age = 15.14 years; N = 47) were recruited from local comprehensive schools and youth centres from relatively deprived areas in Cardiff. The Youth Self Report (YSR; ) was used to screen for ADHD and CD. All NCs completed the Wechsler Abbreviated Scale of Intelligence (WASI; ) and the UG. Nobody had estimated IQ scores of <70.
Ethical approval was obtained from the Wales Multicentre Research Ethics Committee. Informed written consent was obtained for all accompanying parents and adolescents aged over 16 years. Written assent was obtained for younger adolescents.
2.2. Clinical Measures
Child psychopathology was assessed using the Development and Well Being Assessment (DAWBA) structured interview using both parents and children as informants . Parents completed the ADHD and ODD/CD sections and children the ODD/CD section of the DAWBA. All interviews were administered by trained psychologists, supervised by an experienced clinician (AT). Symptom scores and diagnoses were generated from the DAWBA according to DSM-IV criteria (the DSM-V had not been published at the start of the study; ). CD symptoms were considered present if endorsed by either the parent or child. Given previous findings suggesting that DSM-IV defined aggressive CD items’ index CD heterogeneity [19,54], those with CD were further examined according to whether or not they had a high (>3) number of aggressive symptoms (as defined by DSM).
ODD has previously been viewed as being part of a CD diagnostic spectrum. It is characterised as a less severe form of CD, which is often a developmental precursor to CD . However, ODD has since been shown to have some important diagnostic utility; in particular, the ability to predict risk for later emotional disorders after controlling for CD . In the DSM-5, the exclusion criterion for CD has now been removed from the diagnostic criteria for ODD. ODD was therefore also assessed using the DAWBA to control for differences between groups.
CU traits were measured using the Youth Psychopathic traits Inventory (YPI; ). The CU subscale of the YPI contains 15 items, and each item is answered on a 4-point Likert scale (score range 15–60). The reliability and convergent validity of the YPI with other measures of CU traits has been established [67,68].
Parent-rated emotional symptoms were assessed using the Strengths and Difficulties Questionnaire (SDQ; ). This was also completed as part of the DAWBA. The five emotional items (worries, unhappy, afraid, clingy, somatic) were scored on a 3-point Likert scale and summed to obtain a total emotional symptom score (score range 0–10).
Cognitive ability was re-assessed on all current participants using the Wechsler Abbreviated Scale of Intelligence , 2-subset form (vocabulary and matrix reasoning). All of the participants came from community clinics, and none were stimulant naive. Participants who continued to take stimulant medication were asked to come off medication 24 h prior to testing.
2.3. The Ultimatum Game
In the Ultimatum Game , two players are given the opportunity to split a sum of money. One player (the proposer) proposes a way to split an amount of money with another player (the responder). These offers vary in fairness, and the participant must simply accept or reject the offers made to them. If the responder accepts the offer, both players are paid accordingly. If the offer is rejected, neither player is paid. The participants were instructed that the offers were real and had been made by previous participants of the same study. This was made more believable by asking participants to propose their offer (out of the options below), and after they had done so, their offer was stored in the database for use in future research . In fact, the experimenter predetermined the offers, and photographs of the opponents/responders were taken from the Amsterdam Dynamic Facial Expression Set .
Offers made were either 5/5 (keep 5, give 5 points), 6/4 (keep 6, give 4 points), 7/3 (keep 7, give 3 points), 8/2 (keep 8, give 2 points) or 9/1 (keep 9, give 1). Participants were the responders in a series of 22 trials, in which they saw a photograph of a different person during each trial who made them an offer. In accordance with Koenigs and Tranel’s  paper, offers were generated in the following frequencies: two offers of 5/5 distribution, two offers of 6/4, six offers of 7/3, six offers of 8/2 distribution and six offers of 9/1 distribution. Sanfey et al. (2003) asked participants to rate what offers they considered to be fair, irrespective of whether they decided to reject or accept an offer. Of their participants, 58% considered any offer less than 5/5 as unfair, with the remaining 42% deeming anything less than 7/3 to be unfair. Therefore, although 100% of the participants deemed the offers of 8/2 and 9/1 unfair, participants were divided with respect to the fairness of the 6/4 and 7/3 offers. For these reasons, the offers were grouped into three groups: truly fair (5/5), very unfair (8/2 and 9/1) and moderately unfair (7/3 and 6/4).
2.4. Data Analyses
Two ADHD participants had incomplete DAWBA data, so they could not be included. Eight ADHD participants did not complete the UG due to noncompliance; these participants had significantly more aggressive CD symptoms (p < 0.05). Ten participants had an estimated IQ < 70 and were excluded. Therefore, 184 ADHD participants were included in the analysis, as well as 47 control participants referred to as normal controls (NC). The ADHD group consisted of those with ADHD only (ADHD; n = 90). Those with additional CD (ADHD + CD; n = 94) were split into those with low aggressive CD symptoms (ADHD + CD/LA; n = 64) and high aggressive CD symptoms (ADHD + CD/HA n = 30), based on whether they were below or above the mean (mean = 3.33 symptoms). Between-subject ANOVAs were used to test differences in offers and acceptance rates between groups. Offers were grouped into three offer types: completely fair (5/5), moderately fair (6/4 and 7/3) and highly unfair (8/2 and 9/1). Because the UG variables were not normally distributed, follow up Bonferroni pairwise comparisons were bootstrapped and reported with 95% confidence intervals. Non-parametric Kruskal-Wallis tests were also conducted and found the same results.Effect sizes are reported as partial eta squared (η2p; small ≥0.01, medium ≥0.06, large ≥0.14; ). Anomalies (±3 standard deviations away from the mean for each group) were removed and replaced with the mean of that variable. One-way ANOVAs were used to compare demographic and clinical variables between groups. Spearman’s correlations and regressions examined the effect of these clinical variables on the UG outcome variables. Analyses were carried out using SPSS 16.0 (SPSS Inc., Chicago, IL, USA).
The demographic data for the two subgroups and the results of between-group analyses are presented in Table 1.
Table 1 shows that there was a significant difference in age due to the control group being older than the three clinical groups. There was also a significant difference in estimated IQ, with the ADHD group having a higher IQ score than the two CD groups. Therefore, when significant results were found, follow-up ANCOVA tests were performed in order to analyse the effect with age and IQ as covariates.
There was no difference between the three clinical groups in ADHD severity or the emotion subscale of the SDQ. There was also no significant difference between the CD groups for CU traits and ODD symptoms, but these groups were significantly higher than the ADHD-only group.
|NC (N = 47)||ADHD (N = 90)||ADHD + LA/CD (N = 64)||ADHD + HA/CD (N = 30)|
|Age||15.19||1.33||13.70||1.89||14.28||1.80||13.47||1.55||p < 0.001||NC > ADHD and ADHD + LA/CD and ADHD + HA/CD|
|IQ||88.00||9.46||93.41||10.33||88.92||9.18||86.57||8.70||p < 0.05||ADHD > ADHD + LA/CD and ADHD + HA/CD|
|Total CD score||N/A||N/A||0.98||0.14||4.45||0.16||8.00||0.24||p < 0.001||ADHD < ADHD + LA/CD < ADHD+HA/CD|
|Aggressive CD score||N/A||N/A||0.20||0.43||1.19||0.79||3.50||0.63||p < 0.001||ADHD < ADHD + LA/CD < ADHD + HA/CD|
|Non-Aggressive CD score||N/A||N/A||0.78||0.73||3.27||1.36||4.50||1.93||p < 0.001||ADHD < ADHD + LA/CD < ADHD+HA/CD|
|CU traits||N/A||N/A||16.56||6.15||19.28||7.19||22.28||5.32||p < 0.001||ADHD < ADHD + LA/CD and ADHD + HA/CD|
|ODD score||N/A||N/A||2.91||2.46||4.41||2.72||5.37||2.53||p < 0.001||ADHD < ADHD + LA/CD and ADHD + HA/CD|
Note: LA, low aggressive; CD, conduct disorder; HA, high aggressive; ODD, oppositional defiant disorder. All between-group analyses were done using one-way ANOVAs; ADHD score = number of ADHD symptoms; total CD score = total number of CD symptoms; aggressive CD score = number of aggressive CD symptoms; non-aggressive CD score = number of non-aggressive CD symptoms; CU traits = callous-unemotional traits subscale score; ODD score = number of ODD symptoms; emotional symptoms = strengths and difficulties emotional symptom subscale score; Sig = significance value.
The Ultimatum Game
First, the original proposed offers were compared (see Table 2). A between-subject ANOVA found no significant difference between groups: F(3, 227) = 1.48, p = 0.22, ηp2 = 0.02.
|NC (N = 47)||ADHD (N = 90)||ADHD + CD/LA (N = 64)||ADHD + CD/HA (N = 30)|
Note: Offers were scored accordingly; 5/5 = 1, 6/4 = 2, 7/3 = 3, 8/2 = 4, 9/1 = 5.
We then compared the acceptance rates for the different offer types between the groups (see Figure 1). Between-group ANOVAs showed that the groups did not differ in acceptance rates for the fair offers (F(3, 227) = 0.53, p = 0.66, ηp2 = 0.01) nor highly unfair offers (F(3, 227) = 2.36, p = 0.07, ηp2 = 0.03). However, the groups did differ significantly in acceptance rates for the moderately unfair offers (F(3, 227) = 3.07, p = 0.03, ηp2 = 0.04), and this remained significant after controlling for age and IQ (p = 0.03). The results of nonparametric Kruskal-Wallis tests confirmed these results: proposed offer, χ2 = 2.16, p = 0.54; fair offers, χ2 = 0.59, p = 0.90; moderately unfair offers, χ2 = 9.39, p = 0.03; highly unfair offers, χ2 = 2.43, p = 0.49. Follow-up bootstrapped pairwise comparisons showed that this effect was driven by the ADHD + CD/HA group rejecting significantly more offers than the other three groups (control group: p = 0.007, 95% CIs = −0.32, −0.06; ADHD only: p = 0.034, 95% CIs = −0.26, −0.01; ADHD + CD/LA: p = 0.005, 95% CIs = −0.34, −0.06).
Due to the difference found between the two CD groups, we wanted to explore the variation in symptoms between them. As shown in Table 1, the high aggressive group also reported more non-aggressive symptoms. It was therefore important to find out whether it was aggressive symptoms in particular or CD severity in general that predicted performance on the UG. Table 3 shows that both total CD score and aggressive CD score were significantly correlated with the acceptance rate of moderately unfair offers; none of the other demographic characteristics, including CU traits, were correlated.
|Age||IQ||ADHD||CD||Aggressive CD||CU Traits||ODD||Emotional Symptoms||Mod unfair|
|ADHD||−0.21 *||0.24 *||-||-||-||-||-||-||-|
|Aggressive CD||−0.32 **||−0.17||0.10||0.66 **||-||-||-||-||-|
|CU traits||−0.02||−0.05||0.12||0.21 *||0.16||-||-||-||-|
|ODD||−0.09||0.05||0.45 **||0.27 *||0.33 **||0.15||-||-||-|
|Emotional symptoms||−0.22 *||0.07||0.18||0.15||0.11||−0.11||0.16||-||-|
Note: ADHD = number of ADHD symptoms; CD = total number of CD symptoms; aggressive CD = number of aggressive CD symptoms; ODD = number of ODD symptoms; CU traits = callous-unemotional traits subscale score; emotional symptoms = strengths and difficulties emotional symptom subscale score; Mod unfair= acceptance rate of moderately unfair offers. * p < 0.05, ** p < 0.001.
A stepwise multiple regression was then conducted to evaluate whether both aggressive CD and total CD scores predicted the acceptance of moderately unfair offers. At Step 1 of the analysis, the aggressive CD score entered into the regression equation and was significantly negatively related to acceptance rates: F(1,92) = 5.11, p = 0.026, R = 0.23. Total CD score did not enter into the equation at Step 2 of the analysis (t = −0.246, p = 0.81).
This study sought to examine whether ADHD adolescents in general have a problem with emotion regulation or whether this is a specific problem in those with conduct disorder, especially those with predominantly aggressive symptoms. No study until now has examined economic decision-making using the UG in a clinical sample of youths with ADHD, with or without CD. This study supports previous work  suggesting that children with ADHD show significantly higher levels of emotional dysregulation than control children only in the presence of a comorbid disorder.
Unsurprisingly, the vast majority of the adolescents accepted the fair offers and rejected the unfair offers. Generally our adolescent male groups accepted fewer unfair offers than those reported for adults [26,39]. This supports the suggestion of a peak in emotional reactivity during adolescence . There were no differences between the four adolescent groups’ acceptance rates for fair (5/5) and seriously unfair offers (9/1 and 8/2); however, a significant group effect was found for the moderately unfair offers (6/4 and 7/3), suggesting that problems in emotion regulation become more apparent under ambiguous conditions.
Follow-up tests showed that the ADHD with aggressive CD group rejected significantly more moderately unfair offers than any other group. Previous studies claim that the rejection of unfair offers is due to anger and a desire to punish the opponent, and the responder’s ability to regulate anger and frustration therefore plays a critical role in task performance . All three clinical groups reported the same amount of internalising emotionality in the SDQ. However, when faced with being treated unfairly, group differences in the ability to regulate externalising emotions became clear. Our results suggest that emotion regulation difficulties are not found in adolescents with ADHD alone, but rather only in those who have additional aggressive behaviour. This reflects their clinical presentation: being unable to control their aggressive behaviour .
The results suggest that ADHD alone is not associated with emotion dysregulation during the UG compared to normal adolescents, supporting the view that emotion dysregulation is not a core feature of ADHD. The fact that the biggest difference between groups was between the two CD groups highlights the importance of treating CD as a heterogeneous disorder. The results showed that aggressive symptoms predicted performance on the UG better than overall CD severity, supporting the idea that aggressive antisocial behaviour has a different aetiology than non-aggressive behaviour [19,54].
In the present study, participants were told that the aim of the game was to gain as many points as possible. Apart from this, there was no other incentive for them to win. The use of real reward incentives might, therefore, have a large impact on the rate of offers accepted. Further research is needed to help determine this in order to facilitate the development of more specific interventions for CD. For example, intervention programmes may be more beneficial by focusing on emotion regulation management in individuals with aggressive CD, whilst working with incentive-based goals in individuals with low-aggressive CD.
Unlike aggression, CU traits did not influence the acceptance of offers, supporting previous studies, which found no significant difference between individuals scoring high or low in psychopathy [47,58,59], but not others [28,57]. Previous studies have found that aggressive behaviour is positively correlated with negative emotionality and dysfunction , whereas CU traits are negatively correlated with these same traits . In a modified version of the UG, Radke et al.  found that offenders high in psychopathy, like controls, took the context of the offer into consideration (i.e., whether the proposer had a fair or unfair alternative offer to choose from), whereas offenders low in psychopathy did not, suggesting stronger impairments in social decision-making. However, even if similar behaviour patterns are shown in high and low psychopathy scorers, these might represent different motivations, as suggested by recent imaging studies [47,58], and this now needs to be tested further in clinical samples. Koenigs et al.  observed poorer regulation during the UG in low-anxious psychopathic offenders in comparison to high-anxious psychopathic and non-psychopathic offenders. However, due to the small sample sizes (n = 6) and lack of a non-ASB control sample, further research is needed. Our groups did not differ significantly in internalising emotionality (measured by the SDQ), and it may be the case that the low anxiety component of psychopathy drives regulation problems. Further research is needed using a clinical sample of children with disruptive behaviour problems, and improvements could be made by using a combination of parent, teacher and behavioural observation to assess CU traits, as suggested by the new CU specifier for the CD diagnosis in the DSM-5.
An issue that needs further exploration is the assumption that the acceptance of unfair offers is the rational decision. From an economic perspective, the rejection of offers is irrational, because it results in a personal loss. However, from a social perspective, rejection of unfair offers can be seen as a rational, altruistic action to preserve social norms. Rather than maximizing self-interest, the participant chooses to punish the socially-inappropriate action from the proposer for the good of the general population [73,74]. This would explain why similar rejection rates are found in a modified version of the UG in which the participants play on behalf of a third party, compared to one played by themselves . We would argue that it is unlikely that boys high in aggressive CD symptoms rejected offers for the “good of the general population”, and this is supported by a recent imaging study, which found differences in response to the UG between severely antisocial adolescents and controls . That study found decreased right inferior frontal gyrus (rIFG) activity in antisocial youngsters during the UG and no correlation between rIFG activity and behavioural responses, as was found in the controls. These results complement previous studies that suggest that juvenile antisocial behaviour is associated with difficulties in engaging the regulatory processes associated with the frontal cortex [77,78], in particular the rIFG, which is associated with response inhibition [79,80]. This supports the notion that the rejection of unfair offers in antisocial populations is due to deficient self-regulatory processes. Further research should now investigate more thoroughly participants’ reasoning behind the rejection of offers in order to support this.
Another limitation of the study is that during the UG task, no direct measure of participants’ emotional responses, such as psychophysiological recordings or subjective ratings, were obtained. Because we did not measure participants’ emotional response to offers, we do not know how much participants needed to self-regulate. One would assume that the more intense the shift in emotion, the more regulatory resources would be needed in order to modify that emotion. It is difficult, however, to determine from this study whether the boys with aggressive CD had deficient regulatory resources or experienced a more intense emotional reaction. Previous findings of reduced psychophysiological responding to aversive stimuli in the sample group would suggest the former [81,82]. Future research including such additional measures should help untangle the various potential factors affecting performance on the UG. The simplicity of the paradigm is also well suited for testing this sample using brain imaging techniques.
Emotion dysregulation is a dimensional trait that is not unique to ADHD. It is important to uncover to what extent individuals with ADHD and comorbid CD develop emotion regulation deficits for reasons that are different from those with CD alone by testing psychopathology in non-ADHD samples. Longitudinal studies are needed in order to define how the developmental trajectories interact with one another, to see, for example, whether emotion regulation difficulties bridge the development of aggressive behaviour in children and adolescents with ADHD or whether factors underlying both ADHD and comorbid aggressive CD (i.e., temperamental or biological factors) lead children to demonstrate impairing levels of emotional dysregulation. Furthermore, existing treatments need to be modified to address the role of emotional regulation in children with ADHD. They should incorporate cognitive-behavioural techniques to teach emotion recognition and physiological relaxation exercises for negative emotions [83,84] and encourage problem-solving techniques to help children adjust and self-regulate when their expectations are not met .
In conclusion, this study of adolescent boys with ADHD and controls found a significant difference in the acceptance rate of ambiguously unfair offers of boys with ADHD and highly aggressive CD. The results suggest that it is the subgroup of boys with both ADHD and predominantly aggressive CD that has difficulty with emotion regulation, which causes them to make more “irrational” decisions. Importantly, boys with ADHD alone did not differ from controls in performance on the decision-making task. Further research is needed to better understand how emotion regulation influences decision-making and antisocial behaviour in the short and long term amongst adolescents, including those with psychiatric disorder.
This research has been supported by a grant (G1000632) from the U.K. Medical Research Council awarded to Anita Thapar, Stephanie van Goozen and Kate Langley.
We are very grateful to all of the participants and their families who participated. We thank Valerie Russell for administrative support and Sharifah Syed, Erika Baker, Daniel Burley, Kelly Hubble, Karen Schepman, Katy Bowen, Joanne Morgan and Omer Minhas for research support.
Conceived of and designed the experiment: Stephanie van Goozen., Anita Thapar, and Kate Langley. Performed the experiments: Clare Northover. Analysed the data: Clare Northover and Stephanie van Goozen. Wrote the paper: Clare Northover, Stephanie van Goozen, Anita Thapar, and Kate Langley.
Conflicts of Interest
The authors declare no conflict of interest.
- Jensen, S.A.; Rosen, L.A. Emotional reactivity in children with attention-deficit/hyperactivity disorder. J. Atten. Disord. 2004, 8, 53–61. [Google Scholar] [CrossRef] [PubMed]
- Braaten, E.B.; Rosen, L.A. Self-regulation of affect in attention deficit-hyperactivity disorder (ADHD) and non ADHD boys: Differences in empathic responding. J. Consult. Clin. Psychol. 2000, 68, 313–321. [Google Scholar] [CrossRef] [PubMed]
- Factor, P.I.; Rosen, P.J.; Reyes, R.A. The relation of poor emotional awareness and externalizing behavior among children with ADHD. J. Atten. Disord. 2013. [Google Scholar] [CrossRef] [PubMed]
- Thompson, R.A. Emotion regulation: A theme in search of definition. Monogr. Soc. Res. Child Dev. 1994, 59, 25–52. [Google Scholar] [CrossRef] [PubMed]
- Shaw, P.; Stringaris, A.; Nigg, J.; Leibenluft, E. Emotion dysregulation in attention deficit hyperactivity disorder. Am. J. Psychiatry 2014, 171, 276–293. [Google Scholar] [CrossRef] [PubMed]
- Stringaris, A.; Goodman, R. Three dimensions of oppositionality in youth. J. Child Psychol. Psychiatry 2009, 50, 216–223. [Google Scholar] [CrossRef] [PubMed]
- Clements, S.D. Minimal Brain Dysfunction in Children: Terminology and Identification: Phase One of a Three-Phase Project; Department of Health Education and Welfare: Washington, DC, USA, 1996. [Google Scholar]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 3rd ed.; American Psychiatric Press: Washington, DC, USA, 1980. [Google Scholar]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Press: Alrington, VA, USA, 2013. [Google Scholar]
- Gross, J.J. Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology 2002, 39, 281–291. [Google Scholar] [CrossRef] [PubMed]
- Abelson, J.J.; Liberzon, I.; Young, E.A.; Khan, S. Cognitive modulation of the endocrine stress response to a pharmacological challenge in normal and panic disorder subjects. Arch. Gen. Psychiatry 2005, 62, 668–675. [Google Scholar] [CrossRef] [PubMed]
- Barkley, R.A. Why emotional impulsiveness should be a central feature of ADHD. ADHD Rep. 2010, 18, 1–5. [Google Scholar]
- Achenbach, T.; Rescorla, L. The Manual for the ASEBA School-Age Forms & Profiles; University of Vermont, Research Centre for Children, Youth, and Families: Burlington, VT, USA, 2001. [Google Scholar]
- Factor, P.I.; Reyes, R.A.; Rosen, P.J. Emotional Impulsivity in Children with ADHD Associated with Comorbid—Not ADHD—Symptomatology. J. Child Psychol. Psychiatry 2014, 36, 530–541. [Google Scholar] [CrossRef]
- Biederman, J.; Newcorn, J.; Sprich, S. Comorbidity of attention deficit hyperactivity disorder. Am. J. Psychiatry 1991, 148, 564–567. [Google Scholar] [PubMed]
- Thapar, A.; Langley, K.; Owen, M.J.; O’Donovan, M.C. Advances in genetic findings on attention deficit hyperactivity disorder. Psychol. Med. 2007, 37, 1681–1692. [Google Scholar] [CrossRef] [PubMed]
- Faraone, S.V.; Biederman, J.; Monuteaux, M.C. Toward guidelines for pedigree selection in genetic studies of attention deficit hyperactivity disorder. Genet. Epidemiol. 2000, 18, 1–16. [Google Scholar] [CrossRef]
- Thapar, A.; Harrington, R.; McGuffin, P. Examining the comorbidity of ADHD-related behaviours and conduct problems using a twin study design. Br. J. Psychiatry 2001, 179, 224–229. [Google Scholar] [CrossRef] [PubMed]
- Hamshere, M.L.; Langley, K.; Martin, J.; Agha, S.S.; Stergiakouli, E.; Anney, R.J.; Buitelaar, J.; Faraone, S.V.; Lesch, K.P.; Neale, B.M.; et al. High loading of polygenic risk for ADHD in children with comorbid aggression. Am. J. Psychiatry 2013, 170, 909–916. [Google Scholar] [CrossRef] [PubMed]
- Norvilitis, J.M.; Casey, R.J.; Brooklier, K.M.; Bonello, P.J. Emotion appraisal in children with attention-deficit/hyperactivity disorder and their parents. J. Atten. Disord. 2000, 4, 15–26. [Google Scholar]
- Scime, M.; Norvilitis, J.M. Task performance and response to frustration in children with attention deficit hyperactivity disorder. Psychol. Sch. 2006, 43, 377–386. [Google Scholar] [CrossRef]
- Singh, S.D.; Ellis, C.R.; Winton, A.S.; Singh, N.N.; Leung, J.P.; Oswald, D.P. Recognition of facial expressions of emotion by children with attention-deficit hyperactivity disorder. Behav. Modif. 1998, 22, 128–142. [Google Scholar]
- Melnick, S.M.; Hinshaw, S.P. Emotion regulation and parenting in AD/HD and comparison boys: Linkages with social behaviors and peer preference. J. Abnorm. Child Psychol. 2000, 28, 73–86. [Google Scholar] [CrossRef] [PubMed]
- Walcott, C.M.; Landau, S. The relation between disinhibition and emotion regulation in boys with attention deficit hyperactivity disorder. J. Clin. Child Adolesc. Psychol. 2004, 33, 772–782. [Google Scholar] [CrossRef] [PubMed]
- Guth, W.; Schmittenberger, R.; Schwarze, B. An experimental analysis of ultimatum bargaining. J. Econ. Behav. Organ. 1982, 3, 376–388. [Google Scholar] [CrossRef]
- Koenigs, M.; Tranel, D. Irrational economic decision-making after ventromedial prefrontal damage: Evidence from the ultimatum game. J. Neurosci. 2007, 27, 951–956. [Google Scholar] [CrossRef] [PubMed]
- Crockett, M.J.; Clark, L.; Tabibnia, G.; Lieberman, M.D.; Robbins, T.W. Serotonin modulates behavioural reactions to unfairness. Science 2008, 320, 1739. [Google Scholar] [CrossRef] [PubMed]
- Koenigs, M.; Kruepke, M.; Newman, J.P. Economic decision-making in psychopathy: A comparison with ventromedial prefrontal lesion patients. Neuropsychologia 2010, 48, 2198–2204. [Google Scholar] [CrossRef] [PubMed]
- Fishburn, P.C. Utility Theory for Decision Making; Wiley: New York, NY, USA, 1970. [Google Scholar]
- Bolton, G.E.; Zwick, R. Anonymity versus punishment in ultimatum bargaining. Game Econ. Behav. 1995, 10, 95–121. [Google Scholar] [CrossRef]
- Van’t Wout, M.; Kahn, R.S.; Sanfey, A.G.; Aleman, A. Affective state and decision-making in the Ultimatum Game. Exp. Brain Res. 2006, 169, 564–568. [Google Scholar] [CrossRef] [PubMed]
- Pillutla, M.M.; Murnighan, J.K. Unfairness, anger, and spite: Emotional rejections of ultimatum offers. Organ. Behav. Hum. Dec. 1996, 68, 208–224. [Google Scholar] [CrossRef]
- Fehr, E.; Gachter, S. Altruistic punishment in humans. Nature 2002, 415, 137–140. [Google Scholar] [CrossRef] [PubMed]
- Harle, K.M.; Sanfey, A.G. Incidental sadness biases social economic decisions in the Ultimatum Game. Emotion 2007, 7, 876–881. [Google Scholar] [CrossRef] [PubMed]
- Grecucci, A.; Giorgetta, C.; van’t Wout, M.; Bonini, N.; Sanfey, A.G. Reappraising the ultimatum: An fMRI study of emotion regulation and decision making. Cereb. Cortex 2013, 23, 399–410. [Google Scholar] [CrossRef] [PubMed]
- Van’t Wout, M.; Chang, L.J.; Sanfey, A.G. The influence of emotion regulation on social interactive decision-making. Emotion 2010, 10, 815–821. [Google Scholar] [CrossRef] [PubMed]
- Kirk, D.; Gollwitzer, P.M.; Carnevale, P.J. Self-regulation in ultimatum bargaining: Goals and plans help accepting unfair but profitable offers. Soc. Cogn. 2011, 29, 528–546. [Google Scholar] [CrossRef]
- Gospic, K.; Mohlin, E.; Fransson, P.; Petrovic, P.; Johannesson, M.; Ingvar, M. Limbic justice: Amygdala involvement in immediate rejection in the ultimatum game. PLoS Biol. 2011, 9. [Google Scholar] [CrossRef] [PubMed]
- Sanfey, A.G.; Rilling, J.K.; Aronson, J.A.; Nystrom, L.E.; Cohen, J.D. The neural basis of economic decision-making in the ultimatum game. Science 2008, 300, 1755–1758. [Google Scholar] [CrossRef] [PubMed]
- Anderson, S.W.; Barrash, J.; Bechara, A.; Tranel, D. Impairments of emotion and real-world complex behavior following childhood- or adult-onset damage to ventromedial prefrontal cortex. J. Int. Neuropsychol. Soc. 2006, 12, 224–235. [Google Scholar] [CrossRef] [PubMed]
- Barrash, J.; Tranel, D.; Anderson, S.W. Acquired personality disturbances associated with bilateral damage to the ventromedial prefrontal region. Dev. Neuropsychol. 2000, 18, 355–381. [Google Scholar] [CrossRef] [PubMed]
- Berlin, H.A.; Rolls, E.T.; Kischka, U. Impulsivity, time perception, emotion, and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 2004, 127, 1108–1126. [Google Scholar] [CrossRef] [PubMed]
- Grafman, J.; Schwab, K.; Warden, D.; Pridgen, A.; Brown, H.R.; Salazar, A.M. Frontal lobe injuries, violence, and aggression: A report of the Vietnam head injury study. Neurology 1996, 46, 1231–1238. [Google Scholar] [CrossRef] [PubMed]
- Blumer, D.; Benson, D.F. Personality Changes with Frontal and Temporal Lobe Lesions. In Psychiatric Aspects of Neurological Disease; Benson, D.F., Blumer, D., Eds.; Grune and Stratton: New York, NY, USA, 1975; pp. 151–170. [Google Scholar]
- Damasio, A.R.; Tranel, D.; Damasio, H. Individuals with sociopathic behavior caused by frontal damage fail to respond autonomically to social stimuli. Behav. Brain Res. 1990, 41, 81–94. [Google Scholar] [CrossRef]
- Eslinger, P.J.; Damasio, A.R. Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR. Neurology 1985, 35, 1731–1741. [Google Scholar] [CrossRef] [PubMed]
- Vieira, J.B.; Almeida, P.R.; Ferreira-Santos, F.; Barbosa, F.; Marques-Teixeira, J.; Marsh, A.A. Distinct neural activation patterns underlie economic decisions in high and low psychopathy scorers. Soc. Cogn. Affect. Neurosci. 2014, 9, 1099–1107. [Google Scholar] [CrossRef] [PubMed]
- Murnighan, J.K.; Saxon, M.S. Ultimatum bargaining by children and adults. J. Econ. Psychol. 1998, 19, 415–445. [Google Scholar] [CrossRef]
- Harbaugh, W.T.; Krause, K.; Liday, S.G. Bargaining by children. Soc. Sci. Res. Netw. 2003, 2002–2040. [Google Scholar] [CrossRef]
- Hoffman, R.; Tee, J. Adolescent-adult interactions and culture in the ultimatum game. J. Econ. Psychol. 2006, 27, 98–116. [Google Scholar] [CrossRef]
- Brenhouse, H.C.; Andersen, S.L. Developmental trajectories during adolescence in males and females: A cross-species understanding of underlying brain changes. Neurosci. Biobehav. Rev. 2011, 35, 1697–1703. [Google Scholar] [CrossRef] [PubMed]
- Frick, P.J.; Morris, A.S. Temperament and developmental pathways to conduct problems. J. Clin. Child Adolesc. Psychol. 2004, 33, 54–68. [Google Scholar] [CrossRef] [PubMed]
- Burt, S.A.; Donnellan, M.B. Personality correlates of aggressive and non-aggressive antisocial behavior. Personal. Individ. Differ. 2008, 44, 53–63. [Google Scholar] [CrossRef]
- Lahey, B.B.; Waldman, I.D. Annual research review: Phenotypic and causal structure of conduct disorder in the broader context of prevalent forms of psychopathology. J. Child Psychol. Psychiatry 2012, 53, 536–557. [Google Scholar] [CrossRef] [PubMed]
- Hawes, D.J.; Price, M.J.; Dadds, M.R. Callous-unemotional traits and the treatment of conduct problems in childhood and adolescence: A comprehensive review. Clin. Child Fam. Psychol. Rev. 2014, 17, 248–267. [Google Scholar] [CrossRef] [PubMed]
- Frick, P.J.; Ray, J.V.; Thornton, L.C.; Kahn, R.E. Can callous-unemotional traits enhance the understanding, diagnosis, and treatment of serious conduct problems in children and adolescents? A comprehensive review. Psychol. Bull. 2014, 140, 1–57. [Google Scholar] [CrossRef] [PubMed]
- Osumi, T.; Ohira, H. The positive side of psychopathy: Emotional detachment in psychopathy and rational decision-making in the ultimatum game. Personal. Individ. Differ. 2010, 49, 451–456. [Google Scholar] [CrossRef]
- White, S.F.; Brislin, S.J.; Meffert, H.; Sinclair, S.; Blair, R.J.R. Callous-unemotional traits modulate the neural response associated with punishing another individual during social exchange: A preliminary investigation. Personal. Disord. 2013, 27, 99–112. [Google Scholar] [CrossRef] [PubMed]
- Radke, S.; Brazil, I.A.; Scheper, I.; Bulten, B.H.; De Bruijn, E.R. Unfair offers, unfair offenders? Fairness considerations in incarcerated individuals with and without psychopathy. Front. Hum. Neurosci. 2013, 7, 406. [Google Scholar] [CrossRef] [PubMed]
- Achenbach, T.M. Manual for the YSR and 1991 Profile; University of Vermont: Burlington, VT, USA, 1991. [Google Scholar]
- Wechsler, D. Wechsler Abbreviated Scale of Intelligence (WASI); Harcourt: San Antonio, TX, USA, 1999. [Google Scholar]
- Goodman, R.; Ford, T.; Richards, H.; Gatward, R.; Meltzer, H. The development well-being assessment: Description and initial validation of an integrated assessment of child and adolescent psychopathology. J. Child Psychol. Psychiatry 2000, 41, 645–655. [Google Scholar] [CrossRef] [PubMed]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; American Psychiatric Press: Washington, DC, USA, 2000. [Google Scholar]
- World Health Organisation (WHO). Classification of Mental and Behavioural Disorders: Research Diagnostic Criteria, 10th ed.; World Health Organization: Genva, Switzerland, 1992. [Google Scholar]
- Loeber, R.; Burke, J.; Pardini, D.A. Perspectives on oppositional defiant disorder, conduct disorder, and psychopathic features. J. Child Psychol. Psychiatry 2009, 50, 133–142. [Google Scholar] [CrossRef] [PubMed]
- Andershed, H.; Kerr, M.; Stattin, H.; Levander, S. Psychopathic Traits in Nonreferred Youths: A New Assessment Tool. In Psychopaths: Current International Perspectives; Blaauw, E., Sheridan, L., Eds.; Elsevier: The Hague, Netherlands, 2002; pp. 131–158. [Google Scholar]
- Andershed, H.; Hodgins, S.; Tengstrom, A. Convergent validity of the Youth Psychopathic Traits Inventory (YPI): Association with the Psychopathy Checklist: Youth Version (PCL-YV). Assessment 2007, 14, 144–154. [Google Scholar] [CrossRef] [PubMed]
- Skeem, J.L.; Cauffman, E. Views of the downward extension: Comparing the youth version of the Psychopathy Checklist with the Youth Psychopathic Traits Inventory. Behav. Sci. Law 2003, 21, 737–770. [Google Scholar] [CrossRef] [PubMed]
- Goodman, A.; Goodman, R. Strengths and difficulties questionnaire as a dimensional measure of child mental health. J. Am. Acad. Child Adolesc. Psychiatry 2009, 48, 400–403. [Google Scholar] [CrossRef] [PubMed]
- Van der Schalk, J.; Hawk, S.T.; Fischer, A.H.; Doosje, B. Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES). Emotion 2011, 11, 907–920. [Google Scholar] [CrossRef] [PubMed]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Erlbaum: Hillsdale, MG, USA, 1988. [Google Scholar]
- Frick, P.J. Developmental pathways to conduct disorder: Implications for future directions in research, assessment, and treatment. J. Clin. Child Adolesc. Psychol. 2012, 41, 378–389. [Google Scholar] [CrossRef] [PubMed]
- Fehr, E.; Fischbacher, U. The nature of human altruism. Nature 2003, 425, 785–791. [Google Scholar] [CrossRef] [PubMed]
- Knoch, D.; Pascual-Leone, A.; Meyer, K.; Treyer, V.; Fehr, E. Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science 2006, 314, 829–832. [Google Scholar] [CrossRef] [PubMed]
- Civai, C.; Corradi-Dell’Acqua, C.; Gamer, M.; Rumiati, R.I. Are irrational reactions to unfairness truly emotionally-driven? Dissociated behavioural and emotional responses in the Ultimatum Game task. Cognition 2010, 114, 89–95. [Google Scholar] [CrossRef] [PubMed]
- Van den Bos, W.; Vahl, P.; Güroğlu, B.; van Nunspeet, F.; Colins, O.; Markus, M.; Rombouts, S.A.R.B.; van der Wee, N.; Vermeiren, R.; Crone, E.A. Neural correlates of social decision-making in severely antisocial adolescents. Soc. Cogn. Affect. Neurosci. 2014, 9, 2059–2066. [Google Scholar] [CrossRef] [PubMed]
- Sterzer, P.; Stadler, C. Neuroimaging of aggressive and violent behaviour in children and adolescents. Front. Behav. Neurosci. 2009, 3, 35. [Google Scholar] [CrossRef] [PubMed]
- Fairchild, G.; VanGoozen, S.; Stollery, S.; Aitken, M.; Savage, J.; Moore, S.; Goodyer, I. Decision making and executive function in male adolescents with early-onset or adolescence-onset conduct disorder and control subjects. Biol. Psychiatry 2009, 66, 162–168. [Google Scholar] [CrossRef] [PubMed]
- Hampshire, A.; Chamberlain, S.R.; Monti, M.M.; Duncan, J.; Owen, A.M. The role of the right inferior frontal gyrus: Inhibition and attentional control. NeuroImage 2010, 50, 1313–1319. [Google Scholar] [CrossRef] [PubMed]
- Aron, A.R.; Behrens, T.E.; Smith, S.; Frank, M.J.; Poldrack, R.A. Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI. J. Neurosci. 2007, 27, 3743–3752. [Google Scholar] [CrossRef] [PubMed]
- Van Goozen, S.H.; Fairchild, G.; Snoek, H.; Harold, G.T. The evidence for a neurobiological model of childhood antisocial behavior. Psychol. Bull. 2007, 133, 149–182. [Google Scholar] [CrossRef] [PubMed]
- Fairchild, G.; Van Goozen, S.H.; Stollery, S.J.; Goodyer, I.M. Fear Conditioning and Affective Modulation of the Startle Reflex in Male Adolescents with Early-Onset or Adolescence-Onset Conduct Disorder and Healthy Control Subjects. Biol. Psychiatry 2008, 63, 279–285. [Google Scholar] [CrossRef] [PubMed]
- Suveg, C.; Kendall, P.C.; Comer, J.S.; Robin, J. Emotion-focused cognitive-behavioral therapy for anxious youth: A multiple-baseline evaluation. J. Contemp. Psychother. 2006, 36, 77–85. [Google Scholar]
- Kovacs, M.; Sherrill, J.; George, C.J.; Pollock, M.; Tumuluru, R.V.; Ho, V. Contextual emotion-regulation therapy for childhood depression: Description and pilot testing of a new intervention. J. Am. Acad. Child Adolesc. Psychiatry 2006, 45, 892–903. [Google Scholar] [CrossRef] [PubMed]
- Kazdin, A.E.; Siegel, T.C.; Bass, D. Cognitive problem-solving skills training and parent management training in the treatment of antisocial behavior in children. J. Consult. Clin. Psychol. 1992, 60, 733–747. [Google Scholar] [CrossRef] [PubMed]
© 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).