Next Article in Journal
An Integrated Analytical Approach for the Characterization of Probiotic Strains in Food Supplements
Next Article in Special Issue
The Association of Perceived Vulnerability to Disease with Cognitive Restraint and Compensatory Behaviors
Previous Article in Journal
Promoting Protein Intake in an Ageing Population: Product Design Implications for Protein Fortification
Previous Article in Special Issue
Impact of Impulsivity and Therapy Response in Eating Disorders from a Neurophysiological, Personality and Cognitive Perspective
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Are Signals Regulating Energy Homeostasis Related to Neuropsychological and Clinical Features of Gambling Disorder? A Case–Control Study

by
Mikel Etxandi
1,2,†,
Isabel Baenas
1,3,4,†,
Bernat Mora-Maltas
1,4,
Roser Granero
3,4,5,
Fernando Fernández-Aranda
1,3,4,6,
Sulay Tovar
3,7,
Neus Solé-Morata
1,4,
Ignacio Lucas
1,4,
Sabela Casado
3,7,
Mónica Gómez-Peña
1,4,
Laura Moragas
1,4,
Amparo del Pino-Gutiérrez
3,4,8,
Ester Codina
1,
Eduardo Valenciano-Mendoza
1,
Marc N. Potenza
9,10,11,12,13,
Carlos Diéguez
3,7 and
Susana Jiménez-Murcia
1,3,4,6,*
1
Department of Psychiatry, Bellvitge University Hospital-Bellvitge Institute for Biomedical Research (IDIBELL), 08907 Barcelona, Spain
2
Department of Psychiatry, Hospital Universitari Germans Trias i Pujol, IGTP Campus Can Ruti, 08916 Badalona, Spain
3
Ciber Fisiopatología Obesidad y Nutrición (CIBERObn), Instituto de Salud Carlos III, 28029 Madrid, Spain
4
Psychoneurobiology of Eating and Addictive Behaviors Group, Neurosciences Programme, Bellvitge Institute for Biomedical Research (IDIBELL), 08908 Barcelona, Spain
5
Department of Psychobiology and Methodology, Autonomous University of Barcelona, 08193 Barcelona, Spain
6
Department of Clinical Sciences, School of Medicine and Health Sciences, University of Barcelona, 08907 Barcelona, Spain
7
Department of Physiology, CIMUS, Instituto de Investigación Sanitaria, University of Santiago de Compostela, 15782 Santiago de Compostela, Spain
8
Department of Public Health, Mental Health and Perinatal Nursing, School of Nursing, University of Barcelona, 08907 Barcelona, Spain
9
Department of Psychiatry, Yale University School of Medicine, New Haven, CT 06510, USA
10
Child Study Center, Yale University School of Medicine, New Haven, CT 06510, USA
11
Connecticut Mental Health Center, New Haven, CT 06519, USA
12
Connecticut Council on Problem Gambling, Wethersfield, CT 06106, USA
13
Department of Neuroscience, Yale University, New Haven, CT 06520, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Nutrients 2022, 14(23), 5084; https://doi.org/10.3390/nu14235084
Submission received: 19 October 2022 / Revised: 4 November 2022 / Accepted: 24 November 2022 / Published: 29 November 2022

Abstract

:
Gambling disorder (GD) is a modestly prevalent and severe condition for which neurobiology is not yet fully understood. Although alterations in signals involved in energy homeostasis have been studied in substance use disorders, they have yet to be examined in detail in GD. The aims of the present study were to compare different endocrine and neuropsychological factors between individuals with GD and healthy controls (HC) and to explore endocrine interactions with neuropsychological and clinical variables. A case–control design was performed in 297 individuals with GD and 41 individuals without (healthy controls; HCs), assessed through a semi-structured clinical interview and a psychometric battery. For the evaluation of endocrine and anthropometric variables, 38 HCs were added to the 41 HCs initially evaluated. Individuals with GD presented higher fasting plasma ghrelin (p < 0.001) and lower LEAP2 and adiponectin concentrations (p < 0.001) than HCs, after adjusting for body mass index (BMI). The GD group reported higher cognitive impairment regarding cognitive flexibility and decision-making strategies, a worse psychological state, higher impulsivity levels, and a more dysfunctional personality profile. Despite failing to find significant associations between endocrine factors and either neuropsychological or clinical aspects in the GD group, some impaired cognitive dimensions (i.e., WAIS Vocabulary test and WCST Perseverative errors) and lower LEAP2 concentrations statistically predicted GD presence. The findings from the present study suggest that distinctive neuropsychological and endocrine dysfunctions may operate in individuals with GD and predict GD presence. Further exploration of endophenotypic vulnerability pathways in GD appear warranted, especially with respect to etiological and therapeutic potentials.

Graphical Abstract

1. Introduction

Gambling disorder (GD) has been classified as a behavioral addiction (BA) in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) [1], being characterized by recurrent maladaptive gambling behavior, leading to negative consequences in one or more areas of life functioning [2]. Diagnostic criteria include the need to gamble with increasing amounts of money (i.e., tolerance), the tendency to chase losses, irritability when attempting to stop the behavior (i.e., abstinence), the presence of unsuccessful efforts to control gambling behavior, a predominance of thoughts focused on the gambling behavior, the presence of lies or the loss of a significant relationship or job/educational opportunity because of gambling, and the propensity to gamble when feeling distressed or to rely on others to provide money to relieve desperate financial situations caused by gambling [1]. From an etiological perspective, neuroimaging, genetic, and biochemical studies have suggested shared vulnerability factors between addictive-related disorders, such as GD and substance use disorders (SUDs) [3,4]. For instance, dysfunctional neurobiological pathways involved in reward processing [5], which may underlie impulsive and compulsive tendencies, have been described [6].
Several endocrine factors have been implicated in brain responses to rewards and gratification [7,8] including gut hormones (e.g., ghrelin) and adipocytokines (e.g., leptin and adiponectin) [9,10], classically associated with food intake regulation and energy balance [11]. Despite its stimulating appetite role, ghrelin has been described as a hedonic neural reinforcer for natural (e.g., food) and non-natural rewards (e.g., drugs) by its interaction with dopamine signaling in the mesolimbic circuit and other neuroendocrine pathways (e.g., linked to stress, appetite, and metabolic processing) [12]. Ghrelin has been extensively studied in different addictive-related disorders, such as binge eating disorder (BED) and obesity [13,14], as well as in SUDs [15], especially involving alcohol [16,17].
Noticeably, ghrelin up-regulation has been described in SUDs, which positively correlates with craving, abstinence, and relapse [17,18,19]. Accordingly, exogenous ghrelin administration increases craving and drug consumption [9], contrary to ghrelin antagonists [20,21]. An antagonist of ghrelin named liver enriched antimicrobial peptide 2 (LEAP2) has been recently described [22,23]. It has been related to impulsivity and cognitive functioning [24] and may contribute to addictions due to its interplay with ghrelin. Furthermore, genetic alterations related to the ghrelin system, such as receptor polymorphisms, have been associated with reward-seeking behaviors and consumption [25], which together may have potential therapeutic implications [26,27]. In GD, a study by Sztainert et al. [28] suggests ghrelin as a potential predictor of gambling craving and persistence.
Adipocytokines have also been studied in relation to impulsivity [29] and addiction [30,31]. As in the case of regulation of food intake, opposite effects on craving and abstinence have been attributed to leptin compared with ghrelin [32]. Leptin concentrations have been inversely correlated with consumption severity [33], being proposed as a possible biomarker in SUDs involving alcohol and cocaine [10,34]. However, studies regarding alcohol consumption have shown inconsistent results [30], even describing higher leptin concentrations in individuals with alcohol use disorder than in HCs, positively associated with alcohol intake [30,34]. A single study exploring leptin concentrations in GD did not find significant differences compared with those in HCs [35]. Despite there are fewer studies related to adiponectin and addictions, decreased serum concentrations have been reported in obesity with and without eating disorders and in opioid use disorder [14,36]. Adiponectin has also been proposed as a biomarker of craving, like ghrelin, in alcohol use disorder [37]. Similar to other addictive-related disorders, these endocrine substrates represent potential candidates involved in the pathogenesis of BAs, such as GD [35]. However, this area remains underexplored in GD, and further research is needed.
Other neurobiological features linked to addictive-related disorders include impaired neuropsychological processes not only regarding executive functions, such as response inhibition, self-regulation, decision-making, cognitive flexibility, and planning but also working memory [38,39,40,41,42]. These cognitive functions have been described as core symptoms in BAs [39] and are especially related to impulse control [41]. More severe neuropsychological impairment has been described among older patients with GD and preferences for non-strategic gambling [41,43,44]. Neuropsychological impairment has statistically predicted poorer treatment outcome, with more frequent dropout and relapse [41,45].
Beyond neuropsychological factors, other psychological and clinical features have been implicated in the development of addictive disorders [46]. In GD, for example, certain personality traits such as high levels of novelty-seeking (related to impulsivity) and harm avoidance, especially in women [46,47], together with low self-directedness have been linked to both GD and SUDs [48,49]. Difficulties in emotion regulation and poorer psychological states have been linked to GD [50], particularly in women and older individuals with non-strategic gambling [43,44]. A more dysfunctional psychological profile has been associated with greater neuropsychological impairment [41,43,44]. However, studies have largely not explored relationships between different neurobiological features (i.e., endocrine, and neuropsychological factors) and psychological and clinical variables.
To the best of our knowledge, this is the first study that explores the roles of multiple specific signals implicated in addiction and energy homeostasis, meaning food intake and energy expenditure, and clinical and psychological measures among a clinical population with GD. We aimed to explore and compare plasma concentrations of specific metabolic hormones (i.e., leptin, ghrelin, adiponectin, and LEAP2) between patients with GD and HCs. As a second aim, we analyzed correlations between the mentioned endocrine factors and neuropsychological and clinical features. In line with previous literature in addictive disorders, we hypothesized the existence of significant differences in plasma hormonal concentrations between the GD and HC groups. We also hypothesized poorer cognitive functioning, worse psychopathological state, and a more dysfunctional personality profile among individuals with GD. These features were also hypothesized to be related to endocrine alterations, including being able to statistically predict GD presence.

2. Materials and Methods

2.1. Participants

The sample consisted of n = 297 treatment-seeking adult outpatients with GD (93.6% males) with a mean age of 39.58 years (SD = 14.16), voluntarily recruited at the Behavioral Addictions Unit-Psychiatry Department of Bellvitge University Hospital (Barcelona, Spain). As inclusion criteria, all the patients had a diagnosis of GD according to DSM-5 criteria [1]. The HC group was composed by 41 individuals without GD (90.2% males), with a mean age of 49.27 years (SD = 15.23) and was recruited via advertisement from the same catchment area. Regarding anthropometric and endocrine variables, 79 HCs were evaluated by adding to the initial sample 38 healthy adults from CIMUS, University of Santiago de Compostela (Santiago de Compostela, Spain). General exclusion criteria for all participants were the presence of an organic mental disorder, an intellectual disability, a neurodegenerative disorder (such as Parkinson’s disease) or an active psychotic disorder. Recruitment of participants occurred from April 2018 to September 2021, and the evaluation of individuals with GD took place before starting treatment at the Behavioral Addictions Unit-Psychiatry Department of Bellvitge University Hospital (Barcelona, Spain).
Supplementary Materials Table S1 contains the complete description for the participants in the study.

2.2. Measures

2.2.1. Hormonal Assays

Endocrine variables were quantified from peripheral blood sample extraction by venous aspiration with ethylenediamine tetraacetic acid (EDTA; 25 mM final concentration), all samples were collected at 9 am, after at least 8 h of fasting. The blood was centrifuged at 1700 g in a refrigerated centrifuge (4 °C) for 20 min. Plasma was immediately separated from serum and stored at −80 °C until analysis. Parameter determinations were conducted using commercial kits according to the manufacturer’s instructions and in a single analysis to reduce inter-assay variability. The quantitative measurement of LEAP-2 in plasma was performed using a commercial enzyme-linked immunosorbent assay (ELISA) kit (Human LEAP-2 [37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76] ELISA kit, Phoenix Pharmaceuticals, Inc., Burlingame, CA, USA), previously validated [51,52]. Intra-assay and inter-assay variation coefficients were <10% and <15%, respectively. The assay sensitivity limit was 0.15 ng/mL. Total ghrelin (pg/mL) was measured by ELISA kit (Invitrogen-Thermo Fisher Scientific, Madrid, Spain) for detection of human ghrelin, with a specificity of 100%. Intra-assay variation coefficient was <6% and inter-assay <8.5%. The assay sensitivity limit was 11.8 pg/mL [53]. Adiponectin (ng/mL) and leptin (ng/mL) plasma measurements were performed using a solid-phase sandwich ELISA kit (Invitrogen-Thermo Fisher Scientific, Madrid, Spain) with a specificity of 100%. Intra-assay and inter-assay variation coefficients were <4% and <5%, respectively, and assay sensitivity limit was 100 pg/mL for adiponectin and <3.5 pg/mL for leptin. The absorbance from each sample was measured in duplicate using a spectrophotometric microplate reader at a wavelength of 450 nm (Epoch 2 microplate reader, Biotek Instruments, Inc., Winooski, VT, USA).

2.2.2. Neuropsychological Variables

Iowa Gambling Task (IGT) [54]. A computerized task to evaluate decision-making, risk, reward, and punishment value. The participant must select 100 cards from four decks (i.e., A, B, C, and D), and after each card selection, an output is given either a gain or a loss of money. The participant is instructed that the aim of the task is to win as much money as possible. This test is scored by subtracting the number of cards selected from decks A and B from the number of cards selected from decks C and D. While decks A and B are not advantageous as the final loss is higher than the final gain, decks C and D are advantageous since the punishments are smaller. Higher scores point to better performance, while negative scores point to persistently choosing disadvantageous decks.
Wisconsin Card Sorting Test (WCST) [55] is a task for assessing cognitive flexibility and inhibitory control, composed of four stimulus cards and 128 response cards showing different shapes, colors, and numbers of figures in each one. The participant must match response cards with the stimulus cards in a way that it seems justifiable before receiving the feedback (i.e., correct, or incorrect). After ten sequential correct answers the categorization criteria changes. The number of complete categories, percentage of perseverative errors, and percentage of non-perseverative errors are recorded.
Stroop Color and Word Test (SCWT) [56] consists of three different lists, beginning with a word list containing the names of colors printed in black ink; then, a color list that comprises letter “X” printed in color; and, finally, a color-word list constituted of names of colors in a color ink that does not match the written name. Three final scores are obtained based on the number of items that the participant can read on naming on each list in 45 s. It assesses the ability to inhibit cognitive interference, which occurs when the processing of a stimulus feature affects the simultaneous processing of another attribute of the same stimulus.
Trail Making Test (TMT) [57] consists of 25 circles spread out over two sheets of paper (Parts A and B). The participant is told to connect these circles drawing a line between consecutive numbers (part A) and alternating numbers and letters following a sequential order (part B). The task assesses visual conceptual and visual-motor tracking, entailing motor speed, attention, and the capacity to alternate between cognitive categories (set-shifting). Each part is scored according to the spent time to complete the task.
Digits backward task of the Wechsler Memory Scale-Third Edition (WMS-III) [58] consists of two lists of digits presented verbally by the examiner. The participant is asked to repeat the digits in the same order (first list) and in reverse order (second list). It assesses verbal working memory due to internal manipulation of mnemonic representations of verbal information that is required in the absence of external cues.
Vocabulary subtest of the Wechsler Adult Intelligence Scale, 3rd ed. (WAIS-III) [59] requires defining words of increasing difficulty orally presented, to assess the vocabulary expression and to estimate intellectual capacity [60].

2.2.3. Clinical Variables

South Oaks Gambling Screen (SOGS) [61], Spanish validation [62], is a 20-item instrument for screening past-year gambling problems and related negative consequences. The total score is a measure of problem-gambling severity, with a score of five or more suggestive of “probable pathological gambling”. Its internal consistency in the study sample was Cronbach’s alpha (α) = 0.735.
Diagnostic Questionnaire for Pathological Gambling According to DSM criteria [63], Spanish validation [64], is a self-report questionnaire with 19 items coded in a binary fashion (yes-no), used for diagnosing GD according to the DSM-IV-TR and DSM-5 criteria [1]. Its internal consistency in the study sample was α = 0.796.
Symptom Checklist-90-Revised (SCL-90-R) [65], Spanish validation [66], is a 90-item self-report questionnaire measured on an ordinal 3-point scale, evaluating a broad range of psychological problems and psychopathology, based on nine primary symptomatic dimensions (Somatization, Obsession–Compulsion, Interpersonal Sensitivity, Depression, Anxiety, Hostility, Phobic Anxiety, Paranoid Ideation, and Psychoticism). It includes three global indices (global severity index, positive symptom distress index, and total positive symptom). The internal consistency in the study was α = 0.979.
Temperament and Character Inventory-Revised (TCI-R) [67], Spanish validation [68], is a questionnaire with 240-items scored on a 5-point Likert scale, measuring personality derived from three character dimensions (Self-Directedness, Cooperativeness, and Self-Transcendence) and four temperament dimensions (Harm Avoidance, Novelty Seeking, Reward Dependence, and Persistence). It is used only for research purposes in a public non-profit hospital, in its Spanish adaptation in which the original author participated [68]. The internal consistency in the study was between α = 0.702 (Novelty Seeking) and α = 0.876 (Persistence).
Impulsive Behavior Scale (UPPS-P) [69], Spanish validation [70], measures five facets of impulsive behavior through self-report on 59 items: negative urgency; positive urgency; lack of premeditation; lack of perseverance; and sensation-seeking. The internal consistency in the study was between α = 0.799 (lack of perseverance) and α = 0.928 (positive urgency).

2.2.4. Other Variables

Additional data (e.g., socio-demographic, socio-economic, anthropometric variables, and GD-related characteristics) were collected in a semi-structured face-to-face clinical interview as described elsewhere [71].

2.3. Procedure

All patients and HCs from the same catchment area were evaluated at the Behavioral Addictions Unit-Psychiatry Department of Bellvitge University Hospital (Barcelona, Spain), by an expert multidisciplinary team in the field of GD. In the first session, a comprehensive semi-structured clinical interview was conducted, in which all aspects related to gambling behavior were assessed. During the second session, the extraction of blood samples occurred. Samples were analyzed in CIMUS, University of Santiago de Compostela (Santiago de Compostela, Spain), where 38 out of 79 HCs were evaluated regarding endocrine and anthropometric measures. The neuropsychological assessment was performed in a third session.

2.4. Statistical Analysis

The statistical analysis was conducted with Stata17 for Windows [72]. Comparison between groups (GD versus HC) were made by Analysis of Covariance (ANCOVA), adjusting for sex, age, and body mass index (BMI) for endocrine variables, and adjusting for sex, age, and education level for neuropsychological variables. The effect size for the mean comparisons was obtained with the standardized Cohen’s-d, considering moderate-mild effect values 0.50 < |d| < 0.80 and high-large effect values |d| > 0.80 [73].
Associations between endocrine and neuropsychological and clinical variables were estimated with partial correlation coefficients, adjusting for sex, age, and BMI (associations with the neuropsychological tasks also included adjustment for the education level). Due to strong associations between the null-significance test for the correlation models given the sample sizes (low correlations achieve significance in large samples, and vice versa), in this study mild-moderate correlation was considered for values |R| > 0.24 and high-large correlation for values |R| > 0.37 [74].
A predictive model was obtained to select the variables with discriminative capacity to identify the presence of GD, through logistic regression. The criterion for the modeling was the diagnosis of GD (presence/absence), and potential predictors included sociodemographic measures, global psychopathological distress, impulsivity levels, personality features, and neuropsychological and endocrine measures. A stepwise selection method was used to automatically select significant contributors. Sex, age, and BMI were included as adjustment/covariables. The goodness-of-fit was measured with the Hosmer–Lemeshow test, the overall predictive capacity with the Cox-Snell’s pseudo-R2, and the overall discriminative capacity with the area under the Receiver Operating Curve (ROC).
In this study, the increase in the Type-I error due to the performance of multiple significance tests was controlled with the familywise error Finner’s procedure, which has shown greater efficiency than the classic Bonferroni adjustment method [75].

3. Results

3.1. Comparison of Endocrine Measures

Adjusting for sex, age, and BMI, the GD group reported higher ghrelin and lower LEAP2 and adiponectin values compared with HCs (Table 1 and first panel of Figure 1). No differences were found regarding leptin values.

3.2. Comparison of Neuropsychological and Clinical Measures

ANCOVAs comparing the mean values of the neuropsychological measures and clinical variables are displayed in Table 2 (see also second panel of Figure 1). Compared to HCs, the GD group displayed worse performance on the WCST, WAIS-vocabulary test, and performance-learning curve during IGT performance (Figure 2). The GD group also reported worse psychopathological states (higher mean scores on the SCL-90 R), higher impulsivity (except on the UPPS-P sensation-seeking scale) and more dysfunctional personality profiles (except on the TCI-R persistence scale).

3.3. Associations between Endocrine Variables and Neuropsychological and Clinical Measures

Supplementary Materials Table S2 displays the partial correlation matrix between the endocrine profile with neuropsychological and clinical variables (psychopathology, impulsivity, and problem-gambling severity). No relevant associations were found within the GD subsample. Among HCs, lower ghrelin values were related to higher values on the IGT-block 5 and, on the WCST scales, number of trials and number of perseverative errors. Higher LEAP2 values were associated with worse psychological states and poorer performance on the TMT, Stroop task, and WMS digits-direct task. Higher leptin was also related to higher levels of phobic anxiety and worse performance on the IGT, WCST conceptual portion, and TMT. Finally, higher adiponectin values were correlated with lower scores on the UPPS-P lack of premeditation scale, and worse performance on the WMS direct and total scales.

3.4. Predictive Model for GD Presence

Table 3 shows the results of the logistic regression. The likelihood of being identified as GD was higher for individuals with lower education levels, lower social position indexes, greater psychopathological distress, higher impulsivity, lower self-transcendence, worse neuropsychological performance (specifically for WCST perseverative errors and on the Stroop color and WAIS vocabulary tasks), and lower LEAP2 levels.

4. Discussion

The present work studied gut hormones and adipocytokines, based on their association with reward and impulsive–compulsive processes, in people with GD compared with HCs. Likewise, neuropsychological, and clinical features were also evaluated, as well as its relationship with endocrine factors. Individuals with GD presented altered endocrine profiles compared to HCs, and regardless of BMI, were characterized by higher plasma ghrelin and lower LEAP2 and adiponectin concentrations, without significant differences in leptin levels. A worse neuropsychological performance, higher emotion dysregulation, greater psychopathological scores, higher impulsivity, and a more dysfunctional personality profile were also described in individuals with GD. Although significant correlations between endocrine factors and neuropsychological and clinical features were largely lacking, some neuropsychological domains and lower LEAP2 concentrations predicted GD presence. Implications are described below.
Increased plasma ghrelin concentrations in patients with GD seem consistent with results in SUDs, where ghrelin upregulation has been described [17,18], These findings suggest not only that this hormone could be involved in addictive processes [76] but also shared neurobiological substrates [3,4]. Despite not predicting GD presence, ghrelin up-regulation could speculatively contribute to maintenance of gambling due to its reinforcing properties [28], as well as being a risk factor for relapse, related to intensify craving [28]. If such possibilities received empirical support, similar to in SUDs, they may have important therapeutic implications for GD [27].
Although this is the first study to explore LEAP2 in GD, lower concentrations among individuals with GD suggest a possible dysfunction in the ghrelin system also involving LEAP2. The findings raise the intriguing possibility as to whether altered ghrelin production may influence LEAP2 release, supporting LEAP2 antagonism [22] and favoring lower LEAP2 concentrations. Moreover, both ghrelin and LEAP2 concentrations are subject to BMI in both animals and humans but in opposite ways [52]. Thus, persistent differences in ghrelin and LEAP2 after adjustment by BMI between groups, together with the finding that lower LEAP2 concentrations statistically predicted the presence of GD, suggest that these potential disturbances may be intrinsically associated with GD. Going one step further, our results raise the question of whether LEAP2 could be a potential therapeutic target in GD and other addictive-related disorders because of the neutralization of ghrelin’s possibly deleterious actions in craving, abstinence, and relapse. However, as LEAP2 has only been recently described and there is lack of extensive or consistent data in the literature, future research is needed [22].
The results regarding adiponectin agree with those reported in other addictive disorders [14,37]. Some protective functions have been linked to adiponectin, such as anti-inflammatory, anti-diabetic, and anti-atherogenic properties [77]. Thus, the results may in part explain a neurobiological basis for a worse metabolic state and a higher cardiometabolic risk associated with addiction, including individuals with GD, who had a significant higher BMI than HCs in our sample [77]. Speculatively, they may also in part explain incident cardiovascular conditions in relation to GD symptomatology in older adults [78]. Interestingly, our findings support the previous work by Geisel et al. [35], regarding leptin concentrations in GD. On the one hand, intrinsic compensatory mechanisms exist associated with endocrine dysfunctions in addiction, based on changes in receptors’ activity and/or hormones’ biosynthesis [79], which may be a possible rationale to explain the lack of differences between individuals with GD and HCs. Nevertheless, due to the heterogeneous methodology and mixed conclusions described in other addictive disorders, as well as limited work in GD, further studies are lacking to replicate these extend the current results.
Regarding neuropsychological performance, patients with GD had poorer cognitive flexibility and more perseverative errors than HCs, in line with previous findings [80]. Although we failed to find significant differences in the IGT trials, the GD group showed numerically less learning on the task, which may suggest a potential worse decision-making performance [41]. However, given the absence of statistically significant differences, the findings also resonate with prior reports showing similar patterns but no group differences in independent samples [81].
Patients with GD presented poorer estimated cognitive reserves compared to HCs. Lower scores on intellectual performance scales may be associated with a greater tendency to make risky decisions and may thus be a potential risk factor for the development of GD [82]. As a distinguishing finding, worse performance on the WAIS Vocabulary and WCST Perseverative errors predicted the presence of GD. Taken together, the results are in line with previous research suggesting that compulsive responding is in part mediated by impulsive decisions [39], since perseverative behavior has been “normalized” when feedback-response pause is increased in cognitive flexibility tasks [83]. One possibility is that low cognitive reserve may promote impulsivity, leading to an increase in perseverative behaviors in patients with GD. Even though significant correlations between endocrine and neuropsychological factors were largely absent, it may be worth further investigating possible common links based on relationships with reward-related neurocircuitry [84].
Patients with GD scored higher on general psychopathology and impulsivity measures [85], with more dysfunctional personality features (i.e., higher novelty-seeking and harm avoidance and lower reward dependence, self-directedness, cooperativeness, and self-transcendence) [85]. This profile has been linked to younger age of GD onset and problem-gambling severity [86,87]. Particularly, in our study, lower self-transcendence, and younger age, described as a possible risk factor of GD [2] also predicted the presence of GD. Self-transcendence seems to be a protective factor delaying the age of GD onset [86,88]. On the other hand, younger age has been positively linked to earlier GD onset, male sex, and higher novelty-seeking, and therefore, with problem-gambling severity [89]. Socio-demographic differences related to educational and socio-economic levels aligned with previous studies of our group [85]. From a social perspective, having a lower educational status and less social support have been previously implicated in GD [90].
Newly, relationships between endocrine and clinical variables were largely not observed. However, some previous studies revealed a relationship of appetite-related hormones with impulsivity domains and mood regulation [29,91]. Considering the complexity of addictive disorders and the limitations of cross-sectional studies, prospective studies with larger samples are warranted to understand better relationships over time.

Limitations and Strengths

Some limitations should be mentioned. As the cross-sectional nature of this study limits causal attributions, future longitudinal studies are needed to better understand the involvement of neuroendocrine alterations and their roles in GD. Moreover, endocrine measurements were analyzed from peripheral blood samples, which could limit the inference of their functioning at a neural level. The lower number of individuals in the HC group with respect to the GD group may also limit the interpretation of the results, studies with a larger sample size are necessary to confirm the findings. Moreover, the GD group was principally composed of treatment-seeking males referred to a specialized unit in Catalonia, Spain. As such, studies of other compositions from other jurisdictions are warranted to determine generalizability of the results. Nonetheless, the representation of women in the study is consistent with the prevalence estimates in clinical treatment-seeking samples in GD, and comparable to their frequency in the control group. On the other hand, other strengths of this work is an adequate sample size, the well-characterized clinical and neuropsychological profile of both groups, and the adjustment in models for potentially confounding factors.

5. Conclusions

The present study provides evidence about underlying neuropsychological and endocrine dysfunctions related to reward processing in GD. The results have identified specific endocrine, neuropsychological, and clinical factors statistically predicting the presence of GD. Despite the cross-sectional design, this study supports a multifactorial nature of GD. Additionally, it supports the existence of potential neurobiological targets, known for involvement in other addictive disorders, with possible therapeutic implications. Hence, future research in this area may contribute to the development of more specific psychological and biological treatment strategies in GD.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/nu14235084/s1, Table S1: Characteristics of the sample; Table S2: Partial correlation matrix.

Author Contributions

M.E., I.B., B.M.-M. and S.J.-M. contributed to the development of the study concept and design. R.G. performed the statistical analysis. M.E., I.B., M.G.-P., L.M., A.d.P.-G., B.M.-M., E.V.-M. and S.J.-M. aided with data collection. I.B., A.d.P.-G., E.C., S.T., S.C. and C.D. carried out the procedures related to blood extraction and hormone analysis. M.E., I.B., B.M.-M., N.S.-M. and S.J.-M. aided in the interpretation of data and the writing of the manuscript. F.F.-A., M.N.P., C.D., S.J.-M. and I.L. revised the manuscript and provided substantial comments. F.F.-A. and S.J.-M. obtained funding. All authors have read and agreed to the published version of the manuscript.

Funding

CERCA Programme / Generalitat de Catalunya gave institutional support. This work was additionally supported by a grant from the Ministerio de Ciencia, Innovación y Universidades (grant RTI2018-101837-B-100), the Delegación del Gobierno para el Plan Nacional sobre Drogas (2019I47 and 2021I031), and Instituto de Salud Carlos III (ISCIII) (PI17/01167, PI20/00132) and co-funded by FEDER funds/European Regional Development Fund (ERDF), a way to build Europe. CIBERobn is an initiative of ISCIII. I.B. was partially supported by a Post-Residency Grant from the Research Committee of the University Hospital of Bellvitge (HUB; Barcelona, Spain) 2020–2021. This study has been also funded by Instituto de Salud Carlos III through the grant CM21/00172 (Co-funded by European Social Fund. ESF investing in your future). R.G. is supported by the Catalan Institution for Research and Advanced Studies (ICREA-Academia, 2021-Programme). M.N.P. was supported by the Connecticut Council on Problem Gambling. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Institutional Review Board Statement

The latest version of the Declaration of Helsinki was used to conduct the present study. The Clinical Research Ethics Committee of the Bellvitge University Hospital approved this study (ref. PR329/19 and PR338/17), as part of the scientific production within national and competitive research projects developed by our research group (RTI2018-101837-B-I00; 2017I067, 2019I47, and 2021I031).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Individuals may inquire with Jiménez-Murcia regarding the availability of the data as there are ongoing studies using the data. To avoid overlapping research efforts, Jiménez-Murcia will consider requests on a case-by-case basis.

Acknowledgments

We thank CERCA Programme/Generalitat de Catalunya for the institutional support. We also thank the Ministerio de Ciencia, Innovación y Universidades and the Delegación del Gobierno para el Plan Nacional sobre Drogas, Instituto de Salud Carlos III (ISCIII), CIBERobn (initiative of ISCIII), FEDER funds/European Regional Development Fund (ERDF), a way to build Europe, the European Social Fund-ESF investing in your future, and Bellvitge Biomedical Research Institute (IDIBELL).

Conflicts of Interest

Authors Mikel Etxandi, Isabel Baenas, Bernat Mora-Malta, Roser Granero, Sulay Tovar, Neus Solé-Morata, Ignacio Lucas, Mónica Gómez-Peña, Laura Moragas, Amparo del Pino-Gutiérrez, Ester Codina, Eduardo Valenciano-Mendoza, Sabela Casado, Carlos Diéguez, and Susana Jiménez-Murcia declare that they have no conflicts of interest. Marc N. Potenza has consulted for and advised Opiant Pharmaceuticals, Idorsia Pharmaceuticals, Baria-Tek, AXA, Game Day Data and the Addiction Policy Forum; has been involved in a patent application with Yale University and Novartis; has received research support from the Mohegan Sun Casino and Connecticut Council on Problem Gambling; has participated in surveys, mailings, or telephone consultations related to drug addiction, impulse control disorders, or other health topics; and has consulted for law offices and gambling entities on issues related to impulse control or addictive disorders. Fernando Fernández-Aranda received consultancy honoraria from Novo Nordisk and editorial honoraria as EIC from Wiley.

References

  1. APA American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders; American Psychiatric Publishing: Washington, DC, USA, 2013. [Google Scholar]
  2. Potenza, M.N.; Balodis, I.M.; Derevensky, J.; Grant, J.E.; Petry, N.M.; Verdejo-Garcia, A.; Yip, S.W. Gambling disorder. Nat. Rev. Dis. Prim. 2019, 5, 51. [Google Scholar] [CrossRef] [PubMed]
  3. Solé-Morata, N.; Baenas, I.; Etxandi, M.; Granero, R.; Forcales, S.V.; Gené, M.; Barrot, C.; Gómez-Peña, M.; Menchón, J.M.; Ramoz, N.; et al. The role of neurotrophin genes involved in the vulnerability to gambling disorder. Sci. Rep. 2022, 12, 1–11. [Google Scholar] [CrossRef]
  4. Linnet, J. The anticipatory dopamine response in addiction: A common neurobiological underpinning of gambling disorder and substance use disorder? Prog. Neuropsychopharmacol. Biol. Psychiatry 2020, 98, 109802. [Google Scholar] [CrossRef] [PubMed]
  5. Shevchouk, O.T.; Tufvesson-Alm, M.; Jerlhag, E. An Overview of Appetite-Regulatory Peptides in Addiction Processes; From Bench to Bed Side. Front. Neurosci. 2021, 15, 774050. [Google Scholar] [CrossRef] [PubMed]
  6. Lüscher, C.; Robbins, T.W.; Everitt, B.J. The transition to compulsion in addiction. Nat. Rev. Neurosci. 2021, 21, 247–263. [Google Scholar] [CrossRef] [PubMed]
  7. Geisel, O.; Panneck, P.; Hellweg, R.; Wiedemann, K.; Müller, K.A. Hypothalamic-pituitary-adrenal axis activity in patients with pathological gambling and internet use disorder. Psychiatry Res. 2015, 226, 97–102. [Google Scholar] [CrossRef]
  8. Pettorruso, M.; Zoratto, F.; Miuli, A.; De Risio, L.; Santorelli, M.; Pierotti, A.; Martinotti, G.; Adriani, W.; di Giannantonio, M. Exploring dopaminergic transmission in gambling addiction: A systematic translational review. Neurosci. Biobehav. Rev. 2020, 119, 481–511. [Google Scholar] [CrossRef]
  9. Farokhnia, M.; Grodin, E.N.; Lee, M.R.; Oot, E.N.; Balckburn, A.N.; Stangl, B.L.; Schwandt, M.L.; Farinelli, L.A.; Momenan, R.; Ramchandani, V.A.; et al. Exogenous ghrelin administration increases alcohol self-administration and modulates brain functional activity in heavy-drinking alcohol-dependent individuals. Mol. Psychiatry 2018, 23, 2029–2038. [Google Scholar] [CrossRef]
  10. Martinotti, G.; Montemitro, C.; Baroni, G.; Andreoli, S.; Alimonti, F.; Di Nicola, M.; Tonioni, F.; Leggio, L.; di Giannantonio, M.; Janiri, L. Relationship between craving and plasma leptin concentrations in patients with cocaine addiction. Psychoneuroendocrinology 2017, 85, 35–41. [Google Scholar] [CrossRef]
  11. Iovino, M.; Messana, T.; Lisco, G.; Mariano, F.; Giagulli, V.A.; Guastamacchia, E.; De Pergola, G.; Triggiani, V. Neuroendocrine modulation of food intake and eating behavior. Endocr. Metab. Immune Disord. Drug Targets 2022, 22. [Google Scholar] [CrossRef]
  12. Revitsky, A.R.; Klein, L.C. Role of ghrelin in drug abuse and reward-relevant behaviors: A burgeoning field and gaps in the literature. Curr. Drug Abuse Rev. 2013, 6, 231–244. [Google Scholar] [CrossRef]
  13. Micioni Di Bonaventura, E.; Botticelli, L.; Del Bello, F.; Giorgioni, G.; Piergentili, A.; Quaglia, W.; Cifani, C.; Micioni Di Bonaventura, M.V. Assessing the role of ghrelin and the enzyme ghrelin O-acyltransferase (GOAT) system in food reward, food motivation, and binge eating behavior. Pharmacol. Res. 2021, 172, 105847. [Google Scholar] [CrossRef] [PubMed]
  14. Yu, Y.; Fernandez, I.D.; Meng, Y.; Zhao, W.; Groth, S.W. Gut hormones, adipokines, and pro- and anti-inflammatory cytokines/markers in loss of control eating: A scoping review. Appetite 2021, 166, 105442. [Google Scholar] [CrossRef] [PubMed]
  15. Sustkova-Fiserova, M.; Charalambous, C.; Khryakova, A.; Certilina, A.; Lapka, M.; Šlamberová, R. The Role of Ghrelin/GHS-R1A Signaling in Nonalcohol Drug Addictions. Int. J. Mol. Sci. 2022, 23, 761. [Google Scholar] [CrossRef]
  16. Koopmann, A.; Schuster, R.; Kiefer, F. The impact of the appetite-regulating, orexigenic peptide ghrelin on alcohol use disorders: A systematic review of preclinical and clinical data. Biol Psychol. 2018, 131, 13–40. [Google Scholar] [CrossRef]
  17. Leggio, L.; Ferrulli, A.; Cardone, S.; Nesci, A.; Micelo, A.; Malandrino, N.; Capristo, E.; Canestrelli, B.; Monteleone, P.; Kenna, G.A.; et al. Ghrelin system in alcohol-dependent subjects: Role of plasma ghrelin levels in alcohol drinking and craving. Addict. Biol. 2012, 17, 452–464. [Google Scholar] [CrossRef] [PubMed]
  18. Addolorato, G.; Capristo, E.; Leggio, L.; Ferulli, A.; Abenavoli, L.; Malandrino, N.; Farnetti, S.; Domenicali, M.; D’Angelo, C.; Vonghia, L.; et al. Relationship between ghrelin levels, alcohol craving, and nutritional status in current alcoholic patients. Alcohol. Clin. Exp. Res. 2006, 30, 1933–1937. [Google Scholar] [CrossRef]
  19. Tessari, M.; Catalano, A.; Pellitteri, M.; Di Francesco, C.; Marini, F.; Gerrard, P.A.; Heidbreder, C.A.; Melotto, S. Correlation between serum ghrelin levels and cocaine-seeking behaviour triggered by cocaine-associated conditioned stimuli in rats. Addict Biol. 2007, 12, 22–29. [Google Scholar] [CrossRef] [PubMed]
  20. Edvardsson, C.E.; Vestlund, J.; Jerlhag, E. A ghrelin receptor antagonist reduces the ability of ghrelin, alcohol, or amphetamine to induce a dopamine release in the ventral tegmental area and in nucleus accumbens shell in rats. Eur. J. Pharmacol. 2021, 899, 174039. [Google Scholar] [CrossRef]
  21. Suchankova, P.; Steensland, P.; Fredriksson, I.; Engel, J.A.; Jerlhag, E. Ghrelin Receptor (GHS-R1A) Antagonism Suppresses Both Alcohol Consumption and the Alcohol Deprivation Effect in Rats following Long-Term Voluntary Alcohol Consumption. PLoS ONE 2013, 8, e71284. [Google Scholar] [CrossRef]
  22. Ge, X.; Yang, H.; Bednarek, M.A.; Galon-Tilleman, H.; Chen, P.; Chen, M.; Lichtman, J.S.; Wang, L.; Dalmas, O.; Yin, Y.; et al. LEAP2 Is an Endogenous Antagonist of the Ghrelin Receptor. Cell Metab. 2018, 27, 461–469.e6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Lugilde, J.; Casado, S.; Beiroa, D.; Cuñarro, J.; García-Lavandeira, M.; Álvarez, C.V.; Nogueiras, R.; Tovar, S.; Diéguez, C. LEAP-2 Counteracts Ghrelin-Induced Food Intake in a NutrientGrowth Hormone and Age Independent Manner. Cells 2022, 11, 324. [Google Scholar] [CrossRef] [PubMed]
  24. Voigt, K.; Giddens, E.; Stark, R.; Frisch, E.; Moskovsky, N.; Kakoschke, N.; Stout, J.C.; Bellgrove, M.A.; Andrews, Z.B.; Verdejo García, A. The hunger games: Homeostatic state-dependent fluctuations in disinhibition measured with a novel gamified test battery. Nutrients 2021, 13, 2001. [Google Scholar] [CrossRef] [PubMed]
  25. Zallar, L.J.; Beurmann, S.; Tunstall, B.J.; Fraser, C.M.; Koob, G.F.; Vendruscolo, L.F.; Leggio, L. Ghrelin receptor deletion reduces binge-like alcohol drinking in rats. J. Neuroendocrinol. 2019, 31, e12663. [Google Scholar] [CrossRef] [PubMed]
  26. Engel, J.A.; Jerlhag, E. Role of appetite-regulating peptides in the pathophysiology of addiction: Implications for pharmacotherapy. CNS Drugs 2014, 28, 875–886. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Farokhnia, M.; Lee, M.R.; Farinelli, L.A.; Ramchandani, V.; Akhlaghi, F.; Leggio, L. Pharmacological manipulation of the ghrelin system and alcohol hangover symptoms in heavy drinking individuals: Is there a link? Pharmacol. Biochem. Behav. 2018, 172, 39–49. [Google Scholar] [CrossRef]
  28. Sztainert, T.; Hay, R.; Wohl, M.J.A.; Abizaid, A. Hungry to gamble? Ghrelin as a predictor of persistent gambling in the face of loss. Biol. Psychol. 2018, 139, 115–123. [Google Scholar] [CrossRef]
  29. Sutin, A.R.; Zonderman, A.B.; Uda, M.; Deiana, B.; Taub, D.D.; Longo, D.L.; Ferrucci, L.; Schlessinger, D.; Cucca, F.; Terracciano, A. Personality traits and leptin. Psychosom. Med. 2013, 75, 505–509. [Google Scholar] [CrossRef] [Green Version]
  30. Bach, P.; Koopmann, A.; Kiefer, F. The Impact of Appetite-Regulating Neuropeptide Leptin on Alcohol Use, Alcohol Craving and Addictive Behavior: A Systematic Review of Preclinical and Clinical Data. Alcohol Alcohol. 2021, 56, 149–165. [Google Scholar] [CrossRef]
  31. Peters, T.; Antel, J.; Föcker, M.; Esber, S.; Hinney, A.; Schéle, E.; Dickson, S.L.; Albayrak, O.; Hebebrand, J. The association of serum leptin levels with food addiction is moderated by weight status in adolescent psychiatric inpatients. Eur. Eat Disord. Rev. 2018, 26, 618–628. [Google Scholar] [CrossRef]
  32. Bach, P.; Bumb, J.M.; Schuster, R.; Vollstädt-Klein, S.; Reinhard, I.; Rietschel, M.; Witt, S.H.; Wiedemann, K.; Kiefer, F.; Koopmann, A. Effects of leptin and ghrelin on neural cue-reactivity in alcohol addiction: Two streams merge to one river? Psychoneuroendocrinology 2019, 100, 1–9. [Google Scholar] [CrossRef] [PubMed]
  33. Escobar, M.; Scherer, J.N.; Ornell, F.; Bristot, G.; Medino-Soares, C.; Pinto-Guimarães, L.S.; Von Diemen, L.; Pechansky, F. Leptin levels and its correlation with crack-cocaine use severity: A preliminary study. Neurosci. Lett. 2018, 671, 56–59. [Google Scholar] [CrossRef] [PubMed]
  34. Mehta, S.; Baruah, A.; Das, S.; Avinash, P.; Chetia, D.; Gupta, D. Leptin levels in alcohol dependent patients and their relationship with withdrawal and craving. Asian J. Psychiatr. 2020, 51, 101967. [Google Scholar] [CrossRef] [PubMed]
  35. Geisel, O.; Hellweg, R.; Wiedemann, K.; Müller, C.A. Plasma levels of leptin in patients with pathological gambling, internet gaming disorder and alcohol use disorder. Psychiatry Res. 2018, 268, 193–197. [Google Scholar] [CrossRef]
  36. Shahouzehi, B.; Shokoohi, M.; Najafipour, H. The effect of opium addiction on serum adiponectin and leptin levels in male subjects: A case control study from Kerman Coronary Artery disease risk factors study (KERCADRS). EXCLI J. 2013, 12, 916. [Google Scholar]
  37. Hillemacher, T.; Weinland, C.; Heberlein, A.; Gröschl, M.; Schanze, A.; Frieling, H.; Wilhelm, J.; Kornhuber, J.; Bleich, S. Increased levels of adiponectin and resistin in alcohol dependence--possible link to craving. Drug Alcohol. Depend. 2009, 99, 333–337. [Google Scholar] [CrossRef]
  38. Lozano-Madrid, M.; Bryan, D.C.; Granero, R.; Sánchez, I.; Riesco, N.; Mallorquí-Bagué, N.; Jiménez-Murcia, S.; Treasure, J.; Fernández-Aranda, F. Impulsivity, emotional dysregulation, and executive function deficits could be associated with alcohol and drug abuse in eating disorders. J. Clin. Med. 2020, 9, 1936. [Google Scholar] [CrossRef]
  39. van Timmeren, T.; Daams, J.G.; van Holst, R.J.; Goudriaan, A.E. Compulsivity-related neurocognitive performance deficits in gambling disorder: A systematic review and meta-analysis. Neurosci. Biobehav. Rev. 2018, 84, 204–217. [Google Scholar] [CrossRef]
  40. Hinson, J.M.; Jameson, T.L.; Whitney, P. Impulsive decision making and working memory. J. Exp. Psychology. Learn. Mem. Cogn. 2003, 29, 298–306. [Google Scholar] [CrossRef]
  41. Mallorquí-Bagué, N.; Tolosa-Sola, I.; Fernández-Aranda, F.; Granero, R.; Fagundo, A.B.; Lozano-Madrid, M.; Mestre-Bach, G.; Gómez-Peña, M.; Aymamí, N.; Borrás-González, I.; et al. Cognitive Deficits in Executive Functions and Decision-Making Impairments Cluster Gambling Disorder Sub-types. J. Gambl. Stud. 2018, 34, 209–223. [Google Scholar] [CrossRef]
  42. Mestre-Bach, G.; Fernández-Aranda, F.; Jiménez-Murcia, S.; Potenza, M.N. Decision-Making in Gambling Disorder, Problematic Pornography Use, and Binge Eating Disorder: Similarities and Differences. Curr. Behav. Neurosci. Rep. 2020, 7, 97–108. [Google Scholar] [CrossRef] [PubMed]
  43. Granero, R.; Penelo, E.; Stinchfield, R.; Fernández-Aranda, F.; Savvidou, L.G.; Fröberg, F.; Aymamí, N.; Gómez-Peña, M.; Pérez-Serrano, M.; del Pino-Gutiérrez, A.; et al. Is Pathological Gambling Moderated by Age? J. Gambl. Stud. 2014, 30, 475–492. [Google Scholar] [CrossRef] [PubMed]
  44. Jiménez-Murcia, S.; Granero, R.; Fernández-Aranda, F.; Menchón, J.M. Comparison of gambling profiles based on strategic versus non-strategic preferences. Curr. Opin. Behav. Sci. 2020, 31, 13–20. [Google Scholar] [CrossRef]
  45. Álvarez-Moya, E.M.; Ochoa, C.; Jiménez-Murcia, S.; Aymamí, M.N.; Gómez-Peña, M.; Fernández-Aranda, F.; Santamaría, J.; Moragas, L.; Bove, F.; Menchón, J.M. Effect of executive functioning, decision-making and self-reported impulsivity on the treatment outcome of pathologic gambling. J. Psychiatry Neurosci. 2011, 36, 165–175. [Google Scholar] [CrossRef] [Green Version]
  46. Del Pino-Gutiérrez, A.; Jiménez-Murcia, S.; Fernández-Aranda, F.; Agüera, Z.; Granero, R.; Hakansson, A.; Fagundo, A.B.; Bolao, F.; Valdepérez, A.; Mestre-Bach, G.; et al. The relevance of personality traits in impulsivity-related disorders: From substance use disorders and gambling disorder to bulimia nervosa. J. Behav. Addict. 2017, 6, 396–405. [Google Scholar] [CrossRef] [Green Version]
  47. Lara-Huallipe, M.L.; Granero, R.; Fernández-Aranda, F.; Gónez-Peña, M.; Moragas, L.; del Pino-Gutiérrez, A.; Valenciano-Mendoza, E.; Mora-Maltas, B.; Baenas, I.; Etxandi, M.; et al. Clustering Treatment Outcomes in Women with Gambling Disorder. J. Gambl. Stud. 2021, 38, 1469–1491. [Google Scholar] [CrossRef] [PubMed]
  48. Dash, G.F.; Slutske, W.S.; Martin, N.G.; Statham, D.J.; Agrawal, A.; Lynskey, M.T. Big Five personality traits and alcohol, nicotine, cannabis, and gambling disorder comorbidity. Psychol. Addict. Behav. 2019, 33, 420. [Google Scholar] [CrossRef] [Green Version]
  49. Zilberman, N.; Yadid, G.; Efrati, Y.; Neumark, Y.; Rassovsky, I. Personality profiles of substance and behavioral addictions. Addict. Behav. 2018, 82, 174–181. [Google Scholar] [CrossRef]
  50. Vintró-Alcaraz, C.; Mestre-Bach, G.; Granero, R.; Vázquez-Cobela, R.; Seoane, M.L.; Diéguez, C.; Leis, R.; Tovar, S. Do emotion regulation and impulsivity differ according to gambling preferences in clinical samples of gamblers? Addict. Behav. 2022, 126, 107176. [Google Scholar] [CrossRef]
  51. Barja-Fernández, S.; Lugilde, J.; Castelao, C.; Vázquez-Cobela, R.; Seoane, L.M.; Diéguez, C.; Leis, R.; Tovar, S. Circulating LEAP-2 is associated with puberty in girls. Int. J. Obes. 2021, 45, 502–514. [Google Scholar] [CrossRef]
  52. Mani, B.K.; Puzziferri, N.; He, Z.; Rodríguez, J.; Osborne-Lawrence, S.; Metzger, N.P.; Chhina, N.; Gaylinn, B.; Thorner, M.O.; Thomas, E.L.; et al. LEAP2 changes with body mass and food intake in humans and mice. J. Clin. Investig. 2019, 129, 3909–3923. [Google Scholar] [CrossRef] [PubMed]
  53. Pena-Bello, L.; Pertega-Diaz, S.; Outeiriño-Blanco, E.; García-Buela, J.; Tovar, S.; Sangiao-Alvarellos, S.; Diéguez, C.; Cordido, F. Effect of oral glucose administration on rebound growth hormone release in normal and obese women: The role of adiposity, insulin sensitivity and ghrelin. PLoS ONE. 2015, 10, e121087. [Google Scholar] [CrossRef] [PubMed]
  54. Bechara, A.; Damasio, A.R.; Damasio, H.; Anderson, S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 1994, 50, 7–15. [Google Scholar] [CrossRef]
  55. Grant, D.A.; Berg, E. A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. J. Exp. Psychol. 1948, 38, 404–411. [Google Scholar] [CrossRef] [PubMed]
  56. Golden, C.J. Stroop Color and Word Test: A Manual for Clinical and Experimental Uses; Stoelting: Chicago, IL, USA, 1978. [Google Scholar]
  57. Reitan, R.M. Validity of the Trail Making Test as an Indicator of Organic Brain Damage Perceptual and Motor Skills. Percept. Mot. Ski. 1958, 8, 271–276. [Google Scholar] [CrossRef]
  58. Wechsler, D. Wechsler Memory Scale, 3rd ed.; The Psychological Corporation: San Antonio, TX, USA, 1997. [Google Scholar]
  59. Wechsler, D. KA WAIS-III: Wechsler Adult Intelligence Scale, 3rd ed.; [Book in Spanish]; TEA Ediciones SA: Madrid, Spain, 1999. [Google Scholar]
  60. De Oliveira, M.O.; Nitrini, R.; Yassuda, M.S.; Brucki, S.M.D. Vocabulary is an appropriate measure of premorbid intelligence in a sample with heterogeneous educational level in Brazil. Behav. Neurol. 2014, 2014, 875960. [Google Scholar] [CrossRef] [Green Version]
  61. Lesieur, H.R.; Blume, S.B. The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. Am. J. Psychiatry 1987, 144, 1184–1188. [Google Scholar] [CrossRef]
  62. Echeburúa, E.; Baez, C.; Fernández-Montalvo, J.; Páez, D. Cuestionario de Juego Patológico de South Oaks (SOGS): Validación española. Análisis Modif Conduct. 1994, 20, 769–791. [Google Scholar]
  63. Stinchfield, R. Reliability, validity, and classification accuracy of a measure of DSM-IV diagnostic criteria for pathological gambling. Am. J. Psychiatry 2003, 160, 180–182. [Google Scholar] [CrossRef]
  64. Jiménez-Murcia, S.; Stinchfield, R.; Álvarez-Moya, E.; Jaurrieta, N.; Bueno, B.; Granero, R.; Aymamí, M.N.; Gómez-Peña, M.; Martínez-Giménez, R.; Fernández-Aranda, F.; et al. Reliability, validity, and classification accuracy of a Spanish translation of a measure of DSM-IV diagnostic criteria for pathological gambling. J. Gambl. Stud. 2009, 25, 93–104. [Google Scholar] [CrossRef]
  65. Derogatis, L.R. SCL-90-R: Symptom Checklist-90-R. Administration, Scoring and Procedures Manuall—II for the Revised Version; Clinical Psychometric Research: Towson, MD, USA, 1994. [Google Scholar]
  66. Derogatis, L.R. SCL-90-R. Cuestionario de 90 Síntomas-Manual; TEA Editorial: Madrid, Spain, 2002. [Google Scholar]
  67. Cloninger, C.R. The Temperament and Character Inventory—Revised. Center for Psychobiology of Personality; Washington University: Washington, DC, USA, 1999. [Google Scholar]
  68. Gutiérrez-Zotes, J.A.; Bayón, C.; Montserrat, C.; Valero, J.; Labad, A.; Cloninger, C.R.; Fernández-Aranda, F. Temperament and Character Inventory Revised (TCI-R). Standardization and normative data in a general population sample. Actas Esp Psiquiatr. 2004, 32, 8–15. [Google Scholar] [PubMed]
  69. Whiteside, S.P.; Lynam, D.R.; Miller, J.D.; Reynolds, S.K. Validation of the UPPS impulsive behaviour scale: A four-factor model of impulsivity. Eur. J. Pers. 2005, 19, 559–574. [Google Scholar] [CrossRef]
  70. Verdejo-García, A.; Lozano, Ó.; Moya, M.; Alcázar, M.A.; Pérez-García, M. Psychometric properties of a Spanish version of the UPPS-P impulsive behavior scale: Reliability, validity and association with trait and cognitive impulsivity. J. Pers. Assess. 2010, 92, 70–77. [Google Scholar] [CrossRef] [PubMed]
  71. Jiménez-Murcia, S.; Aymamí-Sanromà, M.; Gómez-Pena, M.; Álvarez-Moya, E.; Vallejo, J. Protocols de Tractament Cognitivoconductual pel joc Patològic i D’altres Addiccions no Tòxiques [Protocols of Cognitive-Behaviour Therapy for Pathological Gambling and Other Behavioural Addictions]; Hospital Universitari de Bellvitge, Departament de Salut, Generalitat de Catalunya: Barcelona, Spain, 2006. [Google Scholar]
  72. Stata-Corp. Stata Statistical Software: Release 17; Stata Press Publication (StataCorp LLC): College Station, TX, USA, 2021. [Google Scholar]
  73. Kelley, K.; Preacher, K.J. On effect size. Psychol. Methods 2012, 17, 137–152. [Google Scholar] [CrossRef] [Green Version]
  74. Rosnow, R.L.; Rosenthal, R. Computing contrasts, effect sizes and counternulls on other people’s published data: General procedures for research consumers. Psychol. Methods 1996, 1, 331–340. [Google Scholar] [CrossRef]
  75. Finner, H.; Roters, M. On the false discovery rate and expecte type I errors. J. Am. Stat. Assoc. 2001, 88, 920–923. [Google Scholar] [CrossRef]
  76. Vengeliene, V. The role of ghrelin in drug and natural reward. Addict Biol. 2013, 18, 897–900. [Google Scholar] [CrossRef]
  77. Benchebra, L.; Alexandre, J.M.; Dubernet, J.; Fatséas, M.; Auriacombe, M. Gambling and Gaming disorders and physical health of players: A critical review of the literature. Presse Med. 2019, 48, 1551–1568. [Google Scholar] [CrossRef]
  78. Pilver, C.E.; Potenza, M.N. Increased incidence of cardiovascular conditions among older adults with pathological gambling features in a prospective study. J. Addict. Med. 2013, 7, 387–393. [Google Scholar] [CrossRef] [Green Version]
  79. Firouzabadi, N.; Haghnegahdar, M.; Khalvati, B.; Dehshahri, A.; Bahramali, E. Overexpression of adiponectin receptors in opium users with and without cancer. Clin. Pharmacol. Adv. Appl. 2020, 12, 59. [Google Scholar] [CrossRef]
  80. Álvarez-Moya, E.M.; Jiménez-Murcia, S.; Aymamí, M.N.; Gómez-Peña, M.; Granero, R.; Santamaría, J.; Menchón, J.M.; Fernández-Aranda, F. Subtyping study of a pathological gamblers sample. Can. J. Psychiatry 2010, 55, 498–506. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  81. Balodis, I.M.; Linnet, J.; Arshad, F.; Worhunsky, P.D.; Stevens, M.C.; Pearlson, G.D.; Potenza, M.N. Relating neural processing of reward and loss prospect to risky decision-making in individuals with and without Gambling Disorder. Int. Gambl. Stud. 2018, 18, 269–285. [Google Scholar] [CrossRef] [PubMed]
  82. Bexkens, A.; Jansen, B.R.J.; Van der Molen, M.W.; Huizenga, H.M. Cool Decision-Making in Adolescents with Behavior Disorder and/or Mild-to-Borderline Intellectual Disability. J. Abnorm. Child Psychol. 2016, 44, 357–367. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  83. Thompson, S.J.; Corr, P.J. A Feedback-Response Pause Normalises Response Perseveration Deficits in Pathological Gamblers. Int. J. Ment. Health Addict. 2013, 11, 601–610. [Google Scholar] [CrossRef]
  84. Novelle, M.G.; Diéguez, C. Unravelling the role and mechanism of adipokine and gastrointestinal signals in animal models in the nonhomeostatic control of energy homeostasis: Implications for binge eating disorder. Eur. Eat. Disord. Rev. 2018, 26, 551–568. [Google Scholar] [CrossRef]
  85. Jiménez-Murcia, S.; Granero, R.; Fernández-Aranda, F.; Arcelus, J.; Aymamí, M.N.; Gómez-Peña, M.; Tárrega, S.; Moragas, L.; del Pino-Gutiérrez, A.; Sauchelli, S.; et al. Predictors of outcome among pathological gamblers receiving cognitive behavioral group therapy. Eur. Addict. Res. 2015, 21, 169–178. [Google Scholar] [CrossRef]
  86. Jiménez-Murcia, S.; Granero, R.; Tarrega, S.; Angulo, A.; Fernández-Aranda, F.; Arcelus, J.; Fagundo, A.B.; Aymamí, N.; Moragas, L.; Sauvaget, A.; et al. Mediational Role of Age of Onset in Gambling Disorder, a Path Modeling Analysis. J. Gambl. Stud. 2016, 32, 327–340. [Google Scholar] [CrossRef]
  87. Castrén, S.; Basnet, S.; Salonen, A.H.; Pankakoski, M.; Ronkainen, J.E.; Alho, H.; Lahti, T. Factors associated with disordered gambling in Finland. Subst. Abus. Treat. Prev. Policy 2013, 8, 1–10. [Google Scholar] [CrossRef]
  88. Martinotti, G.; Andreoli, S.; Giametta, E.; Poli, V.; Bria, P.; Janiri, L. The dimensional assessment of personality in pathologic and social gamblers: The role of novelty seeking and self-transcendence. Compr. Psychiatry 2006, 37, 350–356. [Google Scholar] [CrossRef]
  89. Valero-Solís, S.; Granero, R.; Fernández-Aranda, F.; Steward, T.; Mestre-Bach, G.; Mallorquí-Bagué, N.; Martín-Romera, V.; Aymamí, N.; Gómez-Peña, M.; del Pino-Gutiérrez, A.; et al. The contribution of sex, personality traits, age of onset and disorder duration to behavioral addictions. Front. Psychiatry 2018, 9, 497. [Google Scholar] [CrossRef] [Green Version]
  90. Dodig, D. Assessment challenges and determinants of adolescents’ adverse psychosocial consequences of gambling. Kriminol. Soc. Integr. 2013, 21, 1–29. [Google Scholar]
  91. Misiak, B.; Kowalski, K.; Stańczykiewicz, B.; Bartoli, F.; Carrà, G.; Samochowiec, J.; Frydecka, D. Frontiers in Neuroendocrinology Appetite-regulating hormones in bipolar disorder: A systematic review and meta-analysis. Front. Neuroendocrinol. 2022, 67, 101013. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Radar-charts (z-standardized means are plotted). Note. GD: gambling disorder (n = 297). Control (n = 41). LEAP2: liver enriched antimicrobial peptide 2. IGT: Iowa Gambling Test. WCST: Wisconsin Card Sorting Test. TMT: Trail Making Test. WMS-III: Wechsler Memory Scale Third Edition. WAIS: Wechsler Adult Intelligence Scale. Due the different measurement scale for the variables in the graph, Z-standardized means are plotted to facilitate interpretation.
Figure 1. Radar-charts (z-standardized means are plotted). Note. GD: gambling disorder (n = 297). Control (n = 41). LEAP2: liver enriched antimicrobial peptide 2. IGT: Iowa Gambling Test. WCST: Wisconsin Card Sorting Test. TMT: Trail Making Test. WMS-III: Wechsler Memory Scale Third Edition. WAIS: Wechsler Adult Intelligence Scale. Due the different measurement scale for the variables in the graph, Z-standardized means are plotted to facilitate interpretation.
Nutrients 14 05084 g001
Figure 2. Performance-learning curve in the Iowa Gambling Test task. Note. GD: gambling disorder (n = 297). Control (n = 41).
Figure 2. Performance-learning curve in the Iowa Gambling Test task. Note. GD: gambling disorder (n = 297). Control (n = 41).
Nutrients 14 05084 g002
Table 1. Comparison of clinical characteristics via ANCOVA.
Table 1. Comparison of clinical characteristics via ANCOVA.
Control (N = 79)GD (N = 297)
MeanSDMeanSDp|d|
1 Ghrelin (pg/mL)544.92673.59958.48753.26<0.001 *0.58 †
1 LEAP2 (ng/mL)8.413.995.282.88<0.001 *0.90 †
1 Leptin (ng/mL)9.008.138.187.850.4020.10
1 Adiponectin (ng/mL)12784.9814084.208381.474374.29<0.001 *0.42
2 BMI (kg/m2)24.992.3626.575.040.005 *0.40
Note. GD: gambling disorder. LEAP2: liver enriched antimicrobial peptide 2. BMI: body mass index. SD: standard deviation. |d|: Cohen’s-d coefficient. * Bold: significant comparison. 1 Adjustment by sex, age, and BMI. 2 Adjustment by sex and age. † Bold: effect size into the range mild-moderate (|d| > 0.50 and <0.80) to high-large (|d| > 0.80).
Table 2. Comparison of the clinical characteristics via ANCOVA.
Table 2. Comparison of the clinical characteristics via ANCOVA.
Control (N = 41)GD (N = 297)
1 Neuropsychological MeasuresMeanSDMeanSDp|d|
IGT: block-1−0.394.87−1.875.160.1150.30
IGT: block-20.655.870.095.520.5830.10
IGT: block-33.249.501.196.970.1260.25
IGT: block-42.349.851.257.460.4460.12
IGT: block-52.998.331.188.560.2490.21
IGT: total8.8828.102.1021.940.1040.27
IGT: learning5.0715.124.2213.770.7390.06
IGT: risk5.3315.782.4413.640.2570.20
WCST: trials91.6119.76102.9819.580.001 *0.58 †
WCST: errors20.0416.2833.1421.77<0.001 *0.68 †
WCST: errors perseverative9.136.2715.0910.06<0.001 *0.71 †
WCST: conceptual65.778.6660.6016.250.0630.40
WCST: categories completed5.591.074.761.800.006 *0.56 †
WCST: trials to complete 1-cat17.646.5226.7928.090.0530.45
TMT: A28.818.1031.7710.510.0880.32
TMT: B70.6722.0778.4136.380.2020.26
TMT: Diff41.7418.4847.7532.350.2710.23
Stroop: words101.5013.2798.1313.910.1730.25
Stroop: colors67.829.9768.2811.000.8120.04
Stroop: words-colors43.0710.2542.9710.550.9550.01
Stroop: estimated40.485.2040.115.530.7000.07
Stroop: interference2.597.712.867.750.8380.04
WMS-III: direct8.911.938.962.020.9020.02
WMS-III: direct-span5.991.126.011.160.9470.01
WMS-III: inverse6.551.896.181.990.3040.19
WMS-III: inverse-span4.800.984.641.150.4270.15
WMS-III: total15.463.3615.143.620.6170.09
WAIS: vocabulary45.305.2938.508.52<0.001 *0.96 †
2 Psychological measuresMeanSDMeanSDp|d|
SCL-90R Somatization0.430.350.990.78<0.001 *0.92 †
SCL-90R Obsessive/compul.0.680.521.190.84<0.001 *0.74 †
SCL-90R Interp.sensitivity0.400.380.990.80<0.001 *0.95 †
SCL-90R Depressive0.510.591.540.93<0.001 *1.32 †
SCL-90R Anxiety0.360.341.000.80<0.001 *1.05 †
SCL-90R Hostility0.430.500.960.87<0.001 *0.76 †
SCL-90R Phobic anxiety0.060.160.410.61<0.001 *0.77 †
SCL-90R Paranoid Ideation0.460.470.950.79<0.001 *0.75 †
SCL-90R Psychotic0.220.260.900.75<0.001 *1.20 †
SCL-90R GSI score0.430.341.080.70<0.001 *1.18 †
SCL-90R PST score 26.3716.4547.5320.77<0.001 *1.13 †
SCL-90R PSDI score1.410.331.860.59<0.001 *0.95 †
UPPS-P Lack premeditation20.984.0224.325.51<0.001 *0.69 †
UPPS-P Lack perseverance19.264.1321.974.830.0010.60 †
UPPS-P Sensation seeking28.137.4128.517.890.7700.05
UPPS-P Positive urgency20.705.8531.929.22<0.001 *1.45 †
UPPS-P Negative urgency23.025.5532.256.44<0.001 *1.54 †
UPPS-P Total112.1318.36138.8322.37<0.001 *1.30 †
TCI-R Novelty seeking99.3410.63110.8213.13<0.001 *0.96 †
TCI-R Harm avoidance88.0417.8698.7916.83<0.001 *0.62 †
TCI-R Reward dependence103.9513.9997.9713.500.009 * 0.43
TCI-R Persistence112.6518.18109.0218.900.2590.20
TCI-R Self-directedness148.1719.03130.1320.52<0.001 *0.91 †
TCI-R Cooperativeness136.9815.25130.1815.420.010 * 0.44
TCI-R Self-transcendence66.7315.9361.3813.830.025 * 0.36
Note. GD: gambling disorder. SD: standard deviation. IGT: Iowa Gambling Test. WCST: Wisconsin Card Sorting Test. TMT: Trail Making Test. WMS-III: Wechsler Memory Scale Third Edition. WAIS: Wechsler Adult Intelligence Scale. SCL-90R: Symptom Checklist-90-Revised. UPPS-P: Impulsive Behavior Scale. TCI-R: Temperament and Character Inventory-Revised. * Bold: significant comparison. 1 Adjustment by sex, age, and education. 2 Adjustment by sex and age. † Bold: effect size into the range mild-moderate (|d| > 0.50) to high-large (|d| > 0.80).
Table 3. Predictive logistic regression model for identifying GD.
Table 3. Predictive logistic regression model for identifying GD.
Dependent Variable: 1 = GD vs. 0 = HCBSEpOR95% CI OR
Covariates Sex (0 = women; 1 = men)−0.7811.4980.6020.4580.0248.623
Age (years-old)−0.1000.0330.0020.9050.8480.965
BMI (kg/m2)0.5080.1490.0011.6621.2412.226
Education (low levels)2.8750.7540.00117.7244.04577.665
Socioeconomic status (low levels)1.0990.5430.0433.0001.0358.696
Psychopathology distress (SCL-90R GSI)2.4830.8960.00611.9732.06969.290
Impulsivity (UPPS-P total)0.0820.0230.0011.0861.0381.135
Personality: TCI-R self-transcendence−0.0710.0310.0230.9320.8770.990
WCST Perseverative errors 0.1800.0680.0081.1981.0481.368
Stroop Color0.0930.0470.0461.0981.0021.203
WAIS Vocabulary−0.1750.0640.0070.8400.7400.953
LEAP2 (ng/mL)−0.3260.1260.0090.7220.5640.923
Fit statistics H-L = 0.985; R2 = 0.427; AUC = 0.986 (95% CI: 0.973 to 0.998)
Note. GD: gambling disorder (n = 297). HC: healthy control (n = 41). Stepwise logistic regression adjusted by sex, age, and BMI. SE: standard error. OR: odds ratio. H-L: Hosmer–Lemeshow test (p-value). R2: Cox-Snell R2. AUC: area under the ROC curve (95% confidence interval (CI)). List of statistical predictors: sociodemographics (marital status, studies levels, and socioeconomic position), psychopathology distress (SCL-90R GSI), impulsivity level (UPPS-total), personality features (TCI-R), psycho-neurological profile, and endocrine measures (ghrelin, leptin, LEAP2 and adinopectin).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Etxandi, M.; Baenas, I.; Mora-Maltas, B.; Granero, R.; Fernández-Aranda, F.; Tovar, S.; Solé-Morata, N.; Lucas, I.; Casado, S.; Gómez-Peña, M.; et al. Are Signals Regulating Energy Homeostasis Related to Neuropsychological and Clinical Features of Gambling Disorder? A Case–Control Study. Nutrients 2022, 14, 5084. https://doi.org/10.3390/nu14235084

AMA Style

Etxandi M, Baenas I, Mora-Maltas B, Granero R, Fernández-Aranda F, Tovar S, Solé-Morata N, Lucas I, Casado S, Gómez-Peña M, et al. Are Signals Regulating Energy Homeostasis Related to Neuropsychological and Clinical Features of Gambling Disorder? A Case–Control Study. Nutrients. 2022; 14(23):5084. https://doi.org/10.3390/nu14235084

Chicago/Turabian Style

Etxandi, Mikel, Isabel Baenas, Bernat Mora-Maltas, Roser Granero, Fernando Fernández-Aranda, Sulay Tovar, Neus Solé-Morata, Ignacio Lucas, Sabela Casado, Mónica Gómez-Peña, and et al. 2022. "Are Signals Regulating Energy Homeostasis Related to Neuropsychological and Clinical Features of Gambling Disorder? A Case–Control Study" Nutrients 14, no. 23: 5084. https://doi.org/10.3390/nu14235084

APA Style

Etxandi, M., Baenas, I., Mora-Maltas, B., Granero, R., Fernández-Aranda, F., Tovar, S., Solé-Morata, N., Lucas, I., Casado, S., Gómez-Peña, M., Moragas, L., Pino-Gutiérrez, A. d., Codina, E., Valenciano-Mendoza, E., Potenza, M. N., Diéguez, C., & Jiménez-Murcia, S. (2022). Are Signals Regulating Energy Homeostasis Related to Neuropsychological and Clinical Features of Gambling Disorder? A Case–Control Study. Nutrients, 14(23), 5084. https://doi.org/10.3390/nu14235084

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop