Next Article in Journal
Systems Biology as a Comparative Approach to Understand Complex Gene Expression in Neurological Diseases
Next Article in Special Issue
The Impact of Precaution and Practice on the Performance of a Risky Motor Task
Previous Article in Journal
St. Augustine’s Reflections on Memory and Time and the Current Concept of Subjective Time in Mental Time Travel

Behav. Sci. 2013, 3(2), 244-252; doi:10.3390/bs3020244

Article
The Reality Monitoring Deficit as a Common Neuropsychological Correlate of Schizophrenic and Affective Psychosis
Daniele Radaelli 1,2,,*, Francesco Benedetti 1,2,, Roberto Cavallaro 1,, Cristina Colombo 1,2, and Enrico Smeraldi 1,2,
1
Department of Neuropsychiatric Sciences, Scientific Institute and University Vita-Salute San Raffaele, Milan, 20127, Italy
2
C.E.R.M.A.C. (Centro di Eccellenza Risonanza Magnetica ad Alto Campo), University Vita-Salute San Raffaele, Milan, 20132, Italy
These authors contributed equally to this work.
*
Author to whom correspondence should be addressed; E-Mail: radaelli.daniele@hsr.it; Tel.: +39-02-2643-3229; Fax: +39-02-2643-3265.
Received: 5 February 2013; in revised form: 11 April 2013 / Accepted: 29 April 2013 /
Published: 3 May 2013

Abstract

: For many decades, Neuropsychological functioning has been a key point in the study of psychotic disorders. The main aim of these studies is to give a description of the neurocognitive “profile” of schizophrenia, with only little attention being paid to the common and discriminating features of different psychotic disorders. Recent studies support the hypothesis that patients affected by psychiatric disorders with psychotic symptoms have specific abnormalities of reality testing of ongoing perception, which become evident with source monitoring task. Ninety-eight patients and 50 controls were studied. Patients were divided by diagnosis and previous history of psychotic features and were administered Source Monitoring Task to test reality testing of ongoing perception. Frequencies of correct and false attributions were recorded. To obtain measures of observer sensitivity and response biases, a signal detection analysis was performed. Aims: Studying neuropsychological correlate of psychosis in euthymic mood disordered patients and patients with schizophrenia with or without delusions. Results: Patients with psychotic features use more lax criteria in evaluating self-generated, but not perceived stimuli compared to patients without psychotic features. Conclusions: Our findings support the hypothesis of selective biases in reality monitoring as neuropsychological correlates of psychosis.
Keywords:
reality monitoring; neuropsychology; psychosis; schizophrenia; affective disorder

1. Introduction

There has been a little attempt to study the common and discriminating features of psychotic symptoms. Strongly identified with schizophrenia, psychotic symptoms have traditionally been investigated in schizophrenic populations. A recent shift has led to a strategic focus on other clinical groups on the basis of observations that psychotic experiences are common in several psychiatric and also nonpsychiatric populations. Transdiagnostic studies may shed some light on the mechanisms that are specific to Psychosis independently of other symptoms [1]. In recent years, mounting evidence supported the hypothesis that patients affected by psychiatric disorders with psychotic symptoms have specific abnormalities in reality testing of ongoing perception, which become evident with source monitoring tasks (see review in [2]). Source monitoring refers to the set of processes involved in the attribution of an origin to memories and beliefs [3,4,5,6,7]. The vast majority of these studies have focused on schizophrenia, and found source monitoring errors consistently involving attribution of self-generated item to outside sources [8,9,10,11]. Recent studies show a specific correlation between source monitoring deficits and psychotic symptoms such as disorganization [12,13], confabulation [14], hallucinations [15] and symptoms of alien control [10,16].

The importance of the qualitative characteristics of memories and of an intact judgment process are especially clear when considering specific phenomena such as delusions. Delusions are likely to involve imagined sensory information and involve a loss of control over thoughts that come automatically, or unbidden. Following this way of reasoning source monitoring errors may lead to a wrong identification of imagined events as perceived. Similar considerations can be made for reality-testing errors that produce hallucinations. Some authors specifically suggest that certain hallucination phenomena occurring in hypnosis result from the suspension of a reality “monitor” [2].

Anselmetti et al. [11] found that the source attribution of recognized self-generated items was significantly biased towards external sources in delusional patients in comparison to controls. These findings may represent the relation between cognitive impairment and psychotic symptoms: due to the inability to identify the self as the source of internally generated information, the patient experiences it as originated from an external source in the form of symptoms such as delusions.

Patients affected by major depression were reported to have wide-ranging deficits in several cognitive functions (see reviews in [17,18,19,20]), with psychotic depressed patients showing worse performances than nonpsychotic ones in some studies, [21] but not in others [22] in the absence of disease-specific impairments; our group had previously reported source monitoring deficits in delusional depression [23]. These clinical data supported the hypothesis that, in reality, monitoring deficits are associated with psychosis in general and may play a role in the development of delusions: delusional people could use abnormally lax criteria for the evaluation of mental experiences, and make misattributions about the source of information which may lead to incorrectly identifying imagined events as perceived [2,24] or the opposite.

The aim of the present study is to investigate the presence of source monitoring deficits in the psychotic state by testing reality monitoring in euthimic mood disordered patients with or without previous episodes of major depression with delusional features and in patients with schizophrenia with or without delusional features.

2. Materials and Methods

2.1. Subjects

Ninety eight patients and 50 controls were studied. All patients were in charge at the research center for mood disorders and schizophrenia of San Raffaele Hospital in Milan.

Forty four patients with a DSM-IV [25] diagnosis of mood disorder (unipolar) were divided in two groups: 23 without a history of psychotic features and 21 with a history of psychotic features. Inclusion criteria were: a previous depressive episode with presence or absence of delusional symptoms observed by the psychiatrist in charge; stable euthymia (at least one year); stable long-term treatment (at least six months without changes in drug treatments); absence of concurrent Axis II disorder.

Fifty four patients with DSM-IV [25] diagnosis of schizophrenia were recruited and divided in two subgroups: 19 non-delusional at the time of the test and 35 delusional patients. Exclusion criteria were: history of substance dependence or abuse, co-morbid diagnosis on Axis II, epilepsy or any other major neurological illness or perinatal trauma. All patients had to be treated with a stable dose of the same antipsychotic monotherapy for at least 6 months.

Fifty control subjects (23 males and 27 females) without any Axis I or Axis II relevant psychopathology or history of psychotic disorders in first-degree relatives were recruited.

2.2. Psychopatological Assessment

Psychopatological assessment included two measures of paranoid thinking: the Fenigstein and Vanable Paranoia Scale (FVPS) [26] and the Internal, Personal and Situational Attribution Questionnaire (IPSAQ) [27]. The IPSAQ is a 32 items scale that describe 16 positive and 16 negative social situations in the second person (e.g., “A friend betrays the trust you placed in them”). The respondent is required to generate causal explanations, categorized as internal (something to do with the respondent), personal (something to do with another person or persons), or situational (something to do with circumstances or chance). Three positive and three negative subscale scores are generated by summing the number of times internal, external-personal, or external-situational attributions are chosen for positive and for negative items. Two derivative scores are produced: Externalizing Bias (EB, number of internal attributions for positive events minus number of internal attributions for negative events) and Personalizing Bias (PB, proportion of external attributions for negative events made to personal loci). Previous studies showed that paranoid patients tended to choose external attributions that located blame in other individuals, with higher EB and PB scores, while depressed patients did the opposite [27]. Schizophrenic patients psychopathology was assessed by means of the Positive and negative Symptoms Scale for Schizophrenia (PANSS), administered by a trained psychiatrist; while depressive symptomatology was assessed with the Hamilton Rating Scale for Depression (HAM-D) [28].

2.3. Source Monitoring Task

The task is the same paradigm used by Keefe [10]. Participants were asked to remember word items. During the study phase these items were identified by the participant through word-stem completion (self-generated condition), pictures (picture condition) or read by the experimenter (heard condition). Word items (16 categories and 8 words within each of those categories) were selected from an Italian version of the Battig and Montague (1969) category norms [29]. Picture items were simple black and white pictures on 4x4 note card and were taken from the Picture Database Norms on Italian Population from Job, Lotto and Dell’Acqua (2000) [30]. Heard items were read by the experimenter and repeated by the subject. Self-generated items were printed on 4x4 note cards with two or three letters missing from each word (example, B_N_N_ for “banana”). All participants were given the same items in the same order (for every category, two self-generated items, two picture items and two heard items). They were instructed to remember the presented category items and their sources. After completing all categories the experimenter gave the participant a test sheet that listed the 48 words presented plus 16 new items as distractors in the same order for each participant. The subject was asked to check one of the four response options (saw a picture, read by the experimenter, generated by filling the blanks, not presented before). The test was self-paced.

2.4. Data Analysis

Frequencies of correct and false attributions were recorded. To obtain measures of observer sensitivity and response biases, a signal detection analysis was performed by means of a computerized program (RscorePlus) [31]. Measures of sensitivity (d') and response bias (β) were calculated for the three source conditions of the stimuli (self-generated, heard, pictures). The first measure, d', depends on both the individual’s inherent ability to discriminate between two alternatives and how effectively the material can be encoded into memory; in this study, d' was a measures of the subject’s ability to discriminate between perceived and imagined words. The second measure, β, reflects a priori subjective biases toward certain kind of decisions; depending on this criterion, patients could be more or less conservative in attributing the presented stimuli to a given source. Both measures have been successfully used in psychiatric neuropsychology, and could help in identifying specific biases in information processing [23,32,33,34]. The transformation logβ was used rather than β because it tends to produce a distribution close to normality, since statistical properties of β are still under evaluation [35]. Positive values of logβ indicate a strict criterion, whereas negative values indicate a lax criterion [33].

Clinical and demographic characteristics and test scores were compared with Student’s t-test.

Group analyses were made using an ANOVA statistic and post hoc were analyzed with Fisher LSD test.

3. Results

Clinical and demographic characteristics of the patients, and scores at FVPS and IPSAQ are resumed in Table 1.

Table Table 1. Clinical and demographic characteristics of the patients and scores in the Fenigstein and Vanable Paranoia Scale (FVPS) and Internal, Personal and Situational Attribution Questionnaire (IPSAQ) questionnaires.

Click here to display table

Table 1. Clinical and demographic characteristics of the patients and scores in the Fenigstein and Vanable Paranoia Scale (FVPS) and Internal, Personal and Situational Attribution Questionnaire (IPSAQ) questionnaires.
Mood disorderSchizophreniaControls
Delusional (n = 21)Non delusional (n = 23)Delusional (n = 35)Non delusional (n = 19)(n = 50)Fp
Sex (M/F)7/145/1818/1710/923/27
Age39.3339.4334.1134.9532.282.390.053
Age at onset29.2028.8422.2124.95 5.130.003
FVPS score42.3340.7152.1740.9033.956.470.000
IPSAQ Externalizing Bias3.002.573.084.365.301.940.111
IPSAQ Personalizing Bias0.580.510.560.480.391.860.124

FVPS showed significant differences among groups, with post hoc analysis showing lower scores in controls than in both delusional depressed (p = 0.016) and schizophrenic (p < 0.0001) patients.

In the IPSAQ questionnaire, pooled delusional schizophrenic and depressed patients showed lower tendencies to externalization and higher tendencies to personalization (EB: p = 0.032 and PB: p = 0.009) compared to controls.

This bias toward personalization and against externalization in psychotic patients was confirmed by the signal detection analysis of the source monitoring task showing significant differences for self-generated stimuli (stem). In particular, logβ was significantly lower in delusional depressed (p < 0.0001) and schizophrenic (p = 0.0353) patients compared to controls (Figure 1).

Behavsci 03 00244 g001 1024
Figure 1. Reality monitoring deficits in schizophrenic and affective psychosis.

Click here to enlarge figure

Figure 1. Reality monitoring deficits in schizophrenic and affective psychosis.
Behavsci 03 00244 g001 1024

Measures of observer sensitivity (d') and response criterion (β) for all three different sources are shown in Table 2.

Table Table 2. Measures of observer sensitivity (d') and response criterion (β) for all three different sources.

Click here to display table

Table 2. Measures of observer sensitivity (d') and response criterion (β) for all three different sources.
Mood disorderSchizophreniaControls
Delusional (n = 21)Non delusional (n = 23)Delusional (n = 35)Non delusional (n = 19)(n = 50)Fp
Stem
d'2.68(0.83)1.16(2.11)2.55(0.66)2.13(1.27)3.00(0.69)9.99< 0.001
log β1.28(1.99)2.47(0.72)1.78(1.24)2.59(0.68)2.32(0.80)5.33< 0.001
Picture
d'3.87(0.97)4.03(0.79)3.06(1.03)3.20(1.57)4.24(0.72)9.11< 0.001
log β−0.04(1.32)0.42(1.19)0.62(1.30)1.19(1.33)0.99(1.26)3.360.03
Heard
d'1.41(0.59)1.78(0.71)1.22(0.88)1.34(0.54)2.13(0.62)10.79< 0.001
log β1.51(0.79)1.31(0.58)1.32(1.01)1.65(0.79)1.76(0.86)1.830.12

We also found differences between delusional and non-delusional patients: logβ was significantly lower for delusional depressed patients than for non-delusional ones (p < 0.0001) and for delusional schizophrenic patients than for non-delusional ones (p = 0.014).

4. Discussion

Previously delusional depressed patients and currently delusional schizophrenic patients share a bias toward personalization and abnormally lax criteria in information processing of self-generated verbal material. These biases were absent in never-delusional depressed patients and in currently non-delusional schizophrenic patients, who had a similar performance to control subjects.

An abnormal process of reality testing of ongoing perception and reality monitoring of memories and beliefs, characterized by the use of inappropriately lax criteria in evaluating mental experiences, has been proposed as a neuropsychological correlate for development and maintenance of delusions [2,5].

Our observations in euthymic mood disordered and schizophrenic patients are in agreement with this hypothesis, and suggest that selective biases in reality monitoring are trait characteristics of patients who experience delusional symptoms. Following this line of reasoning, nuclear abnormalities of reality monitoring should be conceived as individual characteristics, which could lead to the development of delusions in the presence of affective or schizophrenic illness.

Despite a great amount of literature supporting this hypothesis some negative finding are present. Achim and Weiss report that, in schizophrenic patients, the associative memory deficit is not specific to self/other distinctions, but is rather a more global effect seen across testing conditions [36]. Externalizing bias represents a greater tendency to attribute negative as opposed to positive events to external causes; depressed patients tend to over attribute negative events to an internal causes and the schizophrenic patients do the opposite [27]. This could explain results obtained for the EB index.

5. Conclusions

The current article provides evidence of the presence of an abnormally lax criteria in information processing of self-generated verbal material for delusional patients (depressed and schizophrenic). This finding suggests that there may be a “psychotic dimension” that occurs in all of these syndromes and that should be considered in future classification systems [37].

Both affective disorder and schizophrenia are strongly familial. Some studies report an excess of mood disorders in relatives of schizophrenia probands. In addition, some studies report an excess of schizophrenia in relatives of mood disorders [38]. Familial and genetic factors may contribute to the risk of ‘‘psychosis in general’’ (schizophrenia spectrum or psychotic mood disorders), and some authors have suggested that the presence of schizophrenia in relatives could predispose people with affective disorders to have psychotic features [39]. Brain imaging studies have advanced our understanding of the neurobiology of schizophrenia and psychotic disorders. In many instances, brain abnormalities in psychotic and mood disorders appear to be on a spectrum, with the most marked changes in schizophrenia, followed by psychotic mood disorders, followed by nonpsychotic mood disorders [40].

Further research is needed to clarify these issues. In particular, future studies will define the continuity vs. discontinuity of the observed differences in respect with general population and other psychiatric conditions.

Dimensional and categorical approaches to psychoses have important limitations. However, technical and conceptual advances promise to continue to yield clinical and preclinical data that will improve psychiatric models.

Conflict of Interest

The authors declare no conflict of interest.

References

  1. Waters, F.; Allen, P.; Aleman, A.; Fernyhough, C.; Woodward, T.S.; Badcock, J.C.; Barkus, E.; Johns, L.; Varese, F.; Menon, M.; et al. Auditory hallucinations in schizophrenia and nonschizophrenia populations: A review and integrated model of cognitive mechanisms. Schizophr. Bull. 2012, 38, 683–693. [Google Scholar]
  2. Johnson, M.K.; Hashtroudi, S.; Lindsay, D.S. Source monitoring. Psychol. Bull. 1993, 114, 3–28. [Google Scholar]
  3. Johnson, M.K.; Foley, M.A.; Leach, K. The consequences for memory of imagining in another person’s voice. Mem. Cognit. 1988, 16, 337–342. [Google Scholar]
  4. Johnson, M.K. Discriminating the origins of information. In Delusional Beliefs; Oltmanns, T.F., Maher, B.A., Eds.; Wiley: New York, NY, USA, 1988; pp. 34–65. [Google Scholar]
  5. Johnson, M.K.; Foley, M.A.; Suengas, A.G.; Raye, C.L. Phenomenal characteristics of memories for perceived and imagined autobiographical events. J. Exp. Psychol. Gen. 1988, 117, 371–376. [Google Scholar]
  6. Hashtroudi, S.; Johnson, M.K.; Chrosniak, L.D. Aging and source monitoring. Psychol. Aging 1989, 4, 106–112. [Google Scholar]
  7. Lindsay, D.S.; Johnson, M.K.; Kwon, P. Developmental changes in memory source monitoring. J. Exp. Child Psychol. 1991, 52, 297–318. [Google Scholar]
  8. Bentall, R.P. The illusion of reality: A review and integration of psychological research on hallucinations. Psychol. Bull. 1990, 107, 82–95. [Google Scholar]
  9. Baker, C.A.; Morrison, A.P. Cognitive processes in auditory hallucinations: Attributional biases and metacognition. Psychol. Med. 1998, 28, 1199–1208. [Google Scholar]
  10. Keefe, R.S.; Arnold, M.C.; Bayen, U.J.; McEvoy, J.P.; Wilson, W.H. Source-monitoring deficits for self-generated stimuli in schizophrenia: Multinomial modeling of data from three sources. Schizophr. Res. 2002, 57, 51–67. [Google Scholar]
  11. Anselmetti, S.; Cavallaro, R.; Bechi, M.; Angelone, S.M.; Ermoli, E.; Cocchi, F.; Smeraldi, E. Psychopathological and neuropsychological correlates of source monitoring impairment in schizophrenia. Psychiatr. Res 2007, 150, 51–59. [Google Scholar]
  12. Harvey, P.D. Reality monitoring in mania and schizophrenia. The association of thought disorder and performance. J. Nerv. Ment. Dis. 1985, 173, 67–73. [Google Scholar]
  13. Nienow, T.M.; Docherty, N.M. Internal source monitoring and thought disorder in schizophrenia. J. Nerv. Ment. Dis. 2004, 192, 696–700. [Google Scholar]
  14. Nathaniel-James, D.A.; Frith, C.D. Confabulation in schizophrenia: Evidence of a new form? Psychol. Med. 1996, 26, 391–399. [Google Scholar]
  15. Brebion, G.; Smith, M.J.; Amador, X.; Malaspina, D.; Gorman, J.M. Word recognition, discrimination accuracy, and decision bias in schizophrenia: Association with positive symptomatology and depressive symptomatology. J. Nerv. Ment. Dis. 1998, 186, 604–609. [Google Scholar]
  16. Keefe, R.S.; Arnold, M.C.; Bayen, U.J.; Harvey, P.D. Source monitoring deficits in patients with schizophrenia; a multinomial modelling analysis. Psychol. Med. 1999, 29, 903–914. [Google Scholar]
  17. Martinez-Aran, A.; Vieta, E.; Colom, F.; Reinares, M.; Benabarre, A.; Gasto, C.; Salamero, M. Cognitive dysfunctions in bipolar disorder: Evidence of neuropsychological disturbances. Psychother. Psychosom. 2000, 69, 2–18. [Google Scholar]
  18. Bearden, C.E.; Hoffman, K.M.; Cannon, T.D. The neuropsychology and neuroanatomy of bipolar affective disorder: A critical review. Bipolar. Disord. 2001, 3, 106–150. [Google Scholar]
  19. Murphy, F.C.; Sahakian, B.J. Neuropsychology of bipolar disorder. Br. J. Psychiatr. Suppl. 2001, 41, s120–s127. [Google Scholar]
  20. Quraishi, S.; Frangou, S. Neuropsychology of bipolar disorder: A review. J. Affect. Disord. 2002, 72, 209–226. [Google Scholar]
  21. Basso, M.R.; Bornstein, R.A. Neuropsychological deficits in psychotic versus nonpsychotic unipolar depression. Neuropsychology 1999, 13, 69–75. [Google Scholar]
  22. Ilsley, J.E.; Moffoot, A.P.; O'Carroll, R.E. An analysis of memory dysfunction in major depression. J. Affect. Disord. 1995, 35, 1–9. [Google Scholar]
  23. Benedetti, F.; Anselmetti, S.; Marcello, F.; Daniele, R.; Roberto, C.; Cristina, C.; Enrico, S. Reality monitoring and paranoia in remitted delusional depression. Clin. Psychiatr. 2005, 23, 199–205. [Google Scholar]
  24. Waters, F.; Woodward, T.; Allen, P.; Aleman, A.; Sommer, I. Self-recognition deficits in schizophrenia patients with auditory hallucinations: A meta-analysis of the literature. Schizophr. Bull. 2012, 38, 741–750. [Google Scholar]
  25. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; American Psychiatric Association: Washington, DC, USA, 1994; pp. 339–345. [Google Scholar]
  26. Fenigstein, A.; Vanable, P.A. Paranoia and self-consciousness. J. Pers. Soc. Psychol. 1992, 62, 129–138. [Google Scholar]
  27. Kinderman, P.; Bentall, R.P. Causal attributions in paranoia and depression: Internal, Personal, and situational attributions for negative events. J. Abnorm. Psychol. 1997, 106, 341–345. [Google Scholar]
  28. Hamilton, M. A rating scale for depression. J. Neurol. Neurosurg. Psychiatr. 1960, 23, 56–62. [Google Scholar]
  29. Battig, W.; Montague, W. Category norms for verbal items in 56 categories: A replication and extension of the Connecticut category norms. J. Exp. Psychol. 1969, 89, 1–46. [Google Scholar]
  30. Dell'Acqua, R.; Lotto, L.; Job, R. Naming times and standardized norms for the Italian PD/DPSS set of 266 pictures: Direct comparisons with American, English, French, and Spanish published databases. Behav. Res. Meth. Instrum. Comput. 2000, 32, 588–615. [Google Scholar]
  31. Harvey, L. RScorePlus, v.5.3.4. Parameter estimation of signal detection models. Available online: http://psych.colorado.edu/~lharvey/ (accessed on 4 October 2006).
  32. Dunbar, G.C.; Lishman, W.A. Depression, Recognition-memory and hedonic tone a signal detection analysis. Br. J. Psychiatr. 1984, 144, 376–382. [Google Scholar]
  33. Mogg, K.; Mathews, A.; Weinman, J. Memory bias in clinical anxiety. J. Abnorm. Psychol. 1987, 96, 94–98. [Google Scholar]
  34. Brown, H.D.; Kosslyn, S.M.; Breiter, H.C.; Baer, L.; Jenike, M.A. Can patients with obsessive-compulsive disorder discriminate between percepts and mental images? A signal detection analysis. J. Abnorm. Psychol. 1994, 103, 445–454. [Google Scholar]
  35. Kadlec, H. Statistical properties of d' and beta estimates of signal detection theory. Psychol. Meth. 1999, 4, 22–43. [Google Scholar]
  36. Achim, A.M.; Weiss, A.P. No evidence for a differential deficit of reality monitoring in schizophrenia: A meta-analysis of the associative memory literature. Cogn. Neuropsychiatr. 2008, 13, 369–384. [Google Scholar]
  37. Schatzberg, A.F. Non-schizophrenic psychoses: Common and distinguishing features. J. Psychiatr. Res. 2004, 38, 1–2. [Google Scholar]
  38. Ketter, T.A.; Wang, P.W.; Becker, O.V.; Nowakowska, C.; Yang, Y. Psychotic bipolar disorders: Dimensionally similar to or categorically different from schizophrenia? J. Psychiatr. Res. 2004, 38, 47–61. [Google Scholar]
  39. Kendler, K.S.; McGuire, M.; Gruenberg, A.M.; O'Hare, A.; Spellman, M.; Walsh, D. The Roscommon Family Study. IV. Affective illness, Anxiety disorders, and alcoholism in relatives. Arch. Gen. Psychiatr. 1993, 50, 952–960. [Google Scholar]
  40. Wang, P.W.; Ketter, T.A. Biology and recent brain imaging studies in affective psychoses. Curr. Psychiatr. Rep. 2000, 2, 298–304. [Google Scholar]
Behav. Sci. EISSN 2076-328X Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert