Next Article in Journal
Speed of Processing and Personality: The Influence of Personality and Extrinsic Feedback on the Performance of Cognitive Tasks
Previous Article in Journal
Developmental Changes in the Locus of Control in Students Attending Integrated and Non-integrated Classes during Early Adolescence in Poland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inflammation and Trauma-Related Psychopathology in Syrian and Iraqi Refugees

by
Lana Ruvolo Grasser
1,
Paul Burghardt
2,
Ana M Daugherty
1,3,4,
Alireza Amirsadri
1 and
Arash Javanbakht
1,*
1
Department of Psychiatry and Behavioral Neurosciences, Wayne State University, Detroit, MI 48201, USA
2
Nutrition and Food Science, Wayne State University, Detroit, MI 48201, USA
3
Department of Psychology, Wayne State University, Detroit, MI 48201, USA
4
Institute of Gerontology, Wayne State University, Detroit, MI 48201, USA
*
Author to whom correspondence should be addressed.
Behav. Sci. 2020, 10(4), 75; https://doi.org/10.3390/bs10040075
Submission received: 4 March 2020 / Revised: 2 April 2020 / Accepted: 4 April 2020 / Published: 7 April 2020

Abstract

:
Refugees experience high rates of post-traumatic stress disorder (PTSD), anxiety, and depression due to exposure to civilian war trauma and forced migration. Inflammatory products may offer viable biological indicators of trauma-related psychopathology in this cohort, promoting rapid and objective assessment of psychopathology. Incoming Syrian and Iraqi refugees (n = 36) ages 18–65 completed self-report measures of PTSD, anxiety, and depression and provided saliva samples during an assessment at a primary care clinic within the first month of resettlement in the United States. Interleukin 1β (IL-1β) and C-reactive protein (CRP) differentially correlated with symptom severity by domain, and there was a non-significant trend for sex moderating the relation between inflammation and PTSD symptoms. Our findings show unique relations between trauma-related psychopathology and inflammation. There is a need for further research in diverse ethnic cohorts with differential trauma exposures for inflammation to be considered a biological indicator of psychopathology.

1. Introduction

An estimated 70.4% of the global population is exposed to trauma in a lifetime [1], however not all individuals exposed develop a trauma-related psychological disorder; only approximately 6.8% develop post-traumatic stress disorder (PTSD) [2]. An enduring aim in trauma research is understanding the factors that may predispose an individual to develop a trauma-related disorder. Recently, inflammatory response has been implicated as a key component in the pathophysiology of trauma [3].
During trauma exposure, physiological changes leading to sympathoexcitation and activation of motor pathways are beneficial for mounting appropriate responses to danger. Activation of the sympathetic adrenomedullary axis (SAM) is a key component of the stress response following a traumatic event or reminders of that event [4,5]. The SAM axis triggers the release of catecholamines epinephrine and norepinephrine, alternatively known as adrenaline and noradrenaline [6]. Catecholamine secretion in turn leads to the production and secretion of pro-inflammatory cytokines and acute phase proteins to drive immune activity via induction of NF-κB [7]. Acute activation of this system is adaptive, however chronic activation is maladaptive [8]. After the traumatic event has ceased, these physiological responses may become sensitized and maladaptive such that stress and trauma-related stimuli can elicit them in the absence of danger [9]. For example, individuals may show attention bias towards threatening stimuli and become hypervigilant and aroused [9]. Chronic activation of the SAM and immune system results in diminished vaccine responses [10], exacerbated viral and bacterial pathogenesis [11], stunted wound healing [12], alteration in autoimmune diseases, and exacerbated psychiatric susceptibility and severity [13]. As such, trauma and psychological stress increase likelihood of disease, circulating levels of pro-inflammatory cytokines, and acute phase immune proteins.
Some pro-inflammatory cytokines, such as interleukin 1β (IL-1β), have been shown to be elevated in individuals exposed to combat trauma, abuse, or man-made accidents as compared to non-exposed healthy controls [14]. Previous research has also linked increased circulating levels of IL-1β with trauma exposure, childhood maltreatment, and PTSD [14,15,16,17,18]. Two studies have shown evidence for elevated concentrations of IL-1β in individuals with panic disorder [19,20]. cDNA array chip analysis indicates downregulation of IL-18 related genes in individuals with PTSD [21], and genotype by trauma interactions have shown transcripts for IL-18 to be positively correlated with post-traumatic stress symptom severity [22]. Taken together, elevated inflammatory state has been shown to increase the risk of developing PTSD following a traumatic event [23,24], and pro-inflammatory cytokine expression may mediate the relation between early life stress and adulthood psychiatric and physical disorders [25].
In addition to increased pro-inflammatory cytokine response, elevated levels of acute phase proteins, namely C-reactive protein (CRP) [3] may be an indicator for trauma-related pathophysiology [20,26,27]. CRP concentration increases during infection and trauma, and minor elevations in CRP may be indicators of future cardiovascular disease [28]. CRP may also represent a risk factor for PTSD, as higher pre-deployment concentrations of CRP predict increased risk for PTSD at post-deployment in a sample of military personnel [29]. Not only does CRP predict risk for PTSD, but also severity of symptoms and fear-potentiated startle, a behavioral measure of trauma-related symptomatology and pathology [30,31]. Yet similar to pro-inflammatory interleukin expression, other research studies show no relation between PTSD symptoms and circulating CRP [32]; one study reported elevated inflammatory cytokines, including IL-1β, were associated with post-traumatic pathology, whereas CRP was not [33]. Levels of CRP may be elevated in patients with generalized anxiety disorder (GAD) compared to controls, and concentrations may increase over time for patients with agoraphobia [34,35,36]. Lower levels of CRP and serum amyloid A (another acute phase protein) have previously been reported in Iraqi refugees with PTSD compared to those without [37]. This may suggest differential ethnic or racial inflammatory responses to trauma, which is an underexplored area of research. Inconsistent replication of a relation between inflammation response and PTSD symptoms or diagnosis can be attributed to a number of study design features but perhaps most important to consider is the representation of meaningful demographic factors such as race or ethnicity, and sex [3].
Sex differences in pro-inflammatory response following trauma may partially account for individual differences in the development of trauma-related psychopathology. Women with fatigue have higher levels of CRP than men with fatigue [38], and experimentally induced inflammation is more strongly associated with socioemotional changes in women compared to men [39]. One study of 1294 middle aged Finnish adults reported higher levels of CRP in women compared to men [40,41], as did another study of 2,749 Caucasian and Black women [42], and a third more diverse cohort study of 6814 adults [43]. A small cohort gene expression study found that consistent with these observations, under-expression of genes on monocytes—immune cells that both initiate and respond to inflammatory signals—was observed in men with a diagnosis of PTSD, whereas women with PTSD displayed highly-variable expression [44]. All together, these data support a hypothesis that women may have higher inflammatory states compared to men, and that the relation between trauma exposure and related psychopathology is greater in women than men.
Trauma is high among Syrian and Iraqi refugees [45,46,47]. However, little attention has been paid to this unique population in research on trauma and trauma-related physiology, psychopathology, and treatment. All may show variation from traditional research cohorts due to potential underlying genetic differences and environmental factors. Our present study examines the relation between inflammation and psychopathology in trauma-exposed Syrian and Iraqi refugees. Here we evaluate complementary and quantifiable indicators of inflammatory response measured from saliva samples: CRP, IL-1β, and IL-18. Based on previous work [3], we hypothesized that elevation in all three indicators would be associated with greater symptom severity of PTSD, anxiety, and depression. We also hypothesized that women would have elevated inflammation as compared to men, and that the relationship between inflammation and symptom severity would be greater for women compared to men. This cohort provides the benefit of homogenous trauma exposure—civilian war trauma and migratory stress with exposure commencing and ending within a similar timeframe for all individuals—and all data having been collected within one month following migration.

2. Materials and Methods

Participants were 36 adult refugees (20 females, 16 males) from Syria (25) and Iraqi (8) (3 did not report origin) who resettled in southeast Michigan between June 2016 and May 2017, part of a larger cohort study of refugee mental health [45,46,47]. All participants originated from Syria or Iraq during the same time period and were refugees of war. Participants were recruited at primary care clinics during mandatory physical health screenings that occur within the first month of resettlement in the United States. Physicians informed individuals of the opportunity to take part in a voluntary research study following the physical health assessment. Those who were interested were introduced by the physician to the research team and were provided with an informed consent form to review and sign if they chose to participate in the study. All study procedures received Institutional Review Board approval from Wayne State University—IRB #012416B3F.
A demographic questionnaire was used to gather information regarding age, sex, body mass index (BMI), any substance use, medical conditions, medication use, psychiatric conditions, and psychiatric treatment. Self-report questionnaires were then administered in both Arabic and English. Adults completed the PTSD Checklist for Civilians (PCL-C for Diagnostic and Statistical Manual of Mental Disorders version IV (DSM IV)) [48,49] as a measure of post-traumatic stress symptoms and the Hopkins Symptoms Checklist (HSCL-25) [50] as a measure of anxiety and depression. Details of scoring methods have previously been reported in a separate article [45,46]. Briefly, a probable diagnosis for PTSD based on the PCL-C is determined by meeting above-threshold scores across criteria B, C, D, and E as defined by the DSM-IV. We have previously used a cutoff of 40 for presence of probable PTSD based on total sum scores [45,46]. For the HSCL-25, a score of 1.75 or higher for the average of the first 10 items is indicative of probable anxiety; a score of 1.75 of higher for the average of the last 15 items is indicative of probable depression. Demographic data are presented in Table 1.
Following completion of demographic forms and questionnaires, 1mL saliva samples were obtained by passive drool into a 2mL collection tube over a timed 60 s period at rest. Participants had not eaten nor drank at least 30 min prior to collection, and saliva production was not stimulated by any task or action. Samples were collected mid-day on average to avoid the peak and nadir of production [51]. Following collection, samples were frozen at −80 °C until assay. Levels of CRP, IL-1β, and IL-18 were determined using an AlphaLISA kit (Perkin Elmer, Waltham, Massachusetts, United States) in single batches to eliminate inter-assay variability.
All statistical tests were performed in IBM SPSS v.25 [52]. Standard data screening for normality was conducted and satisfactorily met. Missing data occurred in 2 cases for IL-1β, 4 cases for IL-18, 1 case for the PCL, 6 cases for the HSCL-anxiety, and 10 cases for the HSCL-depression; resulting in 5.6% of IL-1β, 11.1% of IL-18, 2.8% of PCL, 16.7% of HSCL-anxiety, and 27.8% of HSCL-depression measures missing at random (Little’s χ2 = 32.83), and missing values were replaced with the sample mean, which introduces minimal bias in this application and is preferred to listwise deletion [53]. In this manner, all analyses were conducted with the total available sample (n = 36) and repeated for an assessment of similar effect sizes in the sample with complete data (n = 22).
In a 3-level repeated measure general linear model (GLM), greater symptom severity of PTSD, anxiety, and depression were predicted by inflammation indicators (IL-1β, IL-18, and CRP). This model design takes into account correlations and comorbidities of reported symptoms across diagnostic categories when evaluating total and unique effects of inflammation indicators. To allow this comparison across scales, the PCL, HSCL-anxiety, and HSCL-depression were converted to standardized z-scores. A significant interaction term would indicate a differential effect of inflammation across psychopathologies.
To evaluate significant omnibus effects, the correlation of the inflammation indicator and symptom severity was compared between symptom domains with Steiger’s Z*, controlling for the correlation between domains.
To test the second hypothesis that women had elevated inflammation as compared to men, and the relation between inflammation and symptoms severity differed by sex, we created a composite variable from the three inflammation indicators. The three indicators were submitted to a principle components analysis to extract a single component, representing a weighted composite inflammation score. The use of a composite pro-inflammatory score has previously been used to investigate the relation between IL-1β, IL-6, TNF-α, INF-γ, CRP, and combat exposed males with PTSD compare to combat exposed males without PTSD [54]. Other studies have chosen to sum z-score transformed concentrations for each marker [55,56,57]. We performed analyses deriving composite pro-inflammatory scores both ways, and yielded the same results regardless of computational method. In a hierarchical regression, inflammation score was tested as a predictor of symptom severity with sex as a moderator. With the addition of the sex × inflammation interaction, significant increase in R2 and a significant b-weight were interpreted as evidence of moderation. Due to the restrictions from sample size, each symptom domain was tested separately, and a Bonferroni correction for multiple comparisons was made (α’ = 0.02).

3. Results

A total of 36.1% (n = 13) of individuals screened positive for probable PTSD based on total severity scores from the PCL-C with a threshold score of 40. Almost half (n = 17, 47.2%) screened positive for anxiety and 1/3rd (n = 12, 33.3%) screened positive for depression based on the HSCL. Since diagnoses were not made by clinician interview, and in line with the NIH Research Domain Criteria to assess psychopathology on a continuum, we did not group analyses based on diagnosis henceforth.
While a medical evaluation was not conducted by the research team, chart review as consented to by participants yielded BMI data. Some participants reported medication use (13; 36.1%) and of these, 5 (14% of the total sample) were using an anti-inflammatory medication. Medication use was predominantly for the purpose of alleviating headaches (NSAIDs) and for birth control. No participants reported a serious medical condition. No participants were taking psychiatric medications or were in psychotherapy, and no participants in this sample reported any substance use (including smoking). We did not find any effect of medication on levels of inflammation or relations between inflammation and symptoms (all p’s > 0.07), and none of these individuals were outliers in reported psychiatric symptoms. Previous work suggests that age and BMI can also affect inflammatory state. We did not find age or BMI to be predictors of inflammation or symptoms (all p’s > 0.12). It should be noted, however, that these tests were likely underpowered with this sample size.
Intra-assay coefficients of variation for IL-1β, IL-18, and CRP were as follows: 6.82%, 6.21%, and 4.44%. All assays were run in a single-batch (duplicates on a 384 well plate).

3.1. Relation between Inflammation and Psychiatric Symptom Severity

In a repeated-measure GLM, we found no evidence for a main effect of IL-1β (F(1,32) = 0.86, p = 0.36, partial η2 = 0.03), IL-18 (F(1,32) = 0.70, p = 0.41, partial η2 = 0.02), or CRP (F(1,32) = 0.93, p = 0.34, partial η2 = 0.03) on symptom severity, averaged across domains. However, the multivariate tests demonstrate significant interaction terms that indicate IL-1β (F(2,31) = 5.56, p < 0.01, partial η2 = 0.26) and CRP (F(2,32) = 4.27, p = 0.02, partial η2 = 0.21), but not IL-18 (p = 0.91; partial η2 = 0.006), differentially correlated with symptom severity by domain (Figure 1). Repeating the analysis with listwise deletion of cases with missing data, the pattern of results was similar: there was no evidence for a main effect of IL-1β (F(1,18) = 1.11, p = 0.31, partial η2 = 0.06), IL-18 (F(1,18) = 0.07, p = 0.80, partial η2 = 0.004), or CRP (F(1,18) = 0.44, p = 0.52, partial η2 = 0.02) on symptom severity, averaged across domains. For the multivariate tests, there was no evidence of IL-1β (F(2,17) = 0.36, p = 0.70, partial η2 = 0.04) or IL-18 (F(2,17) = 0.92, p = 0.42, partial η2 = 0.10) differentially correlating with symptom severity by domain; the tests failed to reach significance with reduced power. However, the results were similar for CRP (F(2,17) = 3.51, p = 0.05, partial η2 = 0.29).

3.2. Differential Relations between Inflammation and Symptom Severity by Domain

Following the evidence of a differential effect of inflammation on symptom severity between domains, post-hoc comparisons were made. Whereas elevated IL-1β showed a non-significant inverse relation with PTSD (r(34) = −0.11, p = 0.52), IL-1β showed a non-significant direct relation with depression (r(34) = 0.28, p = 0.10; Z* =−3.12, p < 0.01) and a non-significant positive trend with anxiety (r(34) = 0.07, p = 0.67; Z* = −2.09, p = 0.04). In addition, CRP was more negatively (yet not significantly) correlated with anxiety (r(34) = −0.28, p = 0.11) as compared to depression (r(34) = −0.03, p = 0.10; Z* = −2.52, p = 0.01; Figure 2). All other comparisons were not significantly different (all p’s > 0.05). It is noteworthy that although the effects of these inflammation indicators differed between symptom domains, the magnitude of bivariate correlation with symptom severity in any single domain did not reach nominal significance in this sample. Repeating the analysis with listwise deletion of cases with missing data, the pattern of results for CRP were similar: CRP was negatively, yet non-significantly, correlated with anxiety (r(20) = −0.23, p = 0.31) while CRP was positively, yet non-significantly correlated with depression (r(20) = 0.23, p = 0.31; Z* = −2.449, p = 0.01).

3.3. Sex Differences in Inflammation, and Relation with Symptom Severity

A composite variable for inflammation was created using principle components analysis, and the resulting factor score was then used to test the hypothesis of sex-related differences in inflammation response and correlated symptom severity. An independent samples t-test indicated that inflammation did not differ by self-reported biological sex, t(34) = −1.71, p = 0.10. Additionally, reported severity of anxiety, depression, and PTSD symptoms did not differ by sex (all t’s < −0.80, p’s > 0.06). There was no evidence of sex moderating the relation between inflammation and symptom severity in anxiety (change in R2 = 0.05, F(1,32) = 1.87) or depression (change in R2 = 0.01, F(1,32) = 0.44). There was a non-significant trend for sex moderating the relation between inflammation and PTSD symptom severity (b = −10.09, p = 0.05): change in R2 = 0.1023, F(1,32) = 4.13, p = 0.05; model F(3,32) = 2.79, p = 0.06 (Figure 3). Repeating the analysis with listwise deletion of cases with missing data, there were no significant moderating effects of sex on the relation between PTSD (change in R2 = 0.0067, F(1,21) = 0.50, p = 0.50), anxiety (change in R2 = 0.019, F(1,21) = 2.86, p = 0.11), or depression (change in R2 = 0.0069, F(1,21) = 0.60, p = 0.45) and inflammation. With reduced power, the tests failed to reach significance.

4. Discussion

In this study, we assessed the relation between inflammation and PTSD, anxiety, and depression symptoms in Syrian and Iraqi refugees. All of these conditions have been previously shown to have positive relations with pro-inflammatory cytokines. However, the evidence derived from our small, homogenous cohort indicates that there may be differential inflammatory mechanisms involved in different consequences of stress and trauma exposure (being anxiety, depression, and PTSD). Most prior studies have examined inflammation in relation to only one of these symptoms categories, often times PTSD, and have ignored the comorbidity of trauma-related psychopathology. The results from our present study should be interpreted with care given the small sample size and considered preliminary/exploratory. This evidence calls for greater study of inflammatory profiles across psychological domains in traumatized populations.
Our data from a unique cohort of physically healthy Syrian and Iraqi refugees (relatively young, similar trauma, timing of exposure and stress of migration, and timing of data collection within the first month of their arrival in the host country) showed a negative trend for IL-1β predicting PTSD, where lower concentrations of IL-1β were associated with greater severity of post-traumatic stress symptoms. Conversely, we observed a positive trend for greater IL-1β expression predicting higher anxiety and depression symptoms severity. These results replicate previous findings of increased inflammation in patients with depression; indeed, IL-1β is known to be one of the most reliable biomarkers of inflammation in these patients [58]. While there was no statistically significant effect of IL-1β expression on symptom severity, the magnitude and the direction of the effect significantly differed between symptom domains, and we plan to evaluate this further in the future with a larger cohort.
Similarly, CRP also showed a negative relation to anxiety and depressive symptom severity. Neither bivariate effect was significant, however there was a larger effect of CRP on anxiety as compared to depression. Yet this effect trended in the negative direction; lower basal concentration of CRP predicted greater anxiety symptoms severity. Unlike CRP and IL-1β, there were no significant findings or trends regarding IL-18 and psychological symptoms.
Based upon this admixture of evidence, it is unlikely that the pathophysiology of inflammation is universal in the development of different trauma-related disorders [3,42,59,60]. Additional factors likely modify the effects observed; for example, there was marginal evidence of sex moderating the relation between PTSD symptoms and inflammation, and future research should place a greater focus on sex as a biological variable potentially driving relations between inflammation and psychological symptoms as well as possible diagnoses. Trauma type may also have a role, and there may be differences between refugee populations exposed to war trauma compared to other groups more commonly assessed in the literature, including victims of motor vehicle accidents, assault/abuse, and combat veterans. Type of trauma exposure is critical, as chronic, interpersonal traumas may yield more passive, blunted behavioral and sympathetic responses, while acute, non-interpersonal traumas may yield more active, activating behavioral and sympathetic responses [9]. Finally, uniqueness of our findings in a novel subject population with dominant literature focused on Caucasian and Black/African American racial backgrounds signifies the importance of larger future studies of inflammation and trauma in other ethnic and racial groups; indeed some of the relations we found between psychopathology and inflammatory variables were more akin to findings from a sample of Iraqi individuals [37]. This could then direct the field towards examination of potential genetic underpinnings of such differences.
Moreover, studies that use a single symptom domain, or an assessment that that is contaminated by comorbid symptoms, may have less sensitivity to the effect of inflammation. In other words, if there are opposing effects on IL-1β between two different symptom domains, then a combined assessment would likely produce a null effect. An advantage of our study is that we evaluated multiple symptom categories in relation to inflammation; creating a combined psychopathology severity variable, we determined that there were no main effects of inflammation on this combined variable, however there were differences based on distinct domains of psychopathology. These findings from a small sample may provide further insight into the discrepant results in the current body of literature and speak to the need for standardized and specific assessment measures, taking into account variant psychopathology that may emerge following trauma exposure in the context of diverse populations. Our present study provides the groundwork for multidomain testing and analyses across domains.
Our findings are limited by a relatively small sample size, which was due to our limited ability and time available for data collection within a primary care setting, as well as changes in the US policies in accepting refugees. Psychopathology was based on self-report questionnaire data and not clinical interview. Previous research found that depression was associated with raised IL-1β levels [61]; the association between PTSD and IL-1β levels found in this study could be confounded by depression. Further research is required to evaluate the effect of pharmacotherapy to reduce IL-1β levels in refugees as previous research found that antidepressants were able to reduce IL-1β levels [62]. Due to the research environment—within primary care offices following physical health examinations required of by all newly arriving refugees—conducting a full trauma interview was not possible.
If inflammatory state can be well-established in terms of its relationship to trauma-related disorders including PTSD, anxiety, and depression, then there may be preventative or therapeutic applications. Identifying causation was not a goal of this study, nor would it be possible given the present design. As indicated, there may be a relation between inflammation and trauma-related psychopathology. Treating one may help improve the other. Pre-existing heighted inflammation may be a risk factor for greater pathology following trauma exposure, and additionally heighted inflammation following trauma may predict those at greater risk for psychopathology, and therefore intervention could be implemented immediately following exposure and prior to onset of psychopathology. Our findings emphasize that further work is necessary to investigate inflammatory correlates of psychopathology by sex, in specific ethnic cohorts, and based on comorbidities.

Author Contributions

L.R.G. was involved in the statistical design, data analysis, and preparation of the manuscript. P.B. was involved in the preparation and running of the assays, preparation of the data, and editing of the manuscript. A.M.D. was involved in the statistical design and editing of the manuscript. A.A. was involved in the study design. A.J. was involved in the study design, data analysis plan, and editing of the manuscript. All of the aforementioned authors have reviewed the submitted manuscript and have approved the manuscript for submission. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the State of Michigan Lycaki/Young Foundation, the Department of Psychiatry and Behavioral Neurosciences Start-Up Funds, and the Department of Psychiatry and Behavioral Neurosciences New Investigator Grant.

Acknowledgments

The authors would like to thank Kimberly Hassan and the Arab American Chaldean Council Clinics for providing us a space in which to conduct this study, as well as assisting with recruitment and referrals to the study. The authors would like to thank Ed Mischel, Luay Haddad, and the Wayne State University Physician Group for their support of this project. The authors would also like to thank Mohammed Isam Alsaud, Samantha Sonderman, Suzanne Manji, Zeina Al-Obaidi, Zainab Abdulhameed, Hiba Suhaiban, Heba Al-Saghir, Luna Nasry, Farah Alani, and Bassem Saad for their time, talents, and expertise in working with participants and collecting the data. Finally, the authors would like to thank all those who participated in the study and shared their time, samples, and stories.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kessler, R.C.; Aguilar-Gaxiola, S.; Alonso, J.; Benjet, C.; Bromet, E.J.; Cardoso, G.; Degenhardt, L.; de Girolamo, G.; Dinolova, R.V.; Ferry, F.; et al. Trauma and PTSD in the WHO world mental health surveys. Eur. J. Psychotraumatol. 2017, 8, 1353383. [Google Scholar] [CrossRef]
  2. Kessler, R.C.; Berglund, P.; Demler, O.; Jin, R.; Merikangas, K.R.; Walters, E.E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry 2005, 62, 593–602. [Google Scholar] [CrossRef] [Green Version]
  3. Michopoulos, V.; Powers, A.; Gillespie, C.F.; Ressler, K.J.; Jovanovic, T. Inflammation in Fear- and Anxiety-Based Disorders: PTSD, GAD, and Beyond. Neuropsychopharmacology 2017, 42, 254–270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Haroon, E.; Raison, C.L.; Miller, A.H. Psychoneuroimmunology meets neuropsychopharmacology: Translational implications of the impact of inflammation on behavior. Neuropsychopharmacology 2005, 37, 137–162. [Google Scholar] [CrossRef] [PubMed]
  5. Slavich, G.M.; Irwin, M.R. From stress to inflammation and major depressive disorder: A social signal transduction theory of depression. Psychol. Bull. 2014, 140, 774–815. [Google Scholar] [CrossRef] [PubMed]
  6. Melmed, S.; Auchus, R.J.; Goldfine, A.B.; Koenig, R.J.; Rosen, C.J. Williams textbook of endocrinology, 14th ed.; Elsevier, Inc.: Philadelphia, PA, USA, 2019. [Google Scholar]
  7. Bierhaus, A.; Wolf, J.; Andrassy, M.; Rohleder, N.; Humpert, P.M.; Petrov, D.; Ferstl, R.; von Eynatten, M.; Wendt, T.; Rudofsky, G.; et al. A mechanism converting psychosocial stress into mononuclear cell activation. Proc. Natl. Acad. Sci. USA 2003, 100, 1920–1925. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Chen, L.; Deng, H.; Cui, H.; Fang, J.; Zuo, Z.; Li, Y.; Wang, X.; Zhao, L. Inflammatory responses and inflammation-associated diseases in organs. Oncotarget 2018, 9, 7204–7218. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Terpou, B.A.; Harricharan, S.; McKinnon, M.C.; Frewen, P.; Jetly, R.; Lanius, R.A. The effects of trauma on brain and body: A unifying role for the midbrain periaqueductal gray. J. Neurosci. Res. 2019, 97, 1110–1140. [Google Scholar] [CrossRef]
  10. Segerstrom, S.C.; Schipper, L.J.; Greenberg, R.N. Caregiving, repetitive thought, and immune response to vaccination in older adults. Brain Behav. Immun. 2008, 22, 744–752. [Google Scholar] [CrossRef] [Green Version]
  11. Cohen, S.; Tyrrell, D.A.; Smith, A.P. Psychological stress and susceptibility to the common cold. N. Engl. J. Med. 1991, 325, 606–612. [Google Scholar] [CrossRef]
  12. Padgett, D.A.; Marucha, P.T.; Sheridan, J.F. Restraint stress slows cutaneous wound healing in mice. Brain Behav. Immun. 1998, 12, 64–73. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Dantzer, R.; O’Connor, J.C.; Freund, G.G.; Johnson, R.W.; Kelley, K.W. From inflammation to sickness and depression: When the immune system subjugates the brain. Nat. Rev. Neurosci. 2008, 9, 46–56. [Google Scholar] [CrossRef] [Green Version]
  14. Spivak, B.; Shohat, B.; Mester, R.; Avraham, S.; Gil-Ad, I.; Bleich, A.; Valevski, A.; Weizman, A. Elevated levels of serum interleukin-1 beta in combat-related post-traumatic stress disorder. Biol. Psychiatry 1997, 42, 345–348. [Google Scholar] [CrossRef]
  15. Gouin, J.P.; Glaser, R.; Malarkey, W.B.; Beversdorf, D.; Kiecolt-Glaser, J.K. Childhood abuse and inflammatory responses to daily stressors. Ann. Behav. Med. 2012, 44, 287–292. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Hartwell, K.J.; Moran-Santa Maria, M.M.; Twal, W.O.; Shaftman, S.; DeSantis, S.M.; McRae-Clark, A.L.; Brady, K.T. Association of elevated cytokines with childhood adversity in a sample of healthy adults. J. Psychiatr. Res. 2013, 47, 604–610. [Google Scholar] [CrossRef] [Green Version]
  17. Tietjen, G.E.; Khubchandani, J.; Herial, N.A.; Shah, K. Adverse childhood experiences are associated with migraine and vascular biomarkers. Headache 2012, 52, 920–929. [Google Scholar] [CrossRef]
  18. Oganesyan, L.P.; Mkrtchyan, G.M.; Sukiasyan, S.H.; Boyajyan, A.S. Classic and alternative complement cascades in post-traumatic stress disorder. Bull. Exp. Biol. Med. 2009, 148, 859–861. [Google Scholar] [CrossRef]
  19. Brambilla, F.; Bellodi, L.; Perna, G.; Bertani, A.; Panerai, A.; Sacerdote, P. Plasma interleukin-1 beta concentrations in panic disorder. Psychiatry Res. 1994, 54, 135–142. [Google Scholar] [CrossRef]
  20. Hoge, E.A.; Brandstetter, K.; Moshier, S.; Pollack, M.H.; Wong, K.K.; Simon, N.M. Broad spectrum of cytokine abnormalities in panic disorder and post-traumatic stress disorder. Depress. Anxiety 2009, 26, 447–455. [Google Scholar] [CrossRef]
  21. Zieker, J.; Zieker, D.; Jatzko, A.; Dietzsch, J.; Nieselt, K.; Schmitt, A.; Bertsch, T.; Fassbender, K.; Spanagel, R.; Northoff, H.; et al. Differential gene expression in peripheral blood of patients suffering from post-traumatic stress disorder. Mol. Psychiatry 2007, 12, 116–118. [Google Scholar] [CrossRef] [Green Version]
  22. Mehta, D.; Binder, E.B. Gene × environment vulnerability factors for PTSD: The HPA-axis. Neuropharmacology 2012, 62, 654–662. [Google Scholar] [CrossRef] [PubMed]
  23. Breen, M.S.; Maihofer, A.X.; Glatt, S.J.; Tylee, D.S.; Chandler, S.D.; Tsuang, M.T.; Risbrough, V.B.; Baker, D.G.; O’Connor, D.T.; Nievergelt, C.M.; et al. Gene networks specific for innate immunity define post-traumatic stress disorder. Mol. Psychiatry 2015, 20, 1538–1545. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Tylee, D.S.; Chandler, S.D.; Nievergelt, C.M.; Liu, X.; Pazol, J.; Woelk, C.H.; Lohr, J.B.; Kremen, W.S.; Baker, D.G.; Glatt, S.J.; et al. Blood-based gene-expression biomarkers of post-traumatic stress disorder among deployed marines: A pilot study. Psychoneuroendocrinology 2015, 51, 472–494. [Google Scholar] [CrossRef] [Green Version]
  25. Powers, A.; Dixon, H.D.; Conneely, K.; Gluck, R.; Munoz, A.; Rochat, C.; Mendoza, H.; Hartzell, G.; Ressler, K.J.; Bradley, B.; et al. The differential effects of PTSD, MDD, and dissociation on CRP in trauma-exposed women. Compr. Psychiatry 2019, 93, 33–40. [Google Scholar] [CrossRef] [PubMed]
  26. Plantinga, L.; Bremner, J.D.; Miller, A.H.; Jones, D.P.; Veledar, E.; Goldberg, J.; Vaccarino, V. Association between post-traumatic stress disorder and inflammation: A twin study. Brain Behav. Immun. 2013, 30, 125–132. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Spitzer, C.; Barnow, S.; Volzke, H.; Wallaschofski, H.; John, U.; Freyberger, H.J.; Lowe, B.; Grabe, H.J. Association of post-traumatic stress disorder with low-grade elevation of C-reactive protein: Evidence from the general population. J. Psychiatr. Res. 2010, 44, 15–21. [Google Scholar] [CrossRef]
  28. Black, S.; Kushner, I.; Samols, D. C-reactive Protein. J. Biol. Chem. 2004, 279, 48487–48490. [Google Scholar] [CrossRef] [Green Version]
  29. Eraly, S.A.; Nievergelt, C.M.; Maihofer, A.X.; Barkauskas, D.A.; Biswas, N.; Agorastos, A.; O’Connor, D.T.; Baker, D.G.; Marine Resiliency Study, T. Assessment of plasma C-reactive protein as a biomarker of post-traumatic stress disorder risk. JAMA Psychiatry 2014, 71, 423–431. [Google Scholar] [CrossRef]
  30. Michopoulos, V.; Rothbaum, A.O.; Jovanovic, T.; Almli, L.M.; Bradley, B.; Rothbaum, B.O.; Gillespie, C.F.; Ressler, K.J. Association of CRP genetic variation and CRP level with elevated PTSD symptoms and physiological responses in a civilian population with high levels of trauma. Am. J. Psychiatry 2015, 172, 353–362. [Google Scholar] [CrossRef] [Green Version]
  31. Jovanovic, T.; Kazama, A.; Bachevalier, J.; Davis, M. Impaired safety signal learning may be a biomarker of PTSD. Neuropharmacology 2012, 62, 695–704. [Google Scholar] [CrossRef] [Green Version]
  32. Baumert, J.; Lukaschek, K.; Kruse, J.; Emeny, R.T.; Koenig, W.; von Kanel, R.; Ladwig, K.H. investigators, K No evidence for an association of post-traumatic stress disorder with circulating levels of CRP and IL-18 in a population-based study. Cytokine 2013, 63, 201–208. [Google Scholar] [CrossRef] [PubMed]
  33. Sutherland, A.G.; Alexander, D.A.; Hutchison, J.D. Disturbance of pro-inflammatory cytokines in post-traumatic psychopathology. Cytokine 2003, 24, 219–225. [Google Scholar] [CrossRef] [PubMed]
  34. Bankier, B.; Barajas, J.; Martinez-Rumayor, A.; Januzzi, J.L. Association between C-reactive protein and generalized anxiety disorder in stable coronary heart disease patients. Eur. Heart J. 2008, 29, 2212–2217. [Google Scholar] [CrossRef] [PubMed]
  35. Copeland, W.E.; Shanahan, L.; Worthman, C.; Angold, A.; Costello, E.J. Generalized anxiety and C-reactive protein levels: A prospective, longitudinal analysis. Psychol. Med. 2012, 42, 2641–2650. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Wagner, E.Y.; Wagner, J.T.; Glaus, J.; Vandeleur, C.L.; Castelao, E.; Strippoli, M.P.; Vollenweider, P.; Preisig, M.; von Kanel, R. Evidence for chronic low-grade systemic inflammation in individuals with agoraphobia from a population-based prospective study. PLoS ONE 2015, 10, e0123757. [Google Scholar] [CrossRef] [Green Version]
  37. Sondergaard, H.P.; Hansson, L.O.; Theorell, T. The inflammatory markers C-reactive protein and serum amyloid A in refugees with and without post-traumatic stress disorder. Clin. Chim. Acta 2004, 342, 93–98. [Google Scholar] [CrossRef]
  38. Valentine, R.J.; McAuley, E.; Vieira, V.J.; Baynard, T.; Hu, L.; Evans, E.M.; Woods, J.A. Sex differences in the relationship between obesity, C-reactive protein, physical activity, depression, sleep quality and fatigue in older adults. Brain Behav. Immun. 2009, 23, 643–648. [Google Scholar] [CrossRef]
  39. Moieni, M.; Irwin, M.R.; Jevtic, I.; Olmstead, R.; Breen, E.C.; Eisenberger, N.I. Sex differences in depressive and socioemotional responses to an inflammatory challenge: Implications for sex differences in depression. Neuropsychopharmacology 2015, 40, 1709–1716. [Google Scholar] [CrossRef] [Green Version]
  40. Saltevo, J.; Vanhala, M.; Kautiainen, H.; Kumpusalo, E.; Laakso, M. Association of C-reactive protein, interleukin-1 receptor antagonist and adiponectin with the metabolic syndrome. Mediat. Inflamm. 2007, 2007, 93573. [Google Scholar] [CrossRef] [Green Version]
  41. Saltevo, J.; Vanhala, M.; Kautiainen, H.; Laakso, M. Levels of adiponectin, C-reactive protein and interleukin-1 receptor antagonist are associated with the relative change in body mass index between childhood and adulthood. Diab. Vasc. Dis. Res. 2007, 4, 328–331. [Google Scholar] [CrossRef]
  42. Khera, A.; McGuire, D.K.; Murphy, S.A.; Stanek, H.G.; Das, S.R.; Vongpatanasin, W.; Wians, F.H., Jr.; Grundy, S.M.; de Lemos, J.A. Race and gender differences in C-reactive protein levels. J. Am. Coll. Cardiol. 2005, 46, 464–469. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Lakoski, S.G.; Cushman, M.; Criqui, M.; Rundek, T.; Blumenthal, R.S.; D’Agostino, R.B., Jr.; Herrington, D.M. Gender and C-reactive protein: Data from the multiethnic study of atherosclerosis (MESA) cohort. Am. Heart J. 2006, 152, 593–598. [Google Scholar] [CrossRef] [PubMed]
  44. Neylan, T.C.; Sun, B.; Rempel, H.; Ross, J.; Lenoci, M.; O’Donovan, A.; Pulliam, L. Suppressed monocyte gene expression profile in men versus women with PTSD. Brain Behav. Immun. 2011, 25, 524–531. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Arfken, C.L.; Alsaud, M.I.; Mischel, E.F.; Haddad, L.; Sonderman, S.; Lister, J.J.; Javanbakht, A. Recent Iraqi refugees: Association between ethnic identification and psychological distress. J. Muslim. Ment. Health 2018, 12. [Google Scholar] [CrossRef]
  46. Javanbakht, A.; Amirsadri, A.; Abu Suhaiban, H.; Alsaud, M.I.; Alobaidi, Z.; Rawi, Z.; Arfken, C.L. Prevalence of possible mental disorders in Syrian refugees resettling in the united states screened at primary care. J. Immigr. Minor. Health 2019, 21, 664–667. [Google Scholar] [CrossRef] [PubMed]
  47. Javanbakht, A.; Rosenberg, D.; Haddad, L.; Arfken, C.L. Mental health in Syrian refugee children resettling in the united states: War trauma, migration, and the role of parental stress. J. Am. Acad. Child. Adolesc. Psychiatry 2018, 57, 209–211. [Google Scholar] [CrossRef]
  48. Blevins, C.A.; Weathers, F.W.; Davis, M.T.; Witte, T.K.; Domino, J.L. The post-traumatic stress Disorder checklist for DSM-5 (PCL-5): Development and initial psychometric evaluation. J. Trauma. Stress 2015, 28, 489–498. [Google Scholar] [CrossRef]
  49. Terhakopian, A.; Sinaii, N.; Engel, C.C.; Schnurr, P.P.; Hoge, C.W. Estimating population prevalence of post-traumatic stress disorder: An example using the PTSD checklist. J. Trauma. Stress 2008, 21, 290–300. [Google Scholar] [CrossRef]
  50. Derogatis, L.R.; Lipman, R.S.; Rickels, K.; Uhlenhuth, E.H.; Covi, L. The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory. Behav. Sci. 1974, 19, 1–15. [Google Scholar] [CrossRef]
  51. Mwendwa, D.T.; Ali, M.K.; Sims, R.C.; Madhere, S.; Levy, S.A.; Callender, C.O.; Campbell, A.L. Psychometric properties of the cook medley hostility scale and its association with inflammatory markers in African Americans. Psychol. Health Med. 2013, 18, 431–444. [Google Scholar] [CrossRef]
  52. IBM Corp. IBM SPSS Statistics for Macintosh; IBM Corp.: Armonk, NY, USA, 2017. [Google Scholar]
  53. Dong, Y.; Peng, C.Y. Principled missing data methods for researchers. Springerplus 2013, 2, 222. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Lindqvist, D.; Wolkowitz, O.M.; Mellon, S.; Yehuda, R.; Flory, J.D.; Henn-Haase, C.; Bierer, L.M.; Abu-Amara, D.; Coy, M.; Neylan, T.C.; et al. Proinflammatory milieu in combat-related PTSD is independent of depression and early life stress. Brain Behav. Immun. 2014, 42, 81–88. [Google Scholar] [CrossRef] [PubMed]
  55. Babyak, M.A. What you see may not be what you get: A brief, nontechnical introduction to overfitting in regression-type models. Psychosom. Med. 2004, 66, 411–421. [Google Scholar] [PubMed] [Green Version]
  56. Miller, G.E.; Brody, G.H.; Yu, T.; Chen, E. A family-oriented psychosocial intervention reduces inflammation in low-SES African American youth. Proc. Natl. Acad. Sci. USA 2014, 111, 11287–11292. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Nusslock, R.; Body, G.H.; Armstrong, C.C.; Carroll, A.L.; Sweet, L.H.; Yu, T.; Barton, A.W.; Hallowell, E.S.; Chen, E.; Higgins, J.P.; et al. Higher peripheral inflammatory signaling associated with lower resting-state functional brain connectivity in emotion regulation and central executive networks. Biol. Psychiatry 2019, 86, 153–162. [Google Scholar] [CrossRef]
  58. Bersani, F.S.; Wolkowitz, O.M.; Lindqvist, D.; Yehuda, R.; Flory, J.; Bierer, L.M.; Makotine, I.; Abu-Amara, D.; Coy, M.; Reus, V.I.; et al. Global arginine bioavailability, a marker of nitric oxide synthetic capacity, is decreased in PTSD and correlated with symptom severity and markers of inflammation. Brain Behav. Immun. 2016, 52, 153–160. [Google Scholar] [CrossRef] [Green Version]
  59. Ben-Zion, Z.; Zeevi, Y.; Jackob Keynan, N.; Admon, R.; Sharon, H.; Halpern, P.; Liberzon, I.; Shalev, A.Y.; Benjamini, Y.; Hendler, T. Multi-domain potential biomarkers for post traumatic stress disorder (PTSD) severity in recent trauma survivors. BioRxiv 2019. [Google Scholar] [CrossRef] [Green Version]
  60. Miller, A.H.; Maletic, V.; Raison, C.L. Inflammation and its discontents: The role of cytokines in the pathophysiology of major depression. Biol. Psychiatry 2009, 65, 732–741. [Google Scholar] [CrossRef] [Green Version]
  61. Ng, A.; Tam, W.W.; Zhang, M.W.; Ho, C.S.; Hussain, S.F.; McIntyre, R.S.; Ho, R.C. IL-1beta, IL-6, TNF- alpha and CRP in elderly patients with depression or Alzheimer’s disease: Systematic review and meta-analysis. Sci. Rep. 2018, 8, 12050. [Google Scholar] [CrossRef]
  62. Lu, Y.; Ho, C.S.; Liu, X.; Chua, A.N.; Wang, W.; McIntyre, R.S.; Ho, R.C. Chronic administration of fluoxetine and pro-inflammatory cytokine change in a rat model of depression. PLoS ONE 2017, 12, e0186700. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Steiger’s Z* revealed differential relations between IL-1β and depressive symptoms (top), IL-1β and anxiety symptoms (middle), and IL-1β and post-traumatic stress symptoms (bottom). While these relations were not significant, the difference in correlation coefficients was significant, indicating that there is a differential relation between inflammation and trauma-related psychopathology. Y axes reflect self-reported symptom severity scores for the Hopkins Symptoms Checklist (HSCL)-depression index (range: 0–4) (top), HSCL-anxiety index (range: 0–4) (middle), and posttraumatic stress disorder (PTSD) Checklist for Civilians (PCL) for DSM IV (range: 17–85) (bottom).
Figure 1. Steiger’s Z* revealed differential relations between IL-1β and depressive symptoms (top), IL-1β and anxiety symptoms (middle), and IL-1β and post-traumatic stress symptoms (bottom). While these relations were not significant, the difference in correlation coefficients was significant, indicating that there is a differential relation between inflammation and trauma-related psychopathology. Y axes reflect self-reported symptom severity scores for the Hopkins Symptoms Checklist (HSCL)-depression index (range: 0–4) (top), HSCL-anxiety index (range: 0–4) (middle), and posttraumatic stress disorder (PTSD) Checklist for Civilians (PCL) for DSM IV (range: 17–85) (bottom).
Behavsci 10 00075 g001aBehavsci 10 00075 g001b
Figure 2. Steiger’s Z* revealed differential relations between C-reactive protein (CRP) and depressive symptoms (top) and CRP and anxiety symptoms (bottom), where no relation exists between the former and a slightly negative relation appears between the latter. While these relations were not significant, the difference in correlation coefficients was significant, indicating that there is a differential relation between inflammation and trauma-related psychopathology. All Y axes reflect concentration of CRP in pg/mL. X axes reflect self-reported symptom severity scores for the HSCL-depression index (range: 0–4) (top) and HSCL-anxiety index (range: 0–4) (bottom).
Figure 2. Steiger’s Z* revealed differential relations between C-reactive protein (CRP) and depressive symptoms (top) and CRP and anxiety symptoms (bottom), where no relation exists between the former and a slightly negative relation appears between the latter. While these relations were not significant, the difference in correlation coefficients was significant, indicating that there is a differential relation between inflammation and trauma-related psychopathology. All Y axes reflect concentration of CRP in pg/mL. X axes reflect self-reported symptom severity scores for the HSCL-depression index (range: 0–4) (top) and HSCL-anxiety index (range: 0–4) (bottom).
Behavsci 10 00075 g002
Figure 3. Moderation analysis provides evidence towards a potential role of sex on the relation between post-traumatic stress symptoms and pro-inflammatory variables (IL-1β, IL-18, and CRP).
Figure 3. Moderation analysis provides evidence towards a potential role of sex on the relation between post-traumatic stress symptoms and pro-inflammatory variables (IL-1β, IL-18, and CRP).
Behavsci 10 00075 g003
Table 1. Descriptive statistics for sample. Units for inflammatory variables are pg/mL. Values for PTSD, anxiety, and depression denote total severity scores on self-report psychological questionnaires. Mean severity scores for anxiety and depression were above the probable diagnostic threshold of 1.75 each; mean severity score for PTSD was below the probable diagnostic threshold of 40.
Table 1. Descriptive statistics for sample. Units for inflammatory variables are pg/mL. Values for PTSD, anxiety, and depression denote total severity scores on self-report psychological questionnaires. Mean severity scores for anxiety and depression were above the probable diagnostic threshold of 1.75 each; mean severity score for PTSD was below the probable diagnostic threshold of 40.
AgeSexIL1βCRPIL18PTSDAnxietyDepression
n3636363636363636
Mean36.6390.5564017.320140.9299952.47238.3271.8451.928
Std. Deviation10.9650.5045223.862180.0768068.22914.0200.6330.646
Minimum19.0000.000161.9541.0901338.79617.0001.0001.000
Maximum65.0001.00018820.207639.67040018.59381.000 3.4123.144

Share and Cite

MDPI and ACS Style

Grasser, L.R.; Burghardt, P.; Daugherty, A.M.; Amirsadri, A.; Javanbakht, A. Inflammation and Trauma-Related Psychopathology in Syrian and Iraqi Refugees. Behav. Sci. 2020, 10, 75. https://doi.org/10.3390/bs10040075

AMA Style

Grasser LR, Burghardt P, Daugherty AM, Amirsadri A, Javanbakht A. Inflammation and Trauma-Related Psychopathology in Syrian and Iraqi Refugees. Behavioral Sciences. 2020; 10(4):75. https://doi.org/10.3390/bs10040075

Chicago/Turabian Style

Grasser, Lana Ruvolo, Paul Burghardt, Ana M Daugherty, Alireza Amirsadri, and Arash Javanbakht. 2020. "Inflammation and Trauma-Related Psychopathology in Syrian and Iraqi Refugees" Behavioral Sciences 10, no. 4: 75. https://doi.org/10.3390/bs10040075

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop