Next Article in Journal
Ketogenic Diet: A Dietary Modification as an Anxiolytic Approach?
Next Article in Special Issue
Have Lifestyle Habits and Psychological Well-Being Changed among Adolescents and Medical Students Due to COVID-19 Lockdown in Croatia?
Previous Article in Journal
The Impact of Low-Level Iron Supplements on the Faecal Microbiota of Irritable Bowel Syndrome and Healthy Donors Using In Vitro Batch Cultures
Previous Article in Special Issue
Impact of a Three-Year Obesity Prevention Study on Healthy Behaviors and BMI among Lebanese Schoolchildren: Findings from Ajyal Salima Program
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Nutrients
Volume 12
Issue 12
10.3390/nu12123820
nutrients-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing Orthorexia Nervosa: Validation of the Polish Version of the Eating Habits Questionnaire in a General Population Sample

by
Anna Brytek-Matera
1,*,
Natalija Plasonja
2 and
Greg Décamps
2
1
Faculty of Psychology in Katowice, SWPS University of Social Sciences and Humanities, 40-326 Katowice, Poland
2
LabPsy, University of Bordeaux, F-33000 Bordeaux, France
*
Author to whom correspondence should be addressed.
Nutrients 2020, 12(12), 3820; https://doi.org/10.3390/nu12123820
Submission received: 29 October 2020 / Revised: 7 December 2020 / Accepted: 9 December 2020 / Published: 14 December 2020
(This article belongs to the Special Issue Health Promotion Begins with Healthy Behaviour and Lifestyle Early in Life)
Browse Figure
Versions Notes

Abstract

:
Extreme focus on healthy eating, called orthorexia nervosa (ON), was assessed using a 21-item Eating Habits Questionnaire (EHQ). The present study aimed to validate the Polish version of the EHQ in a general population sample. Nine hundred sixty-seven women (59%) and men participated in the present study. Data was obtained from an internet-administered survey. Exploratory factor analysis with the first split sample (n = 502) produced a three-factor solution accounting for 47% of the variance. In confirmatory factor analysis with the second split sample (n = 465), the three-factor structure showed satisfactory goodness-of-fit (comparative fit index (CFI) = 0.99, root mean square error of approximation (RMSEA) = 0.008). Reliability analysis for the Polish version of the EHQ across the whole questionnaire showed strong internal consistency (α = 0.88, intraclass correlation coefficient (ICC) = 0.86). The internal consistency, measured by Cronbach’s alpha coefficients, for the EHQ subscales were 0.85 (knowledge), 0.81 (problems), and 0.81 (feelings and behaviors). Total EHQ score was positively correlated with its three subscales, cognitive restraint, uncontrolled eating, and emotional eating, and was negatively correlated with body mass index (BMI). The Polish version of the EHQ is a reliable questionnaire that can be used with confidence to better assess ON in a general population sample.

1. Introduction

Attitudes towards healthy eating and dietary behavior have changed in western societies in recent years. Increasing attention is being paid to eating high-quality food [1]. The desire to eat healthy foods is not in itself a disorder [2]; however, restrictive eating patterns may contribute to increasing health risks [3]. An extreme adherence to clean eating (characterized by proper nutrition, restrictive eating patterns, and strict avoidance of foods considered to be unhealthy or impure) [1] may result in a pathological fixation with healthy eating, called orthorexia nervosa (ON) [4]. ON is defined as an obsession, a fixation, or preoccupation with healthy food consumption. The concern about healthy diet results in the attention captured by food (preoccupation); thus, evolving to a persistent and disturbing thought (obsession) and a stereotyped behavior (fixation) [5]. ON is related to the attempt to achieve optimal health by paying attention to healthy dietary intake [6]. Four classification approaches suggest the diagnostic criteria for ON [7,8,9,10] which refer to: (1) Obsessional or pathological preoccupation with “healthy”, “pure”, or “clean” foods, (2) rigid avoidance of foods considered “unhealthy” or “unclean”, (3) emotional consequences for transgressing self-imposed dietary rules (distress at violation of food rules/distress when violating food rules), and (4) impairment to social, physical, and/or psychological wellbeing resulting from these food beliefs and behaviors [5,11]. It is worth noting that ON has so far not been recognized either by the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) or by the International Classification of Diseases (ICD 11). This may be explained by the still ongoing discussion about the conceptualization of ON and its categorization among other mental disorders (a distinct disorder, a variant of eating disorder, or a variant of obsessive–compulsive disorder). Previous studies have shown that ON is related to disordered eating attitudes [5,12,13], eating disorders symptoms (e.g., dietary restraint, shape and weight concern) [14,15], body dissatisfaction [16,17], as well as obsessive–compulsive disorder symptoms [18,19].
Despite the lack of a universally accepted definition or diagnostic criteria, ON has been studied progressively in the last two decades, which has resulted in an increased amount of ON measures. To the best of our knowledge, there are thirteen distinct ON assessment tools (in alphabetical order): The Barcelona Orthorexia Nervosa Scale [20], the Body-Image Screening Questionnaire (BISQ) [21], Burda-Orthorexia Risk Assessment (B-ORA) [22], Bratman Orthorexia Test (BOT) [23], the Düsseldorf Orthorexia Scale (DOS) [24], the Eating Habits Questionnaire (EHQ) [25], the Eating Habits Questionnaire-Revised (EHQ-R) [26], the Orthorexia Nervosa Inventory (ONI) [13], the Orthorexia Nervosa Scale (ONS) [27], the ORTO-15 [28], the ORTO-R [29], the Scale to Measure Orthorexia in Puerto Rican Men and Women [30], and the Teruel Orthorexia Scale (TOS) [31]. The detailed characteristics of ON tools are presented in the recent systematic review by Opitz et al. [32], showing that existing measures demonstrate questionable psychometric properties (BOT, ORTO-15), challenge preliminary diagnostic criteria (DOS, TOS), and require further evaluation (e.g., EHQ-R, ONS, B-ORA). No gold standard exists for the assessment of ON so far [32]. Nevertheless, the recent study [33] found that BOT, EHQ, and DOS are internally reliable self-report instruments (a unidimensional structure—higher ordered for the EHQ, good internal reliability) and their high intercorrelations (rs > 0.70) support convergent validity, indicating that they essentially measure the same construct. In contrast, the ORTO-15 was found to have an unacceptable model fit, low internal reliability, and medium-sized correlations with the other three ON questionnaires, suggesting that it measures a different construct and/or captures ON tendencies less precisely [33]. Thus, according to Meule et al. [33], research on ON should preferably use the BOT, EHQ, or DOS. To have more solid evidence, other researchers [13,34] are also considering using the EHQ and DOS questionnaires, which seem to be reliable assessments of ON symptomatology.
Although the ORTO-15 [28] has been the most widely used tool to assess ON worldwide [35], the EHQ has increasingly been used. The EHQ [25] evaluates cognitions (knowledge of healthy eating), behaviors (problems associated with healthy eating), and feelings (feeling positively about healthy eating) towards an extreme focus on healthy eating. The conceptualization of ON, on which the EHQ is based, defines it as an “overwhelming” preoccupation about eating healthfully. To the best of our knowledge, a total of seventeen studies [36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52] have used the EHQ. This questionnaire has been translated into Italian [46] and French [42] so far. Australian validation of the EHQ also exists [43]. However, the EHQ has never been validated in a Polish population. The EHQ is an already established tool with promising psychometric properties [43] (except for the lack of criterion-related validity [47], and no criticisms have been raised towards EHQ. Therefore, this study aimed to validate the Polish version of the EHQ in a general population sample. In addition, we investigated the association between ON, eating behaviors (cognitive restraint, uncontrolled eating, emotional eating), and body dissatisfaction in a large general population sample of Polish adults.

2. Materials and Methods

2.1. Participants and Study Design

A cross-sectional population-based survey was conducted on 967 Polish women (59%) and men (41%). The mean age was 23.35 (SD = 4.96; age range: 18–60 years). The average body mass index (BMI) was 22.5 kg/m2 (SD = 3.78, BMI range: 16.2–38.1 kg/m2). The response rate was 19.42%.
The survey was administered via the internet and recruited a convenience sample. Participants received notice about the research (through social media platforms) with the announcement including the online link to the study. Interested individuals were invited to visit a website that directed them to the consent form, information form (purpose of the current study, anonymity, voluntariness of consent to research), and questionnaires. All participants offered their informed consent before starting the survey (by ticking a respective box at the first page of the online survey) and responded voluntarily to the survey. There was no financial compensation for participating in the study.
The current study is part of a large project focusing on the impact of negative affect on eating behavior. The research project (Harmonia 10) was funded by the National Science Centre (NCN), Poland (Grant no. 2018/30/M/HS6/00022). The Harmonia 10 research project was approved by the Research Ethics Committee at the Institute of Psychology, University of Wroclaw, Poland (no. IPE 0019). All procedures performed in our study were in accordance with the 1964 Helsinki Declaration (adopted by the 18th World Medical Association General Assembly, Helsinki, Finland) and its later amendments or comparable ethical standards.

2.2. Outcome Measures

2.2.1. The Eating Habits Questionnaire (EHQ)

The EHQ [25] assesses the cognitions, behaviors, and feelings regarding an extreme focus on healthy eating, called ON. It consists of 21 items scored on a 4 points Likert-type scale (1: False, not at all true; 4: Very true) and assembled in three different factors: Knowledge of healthy eating (5 items), problems associated with healthy eating (12 items), and feeling positively about healthy eating (4 items). The EHQ shows good internal consistency (Cronbach’s α = 0.82, 0.90, and 0.86, respectively) [25]. In the present study, the Polish translation of the EHQ [37] was used (Appendix A). A high score on this scale portrays higher ON tendencies.

2.2.2. The Three-Factor Eating Questionnaire (TFEQ-R18)

The TFEQ-R18 [53] assesses eating behaviors. It consists of 18 items scored on a 4-point response scale (1: Definitely true; 4: Definitely false) and is arranged into three different aspects of eating behavior: Cognitive restraint (i.e., conscious restriction of food intake in order to control body weight or to promote weight loss; 6 items), uncontrolled eating (i.e., tendency to eat more than usual due to a loss of control over intake accompanied by subjective feelings of hunger; 9 items), and emotional eating (i.e., inability to resist emotional cues, the tendency to eat in response to negative emotions; 3 items). In the present study, we used the Polish version of the TFEQ-R18 [54], which has demonstrated satisfactory levels of internal reliability (α = 0.78 for cognitive restraint, α = 0.84 for uncontrolled eating, and α = 0.86 for emotional eating). Higher scores are indicative of greater cognitive restraint, uncontrolled eating, and emotional eating.

2.2.3. The Body Dissatisfaction (BD) Scale

The BD assesses discontentment with the overall shape and size (e.g., “I think my hips are too big”). It is a subscale of the Eating Disorder Inventory (EDI) [55], the most widely used multidimensional self-report instrument that evaluates the presence of eating disorder psychopathology. It consists of 9 items on a 6-point response scale (1 = Never; 6 = Always). Higher scores on the scale indicate a greater dissatisfaction with one’s body. In the present study, we used the Polish version of the BD scale [56], which has shown a satisfactory internal consistency (α = 0.92).

2.2.4. Anthropometric and Demographic Measures

In addition to completing the aforementioned questionnaires, the participants reported their age, gender, weight, and height, the latter two allowing us to calculate their body mass index (BMI).

2.3. Statistical Analysis

In order to investigate the factorial structure of the Polish version of the EHQ, the sample was randomly split into two for exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).
Both multivariate and univariate normality of the data were examined using Mardia’s coefficient and the Shapiro–Wilk test, respectively. Normality was lacking if Mardia’s coefficient |z| score exceeded 5 and if the Shapiro-Wilk test was significant (p < 0.05) [57]. All the statistical analyses were performed using the R version 3.4.2. for Windows.

2.3.1. Exploratory Factor Analysis (EFA)

The EFA was carried out on a first randomly split sample. Prior to the analysis, the correlations between the items as well as the Kaiser–Meyer–Olkin index (KMO) and the Bartlett sphericity index were calculated in order to investigate the adequacy of the data for an EFA. The significant values of the correlation coefficients and the Bartlett index (p < 0.05) as well as the satisfactory value of the KMO coefficient (KMO ≥ 0.70) indicated that the data were appropriate for an EFA.
The factor extraction method was chosen according to whether the distribution of the data followed the normal distribution [57]. The number of the factors retained was established using the parallel analysis (eigenvalue > 1) as well as the Cattell criterion [58]. Finally, items that presented nonsignificant correlations with other items, loaded on two or more factors, and/or had low factor loadings (<0.40) were removed from the factorial solution.

2.3.2. Confirmatory Factor Analysis (CFA)

Once the exploratory factor analysis was completed, an independent confirmatory factor analysis was conducted on the other randomly split sample using the lavaan package [59]. The model’s goodness of fit was analyzed according to the following criteria: χ2/df, comparative fit index (CFI), Tucker–Lewis index (TLI), adjusted goodness-of-fit index (AGFI), root mean square error of approximation (RMSEA), and standardized root mean square (SRMR). The fit was considered satisfactory when χ2/df was less than 5, when CFI, TLI, and AGFI were superior to 0.90, and when RMSEA and SRMR were inferior to 0.8, with values inferior to 0.6 being considered as excellent [60].

2.3.3. Multigroup Confirmatory Factor Analysis

The measurement invariance of the Polish version of the EHQ across participants’ gender (female vs. male) was explored using a multigroup confirmatory factor analysis with lavaan [59] and semTools [61] packages. Four different models were tested for this purpose. Model 1 tested for configural invariance (testing the hypothesized model across the two gender categories, without constraints). Model 2 tested for metric invariance (factor loadings were constrained to equality across gender). Model 3 tested for scalar invariance (factor loadings and item intercepts were constrained to equality across the two gender categories). Finally, model 4 tested for strict measurement invariance (factor loadings, item intercepts, and item error variances were constrained to equality across gender). Measurement invariance of the models was supported if ∆χ2 was not significant, ∆CFI ≤ 0.005, ∆RMSEA ≤ 0.01, and ∆SRMR ≤ 0.025 when testing for loadings invariance, and if ∆CFI ≤ 0.005, ∆RMSEA ≤ 0.01 and ∆SRMR ≤ 0.005 when testing for intercept and residual invariance [62]. Before comparing these four models, it was verified that the configural model had an acceptable fit. For this purpose, the aforementioned CFA criteria were applied. Following the inspection of the configural model, measurement invariance was explored by comparing the four models with each other.

2.3.4. Reliability and Sensibility Analyses

The reliability of the Polish version of the EHQ scale was explored using the split-half method and the Cronbach’s alpha coefficient (α). The reliability of the scale was considered to be good if the interclass correlation coefficient, measured between even and odd items, was greater than 0.70 [63,64]. The internal consistency of the scale was interpreted based on the following Cronbach’s alpha criteria: α < 0.60—unacceptable; 0.60 > α > 0.70—correct; 0.70 > α > 0.80—satisfactory; 0.80 > α > 0.90—very good; α > 0.95—problematic [65].
In order to study the scale’s sensibility, Ferguson’s δ coefficient and discrimination analysis of items were performed. Ferguson’s δ coefficient expressed the extent to which the scale discriminated between individuals and ranged from 0 to 1. A delta close to 0 indicated that all subjects had the same score, while a delta close to 1 indicated that each subject had a different score [66]. The discrimination analysis of items relied on the following criteria: Items with d < 0.20 were poor and needed to be revised or eliminated; items with d of 0.20–0.29 were marginal and needed revision; items with d of 0.30–0.39 were reasonably good but could be improved; and items with d > 0.40 were very good [67].

2.3.5. Relationships with Sociodemographic Variables

Nonparametric Spearman’s rhô correlation coefficients were calculated between the Polish version of the EHQ, age, BMI, body dissatisfaction, and the three subscales of the TFEQ-R 18. Mean score comparisons based on participants’ gender were conducted employing the non-parametric Wilcoxon–Mann–Whitney U tests. Cohen’s d coefficient was used to evaluate the size effect of the differences. According to Cohen [68], a size effect equal to 0.20 was considered small, a d = 0.50 was regarded as a medium effect, and d = 0.80 was considered to be a large size effect.

3. Results

3.1. Exploratory Factor Analysis (EFA)

The EFA was conducted on a first randomly split sample (n = 502). The Mardia’s coefficient z score was greater than 5 (|z| = 119.080, p < 0.001), indicating that the multivariate normality condition was not met, as well as the univariate normality of the data, supported by a significant Shapiro–Wilk test (p < 0.001). Hence, nonparametric statistics were employed for the Polish validation of the EHQ.
The Bartlett’s sphericity test and the Kaiser–Meyer–Olkin index (KMO) had correct values (Bartlett test: χ2(210) = 4472.741, p < 0.001; KMO = 0.92), indicating that the data were appropriate for the EFA. The factor extraction method used was the principal axis method, which did not require a normal distribution of the data [57], and the oblimin rotation was applied.
According to the correlation matrix, all items were significantly correlated with each other. The Cattell index and the Kaiser criterion (eigenvalue > 1), obtained using a parallel analysis, suggested a 3-factor solution. While exploring the factorial solution of the scale, two different models were tested. Initially, six items (items 3, 4, 7, 10, 15, and 20) were removed from the first model because they loaded significantly on two factors. However, after conducting an AFC on both gender groups, the indexes revealed that the model fit was poor in the male sample (CFI and TLI values were below 0.90). Therefore, considering the low R2 (R2 = 0.182) of item 16 in the male group, as well as the modification indices, item 16 was excluded from the second and final model, and the correlation between the errors from the items 6 and 8 as well as 8 and 18 were added. The remaining 14 items explained 47% of the total variance. The factors correlated moderately with each other. The correlation between F1 and F2 was 0.34, between F2 and F3 0.36, and between F1 and F3 0.59. The results from the EFA are presented in Table 1.

3.2. Comfirmatory Factor Analysis (CFA)

The CFA was carried out on the second randomly split sample (n = 465) using the MLR estimator. The results presented in Table 2 revealed a good adjustment of the model.
Considering the content of each subscale, the terms “knowledge” (knowledge of healthy eating) incorporating items 1, 5, and 11, “problems” (problems associated with healthy eating) including items 2, 6, 8, 13, 14, 17, and 18, and “feelings and behaviors” (feeling positively about healthy eating and behaviors associated with healthy eating) composed of items 9, 12, 19, and 21 were given to the three subscales of the Polish version of the EHQ (Figure 1).

3.3. Multigroup Confirmatory Factor Analysis

Multigroup confirmatory factor analyses were conducted next in order to explore the EHQ’s measurement invariance across gender (female vs. male).
The 967 participants were divided in two groups according to their gender. Thus, the female group was composed of 573 women (Mage = 23.86, SD = 5.77 years) and the male group was composed of 394 men (Mage = 22.62, SD = 3.34 years).
First, a regular CFA was performed separately on each of the two gender groups. The fit indexes of the model tested in the two groups were satisfactory (Table 3).
Next, four different models of measurement invariance were explored. The comparison of the configural and metric measurement invariance models reported the following indexes: ∆CFI = 0.022; ∆SRMR = 0.003; ∆RMSEA = 0.01. Even though the ∆CFI was higher than the cut-off value of 0.05, we decided to pursue the analysis, given the fact that the values of the other two indexes were correct and the ∆χ2 was not significant (∆χ2 = 38.93, p > 0.05).
The comparison between models 3 and 2 showed that the additional constraint did not significantly weaken the fit (∆CFI = 0.001; ∆SRMR = 0.000; ∆RMSEA = 0.002; ∆χ2 = 7.696, p > 0.05). Finally, the last two models’ comparison (models 4 and 3) argued that the added constraint did not significantly alter the fit (∆CFI = 0.002; ∆SRMR = 0.003; ∆RMSEA = 0.002; ∆χ2 = 9.619, p > 0.05). These results demonstrate that the factor structure, the factor loadings, as well as the intercepts and measurement errors, were equivalent according to gender.

3.4. Reliability and Sensibility Analyses

Cronbach’s alpha coefficient and the split-half method were performed in order to explore the reliability of the Polish version of the EHQ. The intra-class coefficient with a Spearman–Brown correction, calculated between even and odd items, was equal to 0.86. The values of the Cronbach’s alpha coefficients were 0.85 for “knowledge”, 0.81 for “problems”, 0.81 for “feelings and behaviors”, and 0.88 for the whole scale. Important correlations between items, as well as good Cronbach’s alpha coefficient values, implied a satisfactory reliability of the Polish version of the EHQ. Ferguson’s δ coefficient was 0.98 and the discrimination analysis of the items was satisfactory with the discrimination index being superior to 0.40 for all the items. These results supported the hypothesis of the adequate reliability and sensibility of the Polish version of the EHQ scale.

3.5. Relationships with Sociodemographic Variables

Since the data was not distributed normally, a non-parametric Spearman’s rhô correlation coefficient was calculated in order to explore the links between different scales. All the correlations are displayed in Table 4.
BMI was correlated with EHQ total score (rhô = −0.06) and the “knowledge” subscale (rhô = −0.08). The total EHQ score and its three subscales were strongly correlated with each other. Positive correlations were observed between the total EHQ score and cognitive restraint (rhô = 0.32), uncontrolled eating (rhô = 0.10), and emotional eating (rhô = 0.11). While the “problems” and “feelings and behaviors” scales both presented positive correlations with body dissatisfaction (rhô = 0.14 and rhô = 0.1, respectively), uncontrolled eating (rhô = 0.11), emotional eating (rhô = 0.10 and rhô = 0.12, respectively) and cognitive restraint (rhô = 0.24 and rhô = 0.30, respectively), the “knowledge” scale was only positively related to cognitive restraint (rhô = 0.24).
Non-parametric Wilcoxon–Mann–Whitney U tests were conducted in order to compare the scores from different scales according to participants’ gender. There was a significant difference in the EHQ total score and “feelings and behaviors” across gender: Women had higher scores than men (p < 0.001). However, the size effect of those differences was quite small: d = 0.14 and d = 0.17, respectively. Significant differences across gender were also observed in the mean scores of the cognitive restraint, uncontrolled eating, and emotional eating subscales. The results revealed that men had higher sores on these three variables (p < 0.001). The size effect of these differences was moderate: d = −0.54, d = −0.75 and d = −0.43, respectively. The results are presented in Table 5.

4. Discussion

The objective of the present study was to investigate the psychometric properties of the Polish version of the EHQ in a general population sample. The CFA yielded a shorter version composed of 14 items (items 1, 2, 5, 6, 8, 9, 11, 12, 13, 14, 17, 18, 19, 21) for which the three-factor solution showed satisfactory goodness-of-fit (Table 2). Compared to the original scale, the Polish validation encompassed the same number of factors but a reduced number of items (14 items instead of 21). The Polish version of EHQ also had a similar factorial structure to the French validation [42]. However, the number of items was not the same: 5 items were removed from the French version [42], while 7 items were removed from the Polish validation. Furthermore, those two versions had only two removed items in common, items 15 and 16. However, the content of their subscales were quite similar. The subscale “positive feeling of control” from the French version [42] embodied all the items from the “feelings and behaviors” subscale of the Polish validation. Likewise, the “problems of attention control” and “social relation” from the French version [42] consisted of almost all the items from the “problems” subscale of the Polish validation. Apart from the same two items being deleted from the French [42] and Polish validations, there were no other similarities relating to the withdrawn items between the different EHQ validations. In addition, no statistical parameter could explain the removal of the items from the Polish validation. Nevertheless, the majority of the items removed from the Polish validation belonged to the “problems” subscale of the original version. Hence, the withdrawal of those specific items may have been due to the ambiguity of the item’s content in Polish.
The EHQ has been validated in Italian [46] and French populations [42] so far. Novara et al. [46] investigated the psychometric properties of the Italian version of the EHQ among a non-clinical female sample (n = 204). Results from EFA and CFA (Table 2) revealed that the 21-item Italian version of the EHQ [46] represented three ON factors: Knowledge of healthy eating (knowledge), problems associated with healthy eating (problems), and feeling positively about healthy eating (feelings). These findings were consistent with the original three dimensions of the EHQ. The Italian version of the EHQ total score correlated with the Eating Disorder Inventory-3-Referral Form (EDI-3-RF). The psychometric properties of the EHQ were also investigated in a large sample of French adults (n = 2065) [42]. Results of the CFA revealed a very good fit of the improved measurement model (Table 2). A 16-item EHQ [42] represented three ON dimensions: Rigid eating behavior (eating behavior characterized by the rigid pursuit of a strict diet with many rules; REB), positive feeling of control (feeling of one’s capacity to maintain a healthy diet involving a positive feeling of control; PFC), and problems of attention control and social relationships (difficulty to control attention and to maintain the quality of social relationships because of intrusive thoughts related to the obsession of healthy eating; PACSR). The reliability analysis showed that REB (α = 0.82), PFC (α = 0.76), and PACSR (α = 0.75) measurements had satisfactory internal consistency [42]. The reliability and validity of the EHQ was also examined on Australian adult women (n = 286) [43]. The EFA established that the EHQ represented four ON dimensions: Healthy eating cognitions, dietary restriction, diet superiority, and social impairment. Cronbach’s α coefficient was 0.89 for the total EHQ scale and ranged from 0.72 to 0.80 for the four subscales [43] Criterion-related validity showed a significant moderate to strong negative correlation between the EHQ and ORTO-10 (a ten-item version of ORTO-15) [43].
Reliability analysis for the Polish version of the EHQ across the whole questionnaire showed strong internal consistency (α = 0.88; ICC = 0.86). The internal consistency of the EHQ subscales, measured by Cronbach’s alpha coefficients, was 0.85 for “knowledge” (knowledge of healthy eating), 0.81 for “problems” (problems associated with healthy eating), and 0.81 for “feelings and behaviors” (feeling positively about healthy eating and behaviors associated with healthy eating). These values were similar to those reported in other validations, i.e., alpha values between 0.75 and 0.90 [25,42,43].
Our results demonstrated that the total EHQ score was positively correlated with its three subscales (“knowledge”, “problems”, and “feelings and behaviors”), cognitive restraint, uncontrolled eating, and emotional eating, as well as negatively correlated with BMI. This suggests that EHQ score was associated with eating behaviors related to, on the one hand, the intention to control food intake in order to maintain or lose weight and, on the other hand, to consuming more than usual due to a loss of control over intake, accompanied by subjective feelings of hunger and the tendency to eat in response to negative emotions. When cognitive control was undermined, dietary restraint led to reduced sensitivity to internal cues for satiety and, therefore, resulted in overeating [69]. In the case of ON (using the EHQ), preoccupation with healthy food consumption may be related to decreasing sensitivity to internal cues for satiety and may have an effect on uncontrolled eating (e.g., consumption of foods considered to be unhealthy or impure) or emotional eating. The total EHQ score as well as the “feelings and behaviors” and “problems” subscales were positively correlated to cognitive restraint, body dissatisfaction, uncontrolled, and emotional eating, while the “knowledge” subscale was only correlated to cognitive restraint. The absence of significant correlations between the “knowledge” scale and body dissatisfaction, uncontrolled, or emotional eating may be explained by the fact that individuals who scored high on the “knowledge” scale were satisfied with their body, did not have a problematic eating behavior, and were restraining their food intake in order to keep a healthy weight and avoid health consequences related to overweight and obesity. These findings support those of Depa et al. [70], which have identified the motivations for weight control as being involved in orthorexic behavior. The authors explained that, related to the orthorexic behavior, weight control can reduce or prevent health consequences engendered by overweight and obesity.
Our results were consistent with the recent study [42] revealing the negative association between two ON dimensions (REB and PFC) and BMI. In addition, this study noticed that people with high levels of ON symptoms did not typically present high or low BMI, which indicated that ON dimensions were only marginally related to BMI [42]. Our results were in contrast to a previous study [50] that found no relationship between ON (measuring by the EHQ) and BMI, and another one [47] that showed that high BMI was associated with greater ON symptomatology for men (high-BMI and low-BMI women were at equal risk for ON). It is worth pointing out that research investigating the link between ON and BMI have reported inconsistent results. The majority of studies noticed that both high and low BMI are risk factors for developing ON [71].
Additionally, our findings showed that women had higher scores on the EHQ total score and on the “feelings and behaviors scale” when compared to men. However, the size effect of those differences was quite small (d = 0.14 and d = 0.17, respectively). Findings regarding the gender differences in ON were inconsistent. The recent meta-analysis on gender differences in ON [72] pointed out that men represented higher normative healthy eating behaviors and showed more problems from this rigid eating behavior, whereas pathologically healthful eating behaviors among women were more linked with having positive feelings about their healthy eating [72].
A strength of our study was the use of a large population-based sample, representative of the Polish general population in terms of age and gender. Our study had some limitations. First, the cross-sectional design did not allow for the assessment of test–retest reliability of the questionnaire. Then, due to the self-report nature of the data, the results may have been susceptible to a common method and social desirability biases. Although the risk was reduced by relying on anonymity and assuring voluntary participation, it was impossible to completely eliminate the problem. Finally, a selection bias was present because of the convenience sampling technique followed.
The objective of the present was to validate the Polish version of the EHQ in a general population sample. Future study should evaluate the reliability and consistency of the EHQ in more specific clinical groups (e.g., individuals with ON, individuals with ED) as well as in non-clinical groups (e.g., adolescents). Adolescents may be at high risk for disordered eating behavior. The previous study [73] has shown that ON prevalence in the adolescent population was similar to that found in the adult population.

5. Conclusions

Our findings suggest that the Polish version of the EHQ has adequate psychometric properties for measuring ON in a large population-based sample. Therefore, it is possible to use the Polish version of the EHQ for applications in research and clinical practice.

Author Contributions

Conceptualization—A.B.-M.; project administration—A.B.-M., Formal analysis—N.P.; investigation—A.B.-M.; writing—original draft—A.B.-M., N.P.; writing—review and editing—A.B.-M., N.P., G.D.; resources, A.B.-M., funding acquisition—A.B.-M.; methodology—A.B.-M.; supervision—A.B.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Science Centre, Poland under the Harmonia 10 research project (no. 2018/30/M/HS6/00022) awarded to A.B.-M.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table
Table A1. The Polish version of the EHQ.
Table A1. The Polish version of the EHQ.
Fałsz, Całkowita NieprawdaTrochę PrawdaGłównie PrawdaCałkowita Prawda
1. Jestem lepiej niż inni poinformowany(a) w kwestii zdrowego odżywiania się☐☐☐☐
2. Odrzucam propozycje towarzyskie, które wiążą się z jedzeniem niezdrowego jedzenia☐☐☐☐
3. Sposób w jaki przygotowuję jedzenie jest ważny w mojej diecie☐☐☐☐
4. Ilość zasad obowiązujących w mojej diecie wzrosła☐☐☐☐
5. Moje nawyki żywieniowe są lepsze od nawyków żywieniowych innych ludzi☐☐☐☐
6. Rozpraszają mnie myśli dotyczące zdrowego odżywiania się☐☐☐☐
7. Jem tylko to, na co moja dieta pozwala☐☐☐☐
8. Moje zdrowe odżywianie się jest znaczącym źródłem stresu w moich relacjach z innymi ludźmi☐☐☐☐
9. Podejmowałem(am) wysiłki, by z biegiem czasu jeść zdrowiej☐☐☐☐
10. Moja dieta ma wpływ na rodzaj zatrudnienia jakie bym podjął/podjęła☐☐☐☐
11. Moja dieta jest lepsza niż dieta innych ludzi☐☐☐☐
12. Czuję, że mam kontrolę kiedy zdrowo jem☐☐☐☐
13. W ciągu ostatniego roku przyjaciele lub członkowie rodziny powiedzieli mi, że zbytnio przejmuję się zdrowym odżywianiem☐☐☐☐
14. Mam trudność ze znalezieniem restauracji serwujących jedzenie, które jem☐☐☐☐
15. Jedzenie w taki sposób, w jaki ja to robię, daje mi poczucie satysfakcji☐☐☐☐
16. Niewiele pokarmów jest dla mnie zdrowych☐☐☐☐
17. Rzadziej wychodzę z domu odkąd zacząłem/zaczęłam się zdrowo odżywiać☐☐☐☐
18. Spędzam więcej niż trzy godzinny dziennie na myśleniu o zdrowym jedzeniu☐☐☐☐
19. Czuję się świetnie, kiedy zdrowo jem☐☐☐☐
20. Sztywno trzymam się diety opartej na zdrowym jedzeniu☐☐☐☐
21. Przygotowuję jedzenie w najzdrowszy możliwy sposób☐☐☐☐

References

  1. Nevin, S.M.; Vartanian, L.R. The stigma of clean dieting and orthorexia nervosa. J. Eat. Disord 2017, 5, 37. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Hanganu-Bresch, C. Orthorexia: Eating right in the context of healthism. Med. Humanit. 2020, 46, 311–322. [Google Scholar] [CrossRef] [PubMed]
  3. Musolino, C.; Warin, M.; Wade, T.; Gilchrist, P. “Healthy anorexia”: The complexity of care in disordered eating. Soc. Sci. Med. 2015, 139, 18–25. [Google Scholar] [CrossRef] [Green Version]
  4. Bratman, S.; Knight, D. Orthorexia Nervosa: Overcoming the Obsession with Healthful Eating. Health Food Junkies; Broadway Books: New York, NY, USA, 2000. [Google Scholar]
  5. Cena, H.; Barthels, F.; Cuzzolaro, M.; Bratman, S.; Brytek-Matera, A.; Dunn, T.; Varga, M.; Missbach, B.; Donini, L.M. Definition and diagnostic criteria for orthorexia nervosa: A narrative review of the literature. Eat. Weight Disord. 2019, 24, 209–246. [Google Scholar] [CrossRef] [PubMed]
  6. Scarff, J.R. Orthorexia Nervosa: An obsession with healthy eating. Fed Pract. 2017, 34, 36–39. [Google Scholar] [PubMed]
  7. Barthels, F.; Meyer, F.; Huber, T.; Pietrowsky, R. Orthorexic eating behaviour as a coping strategy in patients with anorexia nervosa. Eat. Weight Disord. 2017, 22, 269–276. [Google Scholar] [CrossRef]
  8. Dunn, T.M.; Bratman, S. On orthorexia nervosa: A review of the literature and proposed diagnostic criteria. Eat. Behav. 2016, 21, 11–17. [Google Scholar] [CrossRef]
  9. Moroze, R.M.; Dunn, T.M.; Craig, J.H.; Yager, J.; Weintraub, P. Microthinking about micronutrients: A case of transition from obsessions about healthy eating to near-fatal” orthorexia nervosa” and proposed diagnostic criteria. Psychosomatics 2015, 56, 397–403. [Google Scholar] [CrossRef]
  10. Setnick, J. The Eating Disorders Clinical Pocket Guide: Quick Reference for Healthcare Providers, 2nd ed.; Understanding Nutrition: Dallas, TX, USA, 2013. [Google Scholar]
  11. Greville-Harris, M.; Smithson, J.; Karl, A. What are people’s experiences of orthorexia nervosa? A qualitative study of online blogs. Eat. Weight Disord. 2020, 1693–1702. [Google Scholar] [CrossRef] [Green Version]
  12. Mitrofanova, E.; Pummell, E.; Martinelli, L.; Petróczi, A. Does ORTO-15 produce valid data for ‘Orthorexia Nervosa’? A mixed-method examination of participants’ interpretations of the fifteen test items. Eat. Weight Disord. 2020, 1–13. [Google Scholar] [CrossRef]
  13. Oberle, C.D.; De Nadai, A.S.; Madrid, A.L. Orthorexia Nervosa Inventory (ONI): Development and validation of a new measure of orthorexic symptomatology. Eat. Weight Disord. 2020, 1–14. [Google Scholar] [CrossRef] [PubMed]
  14. Strahler, J.; Hermann, A.; Walter, B.; Stark, R. Orthorexia nervosa: A behavioral complex or a psychological condition? J. Behav. Addict. 2018, 7, 1143–1156. [Google Scholar] [CrossRef] [PubMed]
  15. Brytek-Matera, A.; Onieva-Zafra, M.D.; Parra-Fernández, M.L.; Staniszewska, A.; Modrzejewska, J.; Fernández-Martínez, E. Evaluation of Orthorexia Nervosa and Symptomatology Associated with Eating Disorders among European University Students: A Multicentre Cross-Sectional Study. Nutrients 2020, 12, 3716. [Google Scholar] [CrossRef] [PubMed]
  16. Barthels, F.; Kisser, J.; Pietrowsky, R. Orthorexic eating behavior and body dissatisfaction in a sample of young females. Eat. Weight Disord. 2020. [Google Scholar] [CrossRef] [PubMed]
  17. Parra-Fernández, M.L.; Onieva-Zafra, M.D.; Fernández-Martínez, E.; Abreu-Sánchez, A.; Fernández-Muñoz, J.J. Assessing the prevalence of orthorexia nervosa in a sample of university students using two different self-report measures. Int. J. Environ. Res. Public Health 2019, 16, 2459. [Google Scholar] [CrossRef] [Green Version]
  18. Bundros, J.; Clifford, D.; Silliman, K.; Morris, M.N. Prevalence of Orthorexia Nervosa among college students based on Bratman’s test and associated tendencies. Appetite 2016, 101, 86–94. [Google Scholar] [CrossRef]
  19. Hayes, O.; Wu, M.S.; De Nadai, A.S.; Storch, E.A. Orthorexia Nervosa: An examination of the prevalence, correlates, and associated impairment in a university sample. J. Cogn. Psychother. 2017, 31, 124–135. [Google Scholar] [CrossRef]
  20. Bauer, S.M.; Fusté, A.; Andrés, A.; Saldaña, C. The Barcelona Orthorexia Scale (BOS): Development process using the Delphi method. Eat. Weight Disord. 2019, 24, 247–255. [Google Scholar] [CrossRef]
  21. Jenaro Río, C.; Flores Robaina, N.; Bermejo, B.G.; Cruz, M.I. Cuestionario de imagen corporal para la detección temprana de trastornos de la conducta alimentaria. Acción Psicol. 2011, 8, 7–20. [Google Scholar]
  22. Burda, L. Development and Validation of an Inventory Measuring Dietary Attitudes of Healthy Eating and Orthorexia Nervosa. Ph.D. Thesis, Texas A&M University, Corpus Christi, TX, USA, May 2018. [Google Scholar]
  23. Bratman, S. The Authorized Bratman Orthorexia Self-Test 2017. Available online: http://www.orthorexia.com/the-authorized-bratman-orthorexia-self-test/ (accessed on 2 December 2020).
  24. Barthels, F.; Meyer, F.; Pietrowsky, R. Die Düsseldorfer Orthorexie Skala–Konstruktion und Evaluation eines Fragebogens zur Erfassung ortho-rektischen Ernährungsverhaltens. Z. Klin. Psychother. 2015, 44, 97–105. [Google Scholar] [CrossRef]
  25. Gleaves, D.H.; Graham, E.C.; Ambwani, S. Measuring “orthorexia”: Development of the Eating Habits Questionnaire. Int. J. Educ. Psychol. Assess. 2013, 12, 1–18. [Google Scholar]
  26. Glen, K.; Gleaves, D. Development and Validation of the Eating Habits Questionnaire-Revised (EHQ-R). Master’s Thesis, University of South Australia, Adelaide, Australia, 2018. Unpublished. [Google Scholar]
  27. Kramer, M. The Development of a Scale to Measure Orthorexia Nervosa. Master’s Thesis, Colorado State University, Fort Collins, CO, USA, 2016. [Google Scholar]
  28. Donini, L.M.; Marsili, D.; Graziani, M.P.; Imbriale, M.; Cannella, C. Orthorexia nervosa: Validation of a diagnosis questionnaire. Eat. Weight Disord. 2005, 10, e28–e32. [Google Scholar] [CrossRef] [PubMed]
  29. Rogoza, R.; Donini, L.M. Introducing ORTO-R: A revision of ORTO-15: Based on the re-assessment of original data. Eat. Weight Disord. 2020. [Google Scholar] [CrossRef] [PubMed]
  30. Carrero, T.; Padilla Cotto, L.; Rodríguez-Gómez, J. Construcción y validación de una Escala para Tamizar Ortorexia: Primer estudio piloto en Puerto Rico. Bol. Asoc. Med. P. R. 2016, 108, 89–95. [Google Scholar] [PubMed]
  31. Barrada, J.R.; Roncero, M. Bidimensional structure of the orthorexia: Development and initial validation of a new instrument. An. Psicol. 2018, 34, 283–291. [Google Scholar] [CrossRef]
  32. Opitz, M.C.; Newman, E.; Alvarado Vazquez Mellado, A.S.; Robertson, M.D.A.; Sharpe, H. The psychometric properties of orthorexia nervosa assessment scales: A systematic review and reliability generalization. Appetite 2020, 155, 104797. [Google Scholar] [CrossRef]
  33. Meule, A.; Holzapfel, C.; Brandl, B.; Greetfeld, M.; Hessler-Kaufmann, J.B.; Skurk, T.; Quadflieg, N.; Schlegl, S.; Hauner, H.; Voderholzer, U. Measuring orthorexia nervosa: A comparison of four self-report questionnaires. Appetite 2020, 146, 104512. [Google Scholar] [CrossRef]
  34. Brytek-Matera, A. Vegetarian diet and orthorexia nervosa: A review of the literature. Eat. Weight Disord. 2019. [Google Scholar] [CrossRef]
  35. Valente, M.; Syurina, E.V.; Donini, L.M. Shedding light upon various tools to assess orthorexia nervosa: A critical literature review with a systematic search. Eat. Weight Disord. 2019, 24, 671–682. [Google Scholar] [CrossRef] [Green Version]
  36. Bert, F.; Gualano, M.R.; Voglino, G.; Rossello, P.; Perret, J.P.; Siliquini, R. Orthorexia nervosa: A cross-sectional study among athletes competing in endurance sports in northern italy. PLoS ONE 2019, 14, e0221399. [Google Scholar] [CrossRef]
  37. Brytek-Matera, A.; Czepczor-Bernat, K.; Jurzak, H.; Kornacka, M.; Kołodziejczyk, N. Strict health-oriented eating patterns (orthorexic eating behaviours) and their connection with a vegetarian and vegan diet. Eat. Weight Disord. 2019, 24, 441–452. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Brytek-Matera, A. The Polish version of the Düsseldorf Orthorexia Scale (PL-DOS) and its comparison with the English version of the DOS (E-DOS). Eat. Weight Disord. 2020. [Google Scholar] [CrossRef] [PubMed]
  39. Brytek-Matera, A. Interaction between Vegetarian Versus Omnivorous Diet and Unhealthy Eating Patterns (Orthorexia Nervosa, Cognitive Restraint) and Body Mass Index in Adults. Nutrients 2020, 12, 646. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Brytek-Matera, A. Restrained eating and vegan, vegetarian and omnivore dietary intakes. Nutrients 2020, 12, 2133. [Google Scholar] [CrossRef]
  41. Chard, C.A.; Hilzendegen, C.; Barthels, F.; Stroebele-Benschop, N. Psychometric evaluation of the English version of the Düsseldorf Orthorexie Scale (DOS) and the prevalence of orthorexia nervosa among a U.S. student sample. Eat. Weight Disord. 2019, 24, 275–281. [Google Scholar] [CrossRef]
  42. Godefroy, V.; Trinchera, L.; Dorard, G. Optimizing the empirical assessment of orthorexia nervosa through EHQ and clarifying its relationship with BMI. Eat. Weight Disord. 2020. [Google Scholar] [CrossRef]
  43. Mohamed Halim, Z.; Dickinson, K.M.; Kemps, E.; Prichard, I. Orthorexia nervosa: Examining the Eating Habits Questionnaire’s reliability and validity, and its links to dietary adequacy among adult women. Public Health Nutr. 2020, 23, 1684–1692. [Google Scholar] [CrossRef]
  44. Hayatbini, N.; Oberle, C.D. Are orthorexia nervosa symptoms associated with cognitive Inflexibility? Psychiatry Res. 2019, 271, 464–468. [Google Scholar] [CrossRef]
  45. Jovičić, A.Đ. Healthy eating habits among the population of Serbia: Gender and age differences. J. Health Popul. Nutr. 2015, 33, 76–84. [Google Scholar]
  46. Novara, C.; Pardini, S.; Pastore, M.; Mulatti, C. Ortoressia Nervosa: Un’indagine del costrutto e delle caratteristiche psicometriche della versione italiana dell’Eating Habits Questionnaire-21(EHQ-21). Psicoter. Cogn. Comport. 2017, 23, 291–316. [Google Scholar]
  47. Oberle, C.D.; Samaghabadi, R.O.; Hughes, E.M. Orthorexia nervosa: Assessment and correlates with gender, BMI, and personality. Appetite 2017, 108, 303–310. [Google Scholar] [CrossRef] [PubMed]
  48. Oberle, C.D.; Watkins, R.S.; Burkot, A.J. Orthorexic eating behaviors related to exercise addiction and internal motivations in a sample of university students. Eat. Weight Disord. 2018, 23, 67–74. [Google Scholar] [CrossRef] [PubMed]
  49. Oberle, C.D.; Klare, D.L.; Patyk, K.C. Health beliefs, behaviors, and symptoms associated with orthorexia nervosa. Eat. Weight Disord. 2019, 24, 495–506. [Google Scholar] [CrossRef] [PubMed]
  50. Oberle, C.D.; Lipschuetz, S.L. Orthorexia symptoms correlate with perceived muscularity and body fat, not BMI. Eat. Weight Disord. 2018, 23, 363–368. [Google Scholar] [CrossRef]
  51. Zickgraf, H.F.; Ellis, J.M.; Essayli, J.H. Disentangling orthorexia nervosa from healthy eating and other eating disorder symptoms: Relationships with clinical impairment, comorbidity, and self-reported food choices. Appetite 2019, 134, 40–49. [Google Scholar] [CrossRef]
  52. Voglino, G.; Parente, E.; Bert, F.; Lo Moro, G.; Corradi, A.; Lapiccirella, M.; Gualano, M.R.; Siliquini, R. Orthorexia nervosa, a challenging evaluation: Analysis of a sample of customers from organic food. Psychol Health Med. 2020, 25, 1–9. [Google Scholar] [CrossRef]
  53. Karlsson, J.; Persson, L.-O.; Sjöström, L.; Sullivan, M. Psychometric properties and factor structure of the Three-Factor Eating Questionnaire (TFEQ) in obese men and women. Results from the Swedish obese subjects (SOS) study. Int. J. Obesity 2000, 24, 1715–1725. [Google Scholar] [CrossRef] [Green Version]
  54. Brytek-Matera, A.; Rogoza, R.; Czepczor-Bernat, K. The Three-Factor Eating Questionnaire-R18 Polish version: Factor structure analysis among normal weight and obese adult women. Arch. Psychiatry Psychother. 2017, 19, 81–90. [Google Scholar] [CrossRef]
  55. Garner, D.M.; Olmstead, M.P.; Polivy, J. Development and validation of a multidimensional Eating Disorder Inventory for anorexia nervosa and bulimia. Int. J. Eat. Disord. 1983, 2, 15–34. [Google Scholar] [CrossRef]
  56. Żechowski, C. Polska wersja Kwestionariusza Zaburzeń Odżywiania (EDI)–adaptacja i normalizacja. Psychiatr. Pol 2008, 42, 179–193. [Google Scholar]
  57. Gana, K.; Broc, G. Introduction à la Modélisation par Equations Structurales. Manuel Pratique avec Lavaan; ISTE Editions Ltd.: London, UK, 2018. [Google Scholar]
  58. Cattell, R.B. The scree test for the number of factors. Multivar. Behav. Res. 1966, 1, 245–276. [Google Scholar] [CrossRef]
  59. Rosseel, Y. lavaan: An R package for structural equation modeling. J. Stat. Softw. 2012, 48, 1–36. [Google Scholar] [CrossRef] [Green Version]
  60. Hooper, D.; Coughlan, J.; Mullen, M. Structural Equation Modelling: Guidelines for Determining Model Fit. Electron. J. Bus. Res. Methods 2008, 6, 53–60. [Google Scholar]
  61. Jorgensen, T.D.; Pornprasertmanit, S.; Schoemann, A.M.; Rosseel, Y.; Miller, P.; Quick, C.; Garnier-Villarreal, M.; Selig, J.; Boulton, A.; Preacher, K.; et al. semTools: Useful Tools for Structural Equation Modeling 2015. Available online: http://cran.r-project.org/package=semTools (accessed on 4 May 2020).
  62. Chen, F.F. Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Struct. Equ. Modeling 2007, 14, 464–504. [Google Scholar] [CrossRef]
  63. dos Santos Fontes, A.; Santos, M.S.; de Almeida, M.B.; Marín, P.J.; da Silva, D.R.P.; Da Silva-Grigoletto, M.E. Inter-day reliability of the Upper Body Test for shoulder and pelvic girdle stability in adults. Braz. J. Phys. Ther. 2020, 24, 161–166. [Google Scholar] [CrossRef]
  64. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [Green Version]
  65. DeVellis, R.F. Scale Development: Theory and Applications, 4th ed.; SAGE Publications: Newbury Park, CA, USA, 2017. [Google Scholar]
  66. Hankins, M. Questionnaire discrimination: (re)-introducing coefficient delta. BMC Med. Res. Methodol. 2007, 7, 1–5. [Google Scholar] [CrossRef] [Green Version]
  67. Ebel, R.L. Essentials of Educational Measurement, 2nd ed.; Prentice-Hall: Englewood Cliffs, NJ, USA, 1972; p. 232. [Google Scholar]
  68. Cohen, J. Statistical Power Analysis for the Behavioral Science, 2nd ed.; Academic Press: New York, NY, USA, 1988. [Google Scholar]
  69. Herman, C.P.; Mack, D. Restrained and unrestrained eating. J. Pers. 1975, 43, 647–660. [Google Scholar] [CrossRef]
  70. Depa, J.; Barrada, J.R.; Roncero, M. Are the motives for food choices different in orthorexia nervosa and healthy orthorexia? Nutrients 2019, 11, 697. [Google Scholar] [CrossRef] [Green Version]
  71. McComb, S.E.; Mills, J.S. Orthorexia nervosa: A review of psychosocial risk factors. Appetite 2019, 140, 50–75. [Google Scholar] [CrossRef]
  72. Strahler, J. Sex differences in orthorexic eating behaviors: A systematic review and meta-analytical integration. Nutrition 2019, 67–68, 110534. [Google Scholar] [CrossRef] [PubMed]
  73. Hyrnik, J.; Janas-Kozik, M.; Stochel, M.; Jelonek, I.; Siwiec, A.; Rybakowski, J. K The assessment of orthorexia nervosa among 1899 Polish adolescents using the ORTO-15 questionnaire. Int. J. Psychiatry Clin. Pract. 2016, 20, 199–203. [Google Scholar] [CrossRef] [PubMed]
Nutrients 12 03820 g001 550
Figure 1. Standardized factor loadings of the three-factor model for the total sample after confirmatory factor analysis.
Figure 1. Standardized factor loadings of the three-factor model for the total sample after confirmatory factor analysis.
Nutrients 12 03820 g001
Table
Table 1. Exploratory factor analysis (EFA) results of the Polish version of the EHQ.
Table 1. Exploratory factor analysis (EFA) results of the Polish version of the EHQ.
EHQ ItemsFactor Loading
F1F2F3
1. I am more informed than others about healthy eating.0.53−0.030.21
2. I turn down social offers that involve eating unhealthy food.0.130.490.05
3. The way my food is prepared is important in my diet.0.40.030.42
4. I follow a diet with many rules.0.310.130.42
5. My eating habits are superior to others.0.83−0.070.08
6. I am distracted by thoughts of eating healthy.−0.160.560.17
7. I only eat what my diet allows.0.40.37−0.02
8. My healthy eating is a significant source of stress in my relationships.−0.120.79−0.07
9. I have made efforts to eat more healthily over time.−0.070.030.73
10. My diet affects the type of employment I would take.0.20.440
11. My diet is better than other peoples’ diets.0.790.07−0.02
12. I feel in control when I eat healthily.0.110.090.64
13. In the past year, friends or family members have told me that I’m overly concerned with eating healthily.0.150.62−0.01
14. I have difficulties finding restaurants that serve the foods I eat.0.130.58−0.05
15. Eating the way I do gives me a sense of satisfaction.0.2−0.010.39
16. Few foods are healthy for me to eat.−0.070.510.14
17. I go out less since I began eating healthily.0.090.65−0.03
18. I spend more than three hours a day thinking about healthy food.−0.10.740.09
19. I feel great when I eat healthily.−0.02−0.070.79
20. I follow a health-food diet rigidly.0.370.430.09
21. I prepare food in the most healthful way.0.160.180.47
Items in bold were included in the final Polish version of the Eating Habits Questionnaire (EHQ).
Table
Table 2. Goodness-of-fit indices of the Polish version of the EHQ (PL-EHQ) and its comparison with the original version of the EHQ, as well as with the Italian and French versions of the EHQ.
Table 2. Goodness-of-fit indices of the Polish version of the EHQ (PL-EHQ) and its comparison with the original version of the EHQ, as well as with the Italian and French versions of the EHQ.
EHQ and Its Versionsχ2pχ2dfRMSEASRMRAGFITLICFI
EHQ [18]NANANA0.07NANA0.900.91
PL-EHQ76.2400.4061.0300.0080.0560.9830.9990.999
Italian version of the EHQ [46]228.1900.020NA0.050NANANA0.990
French version of the EHQ [42]NANANA0.040.05NA0.98NA
NA—information not reported in the article; EHQ—Eating Habits Questionnaire; PL-EHQ—the Polish version of the EHQ; RMSEA—root mean square approximation; SRMR—standardized root mean square; AGFI—adjusted goodness-of-fit index; TLI—Tucker–Lewis index; CFI—comparative fit index.
Table
Table 3. Goodness-of-fit indices of models testing for cross-gender invariance.
Table 3. Goodness-of-fit indices of models testing for cross-gender invariance.
ModelCFISRMRRMSEAχ2ΔCFIΔSRMRΔRMSEAΔχ2
Female0.9450.0420.046160.881
Male0.9250.0500.044126.038
Configural0.9350.0450.046289.515
Metric0.9570.0480.036250.5850.0220.0030.0138.93
Scalar0.9590.0480.034258.2810.00100.0027.696
Strict0.9610.0510.032267.90.0020.0030.0029.619
CFI—comparative fit index; SRMR—standardized root mean square; RMSEA—root mean square approximation.
Table
Table 4. Correlations for study variables.
Table 4. Correlations for study variables.
VariablesAgeBMIBDEHQKPF&BUEEE
1. Age
2. Body mass index0.22 *
3. Body dissatisfaction (EDI)0.010.18 *
4. Eating Habits Questionnaire total score−0.05−0.06 *0.11 *
5. Knowledge (EHQ)0−0.08 *−0.010.76 *-
6. Problems (EHQ)−0.07 *−0.040.14 *0.81 *0.38 *
7. Feelings and behaviors (EHQ)−0.04−0.040.1 *0.83 *0.58 *0.43 *
8. Uncontrolled eating (TFEQ-R18)−0.16 *0.040.11 *0.1 *00.11 *0.11 *
9. Emotional eating (TFEQ-R18)−0.1 *0.12 *0.14 *0.11 *0.030.1 *0.12 *0.74 *
10. Cognitive restraint (TFEQ-R18)−0.020.1 *0.08 *0.32 *0.24 *0.24 *0.3 *0.33 *0.34 *
BMI—body mass index, EDI—Eating Disorder Inventory; BD—Eating Disorder Inventory—Body Dissatisfaction Scale; EHQ—Eating Habits Questionnaire; TFEQ-R18—Three-Factor Eating Questionnaire, K—knowledge (EHQ), P—problems (EHQ), F&B—feelings and behaviors (EHQ), UE—Uncontrolled eating (TFEQ-R18), EE—Emotional eating (TFEQ-R18); * p < 0.05.
Table
Table 5. Means, standard deviation, and Wilcoxon–Mann–Whitney statistics for study variables.
Table 5. Means, standard deviation, and Wilcoxon–Mann–Whitney statistics for study variables.
MeasureFemaleMaleU (1, 965)p-Valued
MSDMSD
EHQ25.77.3224.76.91121732 *0.038 a0.14
Knowledge (EHQ)5.962.335.632.181129330.990
Problems (EHQ)10.873.6910.453.481210990.0500.17
Feelings and behaviors (EHQ)3.143.098.623.00124090 **0.008 a
Body dissatisfaction (EDI)1.410.491.380.491151780.433
Cognitive restraint (TFEQ-R18)9.753.7511.834.0379207 ***<0.001 a−0.54
Uncontrolled eating (TFEQ-R18)10.22−6.0315.067.1167251 ***<0.001 a−0.75
Emotional eating (TFEQ-R18)3.732.684.933.0586818 ***<0.001 a−0.43
Body mass index22.263.7622.853.79101221 **0.006 a−0.15
Age23.865.7722.623.3461190160.147
EHQ—Eating Habits Questionnaire; EDI—Eating Disorder Inventory; TFEQ-R18—Three-Factor Eating Questionnaire. a—Numbers that indicate significant p-values: * p < 0.05; ** p < 0.01; *** p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Brytek-Matera, A.; Plasonja, N.; Décamps, G. Assessing Orthorexia Nervosa: Validation of the Polish Version of the Eating Habits Questionnaire in a General Population Sample. Nutrients 2020, 12, 3820. https://doi.org/10.3390/nu12123820

AMA Style

Brytek-Matera A, Plasonja N, Décamps G. Assessing Orthorexia Nervosa: Validation of the Polish Version of the Eating Habits Questionnaire in a General Population Sample. Nutrients. 2020; 12(12):3820. https://doi.org/10.3390/nu12123820

Chicago/Turabian Style

Brytek-Matera, Anna, Natalija Plasonja, and Greg Décamps. 2020. "Assessing Orthorexia Nervosa: Validation of the Polish Version of the Eating Habits Questionnaire in a General Population Sample" Nutrients 12, no. 12: 3820. https://doi.org/10.3390/nu12123820

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop