Validation and Test of Measurement Invariance of the Adapted Health Consciousness Scale (HCS-G)

The objective of this study was the translation and validation of a health consciousness scale in order to provide an economically and empirically confirmed measurement of health consciousness, which is associated with health-related behavior. We evaluated this translation on the basis of psychometric testing in a German convenience sample. A cross-sectional online survey (n = 470) was carried out using a translated version of the health consciousness scale, oriented on the basis of international guidelines. As previous studies have not consistently confirmed the factorial structure of the health consciousness scale, we conducted a Confirmatory Factor Analysis to verify its factorial structure. Furthermore, we cross-validated the questionnaire with other scales in order to verify convergent and discriminant validity. The results indicated a two-factor solution for the Health Consciousness Scale-German (HCS-G). The criterion validity was confirmed on the basis of a significantly positive correlation between the HCS-G and health literacy. Furthermore, strict measurement invariance was able to be verified, indicating that the HCS-G is an applicable measurement, regardless of gender. In practical research, this questionnaire can help to assess health consciousness and its influence on health-related constructs. Future studies should consider possible mediating variables between health consciousness and health outcomes.


Introduction
Health-related or preventive behaviors are an omnipresent topic in research. Metaanalyses as well as reviews have shown their influence on physical and mental health [1,2]. For example, reviews and different studies have found correlations between healthy diets and cardiovascular, metabolic (e.g., Diabetes mellitus), or oncological diseases [3][4][5]. Health-related and preventive behaviors such as physical activities are also recommended by international societies and studies, which have shown positive effects on disease prevention [6][7][8][9]. Furthermore, during the Covid-19 pandemic, preventive behavior seems key to protection from infection with the Covid-19 virus [10,11].
Different determinants of these health-related or preventive behaviors have been identified in studies [12][13][14][15]. These studies show that attitudes toward one's own health or the perception of one's health status are possible determinants of health-related or preventive behaviors. Constructs such as health consciousness [12], health orientation [16], health conception [17] and health locus of control [18] are psychological constructs that have been explored in health science that influence these behaviors. The construct of health consciousness, especially, focusses on one's own perception of health status, and is described by Gould [12] as a self-awareness regarding one's own health. Gould [12,19] distinguished between four different dimensions focused on an individual's psychological inner state towards health-related awareness: health self-consciousness, health alertness, health self-monitoring and health involvement. Health consciousness and its interrelations related and preventive behavior in the German population. Furthermore, different studies (e.g., [22,31,32]) using the health consciousness scale have shown ambiguous factorial structures, which have seldom been validated, while only rarely representing the assumed factorial structure of Gould [12].
In summary, we are appealing to different aims by conducting this validation study of a psychometric instrument measuring health consciousness. Due to the practical and scientific demands and the described limitations, we focused on four objectives. First, we wanted to develop a validated and a translated version of the health consciousness scale in German language according to common scientific recommendations [33,34] to ensure content validity. Second, we aimed to verify a valid factorial structure of this new instrument. For this purpose, we performed Confirmatory Factor Analysis (CFA) to examine the factorial structure of the translated instrument. Additionally, to confirm construct validity, we scrutinized convergent and discriminant validity. To verify convergent validity, we assumed a positive correlation between health consciousness and personality trait conscientiousness, because both constructs describe a person's tendency to be aware of and responsive to one's surroundings in a thoughtful way. We assumed that personality trait openness would be associated with health consciousness, because both constructs symbolize a person's interest in searching for and discovering changes and improvements in one's life with respect to health status and life situations (e.g., [37]). Moreover, as health consciousness focuses on a mindful handling of one's body, we expected a negative interrelation with impulsivity. To verify discriminant validity, we looked at interrelations with different personality traits such as extraversion and neuroticism, assuming no significant correlations, as there were no content-related overlaps with health consciousness. Third, we wanted to ensure the criterion validity of the adapted instrument. For this purpose, we asked participants about their health literacy and the frequency with which they had used medical or therapeutic help within the previous twelve months. As in the original study of Gould [12], there were, unexpectedly, no significant interrelations found between health consciousness and physical or mental health, we captured these constructs as well. Fourth, we wanted to perform an analysis of measurement invariance of the Health Consciousness Scale-German (HCS-G) regarding gender. To our knowledge, there is no study examining measurement invariance of health consciousness between women and men. Nevertheless, a lot of studies have shown differences between women and men regarding their health and preventive behavior, such as their use of health services [38], their attitude towards seeking psychological help [39], and health status [40]. However, interpretation of gender differences should be made with caution when the measurement invariance of the applied instruments has not been confirmed. Therefore, it is essential to ensure measurement invariance between women and men, as increasingly frequently examined in recent studies (e.g., [41][42][43]).

Adaption of the HCS-G and Study Design
We conducted the translation following the guidelines for translation of academic literature to ensure content validity [33,34]. The translation was conducted in four steps. In a first step, the items were translated into German by two authors, and these translations were merged into a first translation proposal. In the second step, a systematic expert panel consisting of the two translators and two psychologists discussed the merged items. The two psychologists were experts within the context of healthcare. In a third step, the resulting items in the German language were translated back into English by an English native speaker, confirming that their meaning was consistent with the original items. In a fourth step, cognitive interviews were conducted to ensure easy understanding, and inoffensive and non-discriminatory phrasing of the items. The resulting final version of the translated questionnaire consisted of nine items. The original items, as well as the translated items, are displayed in Table S1. We used a 5-point Likert scale from 1 = "strongly disagree" to 5 = "strongly agree". A sample item is "I'm very involved with my health".
We clustered the items according to the assumed factorial structure of Gould (1990): health self-consciousness, health alertness, health self-monitoring and health involvement [12].
Our cross-sectional online survey was conducted between October 2020 and November 2020 in a German-speaking convenience sample. Participants were recruited via online social networks like Xing, LinkedIn, and Facebook. All data were collected anonymously. We considered completed data sets only. We conducted the study according to the guidelines of the Declaration of Helsinki and the Ethics Committee of the Medical Faculty of the University of Duisburg-Essen approved our survey (approval number 20-9592-BO).

Participants
524 participants completed our questionnaire which represents a completion rate of 32%. Participants who took less than 5:34 min (5% percentile) or more than 25:45 min (95% percentile) to complete the survey were excluded from the analysis. We decided not only to exclude extreme fast responders but also extreme slow responders as we wanted to ensure that our analysis was based on an average sample where possible biases in response behavior were minimized. Furthermore, we excluded one participant for being under 18 years of age. One person indicated their gender as "diverse", which we excluded to perform the analysis of measurement invariance of gender. The resulting sample consisted of n = 470 participants, which is in accordance with the sample size recommendation for test validation [44,45].

Study Variables
The following measurements were captured to cover the study objectives. Prior to the statistical analyses, inverted items were recoded.

Health Literacy
The Health Literacy Questionnaire (HLS-EU-Q16) measures health literacy with 16 items [46]. A sample item is "How easy/difficult is it to find information on treatments of illnesses that concern you?". Health literacy was measured on a two-point scale (easy/hard), resulting in a sum-score of health literacy between 0 and 16.

Impulsivity
The Impulsive Behavior-8 Scale (I-8) measured impulsivity using eight items (e.g., "Sometimes I spontaneously do things that I should not have done" [47].

Personality Traits
The BFI-10 [48] measures personality traits (extraversion, neuroticism, openness, conscientiousness, agreeableness), which are each assessed by two items. A sample item for neuroticism is "I get nervous and insecure easily". The reliabilities of conscientiousness and agreeableness were low, as the items capturing these constructs represent different contents of these traits. One item of conscientiousness measures if one tends to laziness, while the other measures if one completes tasks thoroughly. As we judged both aspects of conscientiousness to be highly relevant in the context of health consciousness, we decided to use the single items in further analyses. As agreeableness was not regarding as contributing to the validation of health consciousness, it was excluded from further analyses.

Further Constructs
Physical health and mental health were measured using self-developed single items on an 11-point Likert scale (0 = "very bad health" to 10 = "very good health"). Furthermore, we asked participants about their frequency of use of medical or therapeutic help within the previous twelve months from 1 = "never" to 6 = "every week".
Additionally, sociodemographic variables (age, gender, marital status, educational level, financial situation, and residential area) were assessed.

Statistical Analysis
All statistical analyses were performed with R, RStudio and additional packages [49][50][51][52][53][54][55]. We first examined sample characteristics and item statistics of the HCS-G. To investigate the factorial structure of the health consciousness items, we conducted several Confirmatory Factor Analyses. We considered the recommendations of Hu and Bentler [56] for model evaluation. We examined Comparative Fit Index (CFI), Tucker Lewis index (TLI), Root Mean Square Error of Approximation (RMSEA), and Standardized Root Mean Square Residual (SRMR), as well as the factor loadings of items, to determine which model fits best to the data. As we collected survey data, we assumed data to be ordinal level rather than interval level. The use of Weighted Least Square Mean and Variance Adjusted estimator (WLSMV) is recommended for ordinal data rather than the Maximum Likelihood Robust estimator (MLR) in terms of the robustness of estimations of factor loadings and model fit indices [57]. Therefore, we conducted the CFA using the WLSMV estimator. However, WLSMV tends to overestimate inter-factor correlations, which will be taken into account in the discussion section [57,58]. Furthermore, we calculated Cronbach s alpha (CA) with 95% confidence interval boundaries (CI) to report the reliability of the HCS-G, as well as the scales for construct and criterion validation.
To scrutinize the convergent, discriminant, and criterion validity of health consciousness, we performed two-tailed Pearson correlations and considered correlations to be significant at p < 0.05.
We examined measurement invariance to test whether the measurement of health consciousness was equally appropriate for both genders. The test of measurement invariance follows four sequential steps. Each step assumes a more constrained model. In step one, the number of factors and the factor-to-indicator relationship were considered to be equal between genders, which describes configural invariance. In step two, we scrutinized metric invariance by additionally keeping factor loadings equal between genders. Moreover, in step 3 (scalar invariance), intercepts are kept equal. Finally, the most constrained model 4 (conservative invariance) assumes the equality of residual variances. A more constrained model can be accepted in cases where the differences between it and the less constrained model are low [59,60]. The WLSMV estimator is also used for measurement invariance in order to compare the different models. As the interpretation of results of measurement invariance using the WLSMV estimator is limited, especially regarding changes in Chi 2 , we focus on changes in CFI and the other fit indices [61][62][63].

Study Sample
After the described case exclusion, average completion time of our survey was 11:32 min (SD = 4:24 min, Median = 10:38 min). The mean age of our participants was 37.2 (SD = 13.4, Median = 33, Minimum = 18, Maximum = 82). Table 1 shows detailed sociodemographic characteristics of the study sample. Table 2 depicts the item statistics of the nine items of the preliminary HCS-G. The last characters indicate the subscales as proposed in the original study (C = self-consciousness; I = involvement; A = alertness; M = self-monitoring).

Item Statistics
All item distributions are slightly negatively skewed. Items hcon3C (health selfconsciousness), hcon5A and hcon6A (both health alertness) showed high values of kurtosis. Response distribution and SD indicated that these items were poor in generating variance between participants.

Confirmatory Factor Analyses
In our first model, all nine items loaded on a single factor. Model 2 considered the proposed subscales of the original study from Gould, 1990 [12]. Due to poor item statistics of three items (hcon3C, hcon5A and hcon6A) and their low factor loadings, we conducted a third model as a single factor model with remaining items. We verified a fourth model as a three-factor model with intercorrelated factors. Since in this model the subscales of health self-consciousness and health involvement were highly correlated (r = 0.93, p < 0.001), we carried out a fifth CFA as a two-factor model with items of health self-consciousness and health involvement considered as one factor. A second-level factor of health consciousness led to convergence problems just as Gould reported in his study [12]. Therefore, we assumed health consciousness to consist of two intercorrelated constructs which measure different aspects of health consciousness. Table 3 shows the results of performed CFA. In the three-factor (short) model, reliabilities for health self-consciousness, health involvement, and health self-monitoring were 0.74 (CI = 0.69-0.79), 0.80 (CI = 0.76-0.83), and 0.84 (CI = 0.81-0.87), respectively. Within the two-factor (short) model, items of health self-consciousness and health involvement were considered to load on a single factor, which reached a reliability of 0.85 (CI = 0.83-0.88). Considering these results, the two-factor (short) model was assumed to best represent the construct of health consciousness. In fact, the three-factor (short) model had partly better fit indices than the two-factor (short) model. Nevertheless, the correlation of 0.93 between self-consciousness and involvement strongly indicated that those two subscales were measuring the same content. Moreover, the two-factor (short) model was a less constrained model, representing a more applicable and parsimonious model.  Figure 1 shows the final two-factor (short) model with factor loadings as well as inter-factor correlation. In the three-factor (short) model, reliabilities for health self-consciousness, health involvement, and health self-monitoring were 0.74 (CI = 0.69-0.79), 0.80 (CI = 0.76-0.83), and 0.84 (CI = 0.81-0.87), respectively. Within the two-factor (short) model, items of health selfconsciousness and health involvement were considered to load on a single factor, which reached a reliability of 0.85 (CI = 0.83-0.88). Considering these results, the two-factor (short) model was assumed to best represent the construct of health consciousness. In fact, the three-factor (short) model had partly better fit indices than the two-factor (short) model. Nevertheless, the correlation of 0.93 between self-consciousness and involvement strongly indicated that those two subscales were measuring the same content. Moreover, the two-factor (short) model was a less constrained model, representing a more applicable and parsimonious model. Figure 1 shows the final two-factor (short) model with factor loadings as well as interfactor correlation.

Validation Analyses
As described, our CFA process found the two-factor (short) model with intercorrelated factors to best fit the data. Therefore, we conducted the following analyses, considering the two identified factors self-consciousness (M = 3.81, SD = 0.77) and self-monitoring (M = 3.40, SD = 0.89) as independent variables.

Health Consciousness and Sociodemographic Variables
To test whether health consciousness differs between genders, two-sided t-tests were conducted. There was no significant difference between men and women in selfconsciousness (t = 1.37, p = 0.17) or self-monitoring (t = 0.30, p = 0.77). Further interrelations between health consciousness and sociodemographic variables are shown in Table 4.
The results show that there are no significant correlations between self-consciousness or self-monitoring and sociodemographic variables, except for educational level, which correlated significantly negative with self-monitoring (r = −0.13, p = 0.006).  Table 5    Looking at convergent validity, both HCS-G scales correlated significantly positively with openness and significantly negatively with impulsivity. Furthermore, both items of conscientiousness were significantly interrelated with self-consciousness, but not with self-monitoring. Considering discriminant validity, correlations of both HCS-G scales with personality traits of extraversion and neuroticism were not significant.

HCS
Regarding criterion validity, correlations between the health consciousness scales and the health-related construct of health literacy (M = 12.63, SD = 2.99, CA = 0.79, CI = 0.76-0.81), as well as the frequency of use of medical or therapeutic help (M = 3.80, SD = 1.50) are shown in Table 6. Table 6. Pearson correlations of health consciousness and criterion validity scales.

Measurement Invariance
The tests of measurement invariance regarding the gender of participants were conducted on the final two-factor model. Table 7 shows the results of these analyses. At all levels of measurement invariance, only small changes in CFI and the other fit indices could be observed. Improvement of RMSEA can be explained by the sensitivity of this fit index to small degrees of freedom [64].

Discussion
The most essential strengths of our study are due to the high methodological and psychometrical standards applied to the validation and adaptation of the HCS-G. In this regard, this study confirmed its content, construct, and criterion validity. Another main strength of this study is the confirmation of measurement invariance with respect to gender. To our knowledge, no other study has examined the measurement invariance of the health consciousness construct or revealed methodological insufficiencies.
Our first aim was to develop a valid version of the health consciousness scale in the German language and to confirm the content validity of our new instrument, which we achieved by strongly following the scientific recommendations implied by the development of the HCS-G. To achieve our second aim, we validated our new instrument by performing several Confirmatory Factor Analyses to examine the factorial structure. Within the correlational analyses, we verified convergent and discriminant validity with respect to construct validity. We followed a stepwise CFA approach in order to acquire the best-fitting and most parsimonious model. Therefore, we excluded single items, resulting in a six-item model that represents health consciousness on two subscales. To our knowledge, this is the first study to critically examine the assumed factorial structure according to Gould [12]. A twofactorial structure best represented the construct of health consciousness, while also solving the convergence problems of Gould's original instrument [12] and confirming a valid factorial structure which has been neglected in other studies so far [21,32,[65][66][67]. Our final model achieved good fit indices and factor loadings of the items representing the factors self-consciousness and self-monitoring. A slight to high value of RMSEA can be explained by its sensitivity to small degrees of freedom, which was true for the tested model [64]. Both factors were significantly positively interrelated, but represented different aspects of health consciousness, as confirmed by our correlational analyses. Self-consciousness can be understood as the awareness of one's health in the long term, whereas self-monitoring focuses more on daily routines of self-observation.
As expected, the HCS-G scales were significantly positively correlated with consciousness and openness, as well as being significantly negatively correlated with impulsivity, indicating convergent validity. This indicates that a greater score in the HCS-G scales is associated with greater conscientiousness and openness, and lower impulsivity. Furthermore, the HCS-G scales did not correlate with constructs that were different from health consciousness (extraversion and neuroticism), confirming discriminant validity. Surprisingly, HCS-G (sm) was significantly negatively correlated with educational level. This result replicates the findings of Gould [12], who suggested that people with lower educational levels may spend more time on their health, resulting in a higher health consciousness. Nevertheless, a valid explanation of this relationship is still lacking. One could also think that conceptions regarding one's health and health consciousness might carry different meanings in different educational levels, resulting in different relational patterns. However, as our sample mainly consisted of higher-educated people, it was not possible to administer an in-depth analysis within a subsample of lower-educated people. Hence, future studies should examine this relationship in lower-educated subsamples or from a causal viewpoint.
Regarding our third aim, the criterion validity of the HCS-G was confirmed by verifying a positive correlation between both scales of health consciousness and health literacy. This indicates that a greater score in the HCS-G scales is associated with greater health literacy, which is in agreement with the results of Gould [12]. It is possible that people with greater health consciousness examine their health more precisely and look for health information from different sources in order to assess their own state of health. Furthermore, as health literacy can be understood as a competence in dealing with one's health issues, which is associated with many health-related outcomes (e.g., [68][69][70]), health consciousness is a highly relevant construct in the understanding of a holistic concept of people's health. However, only HCS-G (sc) was significantly correlated with the use of medical or therapeutic assistance, indicating that highly self-conscious people use medical or therapeutic help more often. HCS-G (sm) was not significantly correlated with the frequency of medical or therapeutic help, which could be explained by the fact that self-monitoring items tend to focus on daily routines, while self-consciousness items tend to be oriented towards long-term aspects. Unexpectedly, health consciousness was not correlated with possible outcome variables of physical and mental health, which is in agreement with the results of Gould [12]. We assumed health consciousness to be related to higher physical and mental health statuses. To explain these findings, one could think that people with lower subjective health statuses may be forced to become more concerned with their health, leading to higher scores in health consciousness. Furthermore, several studies have shown that conceptualizations, attitudes, and intentions are not causally linked to actual health behavior [71][72][73]. In consequence, the relationship between health consciousness and health-related outcomes may be mediated by other variables. Future studies should investigate possible mediating variables between health consciousness and health outcomes.
In the case of the Covid-19 pandemic, health consciousness could be a relevant psychological construct for preventing further Covid-19 outbreaks. In our study, health consciousness and health literacy are associated constructs. Thus, one could assume that health-conscious people will be more likely to be self-aware and vigilant with respect to diseases and their influences on the body. Furthermore, health-conscious people will be more likely to understand Covid-19 interventions and to comply with the regulations, resulting in a reduced spread of Covid-19. The compliance with the regulations [74] is a relevant indicator for the prevention of an infection. Thus, health-conscious people could be more likely to successfully avoid Covid-19 infection, e.g., because of a higher adherence to safety behaviors [75]. Future studies should take the associations between health consciousness and infection prevention, especially infection with Covid-19, into account precisely because health consciousness could be a relevant mediator in the association between prevention knowledge and prevention behavior in Covid-19 infection [76].
Our fourth aim contributed an examination of the measurement invariance of health consciousness between women and men. The measurement invariance of the HCS-G with respect to gender was confirmed, verifying that the HCS-G is a reliable instrument for measuring health consciousness and interpreting gender differences. Measurement invariance is an essential requirement when measurements are used to interpret differences between groups. Through the confirmation of the measurement invariance of the HCS-G with respect to gender, the interpretation of differences in gender can be regarded as valid, i.e., the differences found are not a result of the measurement method itself. Therefore, our instrument provides researchers as well as practitioners the opportunity to capture and interpret gender differences with respect to health consciousness, as well as to develop and evaluate interventions in consideration of gender. In conclusion, the HCS-G is an ideal instrument for practical applications, as the interpretation of the results is carried out independently of gender. As health consciousness is a relevant construct with respect to both maintaining health and influencing health-related behavior, the HCS-G can be used during the diagnostic process as one of the resources for patients. By considering two aspects of health consciousness, the HCS-G can also be used to develop and evaluate psychological training with the aim of improving health consciousness.
Nevertheless, limitations have to be considered in this study. One limitation is related to the cross-sectional study design. Thus, correlations are not causally interpretable, but show relationships between the different measured constructs. A second limitation with respect to our study design is related to the method of data collection being via an online survey, which could lead to a selection bias. It is likely that only participants who were familiar with the use of the Internet took part in our study. A third limitation is related to our distribution of educational levels: a high proportion of people that took part in our study held a university degree, limiting the representativeness with respect to educational level. Even though it was our goal to collect data on a convenience sample representing the German population, the study sample did not reflect a balanced gender distribution (71% female participants).

Conclusions
Health consciousness is a highly relevant psychological construct in the context of several health-related outcomes and in examining people's health. We conducted our study with a focus on the highest methodological and sychometrical standards in order to provide a valuable opportunity to measure health consciousness, especially when it comes to the interpretation of gender differences. Until now, a deeper understanding of the factorial structure, as well as the validity, of the measurement of health consciousness has been missing. The HCS-G fills this important gap and enhances the field of application by confirming the measurement invariance. Furthermore, the HCS-G is the first instrument to measure this highly relevant construct in the German language.