1. Introduction
Health literacy (HL) refers to the ability of individuals to obtain, understand and process basic health information or services and to make correct health decisions [
1]. The level of HL is related to the health status of individuals and even society as a whole. At present, HL has become the core goal of international public health. Improving HL plays a key role in improving the overall health level of the population, the utilization rate of preventive health services, reducing hospitalization rates and strengthening disease prevention and control. In 2008, the Ministry of Health of China issued 66 items of Chinese Citizens’ Health Literacy—basic knowledge and skills, which is an official document to elaborate on the content of citizens’ basic health literacy. Continuous monitoring of HL has been carried out throughout China.
Nutrition literacy (NL) is an important part of HL that refers to the ability of individuals to obtain, understand and process nutritional information or services and to use information and services to make correct decisions so as to maintain and promote their own health [
2]. NL can affect individual food choices and dietary behavior [
3], so it is of great significance in promoting health and nutrition-related chronic disease control [
4,
5].
Lactation is a special physiological stage in which mothers feed infants with breast milk to achieve the best growth and development and lay the foundation for their adult health. At this stage, lactating women not only produce enough breast milk to feed their offspring but also gradually compensate for their physical consumption during pregnancy and delivery, so their energy and nutritional requirements are significantly higher than those of non-lactating women. However, nutrition and health-monitoring data show that Chinese lactating women have a variety of nutritional problems, such as unreasonable dietary structure, insufficient intake of micronutrients, weight retention and so on [
6,
7,
8].
In recent years, studies have pointed out that the lack of NL may be an important cause of nutritional health problems. Improving NL during lactation is the basic measure to promote the health of lactating women. Improving the NL level of lactating women contributes to improving their ability to acquire, apply and identify nutritional knowledge and establishing healthy eating habits and improving feeding skills, which has a positive impact on both mothers and infants. Therefore, improving the NL is an important measure to promote the health status of lactating women, prevent nutrition-related chronic diseases and is conducible to the healthy growth and development of their offspring. The nutrition literacy assessment instrument is an effective method to measure the level of NL. At present, a nutrition literacy assessment instrument for general adults, school-age children and the elderly has been developed at home and abroad, and there is an urgent need to establish an assessment instrument suitable for lactating women. The research group has established a total of 24 core items of NL for Chinese lactating women [
9]. Based on this, this study aims to establish and validate the instrument for assessing the NL of Chinese lactating women and then apply it to the target population.
2. Materials and Methods
This study was carried out in two phases:
Phase 1 was the establishment of NL core items for lactating women in China.
Phase 2 was conducted for the development, validation and application of NLAI-L.
The flow chart of the study is demonstrated in
Figure 1.
Based on 66 items from Chinese Citizen’s Health Literacy—basic knowledge and skills, the research group systematically reviewed the literature, combined with the main nutrition-related problems existing during lactation in China, and selected dietary and nutrition-related recommendations for lactating women to form a list of NL items for lactating women. After two rounds of Delphi expert consultation and adjustments, 24 items were selected as core items of NL for lactating women. The core items are divided into three dimensions (basic knowledge and concept, lifestyle and dietary behavior and basic skills) and 10 topics (feeding knowledge, nutrition concept, food and nutrition knowledge, lifestyle, feeding behavior, dietary behavior, supplementary food production, nutrition information acquisition, information identification and decision-making).
The core items were scientific, reliable and had been previously published [
9]. The NL core items for Chinese lactating women are shown in
Table 1.
2.1. The Development of NLAI-L
Based on the NL core items for lactating women mentioned above, the initial NLAI-L was conducted, consisting of three dimensions, eight topics and 54 questions.
A total of 811 questionnaires were collected, of which 793 were valid. Inclusion criteria were age ≥ 18 years old, being able to read and understand words correctly, no mental disorders (diagnosed mental disorders including bipolar disorder, schizophrenia, paranoid mental disorder, etc.), no malignant tumors and willingness to participate in the survey. Exclusion criteria were cognitive dysfunction and incapability of cooperating with the questionnaire survey. Before collecting data, all respondents signed their informed consent. The research was approved by the Medical Ethics Committee of Peking University (IRB00001052-17107).
Respondents were randomly divided into two groups, with the first group (n = 396) selected for the development of NLAI-L and the second group (n = 397) selected for the validation of NLAI-L. After consultation with experts (two doctoral supervisors majoring in maternal and child nutrition, two master’s degree supervisors, and two doctoral students majoring in nutrition and food hygiene) and selection of questions, the finalized NLAI-L consisted of three dimensions, nine topics under dimensions and a total of 38 questions.
The whole NLAI-L consisted of two parts: The first part was designed to collect the demographic, information such as age, ethnicity, occupation and education level. The second part was the NL questionnaire for Chinese lactating women. The scoring standards of each question were detailed as follows:
The questions included single-choice, multiple-choice questions and Likert-type questions. Single-choice questions were scored 2 points for correct answers and 0 points for errors. Five-point Likert graded questions were divided into five levels: “strongly disagree”, “disagree”, “unsure”, “agree” and “strongly agree”. If the question was positive, choose “very agree” to score 2 points, choose “agree” to score 1 point, choose “uncertain” or “disagree” or “very disagree” to score 0, and vice versa. Further, the score of one question for food classification was 2 points, which was divided into 10 questions, with 0.2 points for each question and answer and no score for wrong answers.
2.2. The Validation of NLAI-L
2.2.1. Sample Size
According to the exploratory factor analysis, it was considered sufficient to perform reliability and validity tests when the number of the sample size was five to ten times the number of questions [
10]. Boomsma [
11] recommended that the sample size for confirmatory factor analysis should not be less than 200. Some research points out that a sample size of about 300 is ideal, and a sample size of about 150 is sufficient [
12]. A total of 397 participants were used for the validity test, so the sample size in our study was acceptable.
2.2.2. Validity Test
- (1)
Content validity
Experts in relevant fields were invited to evaluate the questionnaire questions. There were six assessment experts included. Content validity was evaluated using the content validity index (CVI) and content validity ratio (CVR).
When testing the content validity index (CVI), experts filled out the five-point Likert scale according to relevance and rated each question. The scale was set as follows: (1) very irrelevant, (2) irrelevant, (3) general relevant, (4) relevant, (5) very relevant. Calculate the item content validity index (I-CVI) of the project by dividing the total number of experts who selected options four and five by the total number of experts. When the entry I-CVI ≤ 0.78, consider revising or adjusting [
13]. The scale validity index (S-CVI) was calculated as the average of I-CVI. The content validity ratio (CVR) was calculated using the Lawshe formula to measure the importance of the survey items [
14]. The experts defined the purpose of the questionnaire and provided the relevant operational definitions of the content questions. Each question was given to experts based on a three-point Likert special scale, and each question was rated respectively. Entries are (1) unnecessary, (2) useful but unnecessary and (3) necessary. Entries with CVR < 0.60 are substandard. Revise projects with CVR between 0.60 and 0.80.
Pearson correlation coefficient was computed to analyze the correlation between NL questions and the total score of each dimension. When
p < 0.05, it indicates that the correlation between questions and dimension scores was statistically significant. When r > 0.2, the correlation is good [
15].
- (2)
Construct validity test
Exploratory factor analysis (EFA) is used to establish the theoretical framework for each dimension. Kaiser–Mayer–Olkin (KMO) and Bartlett’s spherical test is used to check the suitability of EFA.KMO > 0.5, and
p < 0.05 in Bartlett’s test of sphericity suggests the feasibility of EFA [
16].
Confirmatory factor analysis (CFA) is used to verify the theoretical framework established by EFA and to test the authenticity and appropriateness of the construct validity. In this study, the overall model adaptation index refers to the Root Mean Square Error of Approximation (RMSEA). If RMSEA is less than 0.08, the model is acceptable, and if RMSEA is less than 0.05, the model fits well. The larger the CFI and TLI and the smaller the RMSEA, the better the model [
17]. The reasonable criteria of other indices were as follows: the Comparative Fit Index (CFI) >0.90, the Adjusted Goodness of Fit (AGFI) ≥ 0.80 [
18,
19] and the ratio of χ
2 to the degree of freedom (χ
2/
df) <3 [
20].
2.2.3. Reliability
Cronbach’s α coefficient is the most commonly used measurement method at present. Cronbach’s α > 0.7 indicates that the questions in the total scale are consistent [
21].
Split-half reliability is also often used to test the consistency of the scale across dimensions [
22]. The questions of each dimension of the scale are divided into odd and even halves, and the correlation between the scores of the two parts is calculated. The calculation is to be corrected and restored by Spearman–Brown formula.
2.3. The Application of NLAI-L
To evaluate the NL level of lactating women in China and analyze the potential influencing factors, 622 lactating women were included in our study. The on-site investigation and online survey were carried out. The inclusion and exclusion criteria were the same as that mentioned above.
2.4. Data Analysis
The CFA was carried out using software AMOS23.0 (SPSS Inc., Chicago, IL, USA). The analysis for exploring potential factors was carried out using R4.2.2 (R Foundation for Statistical Computing;
http://www.rproject.org (accessed on 10 February 2023)). Multiple linear regression model was performed to determine the factors related to NL levels of Chinese lactating women. To exclude the influence of confounding factors to some extent, factors with
p < 0.10 in the one-way analysis were included in the multivariate analysis model. The significance level of the statistical test was 0.05 on both sides.
4. Discussion
In this study, an effective and reliable instrument for evaluating the NL of Chinese lactating women (NLAI-L) was established qualitatively and quantitatively. In terms of content, NLAI-L includes three dimensions of knowledge, behavior and skills; nine topics (the first part: feeding knowledge, nutrition and health, food and nutrition; the second part: feeding knowledge, diet and lifestyle, reading and understanding of labels, information acquisition and decision-making of nutritional information, infant weight management, breastfeeding mother weight management); and 38 questions in total.
The knowledge dimension contains 22 questions, which is the most among the three dimensions. For the content of knowledge dimension, it consists of four topics representing feeding knowledge 1, nutrition and health knowledge, food and nutrition knowledge and feeding knowledge 2. From the results of item analysis and exploratory factor analysis, the topic of feeding knowledge is divided into two parts. The first part is mainly a five-point Likert scale, which primarily evaluates the breastfeeding knowledge recognition of breastfeeding mothers, while the second part is mainly information through single-choice and multiple-choice questions focusing on the details of specific feeding knowledge. Among the topics of food and nutrition knowledge, questions focus on food sources of important nutrients during lactation and their health effects. Gibbs also stressed the importance of popularizing the effects of nutrients in food on disease and health outcomes in nutrition education [
5]. Nutrition and health knowledge involve questions such as a balanced diet and avoiding tobacco and alcohol during breastfeeding, emphasizing the importance of a healthy lifestyle to maternal and fetal health. In the feeding knowledge, the questions listed emphasize the importance of breastfeeding during lactation, feeding skills and the timing and skills of supplementary feeding, which have important guiding significance for breastfeeding.
For the behavior dimension, the research group modified the topics of the behavior dimension, divided the relevant questions of feeding behavior into the knowledge dimension and retained only the lifestyle and eating behavior part. The reason for this is that most of the lactating women’s children are not old enough to add supplementary food, so the questions of feeding behavior are more appropriate as the examination of feeding knowledge. The dimension question belongs to functional NL, and the questions of lifestyle and eating behavior cover different types of food intake, water intake during lactation, milk and dairy product intake and so on. This is reflected in other NL assessment instruments [
23,
24,
25,
26].
Four topics were revealed in the skill dimension, representing the interpretation of nutrition labels, nutrition information acquisition and decision-making, weight management for infants and weight management for lactating women. In terms of content, the questions in the skill dimension tend to be functional and critical NL. The part regarding the interpretation of nutrition labels mainly examines the ability of nursing mothers to cook and apply nutrition labels, including judging the nutritional composition of food, so as to make a reasonable choice of food. In most assessment instruments, reading nutrition labels is an important part of the investigation [
5,
23,
27,
28,
29]. The part regarding weight management for lactating women involves the aspect of breastfeeding mothers’ BMI classification and postpartum weight recovery. Reasonable weight ranges play an important role in the long-term health of nursing mothers. The infant weight management part includes the length and weight measurement time of infants of different ages. The part regarding nutrition information acquisition and decision-making mainly examines whether lactating women can identify information from different sources, so as to obtain nutrition information and knowledge, and whether to apply knowledge to make nutrition decisions.
Generally speaking, NLAI-L has good content validity and construct validity, and the reliability of knowledge and skill dimensions is good, but the reliability of the behavior dimension is general, which is related to the small number of questions and individual differences in behavior dimension. Due to the great differences in crowd behavior, it is necessary to have a sufficient number of questions in order to measure accurately, but this will lead to too many questions in the questionnaire, take too long to answer all the questions and affect the quality of the overall answers in order to strictly control the length of the instrument. This time, we screened the representative behavior questions and gave up a certain degree of reliability. The instrument is constantly evolving and improving, and we will add behavior-related questions later as needed. In terms of content, the questions retained by NLAI-L cover functional, interactive and critical NL. From the perspective of research methods, we should first establish a theoretical framework and establish the core questions of the NL of lactating women, and there is a solid theoretical basis for dimensional division and compilation of questions. It is a multi-level assessment instrument.
The results in the multivariate linear model indicated that age, occupation, education levels and postnatal period were the main factors influencing the NL for lactating women, with each of them having a significant influence on at least one dimension of the NLAI-L. Lactating women younger than 25 years old were more likely to have lower levels of NL, which may be due to the fact that this group is more likely to have lower levels of education due to their earlier age during childbearing and lower levels of all NL due to social experience. Among the different occupations listed in the questionnaire, housewives appear to have lower scores in all dimensions. This suggests that housewives may have less contact with others, which may result in less access to relevant knowledge and less chance of being influenced by others. We also found that education level was one of the main factors in the NL in all dimensions. Similar to our results, an investigation on NL among the elderly in America showed that education level and age could be influencing factors for NL [
30]. A study among Italian adults indicates that being young and having a low school education level were factors associated with low nutrition literacy [
31]. Another study in Greece showed that education was positively associated with nutrition literacy [
32]. The postnatal period was another factor influencing lactating women’s NL scores. We found that women who were within 3 months postpartum had significantly lower levels of NL except for those who were over 24 months postpartum. This may be because they had less time to learn about the process of feeding their infants, which leads to increased NL. For women who were more than 24 months postpartum, there is little practical significance in improving NL for lactating women. In addition, it should be noted that lactating women who give birth naturally have higher NL scores in the knowledge dimension. This may be because they are more aware of the disadvantages of a cesarean section, and the possibility of cesarean section for non-medical reasons may decline [
33,
34]. However, the hypothesis mentioned above needs to be verified by researchers in China after using NLAI-L to investigate the NL of people in a larger population.
Our study had some advantages. First of all, it was the first instrument to evaluate the NL of Chinese lactating women. We conducted reliability and validity tests in a sufficiently large sample size and obtained acceptable results. Secondly, the development of NLAI-L has a solid theoretical foundation. The core items were scientifically established with the participation of experts and references from Chinese Citizen’s Health Literacy—basic knowledge and skills.
However, there are some limitations to our study. This study has limitations on the diversity and number of samples. When the research was carried out for the first time, limited by the promotion conditions, the samples were mostly concentrated in the eastern part of China, and there may be a certain bias in the economic income and HL of people in different regions. The results of CFA need to be confirmed in a larger population sample. The overall reliability of the questionnaire is high (Cronbach’s α coefficient is 0.84), but Cronbach’s α coefficients of food intake types and nutrition information acquisition topics are lower (0.31 and 0.45, respectively). This is similar to the NL series instrument NLAI-L developed by Gibbs and others [
5,
35], which may be related to the small number of topic questions. [
36]. NLAI-L is still preliminary, and the research group will improve the relevant items in the follow-up investigation. In addition, there is still some room for research on the relationship between NL level and lactation outcome. More surveys are needed to improve demographic information and combine dietary surveys and biochemistry to explore the correlation between NLAI-L and dietary intake and more nutritional indicators.