Next Article in Journal
Future Time Perspective and Bedtime Procrastination: The Mediating Role of Dual-Mode Self-Control and Problematic Smartphone Use
Previous Article in Journal
Cross-Sectional Study of Factors Influencing Perceived Threat and Stress among the Arab Minority in Israel during the COVID-19 Pandemic
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 16
10.3390/ijerph191610330
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Construct Validity of a New Health Assessment Questionnaire for the National Screening Program of Older Adults in Japan: The SONIC Study

by
Tatsuro Ishizaki
1,*,
Yukie Masui
1,
Takeshi Nakagawa
2,
Yuko Yoshida
1,
Yoshiko L. Ishioka
3,
Noriko Hori
1,
Hiroki Inagaki
1,
Kae Ito
1,
Madoka Ogawa
4,
Mai Kabayama
5,
Kei Kamide
5,
Kazunori Ikebe
6,
Yasumichi Arai
7 and
Yasuyuki Gondo
4
1
Tokyo Metropolitan Institute of Gerontology, Tokyo 173-0015, Japan
2
National Center for Geriatrics and Gerontology, Obu 474-8511, Japan
3
Jindal School of Liberal Arts and Humanities, O.P. Jindal Global University, Sonipat 131001, Haryana, India
4
Clinical Thanatology and Geriatric Behavioral Science, Graduate School of Human Sciences, Osaka University, Osaka 565-0871, Japan
5
Division of Health Sciences, Graduate School of Medicine, Osaka University, Osaka 565-0871, Japan
6
Department of Prosthodontics, Gerodontology and Oral Rehabilitation, Graduate School of Dentistry, Osaka University, Osaka 565-0871, Japan
7
Center for Supercentenarian Medical Research, Keio University School of Medicine, Tokyo 160-8582, Japan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(16), 10330; https://doi.org/10.3390/ijerph191610330
Submission received: 12 June 2022 / Revised: 16 August 2022 / Accepted: 17 August 2022 / Published: 19 August 2022
Browse Figures
Review Reports Versions Notes

Abstract

:
The Japanese government has implemented a new screening program to promote measures to avoid worsening lifestyle-related diseases and frailty among the older population. In this effort, the government formulated a new health assessment questionnaire for the screening program of old-old adults aged ≥75 years. The questionnaire comprises 15 items, of which 12 address frailty, two address general health status, and one addresses smoking habits. This study examined the construct validity of this questionnaire, using the explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The data used in this study were drawn from a mail-in survey conducted in 2020 as part of the Septuagenarians, Octogenarians, Nonagenarians Investigation with Centenarians study. A total of 1576 respondents (range, 78–99 years of age) were included in the study. Although the EFA did not show an interpretable factor structure of the questionnaire with 15 items, the CFA using only 12 frailty-related items showed the goodness of fit for a higher-order factor “frailty”, and the five frailty-related sub-factors model was acceptable. These results suggest that the total score of the 12 frailty-related items in the questionnaire can be used as an indicator of the degree of “frailty”.

1. Introduction

In April 2008, the Japanese government implemented a nationwide annual screening program to identify the individuals who were at risk of metabolic syndrome and to provide health guidance to help reduce such a risk for all residents aged 40–74 years [1]. The annual screening program was extended to those aged 75 years and above (old-old adults). As most old-old adults have been undergoing drug therapy for their chronic conditions, such as hypertension, dyslipidemia, coronary heart disease, and osteoarthritis, and have undergone screening at the time [2,3,4], we believe that the annual screening program was of poor value for the old-old adults who were already receiving treatment for such diseases. In April 2016, the Japanese government amended the health policy for old-old adults to implement a new screening program that promotes measures to avoid the worsening of lifestyle-related diseases and frailty in each municipality [5]. Frailty is a state in which the standby capacity of the body decreases because of aging; older adults with frailty are vulnerable to various stresses, and their degree of independence in functioning is reduced [6]. As advanced frailty interferes with independence in performing the activities of daily living and increases the risk of disability, it is necessary for older adults to assess their health conditions comprehensively, to avoid frailty and worsening chronic diseases.
In April 2020, the national government formulated a new health assessment questionnaire for the annual screening program of old-old adults and asked each municipality to use it (Table 1) [7].
This questionnaire comprises 15 items, including two items on general health status, such as self-rated health and life satisfaction, 12 items on multidimensional aspects of frailty, such as physical function, nutritional status, oral function, cognitive function, and social participation, and one item on smoking habits. Because this questionnaire is aimed at providing a comprehensive assessment of the health status of older adults using each of the 15 items individually, the expert committee that developed this questionnaire did not initially envision that the items would be scored to identify the older adults with health risks [8]. However, some of the public health nurses in charge of community health expressed demands to assess the priority of the need for health guidance among the community-dwelling old-old adults by calculating the total score on this questionnaire.
A recent study examined the construct validity of the questionnaire using all 15 items [9]. This study had a few limitations. First, the authors assumed six factors were extracted from the explanatory factor analysis (EFA), including nine with factor loadings <0.4, which were rather small to the point that they should have been excluded [10]. Second, because the authors did not show the results of the tests for the statistical significance of the factor loadings in the confirmatory factor analysis (CFA), we were unable to statistically and logically interpret as independent the meanings of the sub-factors shown in the study. As the health assessment questionnaire for old-old adults was not developed with the intention of using all of the 15 items as a rating scale in the first place, we believe that the construct validity of the questionnaire does not need to be examined using all of the 15 items and should have been evaluated in a statistically appropriate manner. The current study aimed to re-examine the construct validity of this questionnaire and discuss its applicability as a comprehensive health assessment scale for old-old adults.

2. Methods

2.1. Study Design and Participants

The data used in this study were drawn from a mail-in survey conducted in August and September 2020 in the Septuagenarians, Octogenarians, Nonagenarians Investigation with Centenarians (SONIC) study [11]. The SONIC study used a narrow age-range cohort design: all of the residents in four areas (urban and nonurban) in the Tokyo Metropolitan and Hyogo Prefectures; aged 69–71 years (70s group); 79–81 years (80s group); and 89–91 years (90s group) in the initial survey, were recruited for participation in an in-venue survey. The follow-up with the participants of the in-venue survey was conducted once every 3 or 4 years. The 70s group was recruited for the initial survey in 2010. The additional participants were recruited during the first follow-up survey conducted in 2013. The 80s group was recruited for the initial survey in 2011, and additional participants were recruited during the first follow-up survey in 2014. The 90s group was recruited for the initial survey in 2012, and additional participants were recruited during the first and second follow-up surveys, conducted in 2015 and 2018, respectively. The total number of participants at the time of the baseline survey was 3346 (1592 men and 1754 women; 70s = 1129; 80s = 1234; 90s = 883). For the present mail-in survey, a letter of request and questionnaire were sent via postal mail to 2649 people (1230 men and 1419 women; 70s = 1053; 80s = 961; 90s = 635), excluding 693 dropouts from the original list of 3346 participants, due to death, institutionalization, falling in a state requiring nursing care, unknown new address, refusal to participate further, and other reasons.

2.2. The Health Assessment Questionnaire for Old-Old Adults

A health assessment questionnaire for the old-old adults (Table 1) [7] was used in this study. Although this was self-administered, when the respondents could not respond by themselves or answer the questions, a family member or a third person who knew them was allowed to fill it on their behalf. The responses to the individual items were converted into scores in the following manner. For Question 1, a score scale of 0 “excellent” to 4 points “very poor” in 1-point increments was used for each option. For Question 2, a score scale of 0 “satisfied” to 3 points “dissatisfied” in 1-point increments was used for each option. For Question 12, “Yes” was scored 2, “No” was scored 0, and “I quit” was scored 1. For questions 3, 9, 13, 14, and 15, “Yes” was scored 0, and “No” was scored 1. For questions 4–8, 10, and 11, “Yes” was scored 1, and “No” was 0.

2.3. Basic Characteristics of the Participants

To identify the basic characteristics of the participants, we collected data on sex, age, educational attainment, living arrangements, instrumental activities of daily living (IADL), and eligibility for public long-term care (LTC) insurance benefits. The items of the IADL included being able to use public transportation by oneself, shop for daily necessities, prepare meals, pay bills, and manage one’s own bank account [12]. For each item, a score of 1 was assigned for “yes” and 0 for “no”, and the total score for the five items was calculated. The higher the score, the more independent the participant was in the IADL. Regarding eligibility for LTC insurance benefits, all of the residents aged ≥40 years in Japan are mandatorily enrolled in the public LTC insurance system. The municipality assesses whether an insured person is eligible for insurance benefits based on an evaluation of the person’s current physical and cognitive status [13]. When an insured person is certified as having LTC needs by the local government, they are categorized into either two or five levels of support or LTC needs (Levels 1 to 5).

2.4. Statistical Analysis

The factor structure of the health assessment questionnaire items for the old-old adults was examined using EFA and CFA. The principal factor method was used for factor extraction from the 15 items of the questionnaire, with Promax rotation in the EFA. We used both the Kaiser–Guttman test and the scree test to determine the number of factors to be extracted in the EFA [14]. We decided that any item with a factor loading of ≥0.4 was interpretable for each factor in the EFA [10]. Because the health assessment questionnaire for old-old adults includes 12 items to assess the multidimensional aspects of frailty, such as physical, cognitive, and social aspects, we then used CFA to examine whether the 12 frailty-related items in this questionnaire fit the multidimensional model of frailty [15]. Recent review articles have described that an assessment tool for frailty should include physical, psychological, cognitive, and social dimensions [16,17], and the physical domain includes three factors: physical function, nutritional status [15], and oral health status [18]. We assume that, behind these five frailty-related domains, there is a concept of multidimensional frailty that affects each of the five domains. Therefore, we assumed that the model of frailty for this CFA had five sub-factors as the primary factors: physical function (Q7, Q8, Q9, and Q13); nutritional status (Q3 and Q6); oral function (Q4 and Q5); cognitive function (Q10 and Q11); and social aspects (Q14 and Q15); with the secondary factor of “a comprehensive concept of frailty” on top of these five sub-factors. In the CFA, using structural equation modeling (SEM), the parameter estimates in the model were led by the maximum likelihood method [19], using only 12 frailty-related items. The χ2 score, goodness of fit index (GFI), adjusted GFI (AGFI), root mean square error of approximation (RMSEA), and Akaike’s information criterion (AIC) were used to assess the model’s goodness of fit for the CFA. We also calculated the Cronbach’s alpha coefficient using these 12 items. A two-tailed p-value < 0.05 was considered statistically significant in the CFA. IBM SPSS Statistics ver.25 was used for the fundamental statistical analysis and EFA, and IBM SPSS Amos ver.25 was used for the CFA.

3. Results

3.1. Characteristics of the Participants

Among the 2653 people, 1783 responded to the questionnaire (response rate, 67.2%). A total of 1576 (88.4%) respondents who provided answers to all 15 items of the health assessment questionnaire were included in the analysis. The respondents’ basic characteristics are listed in Table 2.
The men accounted for 47.1% of the total study population. The mean age was 85.6 years (standard deviation 5.9), and the age range was 78–99 years. Of the total, 87.8% responded on their own, 6.5% responded through a proxy, 1.9% relied on a third person, and 3.9% had an unknown response status.

3.2. EFA

Table 3 shows the mean values for each item stratified by sex and age group.
First, to investigate the factor structure of the health assessment questionnaire for old-old adults, we conducted an EFA using the 15 items identified using the principal factor method. Based on the Kaiser–Guttman test, we extracted five factors with eigenvalues of one or more. Next, the eigenvalues of the identified factors were plotted on a scree plot (Figure 1). Because the shape of the scree plot showed a smooth decrease after the fifth factor, we determined that there were five factors in this EFA.
The proportion of variance accounted for by these five factors was 25.1%. The principal factor method was used to identify the factor loadings of each item by setting the number of factors to five. Promax rotation was performed to obtain the factor pattern matrix. Table 4 shows the factor loading of each item after factor rotation, and the estimated communality after factor identification. The factor loadings were interpretable with respect to the items of both Factor 1 (general health assessment: self-rated health status; life satisfaction) and Factor 4 (cognitive function: always asking the same thing; not remembering today’s date). However, the other factors were difficult to interpret because Factor 3 included various aspects, such as oral function, weight loss, and physical function, and Factor 5 included social relationships, nutritional status, and smoking habits. In addition, Factor 2 was difficult to interpret because there was only one item with a factor loading of ≥0.4. Although the estimated communality of items Q1 and Q2 were the highest, at 0.72 and 0.40, respectively, the communality of the eight items was approximately 0.2. Specifically, the estimated communality of item Q12 “smoking habits“ was the lowest (0.02). These results indicate that the questionnaire with 15 items was not explained by the five factors, and the EFA using 15 items did not extract interpretable factor structures.

3.3. CFA

The next step was the CFA, using only 12 frailty-related items. These items were developed as representatives of the five frailty-related domains: physical function (Q7, Q8, Q9, and Q13); nutritional status (Q3 and Q6); oral function (Q4 and Q5); cognitive function (Q10 and Q11); and social aspects (Q14 and Q15). CFA assumed that the model had a higher-order factor (frailty) above these five frailty sub-factors. Figure 2 shows that all of the estimated factor loadings on the 12 items were 0.34 or more, except for one item (Q 15), and all of them were statistically significant (p < 0.05).
Each item had a factor loading at almost the same level as initially assumed. The factor loadings of the five sub-factors from the higher-order factor were sufficiently high (i.e., 0.46 or more), and all of them were statistically significant (p < 0.05). The goodness of fit of the model was sufficiently, with χ2 (49) = 156.2 (p < 0.001), with GFI, AGFI, RMSEA, AIC being 0.983, 0.973, 0.037, and 214.2, respectively. The Cronbach’s alpha coefficient for the 12 items was 0.569.

4. Discussion

The responses to the new health assessment questionnaire for old-old adults were obtained from community-dwelling older adults through a mail-in survey that covered the participants in the SONIC study. The factor structure of the questionnaire was then examined. The EFA revealed that an interpretable factor structure was not obtained through the analysis of all 15 items. In contrast, the results from the CFA showed that there were five sub-factors: physical function; nutritional status; oral function; cognitive function; and social aspects, indicating the goodness of fit of the model with the higher-order factor of “frailty” on top of these five sub-factors. In addition, the goodness of fit of the model that assumes frailty as the secondary factor may indicate that the total score of the 12 frailty-related items in the health assessment questionnaire for old-old adults can be used as an indicator of the degree of “frailty”.
This study indicated that the total score of the 12 frailty-related items in the questionnaire showed the possibility of screening older adults with frailty. This questionnaire comprehensively covered the physical, cognitive, psychological, and social aspects of frailty. Although there are several validated frailty measurement tools [20], most of them have focused on the physical aspects of frailty. In addition to this questionnaire, only some comprehensively assessed the physical, psychological, and social aspects of frailty, such as the Groningen Frailty Indicator [21,22,23] from Germany, the Edmonton Frail Scale [24,25] from Canada, the Tilburg Frailty Indicator [26,27,28] from The Netherlands, and the Kihon Checklist [29,30] and Kaigo Yobo Checklist [31] from Japan. These comprehensive frailty assessment instruments were reported to examine convergent validity and/or concurrent validity and to compare their predictive validity: a comparison of predictive validity for disability between the Groningen Frailty Indicator and the Tilburg Frailty Indicator [32]; a comparison of predictive value for identifying frailty between the Groningen Frailty Indicator and the Tilburg Frailty Indicator [33]; an examination of the convergent validity between the electronic frailty index and the Edmonton Frail Scale [34]; a comparison of diagnostic test accuracy for identifying frailty among the Groningen Frailty Indicator, the Edmonton Frail Scale, and the Kihon Checklist [35]; a comparison of predictive value for frailty between the Kihon Checklist and the Kaigo Yobo Checklist [36]; an examination of convergent validity between the Kihon Checklist (Portuguese version) and the Edmonton Frail Scale [37].
Compared with the two existing Japanese checklists for comprehensive frailty risk assessment, the health assessment questionnaire for the old-old adults has at least two unique features. First, the questionnaire was used across Japan: 91.9% (1600/1741) of the municipalities used it in 2021 [38], and 93.9% (1503/1600) of them used it in the course of the annual screening program for old-old adults. The national government expects all of the municipalities to use the questionnaire within a few years. Second, the data from the questionnaire are routinely registered in the national health insurance database system, known as “the KDB system” [39], which links the data from the national screening program and the claims data from health and LTC insurance on an individual basis. Using the data registered in the KDB system, such as blood test data at the time of the screening program, and treatment and prescription status, each municipality can provide health guidance to those at risk of frailty to prevent them from becoming frail.
We limited CFA to 12 frailty-related items out of the 15 items in the questionnaire and excluded the other 3 (subjective health, life satisfaction, and smoking habits). However, these 3 items, and the other 12, are important for the sake of the comprehensive health assessment of old-old adults living in the community. As is true for all of the items in the questionnaire for old-old adults, it is not appropriate in health guidance for them to focus only on the items with unfavorable responses and to focus too heavily on guidance for the shift to favorable health behaviors. What is important is for the health guidance instructor to acknowledge that there are favorable health behaviors that are currently being implemented and support their continuation [5]. For the items that received unfavorable responses, it is important to consider the background and causes for such unfavorable conditions, while taking into account the subject’s injuries and psychosocial conditions, and to provide health guidance that addresses the issues while taking care not to cause physical and/or cognitive impairment.
This study has at least two limitations. First, the alpha coefficient of the total score of the 12 items in the health assessment questionnaire was relatively low at 0.57, indicating a low internal consistency. We consider the reason for the low internal consistency to be because the five domains measure different aspects of frailty, which are likely to be diverse and have high variance, namely physical, oral, nutritional, cognitive, and social aspects. Therefore, it is within our expectation that the within-subject consistency among the 12 items was limited to some extent. Second, because the analyzable subjects in this study were survivors of the SONIC study, they may be healthier and have better health behaviors than the general population who participate in the annual health screening program in Japan. We believe that the construct validity of this questionnaire needs to be re-examined using the questionnaire data registered in the KDB system, which are from old-old adults who underwent health screening programs in their communities.

5. Conclusions

We propose that the total score of the 12 frailty-related items in the health assessment questionnaire for old-old adults can be used as an indicator of the degree of “frailty”. We expect that health professionals working in municipalities will be able to use the total score of the 12 frailty-related items out of the 15 items of the questionnaire to identify those who are eligible for health guidance aimed at preventing frailty among community-dwelling older adults. Future research should examine the criterion validity of the health assessment questionnaire for old-old adults, and the extent to which this questionnaire correlates with actual frailty status among community-dwelling old-old adults.

Author Contributions

Conceptualization, T.I. and Y.M.; Data curation, T.I., Y.M., Y.Y., M.O., M.K. and Y.G.; Formal analysis, T.I. and Y.M.; Funding acquisition, T.I.; Investigation, T.I., Y.M., T.N., Y.Y., Y.L.I., N.H., H.I., K.I. (Kae Ito), M.O., M.K., K.K., K.I., Y.A. and Y.G.; Methodology, T.I., Y.M., T.N. and Y.L.I.; Project administration, T.I., Y.M., K.K., K.I. (Kazunori Ikebe) and Y.G.; Software, T.I. and Y.M.; Writing—original draft, T.I. and Y.M.; Writing—review and editing, T.N., Y.Y., Y.L.I., N.H., H.I., K.I. (Kae Ito), M.O., M.K., K.K., K.I., Y.A. and Y.G. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported in part by a Grant-in-Aid from the Ministry of Health, Labor and Welfare of Japan (Grant Numbers: 19CA2004 and 20AA2006).

Institutional Review Board Statement

The study protocol was approved by the Institutional Review Board of the Tokyo Metropolitan Institute of Gerontology in 2020.

Informed Consent Statement

All participants were informed of the purpose of this study as well as the protection of personal information and agreed to participate in writing.

Data Availability Statement

The data supporting the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Fukuma, S.; Iizuka, T.; Ikenoue, T.; Tsugawa, Y. Association of the National Health Guidance Intervention for Obesity and Cardiovascular Risks with Health Outcomes among Japanese Men. JAMA Intern. Med. 2020, 180, 1630–1637. [Google Scholar] [CrossRef] [PubMed]
  2. Mitsutake, S.; Ishizaki, T.; Teramoto, C.; Shimizu, S.; Ito, H. Patterns of Co-Occurrence of Chronic Disease among Older Adults in Tokyo, Japan. Prev. Chronic Dis. 2019, 16, E11. [Google Scholar] [CrossRef] [PubMed]
  3. Ishizaki, T.; Mitsutake, S.; Hamada, S.; Teramoto, C.; Shimizu, S.; Akishita, M.; Ito, H. Drug Prescription Patterns and Factors Associated with Polypharmacy in >1 Million Older Adults in Tokyo. Geriatr. Gerontol. Int. 2020, 20, 304–311. [Google Scholar] [CrossRef] [PubMed]
  4. Mitsutake, S.; Ishizaki, T.; Tsuchiya-Ito, R.; Teramoto, C.; Shimizu, S.; Yamaoka, T.; Kitamura, A.; Ito, H. Association of Pharmacological Treatments for Hypertension, Diabetes, and Dyslipidemia with Health Checkup Participation and Identification of Disease Control Factors Among Older Adults in Tokyo, Japan. Prev. Med. Rep. 2020, 17, 101033. [Google Scholar] [CrossRef]
  5. Ministry of Health, Labour and Welfare, Japan. Guideline for Public Health Program for Older Adults; Ministry of Health, Labour and Welfare: Tokyo, Japan, 2019. (In Japanese) [Google Scholar]
  6. Kim, H.K.; Ishizaki, T. Prevention Strategy for Frailty. In Health Issues and Care System for the Elderly, Current Topics in Environmental Health and Preventive Medicine; Washio, M., Kiyohara, C., Eds.; Springer: Singapore, 2019; pp. 45–68. ISBN 978-981-13-1761-3. [Google Scholar]
  7. Satake, S.; Arai, H. Questionnaire for Medical Checkup of Old-Old (QMCOO). Geriatr. Gerontol. Int. 2020, 20, 991–992. [Google Scholar] [CrossRef]
  8. Ishizaki, T. Integrated Implementation of Public Health Program and Long-Term Care Needs Prevention of Older Adults. Kokuho Miyagi 2020, 242, 8–10. (In Japanese) [Google Scholar]
  9. Shinohara, T.; Saida, K.; Tanaka, S.; Murayama, A.; Higuchi, D. Construct Validity of the Questionnaire for Older Senior Citizens Based on A Confirmatory Factor Analysis: A Study During the Period of Self-restraint to Prevent the Spread of Coronavirus Disease 2019. Geriatr. Gerontol. Int. 2021, 21, 1018–1025. [Google Scholar] [CrossRef]
  10. Guadagnoli, E.; Velicer, W.F. Relation of Sample Size to the Stability of Component Patterns. Psychol. Bull. 1988, 103, 265–275. [Google Scholar] [CrossRef]
  11. Gondo, Y.; Masui, Y.; Kamide, K.; Ikebe, K.; Arai, Y.; Ishizaki, T. A Longitudinal Cohort Study of The Older People as Part of A Centenarian Study. In Encyclopedia of Geropsychology; Pachana, N.A., Ed.; Springer: Singapore, 2016; ISBN 978-981-28-7081-0. [Google Scholar]
  12. Koyano, W.; Shibata, H.; Nakazato, K.; Haga, H.; Suyama, Y. Measurement of Competence: Reliability and Validity of The TMIG Index of Competence. Arch. Gerontol. Geriatr. 1991, 13, 103–116. [Google Scholar] [CrossRef]
  13. Tsutsui, T.; Muramatsu, N. Care-Needs Certification in the Long-Term Care Insurance System of Japan. J. Am. Geriatr. Soc. 2005, 53, 522–527. [Google Scholar] [CrossRef]
  14. Pett, M.A.; Lackey, N.R.; Sullivan, J.J. Making Sense of Factor Analysis; SAGE: Thousand Oaks, CA, USA, 2003; ISBN 0-7619-1950-3. [Google Scholar]
  15. de Vries, N.M.; Staal, J.B.; van Ravensberg, C.D.; Hobbelen, J.S.; Olde Rikkert, M.G.; Nijhuis-van der Sanden, M.W. Outcome instruments to measure frailty: A systematic review. Ageing Res. Rev. 2011, 10, 104–114. [Google Scholar] [CrossRef] [PubMed]
  16. Sezgin, D.; O’Donovan, M.; Cornally, N.; Liew, A.; O’Caoimh, R. Defining frailty for healthcare practice and research: A qualitative systematic review with thematic analysis. Int. J. Nurs. Stud. 2019, 92, 16–26. [Google Scholar] [CrossRef] [PubMed]
  17. Gabrovec, B.; Veninšek, G.; Samaniego, L.L.; Carriazo, A.M.; Antoniadou, E.; Jelenc, M. The role of nutrition in ageing: A narrative review from the perspective of the European joint action on frailty—ADVANTAGE JA. Eur. J. Intern. Med. 2018, 56, 26–32. [Google Scholar] [CrossRef] [PubMed]
  18. Parisius, K.G.H.; Wartewig, E.; Schoonmade, L.J.; Aarab, G.; Gobbens, R.; Lobbezoo, F. Oral frailty dissected and conceptualized: A scoping review. Arch. Gerontol. Geriatr. 2022, 100, 104653. [Google Scholar] [CrossRef] [PubMed]
  19. Blunch, N.J. Introduction to Structural Equation Modeling Using IBM SPSS Statistics and AMOS; SAGE: London, UK, 2013. [Google Scholar]
  20. Dent, E.; Martin, F.C.; Bergman, H.; Woo, J.; Romero-Ortuno, R.; Walston, J.D. Management of Frailty: Opportunities, Challenges, And Future Directions. Lancet 2019, 394, 1376–1386. [Google Scholar] [CrossRef]
  21. Steverink, N.S.J.; Schuurmans, H.; van Lis, M. Measuring Frailty: Developing and Testing of the Groningen Frailty Indicator (GFI). Gerontologists 2001, 41, 236–237. [Google Scholar]
  22. Bieldermanm, A.; van der Schansm, C.P.; van Lieshout, M.R.; de Greef, M.H.; Boersma, F.; Krijnen, W.P.; Steverink, N. Multidimensional Structure of the Groningen Frailty Indicator in Community-Dwelling Older People. BMC Geriatr. 2013, 13, 86. [Google Scholar]
  23. Peters, L.L.; Boter, H.; Burgerhof, J.G.; Slaets, J.P.; Buskens, E. Construct validity of the Groningen Frailty Indicator established in a large sample of home-dwelling elderly persons: Evidence of stability across age and gender. Exp. Gerontol. 2015, 69, 129–141. [Google Scholar] [CrossRef]
  24. Rolfson, D.B.; Majumdar, S.R.; Tsuyuki, R.T.; Tahir, A.; Rockwood, K. Validity and reliability of the Edmonton Frail Scale. Age Ageing 2006, 35, 526–529. [Google Scholar] [CrossRef]
  25. Perna, S.; Francis, M.D.; Bologna, C.; Moncaglieri, F.; Riva, A.; Morazzoni, P.; Allegrini, P.; Isu, A.; Vigo, B.; Guerriero, F.; et al. Performance of Edmonton Frail Scale on frailty assessment: Its association with multi-dimensional geriatric conditions assessed with specific screening tools. BMC Geriatr. 2017, 17, 2. [Google Scholar] [CrossRef]
  26. Gobbens, R.J.; van Assen, M.A.; Luijkx, K.G.; Wijnen-Sponselee, M.T.; Schols, J.M. The Tilburg Frailty Indicator: Psychometric Properties. J. Am. Med Dir. Assoc. 2010, 11, 344–355. [Google Scholar] [CrossRef] [PubMed]
  27. Zhang, X.; Tan, S.S.; Bilajac, L.; Alhambra-Borrás, T.; Garcés-Ferrer, J.; Verma, A.; Koppelaar, E.; Markaki, A.; Mattace-Raso, F.; Franse, C.B.; et al. Reliability and Validity of the Tilburg Frailty Indicator in 5 European Countries. J. Am. Med Dir. Assoc. 2020, 21, 772–779. [Google Scholar] [CrossRef] [PubMed]
  28. Zamora-Sánchez, J.J.; Urpí-Fernández, A.M.; Sastre-Rus, M.; Lumillo-Gutiérrez, I.; Gea-Caballero, V.; Jodar-Fernández, L.; Julián-Rochina, I.; Zabaleta-Del-Olmo, E. The Tilburg Frailty Indicator: A psychometric systematic review. Ageing Res. Rev. 2022, 76, 101588. [Google Scholar] [CrossRef] [PubMed]
  29. Arai, H.; Satake, S. English Translation of The Kihon Checklist. Geriatr. Gerontol. Int. 2015, 15, 518–519. [Google Scholar] [CrossRef]
  30. Satake, S.; Senda, K.; Hong, Y.J.; Miura, H.; Endo, H.; Sakurai, T.; Kondo, I.; Toba, K. Validity of the Kihon Checklist for Assessing Frailty Status. Geriatr. Gerontol. Int. 2016, 16, 709–715. [Google Scholar] [CrossRef]
  31. Shinkai, S.; Yoshida, H.; Taniguchi, Y.; Murayama, H.; Nishi, M.; Amano, H.; Nofuji, Y.; Seino, S.; Fujiwara, Y. Public Health Approach to Preventing Frailty in The Community and its Effect on Healthy Aging in Japan. Geriatr. Gerontol. Int. 2016, 16 (Suppl. S1), 87–97. [Google Scholar] [CrossRef]
  32. Daniels, R.; van Rossum, E.; Beurskens, A.; van den Heuvel, W.; de Witte, L. The predictive validity of three self-report screening instruments for identifying frail older people in the community. BMC Public Health 2012, 12, 69. [Google Scholar] [CrossRef]
  33. Si, H.; Jin, Y.; Qiao, X.; Tian, X.; Liu, X.; Wang, C. Comparing diagnostic properties of the FRAIL-NH Scale and 4 frailty screening instruments among Chinese institutionalized older adults. J. Nutr. Health Aging 2020, 24, 188–193. [Google Scholar] [CrossRef]
  34. Brundle, C.; Heaven, A.; Brown, L.; Teale, E.; Young, J.; West, R.; Clegg, A. Convergent validity of the electronic frailty index. Age Ageing 2019, 48, 152–156. [Google Scholar] [CrossRef]
  35. Ambagtsheer, R.C.; Visvanathan, R.; Dent, E.; Yu, S.; Schultz, T.J.; Beilby, J. Commonly used screening instruments to identify frailty among community-dwelling older people in a general practice (primary care) setting: A study of diagnostic test accuracy. J. Gerontol. A Biol. Sci. Med. Sci. 2020, 75, 1134–1142. [Google Scholar] [CrossRef]
  36. Kojima, G.; Taniguchi, Y.; Kitamura, A.; Shinkai, S. Are the Kihon Checklist and the Kaigo-Yobo Checklist Compatible with the Frailty Index? J. Am. Med Dir. Assoc. 2018, 19, 797–800. [Google Scholar] [CrossRef] [PubMed]
  37. Sewo Sampaio, P.Y.; Sampaio, R.A.; Yamada, M.; Ogita, M.; Arai, H. Validation and translation of the Kihon Checklist (frailty index) into Brazilian Portuguese. Geriatr. Gerontol. Int. 2014, 14, 561–569. [Google Scholar] [CrossRef] [PubMed]
  38. Ministry of Health, Labour and Welfare, Japan. National Survey of Implementation Status of the Public Health Program for Old-Old Adults in 2021; Ministry of Health, Labour and Welfare: Tokyo, Japan, 2022. (In Japanese) [Google Scholar]
  39. All-Japan Federation of National Health Insurance Organizations. Kokuho Database (KDB) System. Available online: https://www.kokuho.or.jp/hoken/kdb.html (accessed on 18 July 2022).
Ijerph 19 10330 g001 550
Figure 1. A scree plot of the health assessment questionnaire for old-old adults (15 items) in the EFA.
Figure 1. A scree plot of the health assessment questionnaire for old-old adults (15 items) in the EFA.
Ijerph 19 10330 g001
Ijerph 19 10330 g002 550
Figure 2. Factor structure and loadings on the 12 frailty-related items of the health assessment questionnaire for old-old adults in the CFA using SEM. χ2 (49) = 156.2 (p < 0.001), GFI = 0.983, AGFI = 0.973, RMSEA = 0.037, AIC = 214.2. All factor loadings were statistically significant (p < 0.05). #3 eating habits; #4 masticatory function; #5 swallowing function; #6 weight loss; #7 walking speed; #8 experiences of falls; #9 exercise habits; #10 memory loss; #11 date disorientation; #13 going out; #14 interaction with others; and #15 health-related consultation.
Figure 2. Factor structure and loadings on the 12 frailty-related items of the health assessment questionnaire for old-old adults in the CFA using SEM. χ2 (49) = 156.2 (p < 0.001), GFI = 0.983, AGFI = 0.973, RMSEA = 0.037, AIC = 214.2. All factor loadings were statistically significant (p < 0.05). #3 eating habits; #4 masticatory function; #5 swallowing function; #6 weight loss; #7 walking speed; #8 experiences of falls; #9 exercise habits; #10 memory loss; #11 date disorientation; #13 going out; #14 interaction with others; and #15 health-related consultation.
Ijerph 19 10330 g002
Table
Table 1. The health assessment questionnaire for old-old adults.
Table 1. The health assessment questionnaire for old-old adults.
DomainItemScore
Health condition1. How is your health condition?Excellent = 0; good = 1; fair = 2; poor = 3; very poor = 4
Mental health2. Are you satisfied with your daily life?Satisfied = 0; moderately satisfied = 1; moderately dissatisfied = 2; dissatisfied = 3
Eating behavior3. Do you eat three meals a day?Yes = 0; no = 1
Oral function4. Do you have any difficulties eating tough foods when compared to 6 months ago?No = 0; yes = 1
5. Have you choked on your tea or soup recently?No = 0; yes = 1
Bodyweight loss6. Have you lost 2 kg or more in the past 6 months?No = 0; yes = 1
Physical function and falls7. Do you think you walk slower than before?No = 0; yes = 1
8. Have you experienced a fall in the past year?No = 0; yes = 1
9. Do you go for a walk for your health at least once a week?Yes = 0; no = 1
Cognitive function10. Do your family or friends point out your memory loss? (e.g., “You ask the same questions over and over again.”)No = 0; yes = 1
11. Do you find yourself not knowing today’s date?No = 0; yes = 1
Smoking12. Do you smoke?Yes = 2; no = 0; I quit = 1
Social participation and support13. Do you go out at least once a week?Yes = 0; no = 1
14. Do you maintain regular communications with your family and friends?Yes = 0; no = 1
15. When you feel ill, do you have anyone to reach out/talk to?Yes = 0; no = 1
Note: The scores shown in Satake and Arai [7] were modified by the authors.
Table
Table 2. Basic characteristics of the analyzable respondents.
Table 2. Basic characteristics of the analyzable respondents.
TotalMenWomen
n = 1576n = 742n = 834
Mean age (standard deviation) (years)85.6 (5.9)85.7 (5.9)85.4 (5.9)
Educational attainment (years) (mean (SD))11.6 (2.8)12.1 (3.1)11.2 (2.3)
Place of living (% home)95.1%95.8%94.4%
Living arrangement (% living alone)26.2%15.1%36.1%
LTC need certification (% LTC need Level 1 or more)10.6%10.0%11.0%
Instrumental activities of daily living (points) (mean (SD))4.6 (1.3)4.3 (1.3)4.4 (1.3)
Note: SD denotes standard deviation; LTC denotes long-term care.
Table
Table 3. Mean and standard deviation of each item in the health assessment questionnaire for old-old adults with 15 items by sex and age group.
Table 3. Mean and standard deviation of each item in the health assessment questionnaire for old-old adults with 15 items by sex and age group.
Total
(n = 1576)		Men
(n = 742)		Women
(n = 834)		70s Group
(n = 733)		80s Group
(n = 509)		90s Group
(n = 334)
1. How is your health condition?1.61 (0.98)1.56 (1.00)1.65 (0.96)1.50 (0.98)1.70 (0.95)1.72 (1.00)
2. Are you satisfied with your daily life?0.82 (0.70)0.80 (0.69)0.84 (0.72)0.85 (0.68)0.79 (0.72)0.78 (0.74)
3. Do you eat three meals a day?0.06 (0.24)0.05 (0.22)0.07 (0.25)0.04 (0.19)0.07 (0.26)0.10 (0.30)
4. Do you have any difficulties eating tough foods when compared to 6 months ago?0.32 (0.47)0.28 (0.45)0.35 (0.48)0.24 (0.43)0.36 (0.48)0.42 (0.49)
5. Have you choked on your tea or soup recently?0.22 (0.42)0.20 (0.40)0.25 (0.43)0.21 (0.41)0.22 (0.41)0.27 (0.44)
6. Have you lost 2 kg or more in the past 6 months?0.17 (0.37)0.17 (0.38)0.16 (0.37)0.13 (0.34)0.19 (0.39)0.21 (0.41)
7. Do you think you walk slower than before?0.74 (0.44)0.73 (0.44)0.74 (0.44)0.64 (0.48)0.79 (0.41)0.86 (0.35)
8. Have you experienced a fall in the past year?0.25 (0.44)0.25 (0.43)0.26 (0.44)0.19 (0.39)0.26 (0.44)0.38 (0.49)
9. Do you go for a walk for your health at least once a week?0.43 (0.50)0.42 (0.50)0.43 (0.50)0.34 (0.48)0.47 (0.50)0.55 (0.50)
10. Do your family or friends point out your memory loss? (e.g., “You ask the same questions over and over again.”)0.17 (0.38)0.17 (0.38)0.17 (0.38)0.10 (0.30)0.20 (0.40)0.30 (0.46)
11. Do you find yourself not knowing today’s date?0.31 (0.46)0.30 (0.46)0.33 (0.47)0.24 (0.43)0.33 (0.47)0.44 (0.50)
12. Do you smoke?0.25 (0.51)0.46 (0.60)0.06 (0.31)0.30 (0.57)0.17 (0.42)0.25 (0.48)
13. Do you go out at least once a week?0.17 (0.38)0.16 (0.37)0.18 (0.39)0.09 (0.29)0.20 (0.41)0.28 (0.45)
14. Do you maintain regular communications with your family and friends?0.06 (0.25)0.09 (0.28)0.04 (0.21)0.05 (0.21)0.07 (0.25)0.10 (0.30)
15. When you feel ill, do you have anyone to reach out/talk to?0.06 (0.23)0.07 (0.25)0.05 (0.22)0.06 (0.25)0.06 (0.24)0.04 (0.20)
Note: Values are mean (standard deviation).
Table
Table 4. Factor loadings and estimated communality in the EFA using the principal factor method with Promax rotation of the health assessment questionnaire for old-old adults (15 items).
Table 4. Factor loadings and estimated communality in the EFA using the principal factor method with Promax rotation of the health assessment questionnaire for old-old adults (15 items).
ItemsF1F2F3F4F5Estimated Communality
1. How is your health condition? (reversed)0.800.070.07−0.03−0.030.72
2. Are you satisfied with your daily life? (reversed)0.65−0.03−0.060.050.050.40
13. Do you go out at least once a week? (reversed)0.000.71−0.04−0.03−0.060.44
9. Do you go for a walk for your health at least once a week? (reversed)0.050.390.020.000.000.18
4. Do you have any difficulties eating tough foods when compared to 6 months ago?−0.04−0.020.44−0.03−0.030.15
5. Have you choked on your tea or soup recently?−0.040.030.360.03−0.050.13
6. Have you lost 2 kg or more in the past six months?0.08−0.130.31−0.030.130.13
7. Do you think you walk slower than before?0.110.040.280.020.000.15
8. Have you experienced a fall in the past year?0.010.090.210.080.020.11
10. Do your family or friends point out your memory loss? (e.g., “You ask the same questions over and over again.”)−0.020.000.040.63−0.100.40
11. Do you find yourself not knowing today’s date?0.05−0.03−0.030.540.070.30
15. When you feel ill, do you have someone to reach out/talk to? (reversed)0.08−0.06−0.110.000.530.27
14. Do you maintain regular communications with your family and friends? (reversed)−0.100.190.050.040.420.27
3. Do you eat three meals a day? (reversed)−0.020.030.16−0.010.230.11
12. Do you smoke?0.00−0.070.03−0.050.150.02
Bolded factor loading: absolute value of ≥0.4.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ishizaki, T.; Masui, Y.; Nakagawa, T.; Yoshida, Y.; Ishioka, Y.L.; Hori, N.; Inagaki, H.; Ito, K.; Ogawa, M.; Kabayama, M.; et al. Construct Validity of a New Health Assessment Questionnaire for the National Screening Program of Older Adults in Japan: The SONIC Study. Int. J. Environ. Res. Public Health 2022, 19, 10330. https://doi.org/10.3390/ijerph191610330

AMA Style

Ishizaki T, Masui Y, Nakagawa T, Yoshida Y, Ishioka YL, Hori N, Inagaki H, Ito K, Ogawa M, Kabayama M, et al. Construct Validity of a New Health Assessment Questionnaire for the National Screening Program of Older Adults in Japan: The SONIC Study. International Journal of Environmental Research and Public Health. 2022; 19(16):10330. https://doi.org/10.3390/ijerph191610330

Chicago/Turabian Style

Ishizaki, Tatsuro, Yukie Masui, Takeshi Nakagawa, Yuko Yoshida, Yoshiko L. Ishioka, Noriko Hori, Hiroki Inagaki, Kae Ito, Madoka Ogawa, Mai Kabayama, and et al. 2022. "Construct Validity of a New Health Assessment Questionnaire for the National Screening Program of Older Adults in Japan: The SONIC Study" International Journal of Environmental Research and Public Health 19, no. 16: 10330. https://doi.org/10.3390/ijerph191610330

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop