2.1. Study Design
This study follows an exploratory mixed-methods design that combines both quantitative and qualitative elements to comprehensively capture the development, theoretical foundation, and initial evaluation of an online self-assessment tool for family caregivers (Self-Assessment Tool for Family Caregivers, SSA-PA). The self-assessment tool was developed using a systematic and scientifically sound approach with the aim of creating a tool that is both theoretically sound and practice-oriented. This tool is designed to capture the diverse stresses and needs of family caregivers.
The development process followed a clear chronological sequence consisting of three consecutive phases:
(1) Theoretical conceptualization and a literature review;
(2) Item formulation and validation;
(3) Evaluation by family caregivers.
In addition, experts from nursing science, psychology, and health services research, as well as family caregivers themselves, were involved in the development process to ensure the practicality and relevance of the tool.
2.2. Development of the Tool
Phase 1: Theoretical conceptualization and literature review
The development of the SSA-PA was based on sound theoretical foundations from the fields of nursing science, health science, and psychology. The central theoretical reference points were Dorothea Orem’s nursing model, Lazarus and Folkman’s stress and coping model, and Engel’s biopsychosocial model.
Orem’s concept of self-care emphasizes the ability and responsibility of individuals to actively contribute to their own health and well-being. Orem’s nursing concept pro-vides a basis for identifying support needs by emphasizing the importance of self-care and self-help [
18].
In addition, psychological theories on stress management were applied. Among other things, the stress management model developed by Lazarus and Folkman provides a sound basis by emphasizing cognitive assessment and coping strategies in dealing with stress [
19].
Engel’s biopsychosocial model offers a comprehensive perspective by incorporating physical health factors, psychological states, and social contexts [
20,
21].
To provide empirical support for these theoretical models, a structured literature search was conducted in the PubMed, CINAHL, PsycINFO, and CareLit databases. Search terms (German/English) used included:
“family caregivers” OR “informal caregivers” AND “burden” OR “self-assessment” OR “questionnaire” OR “self-care”.
Search parameters and selection process:
Time frame: The search period generally covered publications from 2015 to 2024 in order to take into account current scientific findings and recent instrument developments. Older sources were only included if they provided fundamental theoretical or empirical contributions to the stress, self-care, or coping of family caregivers and were therefore indispensable to the theoretical foundation of the SSA-PA.
Languages: Only studies published in English or German were included.
Types of publications: Both quantitative and qualitative studies, systematic reviews, meta-analyses, and instrument development studies were considered.
Inclusion criteria: Studies focusing on informal (non-professional) caregivers of adults or older persons receiving home-based care. Research examining burden, stress, coping, self-care, quality of life, or support needs among family caregivers. Publications describing theoretical frameworks or measurement instruments. Studies providing psychometric validation, conceptual models, or dimensions relevant to caregiver well-being and self-care.
Exclusion criteria: Studies focusing exclusively on professional caregivers, institutional care settings, or pediatric caregiving. Publications without empirical or theoretical relevance to the constructs of burden, self-care, or coping (e.g., policy papers, editorials, commentaries). Conference abstracts, letters, and opinion pieces without full methodological transparency.
Of a total of 137 studies identified, 29 papers were included in the conceptualization. From these, four central dimensions were derived that represent the essential areas of life of family caregivers:
The dimension “health status and well-being” includes questions on physical and mental health in order to assess general well-being and health-related stress. For example, Schulz and Sherwood (2018) emphasize the significant impact of caregiving on both physical and mental health, highlighting the chronic stress experienced by caregivers [
22]. Similarly, Savage and Bailey (2004) discuss the mental health effects of family caregiving, underscoring the importance of assessing these aspects [
23]. Other studies also emphasize the considerable physical and psychological strain associated with caregiving tasks, as well as the resulting chronic exhaustion and emotional stress experienced by family caregivers [
24,
25,
26,
27,
28].
The dimension “burden and stress” highlights the everyday challenges and stress factors that family caregivers face. McIlvennan et al. (2021) explore the stress and coping mechanisms among family caregivers, particularly in high-stress situations such as caring for patients with a left ventricular assist device [
29]. Additionally, Uğurlu et al. (2024) examine the relationship between compassion, stress, and coping strategies in caregivers of patients with heart failure, emphasizing the emotional burden and stress experienced by caregivers [
30]. Other studies also emphasize that coping with stress-related burdens in particular plays a central role in the physical and mental health of family caregivers and thus contributes significantly to promoting resilience and prevention [
31,
32,
33,
34,
35].
The dimension “support needs and resources” assesses the need for external support and the use of available resources. Berry et al. (2017) propose a framework for supporting family caregivers of cancer patients, highlighting the importance of assessing caregivers’ needs, educating them, empowering them, and providing proactive assistance [
36]. Shillam (2022) discusses legislative efforts to provide resources and support for family caregivers, emphasizing the need for a national caregiving strategy [
37]. Further studies also confirm the importance of perceived support from formal and informal networks, as well as satisfaction with respite care and nursing services, for the well-being of family caregivers [
28,
38,
39,
40,
41,
42,
43,
44].
The dimension “satisfaction and quality of life” aims to assess subjective quality of life and satisfaction. Perpiñá-Galvañ et al. (2019) examine the burden and health-related quality of life of caregivers of palliative care patients, identifying key factors that predict caregiver burden and its impact on health [
45]. Gan et al. (2022) examine the quality of life of family caregivers of cancer patients in a developing country, highlighting the significant psychological stress and low quality of life experienced by caregivers [
46]. Further studies also confirm the importance of life satisfaction, a sense of purpose, social participation, and emotional resilience as key factors for the well-being and long-term stability of family caregivers [
47,
48,
49].
These dimensions reflect both the stress and resource perspectives and form the theoretical basis for the formulation of the question items.
Phase 2: Item formulation and validation
Based on the theoretical foundations and the identified dimensions, a structured questionnaire was developed. The items were formulated in a multi-stage, theory- and practice-based process that was carried out from September 2024 to December 2024. The aim was to develop a content-based, comprehensible, and practical self-assessment tool for family caregivers.
The item development was divided into several steps:
Based on theoretical models (Orem, Lazarus & Folkman, and Engel) as well as relevant literature and existing validated instruments (e.g., the Zarit Burden Interview, CarerQoL, and the COPE Index), questions were first formulated that reflect the four central dimensions of the tool: health status and well-being, burden and stress, support needs and resources as well as satisfaction and quality of life.
- 2.
Expert validation:
Three experts from the fields of nursing science, psychology, and health services research evaluated the items in terms of comprehensibility, relevance, and theoretical fit. The focus was particularly on ensuring content validity and theoretical coverage. The expert panel consisted of two males and one female, aged between their mid-20s and mid-50s.
- 3.
Target group participation:
To ensure that the tool was practical and comprehensible in everyday use, nine family caregivers were involved in its development. In moderated focus groups, they evaluated the language, emotional appeal, and content suitability of the questions. This feedback enabled the wording and topics to be adapted to the actual experiences of family caregivers in a way that was appropriate for the target group.
- 4.
Revision and fine-tuning:
Based on feedback from experts and the target group, duplicate questions were removed, unclear terms were simplified, and scale options were standardized. In addition, cognitive pre-tests were conducted to check comprehensibility and response behavior. Feedback was incorporated iteratively into the revision of the questions.
The items were predominantly assigned five-point Likert scales (“does not apply at all”–“applies completely”) in order to capture intensities and perceptions in a differentiated manner. In addition, multiple-choice questions (e.g., on the use of support services) and free text fields were used to allow for individual reflections and personal additions.
The final structure of the Self-Assessment for Family Caregivers (SSA-PA) comprises four content sections with a total of 37 items. This structure supports thematically coherent and user-friendly use, both online and in counseling situations.
Table 1 shows the structure of the SSA-PA for family caregivers. The table shows the individual dimensions of the tool, the corresponding questions, and the response formats used (Likert scales, multiple-choice, or open-ended questions). This makes the systematic classification of the survey content and response types within the questionnaire transparent and easy to understand.
Phase 3: Evaluation by family caregivers
An online survey of 33 family caregivers was conducted to test and evaluate the practicality of the SSA-PA. Participants assessed aspects such as user-friendliness, comprehensibility of the questions, and relevance of the content. They were also able to provide suggestions for improvement in free-text fields. The majority of respondents rated the comprehensibility and applicability of the tool positively (see
Figure 1 and
Figure 2).
The evaluation served not only as a practical test but also as preparation for a later psychometric validation with a larger sample. The evaluation of the self-assessment tool was conducted in January 2025.
The results of the evaluation are presented in detail in
Section 3 (“Results”).
2.3. Data Analysis
The quantitative data were analyzed using IBM SPSS Statistics (version 30). Descriptive statistics (means, standard deviations, frequencies) were calculated to describe the sample and evaluate the item responses. The internal consistency of the instrument was determined using Cronbach’s alpha.
The overall instrument yielded a very high value of α = 0.998, indicating an exceptionally high degree of homogeneity among the items. However, such a high alpha value can also indicate redundancy among the items or overlap in content. Therefore, the items were reviewed in terms of content to identify possible overlaps. Some questions showed similarities in content (e.g., repeated wording on stress and exhaustion), indicating the possibility of item consolidation in future versions.
Cronbach’s alpha was calculated based on the closed questions (Likert and multiple-choice items) of the sample of 33 family caregivers. Open-ended questions were not included in the reliability analysis as their content was evaluated qualitatively. A separate calculation of Cronbach’s alpha for the individual dimensions was not performed due to the small sample size, but is planned for a follow-up study.
No factor analyses (exploratory or confirmatory) are available to date to verify validity, as this would require a larger sample size. However, content validity was ensured by the multi-stage development process, which included feedback from both experts and family caregivers.
Content validity index (CVI)
To further verify content validity, the content validity index (CVI) was calculated according to Lynn (1986) [
50]. Three experts from the fields of nursing science, health psychology, and nursing education independently assessed the relevance of the individual items on a four-point scale (1 = not relevant to 4 = highly relevant). The item-level CVI (I-CVI) was calculated as the proportion of experts who rated each item with a 3 or 4 (see
Table 2).
Overall Results:
S-CVI/Ave = 0.892
S-CVI/UA = 0.73
Total agreement (items with full agreement among all experts) = 27
These values indicate a high degree of content validity, as an S-CVI/Ave above 0.80 is considered acceptable for newly developed instruments. Only a few items (e.g., 2, 4, 11, 14, 20, 24) were identified as potentially ambiguous and will be revised in future versions to improve clarity.
Statistical analysis of quantitative data
Non-parametric tests were used for the items on the Likert scale in order to take account of the ordinal level of measurement. Correlation analyses were performed to investigate correlations between key dimensions such as stress, self-care, and need for support. In addition, group comparisons (e.g., by gender, relationship to the care recipient, and duration of care) were performed using appropriate nonparametric methods. The analyses revealed meaningful correlations between several core dimensions and showed that a longer duration of care was associated with higher perceived stress.
The multiple-choice questions were evaluated using descriptive statistics to determine the distribution of responses and identify prevailing trends. The results showed that, after using the instrument, the majority of participants became more aware of their own need for support and were motivated to seek external support.
Qualitative analysis
The validity of the open-ended questions was assessed using a qualitative content analysis according to Mayring (2015) [
51]. The extent to which the responses reflected the theoretically intended dimensions and corresponded in content to the closed-ended questions was examined. The qualitative analysis showed a high degree of consistency between the main topics addressed in the open-ended responses and the four theoretical dimensions of the instrument (health status, stress, need for support, and quality of life). This suggests that the open-ended questions are suitable for capturing and deepening the intended constructs.