1. Introduction
It has been widely reported that the number of strokes will rise by 27% in the next 25 years (Spanish Society of Neurology (SEN), s. f. [
1]). It is a disease that affects approximately 15 million people worldwide each year, with 30% of those affected dying and two-thirds of survivors suffering from disability aftereffects (Tejada Meza et al., 2019) [
2]. When there is a health problem, there is usually a loss or reduction in quality of life. Meanwhile, this alteration in life quality sometimes lasts a long time and affects other people in the patient’s environment. This is the situation of informal caregivers for stroke patients (Bierhals et al., 2019) [
3].
Quality of life is a broad concept that encompasses a multitude of disciplines; to better analyze it, health-related quality of life (HRQoL) has emerged, which relates individuals’ perceptions of health, including objective and subjective aspects (Caqueo-Urízar A and Urzúa M., 2012) [
4]. Although there is no single definition of life quality, it is comprised of several common dimensions, such as life satisfaction, subjective well-being, health status, mental health, and happiness (Andrades-González et al., 2021) [
5]. The aftereffects of a stroke cause dependency in daily activities that must be provided by those around them (usually family members). These people’s quality of life deteriorates over time, affecting their physical, mental, and social health (Woodford J et al., 2017) [
6].
According to a recent systematic review with meta-analysis, there is evidence that an e-Health-based intervention has positive effects on depressive symptoms, caregiver use of medical care, caregiver burden, and physical health (Andrades-González et al., 2021) [
5]. In addition, during the intervention, the majority of the interventions examined were dominated by leaflet guidance and counseling, so educational interventions reflected a positive impact on caregiver burden.
In order to design and develop an App for stroke caregivers, it is essential to introduce a section about the disease’s impact, risk factors, and sequelae. It must also include the changes that the caregiver will experience due to caring for a dependent person. Moreover, it requires advice in the form of video tutorials and support material, as well as informal caregiver associations that have proven to be effective (Andrades-González et al., 2021 [
5]).
The research team of this project set out to create an App aimed at caregivers of stroke patients to improve their quality of life, and that would contain information about the disease, as well as content that will help to improve the day to day life as a caregiver. In addition, they would have a forum to communicate and help each other and a chat that would allow them to communicate directly with the health system.
Effectual techniques must be employed to elaborate the information contained in any App. Many studies have shown that the Delphi technique is a practical methodology for obtaining consensus on a phenomenon from expert opinions. Expert opinions are gathered anonymously and in isolation through a multi-stage survey. This method is based on the idea that the consensus of many experts on a subject is more reliable than the individual opinions of the same experts (Hernández-García and Robaina Castillo, 2017) [
7].
Delphi, a well-known method in health research, has been used to elicit opinions, identify priorities, and make decisions. Examples of applications in the field of health sciences can be seen in a variety of phenomena; this technique has been used to describe typical and relevant aspects of patients with spondylitis (Boonen et al., 2009) [
8], develop scales for the assessment of fatigue in patients with rheumatoid arthritis (Nikolaus et al., 2012) [
9] or, in the area of public health, to manage and prevent food-borne diseases (Palomino-Camargo et al., 2018) [
10]. In addition, several studies have recently been published to develop consensus recommendations for managing COVID-19 (Martínez-Ezquerro et al., 2021) [
11].
To address this issue, a Smartphone App is being developed with the intention of improving the life quality of stroke caregivers. This intervention is supported by studies that have developed e-Health-based interventions for this phenomenon (Andrades-González et al., 2021) [
5].
Therefore, the aim of the study is to reach a general consensus among experts on the supportive information to be housed in an App for stroke caregivers.
2. Materials and Methods
To reach a general expert consensus on supportive information for caregivers of stroke patients hosted on an App.
For this study, a prospective method was used through the Delphi technique, with the goal of obtaining both quantitative and qualitative information that will help to achieve the objective set out in a consensual manner. Between June and December of 2021, this technique was developed. In order to accomplish this, a group of experts is commonly selected (based on inclusion and exclusion criteria) and given a questionnaire covering various aspects of a given topic. The experts provide their opinions on the subject, which are then anonymously incorporated into the questionnaire (as feedback) and returned to them. This procedure is repeated until the established criteria are met. Once the required rounds are completed and the process is finished, the researcher can interpret the data and draw conclusions (Hernández-García and Robaina Castillo, 2017) [
7].
A table of contents was designed first, and then the information to be agreed on for the purpose of the study was created; to this end, a literature search was conducted for clinical practice guidelines and documents from institutions specializing in stroke and informal caregivers (Ferré i Grau et al., 2011; Altuna Azkargota et al., 2018; García Antón et al., 2013; Sierra Díaz and Bravo Piqueras, 2021) [
12,
13,
14,
15]. In the next step, a participatory consensus methodology was applied among the researchers involved in the project through an analysis of the literature and brainstorming. After creating and developing the table of contents, all of the content was reviewed and validated by a panel of subject matter experts using the Delphi method.
2.1. Sample/Participants
The following criteria were considered to form the expert panel: (1) hold a degree in nursing, medicine, physiotherapy, or social education; (2) have specialized training and/or five years or more experience in stroke and its environment; and (3) have a competence coefficient between 0.5 and 1 (0.5 < k < 1).
The population, from which the expert group (N) was formed consisted of Healthcare professionals in stroke-related care practice who met selection criteria 1 and 2. They were invited to join the expert group via e-mail, where the purpose of the study was explained, and informed consent for their participation was requested.
Although some authors (García and Fernández, 2008) [
16] recommend a number of experts ranging from 7 to 30, others, such as Cabero and Barroso (Almenara and Osuna, 2013) [
17], argue that the number of experts for the Delphi method cannot be predetermined in a range. The reason can be linked with the point that on many occasions, access to experts with sufficient knowledge of the subject to be addressed is not possible, or the technique must be carried out quickly. For the development of this study, 16 potential participants were contacted, with 13 agreeing to take part.
The competence coefficient (K) was used to assess expert competence (Hernández-García and Robaina Castillo, 2017) [
7]. It is commonly calculated by the formula K = (Kc + Ka)/2, where Kc is the knowledge coefficient, and Ka is the argumentation coefficient. To obtain Kc, participants are usually asked to rate their knowledge of the topic under discussion on a scale of 1 to 10. Following that, the expert group members self-assess the degree of influence of their knowledge sources, classifying them as high, medium, or low. Finally, Ka is obtained in this manner, and the K coefficient can be calculated.
2.2. Data Collection
The content of the information developed was presented to the experts in the form of 6 sections, and they were asked to rate the relevance of the content in relation to the project objectives using a Likert scale ranging from 1 to 5. On the other hand, they were asked to make suggestions for improving the content. The following indicators were used to investigate the aspects provided: very adequate (5); quite adequate (4); adequate (3); not very adequate (2); and inadequate (1).
The second round was held to reach a consensus on content improvements based on the opinions indicated by the experts in the previous round. The statistical data (percentages, averages, and standard deviations) derived from the first round responses were described in the second round. In addition, improvements to the content based on the suggestions of the first round participants were included, and respondents were asked whether they agreed with the other recommendations.
2.3. Data Analysis
After completing the first round of information evaluation, an analysis of the data obtained was conducted, and statistical processing of the results was carried out to demonstrate reliability and test the level of agreement among the participants. In addition, a qualitative analysis was performed to incorporate the improvements and suggestions made by the group of experts. The coefficient of variation (v) was used as a measure of consensus, which indicates the existing dispersion between the assessments. Notably, if the value is equal to or less than 0.5, the difference is assumed to be significant.
2.4. Validity and Reliability/Rigour
As a methodological rigor strategy, we used the Concordance Index. The concordance index was calculated after analyzing the second round, which establishes the laps’ stability. This coefficient in the Delphi technique defines disagreement as the existence of a discrepancy between the scores of one round and the other without taking into account the magnitude of the difference. The concordance was found to be significant in this case, and the expert group consultation was thus terminated.
2.5. Ethical Considerations
The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of the Balearic Islands (protocol code 4364/20, 24 February 2021) for studies involving humans.
4. Discussion
The advancement of technology has clearly been a driving force in providing remote health care, and smartphones have contributed to the development of e-Health, supporting health education and promotion (Guimaraes Marcelino et al., 2013) [
18].
International literature refers to non-pharmacological psychosocial or psychoeducational strategies and interventions using telephony to support informal caregivers in their process (Romero Guevara et al., 2011; Corry et al., 2019) [
19,
20]. Furthermore, there are studies that display users’ preferences for receiving assistance and interventions through these devices, as well as their satisfaction after receiving it (Beaver et al., 2011) [
21].
According to the literature, it can be concluded that the users’ experiences with e-Health interventions, such as informal caregivers, have been beneficial. Since it has been applied to provide health education, support decision-making, or foster the learning of new skills (Beaver et al., 2011; Chi and Demiris, 2015) [
21,
22].
As a result, the Delphi technique was used to fine-tune the content, which was based on manuals and clinical practice guidelines, in order to create informative content for informal caregivers of stroke patients to be included in an App aimed at improving the life quality of this population segment.
One of the most frequently discussed issues of using a health app is the reliability and accuracy of the information it contains. A review of 12 tertiary prevention mobile apps declared that the collaboration of professional experts in the design and development improves the information quality (Martínez Moreno et al., 2015) [
23].
According to the WHO Bellagio eHealth Evaluation Group, rigorous eHealth evaluation is required to generate evidence and promote the integration and appropriate use of validated and accredited technology with quality, evidence-based information to improve health and reduce health inequalities (WHO|WHO Guideline, s. f.) [
24].
Therefore, we were able to obtain the consensus of different experts in the field, all of whom had a medium-high level of competence by employing the Delphi technique. Furthermore, the content’s reliability was improved, with it being rated as very appropriate for the objectives set, as Boudreaux et al. pointed out (Boudreaux et al., 2014) [
25].
According to the participating experts, the content offered should emphasize the wording of the development, making the information more approachable, practical, and positive for the target population. On the other hand, they believed that the inclusion of graphical elements and videos that aid in synthesizing and clarifying key concepts was essential. These aspects are in line with what a systematic review identified as providing greater satisfaction for users of health apps (Crow et al., 2002) [
26].
Finally, there was complete agreement on the relevance of including the social support and resources available to them at regional and national levels. To that end, they proposed that it be improved to include and highlight the work of social workers as an important pillar, to which they could turn to.
Limitations
A large amount of information on stroke, as well as the scarcity of data on caregivers’ roles and needs, could be assumed as the study’s main limitations. As few studies have figured out the problems and concerns of stroke caregivers, this aspect will be assessed through qualitative research in the App’s piloting.
In addition, another important aspect to highlight as a limitation of the study is the fact that no caregivers, patients or patient representatives were included in the expert group. This approach will be addressed in the piloting and validation of the App, so that real-time information will be improved.