Abstract
Study design: Creating and psychometric testing of a new QoL Questionnaire about Physiotherapeutic Specific Exercises of Scoliosis (Questionnaire of Physiotherapeutic Specific Exercises of Scoliosis—QPSSE). Purpose: The purpose of this study is to create a reliable and valid questionnaire for patients suffering from mild and moderate adolescent idiopathic scoliosis (AIS) who have been treated with Physiotherapeutic Specific Exercises of Scoliosis (PSSE) in order to evaluate their quality of life. Materials and Methods: The developed questionnaire was based on a thorough literature review as well as on authors’ experience. It consists of 53 questions, of which 37 have a positive meaning, 15 have a negative meaning, and 1 is a multiple choice question; additionally, there are 6 “open” questions. Except for the multiple choice question, all other questions are answered on a Likert scale ranging from 1 to 5 points. Five represents a positive meaning or very positive one, whereas one stands for a negative meaning or none at all. Questions were developed by the authors who subsequently categorized the 53 questions into the following eight domains: physical functioning, self-image, Physiotherapeutic Scoliosis-Specific Exercises (PSSEs), psychosocial functioning, cognitive functioning, compliance, motivation, and pain. A pilot study was conducted so that we could calculate Cronbach’s Alpha based on the outcome. Due to the COVID-19 pandemic, the authors worked through the Zoom online platform to structure the questionnaire. Results: Pearson’s correlation coefficient was used for all correlations evaluated. P values of less than 0.05 were considered to be significant. Internal consistency was evaluated with Cronbach’s Alpha. Although there were very few missing values, accounting for 0.78% of the total values of the questionnaire, the expectation maximization likelihood algorithm was used to impute data. IBM® SPSS® Statistics Software v.25 was used for the analysis. Cronbach’s Alpha coefficients for the overall score were 0.84. Conclusions: This original QPSSE was found to be a reliable and valid tool for AIS treated conservatively with PSSE and for the patients’ clinicians.
1. Introduction
In the existing literature for idiopathic scoliosis (IS), the following is widely reported: the common type of it [1,2], its 3-D character [3,4], the incidence of adolescent idiopathic scoliosis (AIS) [4], and how an early diagnosis is made performing the forward bending test, called Adam’s test [5]. Also, the curve that is named scoliosis according to the SRS is discussed [6,7]. Additionally, a plethora of publications report many possible genetic and epigenetic factors [4,8] as causes of its development.
Although scoliosis is considered as a harmless condition, evidence suggests that people with scoliosis are more prone to experiencing back and low-back pain [9,10]. Scoliosis causes multiple dysfunctions and appears to be a burden on healthcare, particularly when patients require extensive surgical treatment [11,12].
The application of Physiotherapeutic Specific Exercises for Scoliosis (PSEE) alone or with bracing is currently one of the therapeutic models for mild and moderate IS.
As far as the definitions of the severity of scoliosis go, there is not full agreement on what is mild and moderate idiopathic scoliosis. Mild idiopathic scoliosis is characterized by a Cobb angle of more than 10 and less than 30 degrees [13], of more than 10 but less than 25 degrees [14], and of more than 10 but less than 20 degrees [4]. Moderate IS is characterized by a Cobb angle of 25–40 degrees, which is indicated for non-operative treatment [2,15] and a Cobb angle greater than 21 to 35 degrees [4]. We consider as mild curves those with a Cobb angle of greater than 10 but less than 20 degrees and as moderate those with a Cobb angle of greater than 21 to 35–40 degrees.
SOSORT uses the term Physiotherapeutic Specific Exercises for Scoliosis (PSSE) for all approved schools and methods. Each method and school incorporates the SOSORT guideline principles and shares a common goal, that of stabilization, arresting progression of IS, and improving the quality of life of patients. The methodology of the PSSE must be based on scientific evidence and adjusted according to the type of the deformity of each patient [16,17]. Another protagonistic and high-priority common goal during the implementation of PSSEs, as recommended by SOSORT, is “three-dimensional self-correction” [4,18]. Self-correction can be defined as the best possible trunk alignment that a patient with scoliosis can achieve in the three planes and axes [19].
The existing PSSE schools that were created involve the following [17,20]:
- Schroth, Germany
- Lyon, France
- SEAS (Scientific Exercise Approach to Scoliosis), Italy
- BSPTS (Barcelona Scoliosis Physical Therapy School), Spain
- Side Shift, UK
- DoboMed, Poland
- FITS (Functional Individual Therapy of Scoliosis), Poland
In Greece, many of the above methods are applied for the rehabilitation of IS. To our knowledge, a specific questionnaire for PSSEs has not yet been published. In this report, a questionnaire is presented, which aims to evaluate the quality of life of children and adolescents with diagnosed IS, who are undergoing treatment with one of the above PSSE methods.
2. Materials and Methods
2.1. The Questionnaire
For the development of the PSSEQ (Physiotherapeutic Scoliosis-Specific Exercises Questionnaire), we followed the recommended guidelines [21] for designing a questionnaire. It is based on a thorough literature review of the field of scoliosis and Physiotherapeutic Scoliosis-Specific Exercises (PSSEs), which are approved by the SOSORT organization [4], as well as on our experience regarding the needs of scoliotic children and adolescent patients in specialized physiotherapeutic centers, in our country. Permission and approval for conducting the research were requested and provided by the ethical committee of the Medical Association of Piraeus. In addition, because participants were minors, consent was provided by their parents for using data from their children who participated in the study.
The total number of the questions was chosen and categorized accordingly to the SOSORT guidelines and scientific articles of IS. The development of questions was carried out by the authors who subsequently divided the questionnaire into the following 8 domains: (1) physical functioning (question numbers 1, 5, 6, 20, 21, 23, 24, 25, 26, 34, 35, 40), (2) self-image (question numbers 2, 47, 49, 50), (3) Physiotherapeutic Scoliosis-Specific Exercises (PSSEs) (question numbers 3, 19, 27, 28, 32, 37, 38, 39), (4) psychosocial functioning (question numbers 4, 7, 22, 29, 36, 41, 42, 44, 45, 46, 48, 51), (5) cognitive functioning (question numbers 11,18, 30, 52,53), (6) compliance (question numbers 8, 9, 10, 12, 13, 14, 15, 16), (7) motivation (question numbers 17, 33), and (8) pain (question numbers 31, 43).
The questionnaire consists of 53 questions. There are 37 with positive meaning and 15 with negative meaning and 1 multiple choice question. Furthermore, 6 open-ended questions were included related to the PSSEs and the questionnaire. In the scored items, a Likert scale of 1 -5 was used. More specifically, responses 1–5 correspond to 5 = Strongly agree and 1 = Strongly disagree. An additional edit was made to the wording of the questions so that they could correspond meaningfully to these responses.
The first sheet of the questionnaire includes questions about the date of data collection, demographic characteristics, first name and surname, father’s and mother’s names, gender, date of birth, address, contact details, height and weight in kilos to calculate BMI, right or left handedness, date of menarche for females, hair and eye color, and type of scoliosis. Data to be filled in by the researcher include the Scoliometer angle, Cobb angle, Risser sign, (Formetric—scoliosis angle), type of treatment (exercise or both exercise and bracing).
A pre-final PSSE questionnaire was developed and a pilot study was conducted, which was completed by 16 participants with AIS. We asked the 16 participants to complete this questionnaire so that we could calculate Cronbach’s Alpha based on the results in their responses. The total sample responses to the questions were entered in SPSS and for each domain, the minimum and maximum effect (floor and ceiling effect), defined as the percentage of participants showing the minimum and maximum possible scores, respectively, were calculated. Results at the minimum and maximum effect exceeding 15% were considered statistically significant. The floor effect was 53/265 and the ceiling effect was 265/265, respectively. Cronbach’s Alpha was calculated as >0.7, which is considered a strong correlation–standard-deviation result between responses. Internal consistency of the questionnaire was evaluated by calculating the Cronbach’s Alpha. The initial number of questions was 64; thus, 11 were excluded from the study or combined with the existing questions just to become more specific and easier for the patients to understand. Thus, the final PSSE questionnaire consists of 53 questions, and 6 “open” questions; see Supplementary Materials. The original questionnaire for PSSEs was developed in the Greek language and was coined QPSSE.
2.2. Study Population
The inclusion criteria for participating in this study are the following: (1) patients should be from 10 to 18 years old, (2) patients should have been diagnosed with mild or moderate AIS, (3) patients should be able to speak and read in Greek, and (4) patients should be undergoing or have undergone in the past Physiotherapeutic Scoliosis-Specific Exercises (PSSEs) for a period of at least 2 months.
The exclusion criteria were mental health problems, a low level of communication, congenital, neurological, or another type of scoliosis, and/or having or had surgery for scoliosis.
Eighty patients qualified and were included in the study. For their characteristics, see below in Section 3.1.
2.3. Psychometric Evaluation
The PSSE questionnaire was evaluated for the following psychometrics: reliability, validity, and floor and ceiling effects. Reliability was assessed by analyzing internal consistency and test–retest reliability. Internal consistency was determined using the Cronbach’s Alpha. The intraclass correlation coefficient (ICC) was calculated to measure the test–retest reliability. The patients completed the questionnaire twice at an interval of 4–7 days for the measuring of test–retest reliability. Convergent validity was compared against the critical value of Pearson’s correlation. Divergent validity was evaluated by analyzing the answers of the patients of the PSSEQ and their characteristics (e.g., Risser sign, Formetric, Cobb angle, gender, etc.) using Pearson’s or Spearman correlation coefficient. The IBM SPSS Statistics v.25 was used for the statistical analysis.
2.4. Materials
2.4.1. Scoliometer Measurement (ATR)
Using a Scoliometer, the angle of trunk rotation (ATR) was assessed [18].
2.4.2. Formetric 4D-DIERS
The Formetric 4D DIERS is a scanning system with a light projector, which scans the back of the patient. This system is connected to a computer that analyzes the data and provides information about the posture of the body, spinal curves (frontal, lateral), pelvic position, vertebral rotation, and muscle imbalance [19].
2.4.3. BMI
Body mass index (BMI) involves a method that calculates body fat according to height and weight in females or males. A normal BMI range is between 18.5 and 24.9 [22].
2.4.4. Cobb Angle
The Cobb angle measurement is used for calculating spine curvatures in the frontal plane. A radiograph is necessary in order for the Cobb angle to be measured. This method is used so as to determine the upper/lower-end vertebras (UEV/LEV) on the radiograph; then, a vertical line at the, respectively, upper/lower-end vertebra endplate lines is necessary (UEVEL/LEVEL), and the included angle of the two vertical lines is the Cobb angle [23].
2.4.5. Risser Sign
The Risser sign is used by clinicians in order to assess the skeletal maturity of a human. The Risser sign is determined using the iliac apophysis from radiographs and is classified in 6 stages (0–5 Risser). It is often used for the evaluation of adolescent idiopathic scoliosis and for the selection of its treatment [24].
2.4.6. Demographics
Demographics are characteristics of a population and are often evaluated for a statistical analysis. Some of them are age, gender, ethnicity, education, geographic location, etc. In this study, age, gender, and color of hair and eyes were used in the statistical analysis.
3. Results
Time needed to complete the PSSEQ was about 10–11 min.
Eighty patients were included in the study and 21 test–retests were completed in a period of 14 months.
3.1. Descriptive Statistics
| Mean | Standard Deviation | ||
| Age (yrs) | 16.5 | 7.1 | |
| BMI (Kg/m2) | 19.89 | 2.75 | |
| Cobb angle (degrees) | 36.1 | 4.08 | |
| Risser sign | 4.6 | 1.6 | |
| Age at menarche | 12.1 | 1.1 | |
| Count | Column N % | ||
| Menarche | No | 12 | 18.2% |
| Yes | 54 | 81.8% | |
| Sex | Male | 11 | 13.8% |
| Female | 69 | 86.3% | |
| Brace | No | 19 | 25.0% |
| Yes | 57 | 75.0% | |
| Dominant hand | Right | 67 | 88.2% |
| Left | 9 | 11.8% | |
| In general, how would you describe the state of your physical health? | Not good at all | 1 | 1.3% |
| Somewhat good | 1 | 1.3% | |
| Moderately good | 20 | 25.0% | |
| Quite good | 41 | 51.3% | |
| Very good | 17 | 21.3% | |
| In general, how would you rate your appearance? | Not good at all | 0 | 0.0% |
| Somewhat good | 2 | 2.5% | |
| Moderately good | 17 | 21.3% | |
| Quite good | 39 | 48.8% | |
| Very good | 22 | 27.5% | |
| In general, how would you describe your experience with PSSE? | Not good at all | 0 | 0.0% |
| Somewhat good | 1 | 1.3% | |
| Moderately good | 11 | 13.8% | |
| Quite good | 42 | 52.5% | |
| Very good | 26 | 32.5% | |
| In general, how would you describe your mental health? | Not good at all | 0 | 0.0% |
| Somewhat good | 3 | 3.8% | |
| Moderately good | 11 | 13.8% | |
| Quite good | 40 | 50.0% | |
| Very good | 26 | 32.5% | |
| In general, how would you rate your posture during the day? | Not good at all | 2 | 2.5% |
| Somewhat good | 5 | 6.3% | |
| Moderately good | 29 | 36.3% | |
| Quite good | 36 | 45.0% | |
| Very good | 8 | 10.0% | |
| In general, how would you rate your endurance? | Not good at all | 3 | 3.8% |
| Somewhat good | 6 | 7.5% | |
| Moderately good | 13 | 16.3% | |
| Quite good | 26 | 32.5% | |
| Very good | 32 | 40.0% | |
| In general, how would you describe your relationship with the people close to you? | Not good at all | 0 | 0.0% |
| Somewhat good | 0 | 0.0% | |
| Moderately good | 5 | 6.3% | |
| Quite good | 17 | 21.3% | |
| Very good | 58 | 72.5% | |
| In this time period, I do PSSE alone at home every day. | Never | 1 | 1.3% |
| Almost never | 5 | 6.3% | |
| Sometimes | 28 | 35.0% | |
| Almost constantly | 32 | 40.0% | |
| Constantly | 14 | 17.5% | |
| In this time period, I keep a PSSE diary. | Never | 51 | 63.8% |
| Almost never | 10 | 12.5% | |
| Sometimes | 7 | 8.8% | |
| Almost constantly | 5 | 6.3% | |
| Constantly | 7 | 8.8% | |
| In this time period, I do PSSE regularly and according to the physiotherapist’s instructions. | Never | 3 | 3.8% |
| Almost never | 1 | 1.3% | |
| Sometimes | 22 | 27.5% | |
| Almost constantly | 26 | 32.5% | |
| Constantly | 28 | 35.0% | |
| In this time period, among my daily activities is trying to make sure that my body weight is better distributed on the right and left side. | Never | 2 | 2.5% |
| Almost never | 6 | 7.5% | |
| Sometimes | 29 | 36.3% | |
| Almost constantly | 39 | 48.8% | |
| Constantly | 4 | 5.0% | |
| I will do PSSE at home even if I’m tired. | Not true at all | 6 | 7.5% |
| Somewhat true | 16 | 20.0% | |
| Almost true | 17 | 21.3% | |
| True enough | 31 | 38.8% | |
| Absolutely true | 10 | 12.5% | |
| I will do PSSE at home even if I’m in a bad mood. | Not true at all | 10 | 12.5% |
| Somewhat true | 14 | 17.5% | |
| Almost true | 19 | 23.8% | |
| True enough | 22 | 27.5% | |
| Absolutely true | 15 | 18.8% | |
| I will do PSSE at home even if I don’t have time. | Not true at all | 12 | 15.0% |
| Somewhat true | 26 | 32.5% | |
| Almost true | 23 | 28.8% | |
| True enough | 14 | 17.5% | |
| Absolutely true | 5 | 6.3% | |
| I will do PSSE at home even if I’m on vacation. | Not true at all | 27 | 33.8% |
| Somewhat true | 19 | 23.8% | |
| Almost true | 16 | 20.0% | |
| True enough | 11 | 13.8% | |
| Absolutely true | 7 | 8.8% | |
| I will do PSSE at home even if the physiotherapist is not with me. | Not true at all | 6 | 7.5% |
| Somewhat true | 8 | 10.0% | |
| Almost true | 15 | 18.8% | |
| True enough | 18 | 22.5% | |
| Absolutely true | 33 | 41.3% | |
| Motivation | I try to do the PSSE because if I don’t, I will feel guilty. | 4 | 5.0% |
| I try to do PSSE because I don’t want to upset some people who are very important to me. | 16 | 20.0% | |
| PSSE are worth the effort and time I spend because of the positive effects on my body. | 37 | 46.3% | |
| I do PSSE because I feel great satisfaction when I achieve the goals I set during each treatment. | 14 | 17.5% | |
| I do PSSEs because they really help me feel good about myself and my life. | 9 | 11.3% | |
| The PSSEs are important in treating scoliosis. | Not true at all | 0 | 0.0% |
| Somewhat true | 0 | 0.0% | |
| Almost true | 6 | 7.5% | |
| True enough | 29 | 36.3% | |
| Absolutely true | 45 | 56.3% | |
| The PSSEs are very useful for me. | Not true at all | 0 | 0.0% |
| Somewhat true | 0 | 0.0% | |
| Almost true | 13 | 16.3% | |
| True enough | 33 | 41.3% | |
| Absolutely true | 34 | 42.5% | |
| The PSSEs help me because I feel more energetic. | Not true at all | 10 | 12.5% |
| Somewhat true | 10 | 12.5% | |
| Almost true | 26 | 32.5% | |
| True enough | 21 | 26.3% | |
| Absolutely true | 13 | 16.3% | |
| The PSSEs help me breath better. | Not true at all | 10 | 12.5% |
| Somewhat true | 12 | 15.0% | |
| Almost true | 24 | 30.0% | |
| True enough | 23 | 28.8% | |
| Absolutely true | 11 | 13.8% | |
| The PSSEs put me in a difficult position because I waste a lot of my free time. | Absolutely true | 12 | 15.0% |
| True enough | 27 | 33.8% | |
| Almost true | 12 | 15.0% | |
| Somewhat true | 16 | 20.0% | |
| Not true at all | 13 | 16.3% | |
| The PSSEs help me sleep better. | Not true at all | 18 | 22.5% |
| Somewhat true | 23 | 28.8% | |
| Almost true | 29 | 36.3% | |
| True enough | 7 | 8.8% | |
| Absolutely true | 3 | 3.8% | |
| The PSSEs help me feel that my body is stronger and more stabilized. | Not true at all | 5 | 6.3% |
| Somewhat true | 4 | 5.0% | |
| Almost true | 17 | 21.3% | |
| True enough | 36 | 45.0% | |
| Absolutely true | 18 | 22.5% | |
| The PSSEs are exhausting. | Absolutely true | 10 | 12.5% |
| True enough | 9 | 11.3% | |
| Almost true | 21 | 26.3% | |
| Somewhat true | 25 | 31.3% | |
| Not true at all | 15 | 18.8% | |
| The PSSEs help me have better endurance. | Not true at all | 5 | 6.3% |
| Somewhat true | 11 | 13.8% | |
| Almost true | 30 | 37.5% | |
| True enough | 26 | 32.5% | |
| Absolutely true | 8 | 10.0% | |
| The PSSEs are easier when I do them in front of the mirror because I can see if I’m doing them right. | Not true at all | 0 | 0.0% |
| Somewhat true | 1 | 1.3% | |
| Almost true | 9 | 11.3% | |
| True enough | 29 | 36.3% | |
| Absolutely true | 41 | 51.3% | |
| The PSSEs are very difficult. | Absolutely true | 10 | 12.5% |
| True enough | 9 | 11.3% | |
| Almost true | 28 | 35.0% | |
| Somewhat true | 16 | 20.0% | |
| Not true at all | 17 | 21.3% | |
| The PSSEs make me feel good about myself. | Not true at all | 3 | 3.8% |
| Somewhat true | 6 | 7.5% | |
| Almost true | 22 | 27.5% | |
| True enough | 35 | 43.8% | |
| Absolutely true | 14 | 17.5% | |
| The PSSEs help change my body for the better. | Not true at all | 0 | 0.0% |
| Somewhat true | 2 | 2.5% | |
| Almost true | 7 | 8.8% | |
| True enough | 29 | 36.3% | |
| Absolutely true | 42 | 52.5% | |
| The PSSEs help me feel less pain. | Not true at all | 13 | 16.3% |
| Somewhat true | 19 | 23.8% | |
| Almost true | 15 | 18.8% | |
| True enough | 13 | 16.3% | |
| Absolutely true | 20 | 25.0% | |
| During the time I’m doing PSSEs, I see my body becoming more straight. | Not true at all | 0 | 0.0% |
| Somewhat true | 0 | 0.0% | |
| Almost true | 12 | 15.0% | |
| True enough | 37 | 46.3% | |
| Absolutely true | 31 | 38.8% | |
| During the time I’m doing PSSEs, I try hard to do every exercise. | Not true at all | 2 | 2.5% |
| Somewhat true | 6 | 7.5% | |
| Almost true | 16 | 20.0% | |
| True enough | 31 | 38.8% | |
| Absolutely true | 25 | 31.3% | |
| During the time I’m doing PSSEs, I feel that I can’t take a deep and satisfying breath. | Absolutely true | 19 | 23.8% |
| True enough | 22 | 27.5% | |
| Almost true | 11 | 13.8% | |
| Somewhat true | 11 | 13.8% | |
| Not true at all | 17 | 21.3% | |
| During the time I’m doing PSSE, my chest feels tight and can’t “inflate” as much as it should. | Absolutely true | 25 | 31.3% |
| True enough | 14 | 17.5% | |
| Almost true | 12 | 15.0% | |
| Somewhat true | 13 | 16.3% | |
| Not true at all | 16 | 20.0% | |
| During the time I’m doing PSSE, I prefer not to be seen by anyone. | Absolutely true | 24 | 30.0% |
| True enough | 16 | 20.0% | |
| Almost true | 9 | 11.3% | |
| Somewhat true | 16 | 20.0% | |
| Not true at all | 15 | 18.8% | |
| During the time I’m doing PSSE, I can straighten my body from a sitting position. | Not true at all | 0 | 0.0% |
| Somewhat true | 6 | 7.5% | |
| Almost true | 10 | 12.5% | |
| True enough | 26 | 32.5% | |
| Absolutely true | 38 | 47.5% | |
| During the time I’m doing PSSE, I can straighten my body from a lying position. | Not true at all | 5 | 6.3% |
| Somewhat true | 8 | 10.0% | |
| Almost true | 9 | 11.3% | |
| True enough | 34 | 42.5% | |
| Absolutely true | 24 | 30.0% | |
| During the time I’m doing PSSE, I can straighten my body from a standing position. | Not true at all | 2 | 2.5% |
| Somewhat true | 10 | 12.5% | |
| Almost true | 16 | 20.0% | |
| True enough | 22 | 27.5% | |
| Absolutely true | 30 | 37.5% | |
| How often have you felt out of breath lately? | Always | 26 | 32.5% |
| Almost always | 22 | 27.5% | |
| Sometimes | 12 | 15.0% | |
| Almost never | 6 | 7.5% | |
| Never | 14 | 17.5% | |
| How often have you lately felt bad about yourself? | Always | 15 | 18.8% |
| Almost always | 22 | 27.5% | |
| Sometimes | 26 | 32.5% | |
| Almost never | 4 | 5.0% | |
| Never | 13 | 16.3% | |
| How often have you lately felt sad, down, or angry? | Always | 5 | 6.3% |
| Almost always | 21 | 26.3% | |
| Sometimes | 41 | 51.3% | |
| Almost never | 7 | 8.8% | |
| Never | 6 | 7.5% | |
| How often have you lately felt pain in your body? | Always | 15 | 18.8% |
| Almost always | 20 | 25.0% | |
| Sometimes | 22 | 27.5% | |
| Almost never | 14 | 17.5% | |
| Never | 9 | 11.3% | |
| How often have you lately felt that you have difficulties in making friends? | Always | 25 | 31.3% |
| Almost always | 19 | 23.8% | |
| Sometimes | 12 | 15.0% | |
| Almost never | 5 | 6.3% | |
| Never | 19 | 23.8% | |
| How often have you lately felt uncomfortable when you’re around people? | Always | 15 | 18.8% |
| Almost always | 28 | 35.0% | |
| Sometimes | 13 | 16.3% | |
| Almost never | 13 | 16.3% | |
| Never | 11 | 13.8% | |
| It is true for me that I find it hard to open up to someone, especially as long as I’ve been dealing with PSSEs? | Strongly agree | 25 | 31.3% |
| Agree | 21 | 26.3% | |
| Neutral | 12 | 15.0% | |
| Disagree | 5 | 6.3% | |
| Strongly disagree | 17 | 21.3% | |
| It is true for me that I am not ashamed to do the PSSEs in front of people I consider close to me? | Strongly disagree | 3 | 3.8% |
| Disagree | 8 | 10.0% | |
| Neutral | 9 | 11.3% | |
| Agree | 16 | 20.0% | |
| Strongly agree | 44 | 55.0% | |
| It is true for me that my physical therapist is very friendly and supportive? | Strongly disagree | 0 | 0.0% |
| Disagree | 1 | 1.3% | |
| Neutral | 2 | 2.5% | |
| Agree | 17 | 21.3% | |
| Strongly agree | 60 | 75.0% | |
| It is true for me that my body’s curve is too obvious to others? | Strongly agree | 12 | 15.0% |
| Agree | 9 | 11.3% | |
| Neutral | 27 | 33.8% | |
| Disagree | 20 | 25.0% | |
| Strongly disagree | 12 | 15.0% | |
| It is true that when I meet someone, I worry about what they think about my appearance? | Strongly agree | 16 | 20.0% |
| Agree | 8 | 10.0% | |
| Neutral | 27 | 33.8% | |
| Disagree | 18 | 22.5% | |
| Strongly disagree | 11 | 13.8% | |
| It is true for me that it doesn’t matter how someone looks? | Strongly disagree | 5 | 6.3% |
| Disagree | 9 | 11.3% | |
| Neutral | 12 | 15.0% | |
| Agree | 32 | 40.0% | |
| Strongly agree | 22 | 27.5% | |
| In general, how satisfied are you with the knowledge you gained through your experience with PSSE? | Not at all | 0 | 0.0% |
| A little | 0 | 0.0% | |
| Moderately | 10 | 12.5% | |
| Enough | 46 | 57.5% | |
| Very much | 24 | 30.0% | |
| In general, how satisfied are you with your physical therapist? | Not at all | 1 | 1.3% |
| A little | 0 | 0.0% | |
| Moderately | 3 | 3.8% | |
| Enough | 16 | 20.0% | |
| Very much | 60 | 75.0% |
3.2. Statistical Analysis
Based on the Kolmogorov–Smirnov goodness-of-fit test and Shapiro–Wilk test for normality, data did not follow the normal distribution; therefore, non-parametric tests were used for the statistical analysis. Pearson’s correlation coefficient was used for all correlations evaluated. p values of less than 0.05 were considered to be significant. Internal consistency was evaluated through the Cronbach’s Alpha method. Although there were very few missing values, accounting for 0.78% of the total values of the questionnaire, the expectation maximization likelihood algorithm was used to impute data. IBM® SPSS® Statistics Software v.25 was used for the analysis.
3.3. Factor Analysis
The results of the content validity analysis demonstrated excellent reliability and content validity for the questionnaire, as summarized in Table 1.
Table 1.
The questionnaire domains and the results of tests of item convergent validity, item consistency reliability, and floor and ceiling effects.
3.4. Internal Consistency Reliability
Cronbach’s Alpha coefficients for the overall score were 0.84, exceeding the minimum recommended standard of 0.70 and indicating satisfactory internal consistency.
3.5. Item Convergent Validity
The criterion for item convergent validity was the correlation coefficient of each item of each domain with the domain scale variable. This value was compared against the critical value of Pearson’s r equal to 0.219, taking into account 78 degrees of freedom for each comparison with a p < 0.05.
3.6. Item Divergent Validity
The criterion for item divergent validity was the correlation coefficient of each domain scale variable and the clinical continuous variables (age, BMI, Cobb angle). Except for the pain domain variable that was positively correlated with age, there was no other significant correlation found between the aforementioned variables, indicating the lack of relationship of the 53 measurements of the questionnaire with the clinical data.
3.7. Test–Retest Reliability
Test–retest reliability was assessed using Pearson’s correlation coefficient, r. Twenty-two subjects were re-evaluated one week after the first interview. The results of the questionnaire were used for 53 discrete bivariate correlations, 1 for each variable of the questionnaire. The results showed that there was perfect test–retest reliability in terms of achieving r values equal to 1 in all correlations.
3.8. Floor and Ceiling Effects for the Overall Score
For the overall score, in the present study, 0% of patients scored at the floor and 0% scored at the ceiling. Therefore, there were no floor or ceiling effects for the overall score. Floor and ceiling effects for each domain are shown in Table 1. Floor and ceiling effects for each item are shown in Table 2.
Table 2.
Floor and ceiling effects (percentage of respondents with minimum/maximum scale scores) for each item of the questionnaire.
The total values for all scale scores, as well as the range of possible scores, are shown in Table 3.
Table 3.
Mean values and ranges for each item of the questionnaire.
4. Discussion
The aim of this study was to develop a questionnaire that evaluates the quality of life in the Greek population with idiopathic scoliosis, who are undergoing Physiotherapeutic Specific Exercises for Scoliosis (PSSE), and the evaluation of its psychometrics.
As it is described below, many other good questionnaires are used to assess scoliosis but a specific treatment for a PSSE questionnaire was not developed until the present. This makes the difference from other questionnaires developed to assess the QoL for IS.
This treatment-specific questionnaire, the QPSSE, was created in order to determine how various parts of treatment of IS using PSSEs influence patients with AIS, and this is its strong point, which is not provided using other pertinent-to-IS questionnaires.
A final 53-item questionnaire was developed with eight domains. The eight domains of the final questionnaire were as follows: (1) physical functioning, (2) self-image, (3) Physiotherapeutic Scoliosis-Specific Exercises (PSSEs), (4) psychosocial functioning, (5) cognitive functioning, (6) compliance, (7) motivation, and (8) pain.
Previous studies have developed other questionnaires that evaluate similar aspects of patients with AIS after other treatments, either conservative or surgical. One questionnaire that evaluates the quality of life regarding AIS is the 22-item revised questionnaire of SRS (SRS-22R) that evaluates quality of life regarding AIS, especially after surgery treatment [25]. Another one is the Brace questionnaire (BrQ) that evaluates quality of life in populations with IS treated with a brace [26]. Also, Short-Form Health Survey 36 (SF-36) or Short-Form Health Survey 12 (SF-12) that evaluates Health-Related Quality of Life (HRQoL) [27,28] and the spinal appearance questionnaire (SAQ) aim to assess self-image in patients with AIS [29].
SRS-22-R is one of the most frequently used questionnaires for patients with scoliosis and includes 22 items that are divided in five domains: pain, self-image, function, mental health, and satisfaction with management [30]. QPSSE was divided into eight domains. Some of them were, also, pain, self-image, and psychosocial functioning. As it was mentioned before, SRS-22R was mainly intended for patients with AIS treated with surgery. However, to date, no questionnaires have been developed to evaluate the quality of life for patients with AIS, so SRS-22R was often used for evaluating general quality of life for these patients regardless of their treatment.
BrQ is a self-administrated questionnaire that evaluates the quality of life for patients with AIS who are treated with a brace. There is a 34-item Likert scale that consists of eight domains such as QPSSE general health perception, physical functioning (physical functioning, also, in QPSSE), emotional functioning (psychosocial functioning in QPSSE), self-esteem and aesthetics (self-image in QPSSE), vitality (motivation in QPSSE), school activity, bodily pain (pain in QPSSE), and social functioning (psychosocial functioning in QPSSE) [26].
SF-36 is a 36-item self-reported questionnaire and one of the most widely used Health-Related Quality of Life questionnaires. It is divided into eight sections: (1) vitality or energy (motivation in QPSSE), (2) physical functioning (also in QPSSE), (3) bodily pain (also in QPSSE), (4) general health perceptions, (5) physical role functioning, (6) emotional role functioning, (7) social role functioning (psychosocial functioning in QPSSE), (8) mental health or emotional wellbeing (cognitive functioning in QPSSE). SF-12 is a smaller version of SF-36. These questionnaires have also been used for patients with AIS in order to evaluate their general quality of life [27,28].
The 32-item SAQ is a questionnaire based on the Walter Reed Visual Assessment Scale (WRVAS) and it evaluates perception of spinal appearance by patients with AIS. After validation, a 20-item SAQ was developed and divided into nine domains, and three textual items about the most distressing aspects of deformity. The items of SAQ are divided into the following domains: general (three items), curve (one), prominence (two), trunk shift (two), waist (three), shoulders (two), kyphosis (one), chest (two), and surgical scar (one), and an extra three textual questions as it was mentioned. The SAQ has been widely used and culturally adapted into many languages for the assessment of the appearance in patients with AIS. The original Greek-QPSSE (has) also included a domain about the self-image of patients with AIS (four items) [31].
The PSSEQ results showed that there was perfect test–retest reliability in terms of achieving r values equal to 1 in all correlations and an overall score for internal consistency of 0.84, exceeding the minimum recommended standard of 0.70 and indicating satisfactory internal consistency. The Greek version of SRS-22 was shown to have three domains with a very satisfactory Cronbach’s α (pain, 0.85; mental health, 0.87; self-image, 0.83) and for two domains (function/activity, 0.72; satisfaction, 0.67), they were good. The intraclass correlation coefficient (ICC) was >0.70, demonstrating very satisfactory or excellent test/retest reliability [30]. The initial Greek BrQ was shown to have satisfactory internal consistency with a Cronbach’s Alpha of 0.82 [26]. The Greek version of SF-36 was found to have a Cronbach’s α > 0.70 [32]. The original English SAQ had good-to-excellent reliability (Spearman’s rho, 0.57–0.99) and high internal scale consistency (Cronbach’s Alpha > 0.7) [29].
Divergent validity in QPSSE was found with no other significant correlation between the aforementioned variables, indicating the lack of relationship of the 53 measurements of the questionnaire with the clinical data. Concurrent validity of SRS-22 was evaluated through its correlation with SF-36 domains analyzing Pearson Correlation Coefficients, and all correlations were found to be statistically significant [30]. Other cultural adaptations of SAQ evaluated convergent validity by correlating SAQ with the appearance domain of SRS-22R and divergent validity by correlating patients’ answers in SAQ with their characteristics, demonstrating good-to-excellent results [31,33,34,35,36] as in this study of the original Greek QPSSE.
The original Greek version of QPSSE showed similar results with the Greek versions or other studies of SRS-22, BrQ, SF-36, or SF-12 and SAQ. All these questionnaires evaluate the quality of life for patients with AIS generally or after a treatment or assess Health-Related Quality of Life in general. Our study assessed the intervention after Physiotherapeutic Scoliosis-Specific Exercises, BrQ after bracing, and SRS-22 especially after surgery. However, further study of the QPSSE is needed in order to evaluate more psychometric properties, such as convergent validity or responsiveness. These tests would be necessary so as to determine if the PSSQ is responsive to changes. In order to assess convergent validity, it would be essential for other similar questionnaires or tools about the PSSEs and quality of life to be developed. Furthermore, a further study with a greater number of participants would potentially have better results in psychometrics in a questionnaire evaluating the quality of life in the Greek population with AIS.
This questionnaire is a significant tool for the clinicians and physical therapists who work using PSSEs for adolescents with IS, in order to evaluate their patients’ quality of life and interventions after exercises. This tool will provide clinicians with information about Greek patients with AIS so as to improve or change something in their treatment or intervention. It would be essential for this questionnaire to be translated into other languages too, so that other countries could have a tool available for evaluation of quality of life for patients who undergo PSSEs.
A limitation of the application of this QPSSE may be considered as the time period of scoliosis exercise treatment, which is not clearly agreed upon and recommended on any curve type, and consequently the outcomes based on the generated data will need carefully conducted further studies including long-term follow ups.
5. Conclusions
In conclusion, the PSSE questionnaire was found to be reliable and valid for clinical use for patients with AIS treated conservatively with PSSEs or both PSSEs and a brace in the Greek population.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm13020318/s1, Questionnaire for Physiotherapeutic Specific Scoliosis Exercises (QPSSE).
Author Contributions
T.B.G., conceptualization, literature search, editing the original draft preparation; D.D., review, literature search; S.A.F., literature search, writing; A.K., data collection; M.K., review, writing; C.M., statistical analysis, writing; M.O., literature search, writing; E.T., data collection; A.M.G., review, editing the original draft preparation. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Piraeus Medical Association (June 2023).
Informed Consent Statement
Informed consent was obtained from all subjects of age involved in the study except for minors according to the Hellenic legislation (children or adolescents), for whom an informed consent statement was obtained from their parents.
Data Availability Statement
Data are available on demand.
Conflicts of Interest
The authors T.B.G., D.D., S.A.F., A.K., C.M., and A.M.G. declare that they have no conflicts of interest concerning this article. M.K.: Physiotherapist and Complementary Therapist (Acupuncture), Athens, Greece, M.O. Aenaon-physio, 17342 Athens, ET Athens Scoliosis-Spine Rehabilitation Clinic.
Abbreviations
AIS = Adolescent Idiopathic Scoliosis; IS = Idiopathic Scoliosis; ATR = Angle of Trunk Rotation; IIS = Infantile Idiopathic Scoliosis; JIS = Juvenile Idiopathic Scoliosis; PSSEs = Physiotherapeutic Scoliosis-Specific Exercises; TA = Truncal Asymmetry.
References
- Kikanloo, S.R.; Tarpada, S.P.; Cho, W. Etiology of Adolescent Idiopathic Scoliosis: A Literature Review. Asian Spine J. 2019, 13, 519–526. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6547389/ (accessed on 19 November 2023). [CrossRef] [PubMed]
- Weinstein, S.L.; Dolan, L.A.; Wright, J.G.; Dobbs, M.B. Effects of Bracing in Adolescents with Idiopathic Scoliosis. N. Engl. J. Med. 2013, 369, 1512–1521. [Google Scholar] [CrossRef] [PubMed]
- Hawes, M.C.; O’Brien, J.P. The transformation of spinal curvature into spinal deformity: Pathological processes and implications for treatment. Scoliosis. 2006, 1, 3. [Google Scholar] [CrossRef] [PubMed]
- Negrini, S.; Donzelli, S.; Aulisa, A.G.; Czaprowski, D.; Schreiber, S.; de Mauroy, J.C.; Diers, H.; Grivas, T.B.; Knott, P.; Kotwicki, T.; et al. 2016 SOSORT guidelines: Orthopaedic and rehabilitation treatment of idiopathic scoliosis during growth. Scoliosis Spinal Disord. 2018, 13, 3. [Google Scholar] [CrossRef] [PubMed]
- Grossman, T.W.; Mazur, J.M.; Cummings, R.J. An Evaluation of the Adams Forward Bend Test and the Scoliometer in a Scoliosis School Screening Setting. J. Pediatr. Orthop. 1995, 15, 535–538. [Google Scholar] [CrossRef] [PubMed]
- Galbusera, F.; Bassani, T.; Panico, M.; Sconfienza, L.M.; Cina, A. A fresh look at spinal alignment and deformities: Automated analysis of a large database of 9832 biplanar radiographs. Front. Bioeng. Biotechnol. 2022, 10, 863054. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9335010/ (accessed on 16 November 2023). [CrossRef] [PubMed]
- Choudhry, M.N.; Ahmad, Z.; Verma, R. Adolescent Idiopathic Scoliosis. Open Orthop. J. 2016, 10, 143–154. [Google Scholar] [CrossRef]
- Peng, Y.; Wang, S.R.; Qiu, G.X.; Zhang, J.G.; Zhuang, Q.Y. Research progress on the etiology and pathogenesis of adolescent idiopathic scoliosis. Chin. Med. J. 2020, 133, 483–493. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7046244 (accessed on 19 November 2023). [CrossRef]
- Balagué, F.; Pellisé, F. Adolescent idiopathic scoliosis and back pain. Scoliosis Spinal Disord. 2016, 11, 27. [Google Scholar] [CrossRef]
- Théroux, J.; Le May, S.; Hebert, J.J.; Labelle, H. Back Pain Prevalence Is Associated With Curve-type and Severity in Adolescents With Idiopathic Scoliosis. Spine 2017, 42, E914–E919. [Google Scholar] [CrossRef]
- Kobayashi, K.; Ando, K.; Machino, M.; Tanaka, S.; Morozumi, M.; Kanbara, S.; Ito, S.; Inoue, T.; Ishiguro, N.; Imagama, S. Trends in Medical Costs for Adolescent Idiopathic Scoliosis Surgery in Japan. Glob. Spine J. 2019, 10, 1040–1045. [Google Scholar] [CrossRef]
- Boylan, M.R.; Riesgo, A.M.; Chu, A.; Paulino, C.B.; Feldman, D.S. Costs and complications of increased length of stay following adolescent idiopathic scoliosis surgery. J. Pediatr. Orthop. B 2019, 28, 27–31. [Google Scholar] [CrossRef] [PubMed]
- Cheung, M.-C.; Yip, J.; Lai, J.S.K. Biofeedback Posture Training for Adolescents with Mild Scoliosis. BioMed Res. Int. 2022, 2022, 5918698. [Google Scholar] [CrossRef] [PubMed]
- Monticone, M.; Ambrosini, E.; Cazzaniga, D.; Rocca, B.; Ferrante, S. Active self-correction and task-oriented exercises reduce spinal deformity and improve quality of life in subjects with mild adolescent idiopathic scoliosis. Results of a randomised controlled trial. Eur. Spine J. 2014, 23, 1204–1214. [Google Scholar] [CrossRef] [PubMed]
- Kuznia, A.L.; Hernandez, A.K.; Lee, L.U. Adolescent Idiopathic Scoliosis: Common Questions and Answers. Am. Fam. Physician 2020, 101, 19–23. [Google Scholar] [PubMed]
- Bettany-Saltikov, J.; Parent, E.; Romano, M.; Villagrasa, M.; Negrini, S. Physiotherapeutic scoliosis-specific exercises for adolescents with idiopathic scoliosis. Eur. J. Phys. Rehabil. Med. 2014, 50, 111–121. Available online: https://pubmed.ncbi.nlm.nih.gov/24525556/ (accessed on 19 November 2023). [PubMed]
- Berdishevsky, H.; Lebel, V.A.; Bettany-Saltikov, J.; Rigo, M.; Lebel, A.; Hennes, A.; Romano, M.; Białek, M.; M’hango, A.; Betts, T.; et al. Physiotherapy scoliosis-specific exercises—A comprehensive review of seven major schools. Scoliosis Spinal Disord. 2016, 11, 20. [Google Scholar] [CrossRef] [PubMed]
- Côté, P.; Kreitz, B.G.; Cassidy, J.D.; Dzus, A.K.; Martel, J. A study of the diagnostic accuracy and reliability of the Scoliometer and Adam’s forward bend test. Spine 1998, 23, 796–802; discussion 803. Available online: https://www.ncbi.nlm.nih.gov/pubmed/9563110 (accessed on 19 November 2023). [CrossRef]
- Diers, H.; Mooshake, S.; Heitmann, K. Dynamic 3D (4D) in objective classification of severe back deformities. Scoliosis 2009, 4, O16. [Google Scholar] [CrossRef][Green Version]
- Seleviciene, V.; Cesnaviciute, A.; Strukcinskiene, B.; Marcinowicz, L.; Strazdiene, N.; Genowska, A. Physiotherapeutic Scoliosis-Specific Exercise Methodologies Used for Conservative Treatment of Adolescent Idiopathic Scoliosis, and Their Effectiveness: An Extended Literature Review of Current Research and Practice. Int. J. Environ. Res. Public Health 2022, 19, 9240. [Google Scholar] [CrossRef]
- Jenn, N.C. Designing A Questionnaire. Malays. Fam. Physician Off. J. Acad. Fam. Physicians Malays. 2006, 1, 32–35. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4797036/ (accessed on 19 November 2023).
- Weir, C.B.; Jan, A. BMI Classification Percentile and Cut off Points; PubMed; StatPearls Publishing: Treasure Island, FL, USA, 2021. Available online: https://pubmed.ncbi.nlm.nih.gov/31082114/ (accessed on 19 November 2023).
- Wang, J.; Zhang, J.; Xu, R.; Chen, T.G.; Zhou, K.S.; Zhang, H.H. Measurement of scoliosis Cobb angle by end vertebra tilt angle method. J. Orthop. Surg. Res. 2018, 13, 223. [Google Scholar] [CrossRef] [PubMed]
- Subramanian, S.; Viswanathan, V.K. Bone Age; PubMed; StatPearls Publishing: Treasure Island, FL, USA, 2021. Available online: https://www.ncbi.nlm.nih.gov/books/NBK537051/ (accessed on 19 November 2023).
- Asher, M.; Min Lai, S.; Burton, D.; Manna, B. The Reliability and Concurrent Validity of the Scoliosis Research Society-22 Patient Questionnaire for Idiopathic Scoliosis. Spine 2003, 28, 63–69. [Google Scholar] [CrossRef] [PubMed]
- Vasiliadis, E.; Grivas, T.B.; Gkoltsiou, K. Development and preliminary validation of Brace Questionnaire (BrQ): A new instrument for measuring quality of life of brace treated scoliotics. Scoliosis 2006, 1, 7. [Google Scholar] [CrossRef] [PubMed]
- Ware, J.E.; Gandek, B. Overview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project. J. Clin. Epidemiol. 1998, 51, 903–912. [Google Scholar] [CrossRef] [PubMed]
- Ware, J.; Kosinski, M.; Keller, S.D. A 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity. Med. Care 1996, 34, 220–233. Available online: https://www.ncbi.nlm.nih.gov/pubmed/8628042 (accessed on 19 November 2023).
- Sanders, J.O.; Harrast, J.J.; Kuklo, T.R.; Polly, D.W.; Bridwell, K.H.; Diab, M.; Dormans, J.P.; Drummond, D.S.; Emans, J.B.; Johnston, C.E.; et al. The Spinal Appearance Questionnaire: Results of Reliability, Validity, and Responsiveness Testing in Patients with Idiopathic Scoliosis. Spine 2007, 32, 2719–2722. Available online: https://journals.lww.com/spinejournal/Abstract/2007/11150/The_Spinal_Appearance_Questionnaire__Results_of.15.aspx#:~:text=This%20study%20tested%20the%20instrument (accessed on 2 May 2021). [CrossRef]
- Antonarakos, P.D.; Katranitsa, L.; Angelis, L.; Paganas, A.; Koen, E.M.; Christodoulou, E.A.; Christodoulou, A.G. Reliability and validity of the adapted Greek version of scoliosis research society—22 (SRS-22) questionnaire. Scoliosis 2009, 4, 14. [Google Scholar] [CrossRef]
- Yapar, A.; Yapar, D.; Ergisi, Y.; Kaptan, A.Y.; Tokgoz, M.A.; Senkoylu, A. Reliability and validity of the adapted Turkish version of the Spinal Appearance Questionnaire. Spine Deform. 2020, 9, 57–66. [Google Scholar] [CrossRef]
- Pappa, E.; Kontodimopoulos, N.; Niakas, D. Validating and norming of the Greek SF-36 Health Survey. Qual. Life Res. 2005, 14, 1433–1438. [Google Scholar] [CrossRef]
- Carreon, L.Y.; Sanders, J.O.; Polly, D.W.; Sucato, D.J.; Parent, S.; Roy-Beaudry, M.; Hopkins, J.; McClung, A.; Bratcher, K.R.; Diamond, B.E. Spinal Appearance Questionnaire. Spine 2011, 36, E1240–E1244. [Google Scholar] [CrossRef] [PubMed]
- Roy-Beaudry, M.; Beauséjour, M.; Joncas, J.; Forcier, M.; Bekhiche, S.; Labelle, H.; Grimard, G.; Parent, S. Validation and Clinical Relevance of a French-Canadian Version of the Spinal Appearance Questionnaire in Adolescent Patients. Spine 2011, 36, 746–751. [Google Scholar] [CrossRef] [PubMed]
- Wei, X.; Zhu, X.; Bai, Y.; Wu, D.; Chen, J.; Wang, C.; Chen, Z.; Yang, C.; Li, J.; Li, M. Development of the Simplified Chinese Version of the Spinal Appearance Questionnaire. Spine 2012, 37, 1497–1504. [Google Scholar] [CrossRef] [PubMed]
- Guo, J.; Lau, A.H.Y.; Chau, J.; Ng, B.K.W.; Lee, K.M.; Qiu, Y.; Cheng, J.C.Y. A validation study on the traditional Chinese version of Spinal Appearance Questionnaire for adolescent idiopathic scoliosis. Eur. Spine J. 2016, 25, 3186–3193. Available online: https://pubmed.ncbi.nlm.nih.gov/27167743/ (accessed on 1 November 2023). [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).