Next Article in Journal
Strengths and Weaknesses of the Pharmacovigilance Systems in Three Arab Countries: A Mixed-Methods Study Using the WHO Pharmacovigilance Indicators
Previous Article in Journal
Public Perception of Pharmacists in Poland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The 17-Item Computer Vision Symptom Scale Questionnaire (CVSS17): Translation, Validation and Reliability of the Italian Version

by
Gemma Caterina Maria Rossi
1,*,
Federica Bettio
1,
Mariano González-Pérez
2,
Aba Briola
1,
Gemma Ludovica Maria Pasinetti
3 and
Luigia Scudeller
4
1
Surgical Sciences Department, UOC Oculistica, University Eye Clinic, Fondazione IRCCS Policlinico S. Matteo, 27100 Pavia, Italy
2
Faculty of Optics and Optometry, Universidad Complutense de Madrid, 28001 Madrid, Spain
3
Liceo Ugo Foscolo, 27100 Pavia, Italy
4
Research and Innovation Unit, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40121 Bologna, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(5), 2517; https://doi.org/10.3390/ijerph19052517
Submission received: 23 November 2021 / Revised: 16 February 2022 / Accepted: 17 February 2022 / Published: 22 February 2022
(This article belongs to the Section Digital Health)

Abstract

:
Background. To validate the 17-item Computer Vision Symptom Scale questionnaire (CVSS17) in Italian. Methods. Cross-sectional validation study on video terminal (VDT) users and a reference sample of subjects not working at a VDT (control group), cognitively able to respond to a health status interview. The Italian self-administered version of the CVSS17 questionnaire was administered to all participants. The reliability and validity of the Italian translation of the CVSS17 were tested using standard statistical methods for questionnaire validation. The Rasch analysis was performed as well. Results. A total of 216 subjects were enrolled. Concerning the reliability, the Cronbach’s alpha coefficient was 0.925 (from 0.917 to 0.924), and the test–retest stability was 0.91 (<0.001). Concerning the validity, the control group had significantly better scores, and there were good correlations between responses to the CVSS17 and analogous domains of the GSS. Conclusion. The Italian version of the CVSS17 has shown psychometric properties comparable to those of the Spanish version, having good validity, discriminatory power, internal consistency and reliability. The questionnaire is a specific measure of vision-related quality of life in Italian-speaking VDT workers and can be used both in clinical practice and for research purposes.

1. Introduction

Video display terminal (VDT) users often report computer-related visual and ocular symptoms, which are the most common health problems among these subjects.
Given the high prevalence of these concerns in VDT workers [1,2,3], the Italian law has introduced an eye examination to assess ocular status in VDT workers (Legislative Decree 81/08 ex legge 626/96).
Studies to estimate the prevalence of computer-related visual and ocular symptoms were based on specific questionnaires designed by some authors [4,5].
Recently, a Spanish group developed and validated the Computer Vision Symptom Scale (CVSS17) questionnaire to assess visual and ocular symptoms in VDT workers: it includes 17 items and has been designed and validated for the Spanish language and culture. The Spanish version measures are valid and reliable, and what it measures correlates with some clinical outcome [6,7,8].
Before using a questionnaire that has been validated in a particular language, it is necessary to follow some validation procedures: the questionnaire must be adequately translated into another language and the translated questionnaire must be revalidated to prove that it is equivalent to the original [9]. In fact, the translation of a questionnaire into another language can compromise its validity [10,11] if the questions and response categories do not have the same meaning for patients and for researchers [12], and also if the original version and the translated one do not match. Consequently, the psychometric properties of the questionnaire must be re-established within the new cultural and linguistic context to achieve a correct transcultural adaptation [13,14].
The aim of the present study was to validate the Italian version of the 17-item Computer Vision Symptom Scale questionnaire, to make a tool available for assessing the symptoms of ocular strain from the patient’s point of view and to be used for all subjects with ocular symptoms due to prolonged stays at a VDT.

2. Materials and Methods

The present study was a single-center, observational, cross-sectional validation study. It was carried out at the University Eye Clinic of Pavia according to the Declaration of Helsinki with the approval of the Ethics Committee of the Fondazione IRCCS Policlinico San Matteo, Pavia (Proc. N. 20140038305). All subjects gave written informed consent before enrollment.
The CVSS17 is the final version of the pilot version of 77 items (CVSS77). The questionnaire contains 17 items with different rating scales. Two items have two response categories, eleven items have three response categories and four items have four response categories. The questionnaire gives information about 15 different symptoms, considering a symptom’s severity and frequency, and the subject’s opinion. The high internal consistency (Cronbach’s α = 0.92) of the Spanish version makes it useful for comparison between groups and for clinical application, for both genders and both for presbyopes and for non-presbyopes.
The steps for getting the Italian adaptation process were: translation into Italian, assessment of item comprehension, backtranslation into English, development of a consensual version, and formal assessment of its validity and reliability [15]. Two bilingual translators (GLP and GCR) translated the questionnaire into Italian (GCMR and GMP), rating difficulty from 0 (lowest) to 100 (highest). A conceptual rather than literal equivalence was aimed at and discrepancies were reconciled. Another translator (LS) rated the reconciled forward translation for conceptual equivalence to the Spanish version (scale 1–100). The translated questionnaire was read to 10 Italian subjects to verify the clarity, unambiguity and completeness of each item. A bilingual Spanish-speaking translator (Isabel Mazzucchelli) translated back the questionnaire into English and then rated the equivalence to the original Spanish version (1–100). The Italian version was then discussed by a panel of experts to obtain content correspondence. We consulted the method for crosscultural equivalence in psychiatric research described by Ware for the IQOLA project in 1998 [16] and McAlinden in 2011 [17]. A pretest was performed on a sample composed of 35 subjects to analyze, review and correct issues related to the translation [14,18,19]: no question required to be corrected or revised.
Eligibility criteria were: age 18 years or older, no ocular surgery in the preceding 6 months, signed written consent, VDT workers as defined by the Italian law (>20 h a week on a PC); in the control group, subjects were not VDT workers.
The employees of the San Matteo Foundation who operate as VDT workers and who carried out an eye examination for occupational medicine, were invited to participate in the study for the VDT group; patients who underwent an outpatient eye examination and who were not VDT workers were invited to participate in the study for the control group.
For each subject, all the following variables were collected: age and gender, best corrected near and distance visual acuity (VA) and current refractive correction, years since working at a VDT, number of effective hours at a VDT per day, number of breaks per day and time spent on breaks, tear film break-up time (tf-BUT), corneal staining and Glaucoma Symptom Scale (GSS) questionnaire.
All the subjects self-completed the questionnaire with paper and pencil prior to the visit with the ophthalmologist to avoid interference with visit results (communication of bad/good news). To assess repeatability, a subset of 20 subjects was asked to self-complete the questionnaire twice: one on the appointed day of the visit and one 5–7 days later.
In order to provide data for the planned tests of correlational validity, the Italian version of the Glaucoma Symptom Scale (GSS) was administered in addition to the CVSS17. The GSS was chosen because it had been adequately translated and validated in Italian in 2013 [20]. The GSS is a vision-targeted instrument designed to measure the impact of ocular surface disease on vision-related quality of life in glaucoma patients. The questionnaire includes 10 ocular complaints, some of nonvisual nature (burning/smarting/stinging, tearing, dryness, itching, soreness/tiredness, feeling of something in the eye: “GSS Symptom score”) and some of visual nature (blurry/dim vision, hard to see in daylight, hard to see in dark places, halos around lights: “GSS Function score”), common among patients treated for glaucoma. For each eye, the questionnaire provides a score ranging from 0 to 100, with 0 representing the presence of a very bothersome problem and 100 representing the absence of a problem. The final GSS score is an unweighted average of the responses to all 10 items; the GSS subscale symptom score (Symp-6) is an unweighted average of all items that comprise the particular subscale.
Visual acuity was recorded in decimal notation unit, it was evaluated with the patients’ current lens correction (distance and near).
Slit lamp examination of the anterior and posterior segment was performed with particular attention to the ocular surface status evaluated with the tear film break-up time (tf-BUT) and corneal staining.
To measure the tf-BUT, a fluorescein-impregnated strip was placed in the inferior fornix and the patient was asked to blink several times; the average value of three measurements was calculated. tf-BUT values greater than or equal to 10 s were coded as normal and tf-BUT values less than 10 s as abnormal.
The presence of corneal staining was defined as more than one dot of fluorescein staining over the corneal surface.

3. Statistical Issues

3.1. Sample Size and Power Calculation

In the hypothesis of a target Cronbach’s alpha of 0.9 (as in the original Spanish version), a sample size of 150 subjects (120 VDT workers and 30 controls) allowed 95% confidence intervals between 0.88 and 0.92. This sample size also allowed the testing of Cronbach’s alpha within the following categories: gender, presbyopia (yes/no), VDT worker vs. control (for testing, in a 17-item questionnaire, a Cronbach’s alpha of 0.9 against 0.8 with a 90% power and alpha error of 5%, 50 subjects are required).

3.2. Statistical Analysis

Descriptive statistics were produced for the demographic, clinical and laboratory characteristics of cases. The groups were compared with parametric or nonparametric tests, according to the data distribution, for continuous variables, and with Pearson’s chi-squared test (Fisher’s exact test where appropriate) for categorical variables. Correlation between continuous variables was assessed by means of Pearson’s or Spearman’s coefficients, according to the data distribution. The Shapiro–Wilk’s test was used to test the normal distribution of quantitative variables. In all cases, 2-tailed tests were used. The p-value significance cutoff was 0.05.
The following analyses were performed:
  • Scoring of the questionnaires according to the Spanish version rules (1–4).
  • Evaluation of the completeness at the item, dimension and scale level.
  • Calculation of the descriptive statistics at the dimension and scale level (mean and 95% CI, percentage of ceiling and floor) and at the group level.
  • Reliability (Cronbach’s alpha) for internal consistency (primary objective).
  • Multitrait/multi-item correlation matrix to assess:
    • The item’s internal consistency (item-scale correlation, corrected for overlap).
    • The equality of item-scale correlations.
    • The item’s discriminant validity (item-scale correlation vs. correlation with other scales and indicators: visual acuity, break-up time, corneal staining, GSS questionnaire).
  • Test–retest correlation for temporal stability (questionnaires completed twice 5–7 days apart): Pearson’s correlation coefficient and intraclass correlation coefficient.
  • Factor analysis.
  • Comparisons between subjects and controls of the 2 dimensions of the scale, for each eye, by means of the Mann–Whitney test, to verify discriminative property.
  • External validity: Association of CVSS17 with:
    • The GSS questionnaire (Pearsons’s correlation coefficient)
    • The number of years since working at a VDT, number of effective hours at a VDT per day, number of breaks (hours) per day, visual acuity (VA), tear film break-up time (tf-BUT), corneal staining (linear regression models).
A principal component analysis (PCA) was applied to confirm dimensionality.
An item response theory analysis was applied to assess the properties of the translated CVSS. Partial credit models (PCM) were employed [21].
For individual items the following analyses were made:
  • Boundary characteristic curves (BCC) to determine the estimated category difficulties (the point at which a person with ability equal to a given difficulty has a 50% chance of responding in a category equal to or higher than the difficulty designates).
  • Category characteristic curves (CCC) (probabilities of respondents choosing exactly category k; the points where the adjacent categories cross-represent transitions from one category to the next). To assess model fit, the empirical response proportions were plotted against the predicted latent trait (difficulty).
  • To indicate the amount of information an item provides for estimating the latent trait, we plotted individual item information functions (IIF).
For the entire scale the following analyses were made:
  • The test characteristic curve (TCC) (plot of the expected score against the latent trait) was calculated; the expected score at the theta value of ±1.96 was calculated.
  • Moreover, we plotted the summated score versus the predicted score, to assess fit.
  • Finally, we obtained a test information function (TIF) plot (test and its standard error), to indicate how well the instrument can estimate person locations.
Stata computer software version 14.0 (Stata Corporation, 4905 Lakeway Drive, College Station, TX 77845, USA) was used for the statistical analysis.

4. Results

4.1. Clinical Data

We enrolled 216 subjects: 128 VDT workers (41 men and 87 women) and 88 controls (38 men and 50 women) (Table 1). The mean age of the whole group was 42.7 ± 15.3 years. One patient signed informed consent and underwent all ophthalmic examinations but did not complete the CVSS17 questionnaire. The two groups were similar apart from the age (p = 0.002), the time spent at video terminals (p = 0.0001), the years since working at a VDT (p = 0.0001), the number of breaks and time spent on a VDT per day (all p < 0.001).
Regarding clinical data (Table 1), there was a statistically significant difference in tf-BUT (p = 0.002) and in corneal staining in both eyes between VDT workers and controls (p = 0.001 for right eye and 0.003 for left eye). Conversely, no difference between groups was found for the following parameters: best corrected visual acuity, intraocular pressure, retinal diseases and use of lacrimal substitutes. GSS questionnaire was statistically different between groups with significant better scores for controls (p < 0.0001).
The 17 CVSS items were completely answered by all subjects. The floor and ceiling effect for the questionnaire were within the predefined quality ranges.

4.2. Reliability

The overall Cronbach’s alpha was extremely high (0.925) and was always lower (from 0.917 to 0.924) (see Table 2) if individual items were removed. Items were well correlated with the entire test (item-test correlation) (Table 2); in addition, item-retest correlations were lower than item-test correlation, and not exceedingly higher than average interitem correlation (Table 2).
The CVSS17 test–retest reliability for temporal stability was high (0.91, p < 0.001) (Figure 1).

4.3. Validity

The control group of participants had better scores across all CVSS17 items (Table 3).
Association between CVSS17 and patients’ characteristics (Table 4) was found for age, gender, years worked at a VDT, years since starting using a VDT, time spent on breaks, BCVA, tf-BUT, corneal staining, use of lacrimal substitutes, presbyopia and GSS (both symptoms and function). Of note, the effect size of the association between the CVSS17 score with the GSS symptom scale (−0.287, p < 0.001) was higher than with the GSS function scale (−0.197, p < 0.001). The correlation coefficients between individual CVSS17 items and GSS symptom scale ranged from 0.38 to 0.78 (all p < 0.001) (data not shown).

4.4. Principal Component Analysis (PCA)

PCA analysis confirmed two main components factor 1 including CVSS2-3-4-5-6-7-10-11-12-13-14-16 and factor 2 including CVSS1-8-9-15-17; in the Spanish version, item 11 was in factor 2; the item contribution to the first component was similar (Figure 2a,b).

4.5. Rasch Analysis

4.5.1. Analyses for Individual Items (BCC, CCC, IIF)

The boundary characteristic curves (BCC) plots confirmed that categories within items were correctly ordered in terms of “difficulty” for all items (Figure 3).
Regarding the category characteristic curves (CCC), the probability of choosing each increasing category was also higher for higher “difficulty” (Figure 4) for all items; there was good fit to the model for most items and response categories.
The item information function (IIF) was low for items 9-11-12-14 (Figure 5).

4.5.2. Analyses for the Entire Scale (TCC, TIF)

A plot of the expected score against the latent trait revealed that patients with scores <17.9 and >43.6 represented less than 5% of the estimated distribution (Figure 6).
The graphical assessment of model fit to the observed summated score appeared satisfactory (Figure 7).
The CVSS can estimate with good precision the latent trait for most values; as expected, the precision was lower for subjects scoring very low or very high, as indicated by the test information plot with its standard errors (Figure 8).
A comparison of the Italian and Spanish versions outlined that some items showed a different ability to capture symptoms (Table 5).

5. Discussion

The perception of visual functioning by video terminal workers in relation to their health-related quality of life should be incorporated into ophthalmological clinical care. The recent COVID-19 pandemic has increased the number of subjects who spend many hours at a terminal and consequently the number of people around the world who complain of disturbances related to prolonged use of video terminals has increased.
The use of validated and reliable questionnaires is mandatory to evaluate the quality of life of these subjects; moreover, it represents a useful tool to follow VDT workers’ discomfort over time.
The CVSS17 is a questionnaire specifically designed to assess the quality of life of VDT workers.
Our study has shown that the Italian version of CVSS17 has psychometric properties comparable to those of the Spanish version; therefore, it represents a specific tool for measuring the quality of life in Italian subjects working at a VDT.
The results of our study suggest that the questionnaire has good validity, discriminatory power, internal consistency and reliability. Regarding the reliability, the high Cronbach’s alpha coefficients and the factor analysis indicate that the CVSS17 items are interdependent and homogeneous in terms of the concepts they measure. The original Spanish questionnaire showed comparable reliability (Cronbach’s alpha of 0.92) [6]. As indicated by the item-scale correlation analysis, all items appear to contribute to the quality of the scale.
The high temporal stability of the CVSS17 was demonstrated by the strength of the test–retest reliability and of the intraclass correlations: these are critical characteristics for a questionnaire to be used in long follow-up studies [16].
Concerning the external validity, a good correlation between the responses to the CVSS17 and analogous domains of the GSS was demonstrated, even if the two questionnaires are capturing different dimensions of health, as suggested by the finding that about half of the CVSS17 items showed a correlation coefficient lower than 0.5 with GSS.
Regarding the scores, the mean score of the questionnaire was similar for the Italian and the Spanish version, respectively, 31.3 ± 7.3 and 30.8 ± 7.5 [6]. The control group had better scores confirming a good discriminatory power between VDT workers and controls for the translated version.
The principal component analysis indicated two main factors (like in the Spanish version) that might be summarized as factor 1, dry eye symptoms and signs, and factor 2, visual impairment and photophobia. We noted that item 11, which belonged to factor 2 in the Spanish version, belonged to factor 1 in the Italian version: this item investigates photophobia and is similar to item 17, which belonged to factor 2; photophobia is also a symptom of dry eye.
The Rasch analysis of the Italian CVSS had a good fit to the data; it is therefore reliable in its conclusions, indicating a fair performance of the response categories within items. Regarding the entire scale, values <18 probably indicated the absence of ocular problems and values >44 might deserve a more careful ophthalmological evaluation of the ocular surface conditions. The Italian CVSS17 can be considered precise in its assessment of ocular surface symptoms of discomfort. The low information provided by some items indicated that some items might be redundant in the Italian version: item 9 was also covered by item 8, item 11 by item 17, item 12 by item 6, and item 14 by item 4.

6. Conclusions

In conclusion, the results of the CVSS17 validation process in Italian support the validity and reliability of the questionnaire and the overall score represents a good measure of the symptoms of the patients working at a VDT. The test can be applied to measure the vision-related quality of life in VDT users in an Italian setting both for clinical and for research purposes. It is likely that a new, shorter version might be built for the Italian setting; however, this would impair the crosscultural comparison.
Patients’ well-being has become crucial in all the most recent studies regarding ocular diseases. The prolonged use of a VDT can cause and/or induce the onset of visual, ocular and even systemic disorders that can impact the patients’ quality of life: the validated Italian version of the CVSS17 will facilitate the clinicians’ work in detecting the impact of visual concerns in these subsets of subjects.

Author Contributions

Conceptualization, G.C.M.R.; methodology, G.C.M.R. and L.S.; software, L.S.; validation, G.C.M.R., F.B., G.L.M.P. and L.S.; formal analysis, L.S.; investigation, G.C.M.R., F.B. and A.B.; data curation, G.C.M.R. and L.S.; writing—original draft preparation, G.C.M.R.; writing—review and editing, G.C.M.R., F.B. and M.G.-P.; supervision, G.C.M.R.; project administration, G.C.M.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the Fondazione IRCCS Policlinico San Matteo, Pavia (protocol code 20140038305, date of approval: 10 February 2015).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available from Authors.

Acknowledgments

We thank Carmine Tinelli (past chief of the Biometric and Epidemiology Unit, Scientific Direction, Fondazione IRCCS Policlinico San Matteo, Pavia) for his advice in answering the reviewers’ questions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ostrovsky, A.; Ribak, J.; Pereg, A.; Gaton, D. Effects of job-related stress and burnout on asthenopia among high-tech workers. Ergonomics 2012, 55, 854–862. [Google Scholar] [CrossRef] [PubMed]
  2. Portello, J.K.; Rosenfield, M.; Bababekova, Y.; Estrada, J.M.; Leon, A. Computer-related visual symptoms in office workers. Ophthalmic Physiol. Opt. 2012, 32, 375–382. [Google Scholar] [CrossRef] [PubMed]
  3. Sa, E.C.; Ferreira, M., Jr.; Rocha, L.E. Risk factors for computer visual syndrome (CVS) among operators of two call centers in Sao Paulo, Brazil. Work 2012, 41, 3568–3574. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Taino, G.; Ferrari, M.; Metad, I.; Fabris, E.; Imbriani, M. Astenopia e lavoro al VDT: Studio di una popolazione di 191 lavoratori esposti al rischio mediante somministrazione di questionario anamnestico mirato a valutazione oftalmologica. Giornale Italiano di Medicina del Lavoro ed Ergonomia 2006, 28, 487–497. [Google Scholar] [PubMed]
  5. Hayes, J.R.; Sheedy, J.E.; Stelmack, J.A.; Heaney, C.A. Computer Use, Symptoms, and Quality of Life. Optom. Vis. Sci. 2007, 84, 738–744. [Google Scholar] [CrossRef] [PubMed]
  6. González-Pérez, M.; Susi, R.; Antona, B.; Barrio, A.; González, E. The Computer-Vision Symptom Scale (CVSS17): Development and Initial Validation. Investig. Opthalmol. Vis. Sci. 2014, 55, 4504–4511. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Rossi, G.C.M.; Scudeller, L.; Bettio, F.; Pasinetti, G.M.; Bianchi, P.E. Prevalence of dry eye in video display terminal users: A cross-sectional Caucasian study in Italy. Int. Ophthalmol. 2018, 39, 1315–1322. [Google Scholar] [CrossRef] [PubMed]
  8. González-Pérez, M.; Susi, R.; Barrio, A.; Antona, B. Five levels of performance and two subscales identified in the computer-vision symptom scale (CVSS17) by Rasch, factor, and discriminant analysis. PLoS ONE 2018, 13, e0202173. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Patrick, D.L.; Wild, D.J.; Johnson, E.S.; Wagner, T.H.; Martin, M.A. Cross cultural validation of quality of life measures. In Quality of Life Assessment Berlin; Orley, A., Kuykev, W., Eds.; Springer: Berlin/Heidelberg, Germany, 1995; pp. 19–32. [Google Scholar]
  10. Gandek, B.; Ware, J.E. Methods for Validating and Norming Translations of Health Status Questionnaires: The IQOLA Project Approach. J. Clin. Epidemiol. 1998, 51, 953–959. [Google Scholar] [CrossRef]
  11. Hays, R.D.; Hadorn, D. Responsiveness to change: An aspect of validity, not a separate dimension. Qual. Life Res. 1992, 1, 73–75. [Google Scholar] [CrossRef] [PubMed]
  12. Grønvold, M.; Klee, M.C.; Sprangers, M.A.; Aaronson, N.K. Validation of the EORTC QLQ-C30 quality of life questionnaire through combined qualitative and quantitative assessment of patient-observer agreement. J. Clin. Epidemiol. 1997, 50, 441–450. [Google Scholar] [CrossRef] [Green Version]
  13. Guillemin, F.; Bombardier, C.; Beaton, D. Cross-cultural adaptation of health related quality of life instruments: Literature review and proposed guidelines. J. Clin. Epidemiol. 1994, 46, 1417–1432. [Google Scholar] [CrossRef]
  14. Pesudovs, K.; Burr, J.M.; Harley, C.; Elliott, D.B. The development, assessment, and selection of questionnaires. Optom. Vis. Sci. 2007, 84, 663–674. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Hunt, S.M.; Alonso, J.; Bucquet, D.; Niero, M.; Wiklund, I.; McKenna, S. Cross-cultural adaptation of health measures. Health Policy 1991, 19, 33–44. [Google Scholar] [CrossRef]
  16. Ware, J.E.; Gandek, B. Methods for testing data quality, scaling assumption, and reliability: The IQOLA project approach. International Quality of Life Assessment. J. Clin. Epidemiol. 1998, 51, 945–952. [Google Scholar] [CrossRef]
  17. McAlinden, C.; Khadka, J.; Pesudovs, K. Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology. Ophthalmic Physiol. Opt. 2011, 31, 330–338. [Google Scholar] [CrossRef] [PubMed]
  18. Downing, S.M. Twelve steps for effective test development. In Handbook of Test Development; Downing, S.M., Haladyna, T.M., Eds.; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2006; pp. 3–25. [Google Scholar]
  19. Haladyna, T.M. Role and importance of validity studies in test development. In Handbook of Test Development; Downing, S.M., Haladyna, T.M., Eds.; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2006; pp. 739–757. [Google Scholar]
  20. Rossi, G.C.M.; Pasinetti, G.M.; Scudeller, L.; Milano, G.; Mazzone, A.; Raimondi, M.; Bordin, M.; Lanteri, S.; Bianchi, P.E. The Italian version of the Glaucoma Symptom Scale questionnaire: Translation, Validation and Reliability. J. Glaucoma 2013, 22, 44–51. [Google Scholar] [CrossRef] [PubMed]
  21. Bradley, C.; Massof, R.W. Validating Translations of Rating Scale Questionnaires Using Rasch Analysis. Ophthalmic Epidemiol. 2017, 24, 1–2. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Reliability: test–retest for temporal stability of CVSS17 in a random subset of 20 subjects.
Figure 1. Reliability: test–retest for temporal stability of CVSS17 in a random subset of 20 subjects.
Ijerph 19 02517 g001
Figure 2. Principal components analysis of the Italian CVSS: scree plot and loadings plot (rotated varimax). (a) Explanation: this is a useful way to decide how many dimensions are represented by the data; it plots the dimensions as the X-axis and the corresponding eigenvalues (variance) as the Y-axis (the dimension with the largest eigenvalue has the most variance, dimensions with smaller or negative eigenvalues are negligible; traditionally, only eigenvalues >1 are considered relevant). Across subsequent dimensions, eigenvalues decline; the number of dimensions necessary to explain the data is indicated by the number of dimensions before the “elbow” (the point where the slope of the curve flattens out). Comment: in our questionnaire, the computer vision scale is well represented by a single dimension. (b) Explanation: it shows the loadings (correlations of the items with the dimension) for the two dimensions with highest variance in each area of awareness. Comment: most items are similarly correlated to the first dimension, and unevenly correlated with the second dimension retained in the analysis; these plots, besides confirming the findings from the multitrait/multi-item analysis, support the correct dimensionality of the questionnaire.
Figure 2. Principal components analysis of the Italian CVSS: scree plot and loadings plot (rotated varimax). (a) Explanation: this is a useful way to decide how many dimensions are represented by the data; it plots the dimensions as the X-axis and the corresponding eigenvalues (variance) as the Y-axis (the dimension with the largest eigenvalue has the most variance, dimensions with smaller or negative eigenvalues are negligible; traditionally, only eigenvalues >1 are considered relevant). Across subsequent dimensions, eigenvalues decline; the number of dimensions necessary to explain the data is indicated by the number of dimensions before the “elbow” (the point where the slope of the curve flattens out). Comment: in our questionnaire, the computer vision scale is well represented by a single dimension. (b) Explanation: it shows the loadings (correlations of the items with the dimension) for the two dimensions with highest variance in each area of awareness. Comment: most items are similarly correlated to the first dimension, and unevenly correlated with the second dimension retained in the analysis; these plots, besides confirming the findings from the multitrait/multi-item analysis, support the correct dimensionality of the questionnaire.
Ijerph 19 02517 g002aIjerph 19 02517 g002b
Figure 3. Boundary characteristic curves (BCC) from the graded response model (IRT analysis) of the Italian version of CVSS.
Figure 3. Boundary characteristic curves (BCC) from the graded response model (IRT analysis) of the Italian version of CVSS.
Ijerph 19 02517 g003
Figure 4. Category characteristic curves (CCC) and empirical proportions for each of the 17 CVSS items from the graded response model (IRT analysis) of the Italian version of the CVSS17.
Figure 4. Category characteristic curves (CCC) and empirical proportions for each of the 17 CVSS items from the graded response model (IRT analysis) of the Italian version of the CVSS17.
Ijerph 19 02517 g004
Figure 5. Item information function (IIF) proportions for each of the 17 CVSS items from the graded response model (IRT analysis) of the Italian version of CVSS.
Figure 5. Item information function (IIF) proportions for each of the 17 CVSS items from the graded response model (IRT analysis) of the Italian version of CVSS.
Ijerph 19 02517 g005
Figure 6. Test characteristic curve (TCC) from the partial credit model (IRT analysis) of the Italian version of CVSS.
Figure 6. Test characteristic curve (TCC) from the partial credit model (IRT analysis) of the Italian version of CVSS.
Ijerph 19 02517 g006
Figure 7. Test characteristic curve (TCC): CVSS summated score vs. predicted score from the graded response model (IRT analysis) of the Italian version of the CVSS.
Figure 7. Test characteristic curve (TCC): CVSS summated score vs. predicted score from the graded response model (IRT analysis) of the Italian version of the CVSS.
Ijerph 19 02517 g007
Figure 8. Test information function (TIF) from the graded response model (IRT analysis) of the Italian version of the CVSS.
Figure 8. Test information function (TIF) from the graded response model (IRT analysis) of the Italian version of the CVSS.
Ijerph 19 02517 g008
Table 1. Patients’ sociodemographic and clinical characteristics (VDT = video terminal workers; BCVA = best corrected visual acuity; IOP = intraocular pressure; tf-BUT = tear film break-up time; R = right eye; L = left eye; GSS = Glaucoma Symptom Scale; Y = yes; ys = years; h = hours; N = number; bold font: statistically significant p-value).
Table 1. Patients’ sociodemographic and clinical characteristics (VDT = video terminal workers; BCVA = best corrected visual acuity; IOP = intraocular pressure; tf-BUT = tear film break-up time; R = right eye; L = left eye; GSS = Glaucoma Symptom Scale; Y = yes; ys = years; h = hours; N = number; bold font: statistically significant p-value).
Variable ControlsVDTp-Value
Number 88128
Women/men N50/38 87/41 0.114
Schooling level8 YearsN611
13 YearsN4157
>13 YearsN41600.631
IRCCS San Matteo Foundation employees N (%)43 (48.8)83 (64.9)0.025
Systemic comorbidities (Y)N (%)19 (21.6)33 (25.8)0.52
Presbyopia (Y) N (%)14 (46.7)48 (42.6)0.662
Age (ys)Median (IQR)32.4 (26.4–53.2)46.7 (34.3–53.7)0.002
Years since VDT users (ys)Median (IQR)0 (0–0)10 (5–20)0.0001
Hours spent at VDT/day (h)Median (IQR)2 (1–3)7.2 (6–8)0.0001
Breaks/day (N)Median (IQR)0 (0–1)2 (1–3)0.0001
Breaks/day (h)Median (IQR)00:00 (00:00–00.30)01:00 (00:45–01:00)0.0001
BCVA
(decimals)
Median (IQR)R10 (10–10)10 (10–10)0.39
L10 (10–10)10 (10–10)0.663
IOP
(mmHg)
Median (IQR)R14 (14–14)14 (14–15)0.064
L14 (14–15)14.5 (14–15)0.086
tf–BUT
(seconds)
Median (IQR)R10 (9–12)9 (7–10)0.0002
L10 (9–12)9 (7–10)0.0002
Corneal staining
(Y)
N (%)R2 (4.2)30 (25.9)0.001
L2 (4.2)27 (23.3)0.003
Retinal fundus
(diseases) (Y)
N (%)R1 (1.1)7 (7.9)0.161
L0 (0.0)5 (3.9)0.372
Lacrimal substitute use
(Y)
N (%)R8 (27.6)19 (17.9)0.295
L8 (27.6)19 (17.9)0.295
GSS totalMedian (IQR)95 (85–100)77.5 (67.5–85)0.0001
GSS symptomMedian (IQR)91.7 (79.2–100)75 (58.3–83.3)0.0001
GSS functionMedian (IQR)100 (100–100)87.5 (71.9–100)0.0001
Table 2. Reliability: item-scale correlations and Cronbach’s alpha of the Italian version of the CVSS17.
Table 2. Reliability: item-scale correlations and Cronbach’s alpha of the Italian version of the CVSS17.
ItemItem-Test CorrelationItem-Retest CorrelationAverage Interitem correlation (IC)Cronbach’s Alpha
A20.59230.53100.42660.9225
A40.73600.69180.41290.9184
A90.76690.72710.41000.9175
A170.75950.71860.41070.9177
A200.72450.67880.41400.9187
A210.73840.69450.41270.9183
A220.70020.65140.41630.9194
A280.62240.56440.42370.9217
A300.53900.47260.43170.9240
A320.77090.73160.40960.9173
A330.74080.69730.41240.9182
B70.63100.57380.42290.9214
B80.56920.50560.42880.9231
C160.67110.61870.41910.9203
C210.67140.61890.41910.9203
C230.58420.52210.42740.9227
C240.62500.56720.42350.9216
Whole scale 0.41890.9246
Table 3. Validity of the CVSS17 items: p-valuecomparison of the item scores between VDT workers and not (bold font: statistically significant).
Table 3. Validity of the CVSS17 items: p-valuecomparison of the item scores between VDT workers and not (bold font: statistically significant).
Item VDT Workers
Mean ± SD
No VDT Workers
Mean ± SD
p-Value
A21.71 ± 0.631.13 ± 0.340.0001
A42.16 ± 0.661.42 ± 0.560.0001
A92.03 ± 0.741.45 ± 0.620.0001
A172.50 ± 0.751.58 ± 0.670.0001
A202.09 ± 0.871.55 ± 0.770.002
A212.17 ± 0.751.74 ± 0.730.005
A221.73 ± 0.691.29 ± 0.530.001
A281.59 ± 0.711.13 ± 0.340.0006
A301.17 ± 0.381.03 ± 0.180.050
A322.21 ± 0.781.74 ± 0.820.005
A332.23 ± 0.671.48 ± 0.630.0001
B71.33 ± 0.471.03 ± 0.180.0008
B81.54 ± 0.641.32 ± 0.540.051
C161.82 ± 0.581.42 ± 0.500.0007
C211.69 ± 0.591.26 ± 0.580.0001
C231.64 ± 0.641.26 ± 0.440.002
C241.69 ± 0.641.26 ± 0.510.0004
CVSS tot31.30 ± 7.3723.10 ± 5.440.0001
Table 4. Validity of the CVSS17: association between CVSS17 score and patients’ characteristics (univariable linear regression models) (F = female; M = male; VDT = video terminal workers; N = number; h = hours; Δ = diopters; tf-BUT = tear film break-up time; IOP = intraocular pressure; GSS = Glaucoma Symptom Scale; (bold font: statistically significant p-Value).
Table 4. Validity of the CVSS17: association between CVSS17 score and patients’ characteristics (univariable linear regression models) (F = female; M = male; VDT = video terminal workers; N = number; h = hours; Δ = diopters; tf-BUT = tear film break-up time; IOP = intraocular pressure; GSS = Glaucoma Symptom Scale; (bold font: statistically significant p-Value).
VariableCategory/DescriptionRegression Coefficient95% Confidence Intervalsp-Value
Age 0.1120.012 to 0.2110.029
GenderF vs. M−4.033−6.51 to −1.560.001
Schooling level8–13 years vs. <80.199−4.07 to 4.470.927
>13 vs. <8 years1.339−2.93 to 5.600.538
Systemic comorbiditiesYes vs. No4.6431.71 to 7.570.002
IRCCS employeesNo vs. Yes1.148−1.63 to 3.930.418
Years since VDT users 0.2160.088 to 0.3440.001
Hours spent at VDT/day 1.3450.953 to 1.74<0.001
Breaks/day (N) 0.119−0.696 to 0.9360.773
Breaks/day (h) <0.0010 to 00.03
BCVA (decimals) −1.685−2.37 to −1.01<0.001
Optical correction (distance)Yes vs. No0.733−1.77 to 3.240.567
Optical correction (near)Yes vs. No2.135−0.43 to 4.710.104
PresbyopiaYes vs. No2.8890.33 to 5.450.027
Fusional Vergence (Δ)(near) −0.07−0.235 to 0.0960.411
Fusional Vergence (Δ) (distance) −0.116−0.289 to 0.0580.193
IOP (mmHg) 1.044−0.037 to 2.1250.058
tf–BUT (seconds) −1.238−1.614 to −0.863<0.001
Corneal staining (grade)Yes vs. No6.5983.73 to 9.465<0.001
Lacrimal substitute useYes vs. No7.6394.72 to 10.56<0.001
Retinal fundus (pathologies)Yes vs. No3.038−1.77 to 7.850.216
GSS total −0.374−0.42 to −0.329<0.001
GSS symptom −0.287−0.319 to −0.254<0.001
GSS function −0.197−0.254 to −0.14<0.001
Table 5. Comparison of Italian and Spanish version of the CVSS for all item measures.
Table 5. Comparison of Italian and Spanish version of the CVSS for all item measures.
Item Spanish VersionItalian Version
Measure ErrorMeasureError
A20.970.090.650.16
A4−1.490.08−1.340.14
A90.120.08−1.040.14
A17−0.920.08−0.980.13
A200.170.070.050.13
A21−0.710.08−0.290.13
A22−0.110.081.500.15
A281.390.090.330.15
A300.990.121.600.28
A320.270.08−0.500.13
A33−0.950.08−2.020.14
B7−0.340.10−0.160.20
B80.380.080.510.16
C16−0.440.08−0.040.15
C21−0.070.090.700.16
C23−0.090.080.650.16
C240.830.090.380.16
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rossi, G.C.M.; Bettio, F.; González-Pérez, M.; Briola, A.; Pasinetti, G.L.M.; Scudeller, L. The 17-Item Computer Vision Symptom Scale Questionnaire (CVSS17): Translation, Validation and Reliability of the Italian Version. Int. J. Environ. Res. Public Health 2022, 19, 2517. https://doi.org/10.3390/ijerph19052517

AMA Style

Rossi GCM, Bettio F, González-Pérez M, Briola A, Pasinetti GLM, Scudeller L. The 17-Item Computer Vision Symptom Scale Questionnaire (CVSS17): Translation, Validation and Reliability of the Italian Version. International Journal of Environmental Research and Public Health. 2022; 19(5):2517. https://doi.org/10.3390/ijerph19052517

Chicago/Turabian Style

Rossi, Gemma Caterina Maria, Federica Bettio, Mariano González-Pérez, Aba Briola, Gemma Ludovica Maria Pasinetti, and Luigia Scudeller. 2022. "The 17-Item Computer Vision Symptom Scale Questionnaire (CVSS17): Translation, Validation and Reliability of the Italian Version" International Journal of Environmental Research and Public Health 19, no. 5: 2517. https://doi.org/10.3390/ijerph19052517

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop