Next Article in Journal
How Do Nursing Students Perceive Care Towards the LGBTIQ+ Community? A Phenomenological Study on Sexual and Gender Diversity
Previous Article in Journal
Characteristics, Antecedents, and Consequences of Non-Nursing Tasks: A Scoping Review Protocol
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Group Environment Questionnaire (GEQ) in a Simulated Learning Environment

by
José Manuel García-Álvarez
1,*,
Alfonso García-Sánchez
2,
Alonso Molina-Rodríguez
3,
María Suárez-Cortés
3 and
José Luis Díaz-Agea
3
1
Health Sciences PhD Program, Catholic University of Murcia (UCAM), Campus de los Jerónimos nº 135, Guadalupe, 30107 Murcia, Spain
2
Faculty of Nursing, Catholic University of Murcia (UCAM), Campus de los Jerónimos nº 135, Guadalupe, 30107 Murcia, Spain
3
Faculty of Nursing, University of Murcia, Campus de Ciencias de la Salud, Edificio LAIB/DEPARTAMENTAL, El Palmar-Murcia, 30120 Murcia, Spain
*
Author to whom correspondence should be addressed.
Nurs. Rep. 2025, 15(5), 154; https://doi.org/10.3390/nursrep15050154
Submission received: 14 March 2025 / Revised: 26 April 2025 / Accepted: 29 April 2025 / Published: 30 April 2025

Abstract

:
Background/Objectives: The complexity of modern healthcare requires teamwork. Healthcare teams must be cohesive to ensure efficient and quality care. The objective of this study was to validate the Spanish short version of the Group Environment Questionnaire (GEQ) in undergraduate nursing students undergoing clinical simulation training. Methods: The psychometric properties of the questionnaire were analyzed. We began with a statistical analysis of the items. Internal consistency was assessed using McDonald’s omega coefficient. Test-retest reliability was determined using Spearman’s correlation coefficient. An exploratory factor analysis was performed using the principal components analysis method with varimax rotation. Finally, a confirmatory factor analysis of the proposed theoretical models was performed to select the most appropriate one using the weighted least squares method adjusted for mean and variance (WLSMV) and goodness-of-fit indices. Results: The questionnaire items showed a standard deviation higher than 1 and a negative skewness lower than 0.5. Internal consistency and test-retest reliability were higher than 0.8. The item-total correlation coefficient values were above 0.44. The exploratory factor analysis confirmed the presence of four factors, each with three items. Confirmatory factor analysis determined that the four-factor cohesion model was the one that obtained the best fit. Conclusions: The Spanish short version of the Group Environment Questionnaire (GEQ) is a valid and reliable instrument for analyzing group cohesion in teams of nursing students undergoing clinical simulation training.

1. Introduction

Teamwork among healthcare professionals improves patient safety, reduces stress, increases healthcare staff satisfaction, optimizes resources, improves planning, and reduces costs, increasing the efficiency and performance of healthcare. Wolking as a team allows each member’s individual strengths to be amplified, making it easier to achieve established goals. It is essential to learn how to work in a team by practicing effective communication, developing empathy, respecting others’ ideas, sharing responsibilities, and valuing each member’s contributions [1,2,3,4].
In addition to scientific and technical skills, the healthcare team must possess non-technical skills including communication, coordination, complementarity, trust, and commitment. These non-technical skills are essential for achieving team cohesion and ensuring success in a stressful work environment characterized by changes in technology, care complexity, excessive workload, exposure to patient suffering, and the constant fear of making mistakes [2,5,6].
Group cohesion can be defined as a dynamic process that keeps the team united in the achievement of common objectives and in the satisfaction of the affective needs of its members. Among the different conceptual models developed for the analysis of group cohesion, those that differentiate between task cohesion and social cohesion stand out. Task cohesion refers to the level of commitment and collaboration of team members to achieve the established objectives [7,8,9]. Social cohesion refers to the degree of interaction and camaraderie among team members, fostering personal relationships and satisfaction with the team’s work [7,8]. Both aspects can be approached from a group and individual perspective, giving rise to the four dimensions that make up group cohesion: the Group Integration-Task (GI-T) or degree of group union to achieve common objectives, Group Integration-Social (GI-S) or degree of group union to develop social relations within the group, Individual Attractions to Group-Task (ATG-T) or individual motivations towards common objectives, and Individual Attractions to Group-Social (ATG-S) or individual motivations towards social relations within the group [7,8,9,10,11].
The Group Environment Questionnaire (GEQ) allows the assessment of these four dimensions of group cohesion. The original questionnaire is composed of 18 items with a nine-choice Likert-type response [12,13]. Different adaptations and validations of the GEQ have been carried out for the Spanish language and context. Among them, the short versions consisting of 12 items that have been adapted and validated for professional athletes [14] and for working groups of Spanish university students of Sports Science and Pedagogy [15] stand out. Both versions presented acceptable values of internal consistency both globally and in their different dimensions and adequate values of the adjustment indexes to the four-dimensional model of group cohesion originally proposed [14,15].
Due to the importance of group cohesion in the quality of healthcare based on teamwork and the lack of validated instruments to analyze group cohesion in the Spanish healthcare field, it is necessary to validate the reduced Spanish version of the GEQ in teams of Spanish students and healthcare professionals. For the validation of this questionnaire, nursing students undergoing clinical simulation training were chosen because of the capacity of this learning tool to develop the nontechnical skills needed to improve group cohesion in teams of students and healthcare professionals [16,17].
The objective of this study was to validate the Spanish short version of the GEQ in undergraduate nursing students undergoing clinical simulation training.

2. Materials and Methods

2.1. Participants

A descriptive and cross-sectional study was carried out to validate the Spanish adaptation of the short version of the GEQ in students of the Nursing Degree of the Catholic University of Murcia (UCAM) and the University of Murcia (UMU), located in the region of Murcia, Spain. The inclusion criteria were to be a fourth-year student of the Nursing Degree who had completed all the clinical simulation sessions and who wished to participate voluntarily in the study. The sample was selected using non-probabilistic convenience sampling based on the groups assigned by the Nursing Practice Unit of each of the participating universities.

2.2. Procedure

To collect the information, a questionnaire including sociodemographic data and the short Spanish version of the GEQ was completed in the clinical simulation classrooms of the participating universities between October 2023 and July 2024.

2.3. Ethics Statement

The study was conducted taking into account the principles established by the Declaration of Helsinki and with the approval of the Ethics Committee of UCAM and the authorization of the UMU.
Students were informed in detail about the procedures and the nature of the study. It was indicated that participation was voluntary and that they could withdraw from the study at any time. No incentives or rewards were offered for participation and there were no sanctions for non-participation. Written informed consent was obtained from all participants. Confidentiality and anonymity were ensured by not recording any identifying information about the participating students.

2.4. Measuring Instrument

The instrument used to measure group cohesion was the Spanish short version of the GEQ validated for groups of Spanish university students of Sports Science and Pedagogy. This questionnaire was composed of 12 items with a five-choice Likert-type response format ranging from totally disagree (1) to totally agree (5). Items 1, 3, and 5 assessed the dimension ATG-S, items 2, 4, and 6 analyzed the dimension ATG-T, items 7, 9, and 11 assessed the dimension GI-S, and items 8, 10, and 12 analyzed the dimension GI-T [15].
The questionnaire items used in this study were rigorously adapted by the researchers to the academic context of Spanish nursing students to preserve content validity in the new context. Specifically, the following terms were substituted: team for group, work for preparation of the simulation sessions, work sessions for conduct of the simulation sessions, and project for clinical simulation (Table 1).

2.5. Variables

The sociodemographic variables used in this study were university, age, gender, region of origin, previous academic degree, and work activity. The main variables of this research were the items and dimensions of the questionnaire to assess group cohesion used in this research.

2.6. Data Analysis

The information obtained was analyzed using SPSSv26® and AMOS v25® statistical software for Windows (Armonk, NY, USA: IBM Corp.).
A descriptive statistical analysis of the sociodemographic variables was carried out by calculating the frequencies and percentages of the qualitative variables, as well as the mean, standard deviation, skewness, and kurtosis of the quantitative variables. An inferential statistical analysis of the sociodemographic variables was performed by applying different statistical tests according to the characteristics of the variables analyzed [18].
In order to evaluate the psychometric properties of the Spanish short version of the GEQ in undergraduate nursing students undergoing clinical simulation training, a statistical analysis of the items, reliability assessment, and evaluation of construct validity was carried out [19]. For the statistical analysis of the questionnaire items, the following statistical measures were calculated: frequency and percentage, mean, median, mode, standard deviation, skewness, kurtosis, and type of distribution [20]. The reliability of the questionnaire was assessed by means of internal consistency, homogeneity, and test-retest reliability [21,22,23,24]. To analyze the overall internal consistency of the questionnaire and its different dimensions, the McDonald’s omega coefficient was used [21,22]. Homogeneity was assessed by item-total and corrected item-total correlations using Spearman’s correlation coefficient [23]. The overall test-retest reliability of the questionnaire and its dimensions was assessed by repeating the questionnaire one week later with a sample of 30 students using Spearman’s correlation coefficient [24].
To analyze the construct validity of the questionnaire, an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were performed [25,26,27,28,29]. To assess the suitability of the data for EFA, Bartlett’s sphericity tests and the Kaiser–Meyer–Olkin (KMO) test were used. To extract the factors or dimensions of the questionnaire, a principal component analysis with orthogonal rotation was performed using the varimax method [25,27,28].
In the CFA, the first-order models present in the literature were tested: a one-factor model of global cohesion, a cohesion model with two factors representing attraction and integration, a cohesion model with two factors representing social and task aspects, and the cohesion model with four factors, ATG-S, ATG-T, GI-S, and GI-T [12,13,14,15]. The robust weighted least squares mean and variance adjusted (WLSMV) estimator and goodness-of-fit indices were used for the analysis of the fit of the proposed models: Chi-square/degrees of freedom (χ2/df), root mean square error of approximation (RMSEA), standardized root mean square residual (SRMR), comparative fit index (CFI), Tucker–Lewis index (TLI), normed fit index (NFI), parsimony ratio (PRATIO), parsimony normed fit index (PNFI), Parsimonic goodness of fit index (PGFI), and Akaike information criterion (AIC) [26,27,28,29].

3. Results

3.1. Sociodemographic Data

The study sample consisted of 311 students in the last year of the nursing degree; 188 students were from the UCAM and 123 students were from the UMU. The age of the students participating in this research had a mode of 21 years, a mean of 23.54, and a standard deviation of 5.318 and did not follow a normal distribution. The minimum age was 20 years and the maximum age was 54 years. Students aged between 21 and 22 years made up 63.65% of participants.
Of the students, 78.14% were women. Most of the students who participated in the study (71.06%) came from the Region of Murcia. Students with no previous degree represented 81.68% of participants. The most frequent previous degree was that of Auxiliary Nursing Care Technician (31.78%). Of the total number of students, 91.00% were not working at the same time as they were studying nursing.
Table 2 describes the inferential statistical analysis performed between the different sociodemographic variables of the study, indicating the statistical test used and the statistical significance obtained. Statistically significant differences were found for students’ age with respect to gender, previous degree, and work activity. Statistically significant differences were observed between the students’ region of origin with respect to the university where they were studying. Statistically significant differences were also observed with respect to the students’ work activity with respect to their previous degree.

3.2. Questionnaire Validation

The descriptive analysis of the scores of the responses to the questionnaire items showed a mean between 3.25 and 3.77; a median of 4 except for items 3, 5, and 12, for which the median was 3; and a mode of 4 except for items 3, 5, and 12, for which the mode was 3. The standard deviation was between 1.001 and 1.041, the skewness was between −0.223 and −0.499, and the kurtosis was between 0.004 and −0.499. The questionnaire items scores did not follow normal distribution as the means, medians, and modes were unequal (Table 3).
In the analysis of the internal consistency of the GEQ and its four dimensions, values above 0.8 were obtained (Table 4). The item-total and corrected item-total correlation coefficients for the questionnaire as a whole and for the four dimensions of group cohesion were greater than 0.44 (Table 5 and Table 6). The test-retest reliability showed correlation values between items and between the different dimensions of the questionnaire higher than 0.8 (Table 7 and Table 8).
The values obtained in the KMO test (0.820) and Bartlett’s sphericity tests (p = 0.000) indicated that a factor analysis can be performed on this questionnaire. The extraction by means of the principal component analysis method has allowed us to obtain a communality of the items with values higher than 0.6 (Table 9).
Considering the total variance explained, it can be deduced that the questionnaire was composed of four factors or dimensions that presented eigenvalues greater than 1, which individually explained more than 5% of the variance of the questionnaire and which together accounted for 74.484% of the variance (Table 10). The factor analysis performed by principal component analysis with varimax rotation identified that factor 1 consisted of items 2, 4, and 6, factor 2 included items 1, 3, and 5, factor 3 consisted of items 8, 10, and 12, and factor 4 included items 7, 9, and 11 (Table 11). Table 12 shows the values obtained in the goodness-of-fit indices of the four models of group cohesion tested by confirmatory factor analysis. The cohesion model with four factors is the one that presented the best goodness-of-fit indices (Table 13).

4. Discussion

The sample of 311 participants can be considered adequate to perform a rigorous psychometric analysis and adequately establish the validity of GEQ for nursing students undergoing clinical simulation training. The literature suggests that in order to perform a rigorous psychometric analysis and adequately establish the validity of a questionnaire, it is necessary to have a minimum sample of 10 participants per item or at least a total of 300 participants [30].
All the items of the questionnaire presented a standard deviation greater than 1, so that their variability can be considered sufficient to find the differences in group cohesion existing among the participating students. In the Likert-type scales with five response options, a standard deviation of the items between 1 and 1.5 can be considered sufficiently discriminative [31]. The questionnaire items presented negative skewness values of less than 0.5, so it could be deduced that the responses to the items were not biased towards either end of the scale. With values of asymmetry greater than ±1, the item is no longer adequate, and it is necessary to review the wording of the item or even to evaluate its elimination [32,33].
The results obtained by means of the McDonald’s omega test indicated that the questionnaire presented a good internal consistency by presenting values for the questionnaire as a whole and for the different dimensions greater than 0.8. These internal consistency results are superior to those obtained by the validation of this version in Spanish athletes [14] or in work groups of Spanish university students [15]. Both studies used Cronbach’s Alpha coefficient to assess internal consistency. The McDonald’s omega coefficient is more suitable than Cronbach’s alpha coefficient for analyzing the internal consistency of this questionnaire because it is an ordinal response scale with fewer than six options [21,22].
The item-total and corrected item-total correlations showed values greater than 0.44, indicating that the items of the questionnaire analyzed had a good level of homogeneity among them [23,34]. Homogeneity was assessed by the item-total and corrected item-total correlation using Spearman’s correlation coefficient, since these were ordinal qualitative variables [23].
The test-retest reliability showed correlation values between the items and between the dimensions of the questionnaire above 0.8, so that it can be considered that there is excellent agreement between the two completions carried out by the same participating subjects [35]. Spearman’s correlation test was chosen instead of the intraclass correlation coefficient because these are ordinal qualitative variables that do not meet the assumptions of randomness and normality [36].
The results obtained in the KMO test (0.820) and Bartlett’s test of sphericity (p = 0.000) indicated the existence of a correlation between the items suitable for factor analysis. A significant Bartlett’s test of sphericity (p < 0.05) indicates that the questionnaire items are correlated. A KMO test with a value greater than 0.8 reports a degree of correlation between items suitable for factor analysis [25,27,28]. The communality values of the items were higher than 0.6, indicating the existence of a high proportion of variability that could be explained by the common factors identified in the EFA. These values guarantee the robustness and internal consistency of the questionnaire in measuring its different dimensions [28,37]
Principal component analysis identified that the questionnaire had four factors with eigenvalues greater than 1, which individually explained at least 5% of the variance and together constituted more than 50% of the variance [25,27,28]. The individual factors explained percentages of variance greater than 8% and together constituted 74.484% of the total variance of the questionnaire. This result indicates that the identified factors are statistically sound and adequately represented the underlying structure of the instrument, allowing a reliable and consistent interpretation of the measurable dimensions of the questionnaire. The factors obtained coincide with those observed in the original version of the GEQ [12] and to the short versions of this questionnaire adapted and validated for Spanish professional athletes and Spanish university work groups [14,15].
The EFA by means of principal component analysis with varimax rotation identified that factor 1-ATG-T was made up of items 2, 4, and 6, that factor 2-ATG-S was composed of items 1, 3, and 5, that factor 3-GI-T was made up of items 8, 10, and 12, and that factor 4-GI-S included items 7, 9, and 11. Therefore, it can be seen that the Spanish short version of the GEQ applied to nursing students undergoing clinical simulation training has been fully adjusted to the factor structure composed of four dimensions with three items each proposed by the original study [12] and by the short versions of this questionnaire adapted and validated in Spanish [14,15].
In the CFA, the first-order models present in the literature were tested: a one-factor model of global cohesion, a cohesion model with two factors representing attraction and integration, a cohesion model with two factors representing social and task aspects, and the cohesion model with four factors, ATG-S, ATG-T, GI-S, and GI-T [12,13,14,15]. The results obtained indicated that the first-order four-factor model was the one that presented optimal values in all the goodness-of-fit indices analyzed [26,27,28,29]. These results coincide with those obtained in the original study [12] and with the short versions of this questionnaire adapted and validated in Spanish [14,15]. The findings obtained by CFA have revealed that the four factors obtained by EFA would consistently explain the theoretical hypothesis of group cohesion proposed [7,8,12,13,14,15]. With the validation of this questionnaire, we may have a reliable, valid, and easy-to-complete instrument that would allow us to analyze the group cohesion of Spanish student teams and healthcare professionals.
The choice of participants by nonrandomized convenience sampling and their belonging to two universities in the same geographical area may limit the external validity of this study. Therefore, it would be necessary to confirm the results obtained by randomly selecting nursing students from different geographical areas. Another limitation of the study is that the validation was performed exclusively with nursing students and not with practicing professionals. This could affect the generalizability of the results, as the experiences and perceptions of students may differ to some extent from those of professionals in the field. In addition, it would be desirable to extend this study to other healthcare professionals and to conduct qualitative studies with in-depth interviews to help understand the specific characteristics of group cohesion in healthcare teams.

5. Conclusions

The Spanish short version of the Group Environment Questionnaire (GEQ) is a valid and reliable instrument for analyzing group cohesion in teams of nursing students undergoing clinical simulation training. Knowledge of group cohesion in teams formed by nursing students or professionals has important practical implications because it would allow the development of intervention programs to improve interpersonal relationships and collaborative work, increasing the efficiency and quality of healthcare.

Author Contributions

J.M.G.-Á. and A.G.-S.: conceptualization, investigation, data curation, writing, original draft preparation, introduction, discussion, and conclusion; J.L.D.-A., M.S.-C. and A.M.-R.: conceptualization, introduction, methodology, project administration, writing, editing, and supervision; J.M.G.-Á. and A.G.-S.: results and editing; J.L.D.-A.: results and editing; J.M.G.-Á. and A.G.-S.: conceptualization, investigation, and results. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was performed in accordance with the guidelines of the Declaration of Helsinki and has been approved by the Ethics Committee of the Catholic University of Murcia (UCAM), Spain (Reference number: CE012310/Date of approval: 26 January 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used to support the findings of this study are available from the corresponding author upon request.

Public Involvement Statement

No public involvement in any aspect of this research.

Guidelines and Standards Statement

This manuscript was drafted against the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for cross-sectional research.

Use of Artificial Intelligence

AI or AI-assisted tools were not used in drafting any aspect of this manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Babiker, A.; El Husseini, M.; Al Nemri, A.; Al Frayh, A.; Al Juryyan, N.; Faki, M.O.; Assiri, A.; Al Saadi, M.; Shaikh, F.; Al Zamil, F. Health care professional development: Working as a team to improve patient care. Sudan. J. Paediatr. 2014, 14, 9–16. [Google Scholar] [PubMed]
  2. Anselmann, V.; Brouwer, J.; Mulder, R.H. The relationships between perceived individual and team characteristics, individual and team learning activities with effectiveness in nursing teams. Front. Psychol. 2023, 14, 1163494. [Google Scholar] [CrossRef] [PubMed]
  3. Wang, Z.; Liang, Q.; Yan, Z.; Liu, J.; Liu, M.; Wang, X.; Wang, J.; Huang, J.; Luan, X. The association between team resilience and team performance in nurses during COVID-19 pandemic: A network analysis. BMC Nurs. 2023, 22, 54. [Google Scholar] [CrossRef]
  4. Schmutz, J.B.; Meier, L.L.; Manser, T. How effective is teamwork really? The relationship between teamwork and performance in healthcare teams: A systematic review and meta-analysis. BMJ Open 2019, 9, e028280. [Google Scholar] [CrossRef]
  5. Stahel, P.F.; Cobianchi, L.; Dal Mas, F.; Paterson-Brown, S.; Sakakushev, B.E.; Nguyen, C.; Fraga, G.P.; Yule, S.; Damaskos, D.; Healey, A.J.; et al. The role of teamwork and non-technical skills for improving emergency surgical outcomes: An international perspective. Patient Saf. Surg. 2022, 16, 8. [Google Scholar] [CrossRef]
  6. Zeng, C.; Kunaviktikul, W.; Thungjaroenkul, P. Head Nurses’ Authentic Leadership and Group Cohesion as Perceived by Nurses in Tertiary Hospitals in Yunnan Province, China. Nurs. J. CMU 2022, 49, 86–98. [Google Scholar]
  7. Carron, A.V.; Chelladurai, P. The dynamics of group cohesion in sport. J. Sport Psychol. 1985, 3, 123–139. [Google Scholar] [CrossRef]
  8. Sghari, O.; Jlassi, A.; Ben Amar, I.; Elloumi, A.; Zoudji, B. Comparative Analysis of Social Cohesion and Task Cohesion in the Context of Tunisian Professional Football. Int. J. Sports Phys. Educ. 2019, 5, 28–38. [Google Scholar]
  9. Mehdi, P. The Role of Team Cohesion in Success: A Literature Review from a Psychological Perspective. Health Nexus 2023, 1, 81–89. [Google Scholar] [CrossRef]
  10. Borrego, C.C.; Cid, L.; Silva, C. Relationship between group cohesion and anxiety in soccer. J. Hum. Kinet. 2012, 34, 119–127. [Google Scholar] [CrossRef]
  11. Gu, S.; Xue, L. Relationships among Sports Group Cohesion, Psychological Collectivism, Mental Toughness and Athlete Engagement in Chinese Team Sports Athletes. Int. J. Environ. Res. Public. Health 2022, 19, 4987. [Google Scholar] [CrossRef] [PubMed]
  12. Carron, A.V.; Widmeyer, W.N.; Bawley, L.R. The development of an instrument to assess cohesion in sport teams: The Group Environment Questionnaire. J. Sport Psychol. 1985, 7, 244–266. [Google Scholar] [CrossRef]
  13. Eys, M.A.; Carron, A.V.; Bray, S.R.; Brawley, L.R. Item wording and internal consistency of a measure of cohesion: The group environment questionnaire. J. Sport Exerc. Psychol. 2007, 29, 395–402. [Google Scholar] [CrossRef]
  14. Leo, F.M.; González-Ponce, I.; Sánchez-Oliva, D.; Pulido, J.J.; García-Calvo, T. Adaptation and validation in Spanish of the Group Environment Questionnaire (GEQ) with professional football players. Psicothema 2015, 27, 261–268. [Google Scholar] [CrossRef]
  15. Checa, I.; Bohórquez, M.R. Psychometric measures of cohesion in university work teams. Retos 2020, 37, 108–114. [Google Scholar]
  16. Innocenti, F.; Tassinari, I.; Ralli, M.L.; Bona, A.; Stefanone, V.T.; Audisio, R.; Meo, F.; Grifoni, C.; Pini, R. Improving technical and non-technical skills of emergency medicine residents through a program based on high-fidelity simulation. Intern. Emerg. Med. 2022, 17, 1471–1480. [Google Scholar] [CrossRef]
  17. Lee, J.; Lee, J.H. Effects of simulation-based education for neonatal resuscitation on medical students’ technical and non-technical skills. PLoS ONE 2022, 17, e0278575. [Google Scholar] [CrossRef]
  18. Guetterman, T.C. Basics of statistics for primary care research. Fam. Med. Community Health 2019, 7, e000067. [Google Scholar] [CrossRef]
  19. Ranganathan, P.; Caduff, C.; Frampton, C.M.A. Designing and validating a research questionnaire—Part 2. Perspect. Clin. Res. 2024, 15, 42–45. [Google Scholar] [CrossRef]
  20. Kaliyadan, F.; Kulkarni, V. Types of Variables, Descriptive Statistics, and Sample Size. Indian Dermatol. Online J. 2019, 10, 82–86. [Google Scholar]
  21. McNeish, D. Thanks coefficient alpha, we’ll take it from here. Psychol. Methods 2018, 23, 412–433. [Google Scholar] [CrossRef] [PubMed]
  22. Kalkbrenner, M.T. Alpha, Omega, and H Internal Consistency Reliability Estimates: Reviewing These Options and When to Use Them. Couns. Outcome Res. Eval. 2021, 14, 77–88. [Google Scholar] [CrossRef]
  23. Zijlmans, E.A.O.; Tijmstra, J.; Andries van der Ark, L.; Sijtsma, K. Item-Score Reliability as a Selection Tool in Test Construction. Front. Psychol. 2019, 9, 2298. [Google Scholar] [CrossRef]
  24. Matheson, G.J. We need to talk about reliability: Making better use of test-retest studies for study design and interpretation. PeerJ 2019, 24, e6918. [Google Scholar] [CrossRef]
  25. Watkins, M.W. Exploratory Factor Analysis: A Guide to Best Practice. J. Black Psychol. 2018, 44, 219–246. [Google Scholar] [CrossRef]
  26. Marsh, H.W.; Guo, J.; Dicke, T.; Parker, P.D.; Craven, R.G. Confirmatory Factor Analysis (CFA), exploratory structural equation modeling (ESEM), and Set-ESEM: Optimal balance between goodness of fit and parsimony. Multivar. Behav. Res. 2020, 55, 102–119. [Google Scholar] [CrossRef]
  27. Koyuncu, I.; Kılıç, A. The Use of Exploratory and Confirmatory Factor Analyses: A Document Analysis. Educ. Sci. 2019, 44, 361–388. [Google Scholar] [CrossRef]
  28. Tavakol, M.; Wetzel, A. Factor Analysis: A means for theory atavakoluysalnd instrument development in support of construct validity. Int. J. Med. Educ. 2020, 11, 245–247. [Google Scholar] [CrossRef]
  29. Li, C.H. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav. Res. Methods 2016, 48, 936–949. [Google Scholar] [CrossRef]
  30. White, M. Sample size in quantitative instrument validation studies: A systematic review of articles published in Scopus, 2021. Heliyon 2022, 8, e12223. [Google Scholar] [CrossRef]
  31. Sin Yin, T.; Othman, A.; Sulaiman, S.; Mohamed-Ibrahim, M.I.; Razha-Rashid, M. Application of mean and standard deviation in questionnaire surveys: Construct validation. J. Teknol. 2016, 78, 99–105. [Google Scholar] [CrossRef]
  32. Revuelta, J.; Ximénez, C.; Minaya, N. Overfactoring in rating scale data: A comparison between factor analysis and item response theory. Front. Psychol. 2022, 13, 982137. [Google Scholar] [CrossRef] [PubMed]
  33. Lodder, P. Why researchers should not ignore measurement error and skewness in questionnaire item scores. Relig. Brain Behavior. 2022, 13, 321–324. [Google Scholar] [CrossRef]
  34. Kılıç, A.F.; Uysal, I. To what extent are item discrimination values realistic? A new index for two-dimensional structures. Int. J. Assess. Tools Educ. 2022, 9, 728–740. [Google Scholar] [CrossRef]
  35. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef]
  36. Schober, P.; Boer, C.; Schwarte, L.A. Correlation Coefficients: Appropriate Use and Interpretation. Anesth. Analg. 2018, 126, 1763–1768. [Google Scholar] [CrossRef]
  37. Schreiber, J.B. Issues and recommendations for exploratory factor analysis and principal component analysis. Res. Soc. Adm. Pharm. 2021, 17, 1004–1011. [Google Scholar] [CrossRef]
Table 1. Spanish short version of the GEQ for nursing students.
Table 1. Spanish short version of the GEQ for nursing students.
NumberItem
1I like to participate in extracurricular activities with the other members of my group (dinners, excursions…)
2I am happy with my contributions to the work of the group
3I have good friends in this group
4In this group I can perform to the best of my ability
5Group members are one of the most important social groups to which I belong
6I like the style of work of this group
7Group members like to party together
8Group members join forces to achieve the objectives during the preparation and conduct of the simulation sessions
9Group members would like to get together a few times after the clinical simulation is over
10All members take responsibility for a poor group performance
11Our group members would like to meet in situations other than preparing and conducting simulation sessions
12If there is a problem during the preparation of the simulation sessions, all members join forces to overcome it
Table 2. Inferential statistics of sociodemographic data.
Table 2. Inferential statistics of sociodemographic data.
VariablesStatistical TestStatistical Significance
University and ageMann–Whitney U0.081
University and genderChi-square0.976
University and region of originChi-square0.000
University and previous degreeChi-square0.297
University and work activityChi-square0.435
Gender and ageMann–Whitney U0.001
Gender and region of origin Chi-square0.989
Gender and previous degreeChi-square0.623
Gender and work activityChi-square0.368
Region of origin and ageKruskal–Wallis0.427
Region of origin and previous degreeChi-square0.630
Region of origin and work activityChi-square0.793
Previous degree and ageMann–Whitney U0.000
Previous degree and work activityChi-square0.000
Work activity and ageMann–Whitney U0.000
Table 3. Descriptive statistics of the items.
Table 3. Descriptive statistics of the items.
Item 1Item 2Item 3Item 4Item 5Item 6Item 7Item 8Item 9Item 10Item 11Item 12
Mean3.683.703.633.773.363.653.253.603.603.683.633.44
Median4.004.004.004.003.004.003.004.004.004.004.003.00
Mode443434444443
Standard deviation1.0131.0081.0011.0021.0321.0011.0271.0391.0011.0411.0011.017
Skewness−0.485−0.475−0.294−0.471−0.223−0.445−0.291−0.489−0.427−0.491−0.499−0.329
Kurtosis−0.407−0.458−0.491−0.499−0.492−0.315−0.492−0.196−0.217−0.2020.004−0.239
Table 4. Internal consistency of the questionnaire and its dimensions.
Table 4. Internal consistency of the questionnaire and its dimensions.
GLOBALATG-SATG-TGI-SGI-T
McDonald’s Omega0.8550.8610.8380.8050.803
Table 5. Item-total correlation coefficients by items.
Table 5. Item-total correlation coefficients by items.
ItemItem-TotalCorrected Item-Total
10.625 *0.534 *
20.706 *0.627 *
30.594 *0.500 *
40.643 *0.554 *
50.649 *0.562 *
60.627 *0.533 *
70.585 *0.485 *
80.572 *0.468 *
90.559 *0.463 *
100.554 *0.453 *
110.562 *0.463 *
120.558 *0.445 *
Note: * The correlation is significant at the 0.01 level (bilateral).
Table 6. Item-total correlation coefficient by dimensions.
Table 6. Item-total correlation coefficient by dimensions.
Dimension ATG-S ATG-T GI-S GI-T
Item 1Item 3Item 5Item 2Item 4Item 6Item 7Item 9Item 11Item 8Item 10Item 12
Item-total0.821 *0.896 *0.897 *0.887 *0.873 *0.819 *0.806 *0.829 *0.849 *0.837 *0.837 *0.788 *
Corrected item-total 0.617 *0.755 *0.768 *0.752 *0.725 *0.595 *0.563 *0.633 *0.648 *0.616 *0.633 *0.557 *
Note. Statistical test used: Spearman’s correlation coefficient. * The correlation is significant at the 0.01 level (bilateral).
Table 7. Test-retest reliability of the items.
Table 7. Test-retest reliability of the items.
Test/RetestItem 1Item 2Item 3Item 4Item 5Item 6Item 7Item 8Item 9Item 10Item 11Item 12
Item 10.928 *-----------
Item 2-0.840 *----------
Item 3--0.888 *---------
Item 4---0.910 *--------
Item 5----0.852 *-------
Item 6-----0.976 *------
Item 7------0.871 *-----
Item 8-------0.818 *----
Item 9--------0.952 *---
Item 10---------0.882 *--
Item 11----------0.846 *-
Item 12-----------0.812 *
Note. Statistical test used: Spearman’s correlation coefficient. * The correlation is significant at the 0.01 level (bilateral).
Table 8. Test-retest reliability of the dimensions.
Table 8. Test-retest reliability of the dimensions.
Test/RetestATG-SATG-TGI-SGI-T
ATG-S0.948 *---
ATG-T-0.940 *--
GI-S--0.897 *-
GI-T---0.926 *
Note. Statistical test used: Spearman’s correlation coefficient. * The correlation is significant at the 0.01 level (bilateral).
Table 9. EFA. Communalities.
Table 9. EFA. Communalities.
InitialExtraction
Item 11.0000.687
Item 21.0000.828
Item 31.0000.854
Item 41.0000.820
Item 51.0000.857
Item 61.0000.679
Item 71.0000.634
Item 81.0000.725
Item 91.0000.770
Item 101.0000.745
Item 111.0000.758
Item 121.0000.681
Note: Extraction method: principal component analysis.
Table 10. EFA. Total variance explained.
Table 10. EFA. Total variance explained.
ItemInitial EigenvaluesSums of Charges Squared by ExtractionSums of Charges Squared by Rotation
Total% of Variance% AccumulatedTotal% of Variance% AccumulatedTotal% of Variance% Accumulated
14.64138.67338.6734.64138.67338.6732.34719.56119.561
22.04317.02255.6942.04317.02255.6942.25518.79538.356
31.1979.97365.6671.1979.97365.6672.17718.14556.502
41.0588.81774.4841.0588.81774.4842.15817.98274.484
50.6175.14179.625
60.4994.15883.783
70.4623.84987.632
80.3773.14090.772
90.3462.88693.658
100.3372.81296.470
110.2271.89498.364
120.1961.636100.000
Note: Extraction method: principal component analysis.
Table 11. EFA. Matrix of rotated components.
Table 11. EFA. Matrix of rotated components.
Factor 1 (ATG-T)Factor 2 (ATG-S)Factor 3 (GI-T)Factor 4 (GI-S)
Item 1 0.249 0.693 0.005 0.075
Item 2 0.855 0.238 0.133 0.150
Item 3 0.168 0.901 0.055 0.106
Item 4 0.875 0.188 0.087 0.104
Item 5 0.205 0.881 0.149 0.130
Item 6 0.696 0.213 0.144 0.169
Item 7 0.136 0.128 0.260 0.729
Item 8 0.120 0.106 0.808 0.214
Item 9 0.148 0.080 0.135 0.850
Item 10 0.149 0.095 0.826 0.178
Item 11 0.113 0.084 0.167 0.843
Item 12 0.058 0.003 0.811 0.141
Note: Extraction method: principal component analysis. Rotation method: varimax with Kaiser normalization.
Table 12. Goodness-of-fit indexes of the models of the GEQ.
Table 12. Goodness-of-fit indexes of the models of the GEQ.
Models Absolute Fit IndexesIncremental Fit IndexesParsimony Fit Indexes
X2/dfRMSEASRMRCFITLINFIPRATIOPNFIPGFIAIC
1 factor: Global Cohesion15.35180.21500.13400.5460.4450.5320.8020.4360.4479820
2 factors: Attraction and Integration9.54710.16600.08120.7350.6700.7150.8030.5740.5909499
2 factors: Social and Task12.64150.54900.15300.6380.5490.6220.8030.4490.5129663
4 factors2.16600.04950.04530.9670.9550.9410.8180.7480.8039107
Table 13. Goodness-of-fit indices of the four-factor model of the GEQ.
Table 13. Goodness-of-fit indices of the four-factor model of the GEQ.
TypeGood FitResults
Absolute Fit Indices
Chi-square/degrees of freedom<52.1660
Root Mean Square Error of Approximation (RMSEA)<0.050.0495
Standardized Root Mean Square Residual (SRMR)<0.050.0453
Incremental Fit Indices
Comparative Fit Index (CFI)>0.90.955
Tucker–Lewis Index (TLI)>0.90.941
Normed Fit Index (NFI)>0.90.967
Parsimonious Fit Indices
Parsimony ratio (PRATIO)Proximity to 10.818
Parsimony Normed fit Index (PNFI)Proximity to 10.748
Parsimonious Goodness of Fit Index (PGFI)Proximity to 10.803
Akaike Information Criterion (AIC)Proximity to 09107
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

García-Álvarez, J.M.; García-Sánchez, A.; Molina-Rodríguez, A.; Suárez-Cortés, M.; Díaz-Agea, J.L. Validation of the Group Environment Questionnaire (GEQ) in a Simulated Learning Environment. Nurs. Rep. 2025, 15, 154. https://doi.org/10.3390/nursrep15050154

AMA Style

García-Álvarez JM, García-Sánchez A, Molina-Rodríguez A, Suárez-Cortés M, Díaz-Agea JL. Validation of the Group Environment Questionnaire (GEQ) in a Simulated Learning Environment. Nursing Reports. 2025; 15(5):154. https://doi.org/10.3390/nursrep15050154

Chicago/Turabian Style

García-Álvarez, José Manuel, Alfonso García-Sánchez, Alonso Molina-Rodríguez, María Suárez-Cortés, and José Luis Díaz-Agea. 2025. "Validation of the Group Environment Questionnaire (GEQ) in a Simulated Learning Environment" Nursing Reports 15, no. 5: 154. https://doi.org/10.3390/nursrep15050154

APA Style

García-Álvarez, J. M., García-Sánchez, A., Molina-Rodríguez, A., Suárez-Cortés, M., & Díaz-Agea, J. L. (2025). Validation of the Group Environment Questionnaire (GEQ) in a Simulated Learning Environment. Nursing Reports, 15(5), 154. https://doi.org/10.3390/nursrep15050154

Article Metrics

Back to TopTop