1. Introduction
Around the globe, where the fourth industrial revolution is unfolding and affecting key aspects of people’s daily lives, information and communication technologies (ICT) have become the cornerstone of human development. At the international level, it is known that 58% of European Union citizens have basic digital skills, ranging from almost 80% in Finland to just over 30% in Italy. Similarly, the predominance of smartphones as a digital medium (99.5%) is noted in countries such as Spain, where there are more Internet users (93.2%) than computer users (81.4%) [
1].
On the other hand, in Latin American households, there is little access to computers (35.5%), especially considering that 82% of European households have computers, potentially representing an obstacle in the acquisition of digital skills [
2]. Similarly, an exponential growth has developed in Latin American countries in relation to access to cell phones, although with significant gaps [
3].
In the Peruvian context, 70% of the population does not have internet access at home, highlighting that there are very marked gaps with respect to urban and rural areas [
4]. According to the National Institute of Statistics and Informatics, [
5], 95.4% of Peruvian households use at least one ICT. Specifically, 97.4% of Peruvian households have at least one member with a cell phone, 40.8% with at least one computer, and 79% with a radio and 84.6% with a television. Young university students are the ones who access the internet the most (95.9%). Smart cell phones without mobile data are the most used means (49.8%) by Peruvians, while communication (email, chat, etc.) and searching for information or entertainment (95%, 78.4%, and 82.3%, respectively) are the main activities performed by the population with internet access.
Ref. [
6] states that pedagogical strategies with technology have an impact on university academic teaching; for this, it is proposed not only to generate students with mastery of internet access, but also to have an important domain in digital platforms and applications. It is crucial to note that, through this virtual environment, students must have a good cognitive and emotional state, the latter highlighting the motivation and desire for improvement in process. It is an important task not only to highlight the student role, but also the teaching role to educate students how to access tools depending on the characteristics of the students.
It is pivotal to mention that the ICT gaps in Peru are still notorious, especially since the beginning of the pandemic. Following this logic, [
7] suggests that the increase in digitalization at a global level in the academic, work, and communication environments has generated changes in society. There are differences in the ease of internet use in rural areas, along with the need for a change in the proportion of telecommunication infrastructure to allow greater coverage.
Thus, the present study aimed to validate through a confirmatory factor analysis the constructs proposed in the CUTIC-28 in Peruvian university students. The constructs are composed of dimensions of frequency of ICT use, behavior/emotion generated by ICT, and perceived usefulness of ICT, by medium or support (computer/laptop or tablet versus cell phone).
There have been previous reviews, such as the review conducted by [
8], which objective was to determine how future Spanish and Norwegian teachers perceive concepts such as privacy, cyberbullying, and digital content evaluation, and how the concepts under study relate to each other. The following conclusion can be made: in both countries, the three terms are distinct and there is a positive relationship between the perceived understandings of the concepts by prospective teachers, implying that these should be taught as separate components of professional digital competence.
On the contrary, we have [
9] who conducted a study translated into English as “Types of ICT applications used and competency level of nursing students in higher education: a cross-sectional study”. The objective of this study was to explore the various types of ICT applications used and the level of knowledge of nursing students at a South African university. It concluded that the use of technology in nursing education is essential when training future nurses, especially in an IT-rich workplace. The author also highlighted the use of programs, such as MS Word, Ms PowerPoint, or Moodle.
In addition, [
10] executed a scientific study which objective was to examine the relationship between ICT and students’ mathematical, reading, and scientific literacy using the latest PISA data. The authors concluded that most of the ICT-related factors significantly influence students’ learning outcomes, while some of them have negative influences. Therefore, on the one hand, it is necessary to integrate ICT in education as it can be a possible solution to some puzzling educational problems; on the other hand, ICT must be used with care in educational settings, and further measures to improve the quality of ICT integration in education are essential.
It is important to mention the work of [
11] who published a scientific article, which objective was to analyze the impact of ICT use in school on the results of students in compulsory secondary education in mathematics, reading, and science, using data from three rounds of PISA (2009, 2012, and 2015) for Spanish regions (autonomous communities). The author concluded that an increase in the use of ICT at a school in an Autonomous Community does not have positive effects on PISA scores in mathematics and reading, while there is a positive effect on PISA scores in science.
Finally, it is pertinent to mention [
12] who published a scientific article. Their objective was to analyze the factors affecting the perception of ICT policy implementation in education in the empirical context of higher education in Namibia from the students’ perspective. This study concluded that the implementation of ICT policy in higher education in Namibia is mainly affected by the lack of ICT literacy and limited access to learning and training content.
It can be mentioned that information and communication technologies (ICTs), which can be defined as technological devices (hardware or software) that allow the editing, production, storage, and exchange and transmission of data through different information systems, have common computer protocols [
13]. Nowadays, ICTs are increasingly integrated in society; computers, laptops, and smartphones with internet access are necessary resources for the successful development of young population in various countries [
14].
Therefore, there is a need to develop competencies that enable the efficient use of digital resources. Digital literacy, or ICT literacy, is a concept that encompasses an individual’s interest, attitude, and ability regarding the appropriate use of digital technology and communication tools that enable effective participation in society [
15]. Although digital literacy is developed under a general perspective, it is often discussed that there are demographic variables, such as gender [
16] and age [
17], that condition the acquisition of digital skills.
Specifically, new technologies have notably changed several aspects of everyday life, modifying how people communicate, work, study, or spend their free time [
18,
19,
20] and reaching a detrimental level on some occasions [
21,
22,
23]. In the perspective of [
24] the growth of ICT has changed how people interact with their social environment; people use the internet for a variety of reasons, including seeking information, mere entertainment, socialization, and expressing both opinions and ideas.
While there is a tendency to attribute negative characteristics to internet use (e.g., dependence, isolation, and deterioration of family relationships), young people view the development of computers and cyberspace with optimism [
25]. Certainly, ICTs have the potential to positively influence students’ lives; for example, it is said that social networks can serve to foster interpersonal relationships with peers [
26], facilitating communication and interaction.
Generally, ICTs are developed in two ways in the life of university students. On the one hand, they serve as tools for study and even work, while, on the other hand, they are very useful for leisure, especially as a medium that allows precise and fast communication [
27] Young people are said to allocate large amounts of time to social networks [
28], as these websites allow users to create profiles and view or create content that can be shared with a large number of internet users [
29]. Likewise, ICTs have caused and promoted, especially in young population, a growing interest in video games, which, although they are usually considered entertainment, have been acquiring competitive nuances [
30].
Ref. [
13] mentions that the integration of ICT has generated a substantial change in education. Therefore, such technologies have become a topic of interest for research educators, as they can improve the effectiveness and productivity of teaching [
31]. At the same time, they could produce adverse effects if they are not integrated in the right way [
10].
The involvement of ICT in education has resulted in the modification of learning processes, giving rise to concepts such as e-education, mobile learning, game-based learning, and ubiquitous learning [
32]. Similarly, ICTs have become commonly used tools in the learning of students and teachers at the higher education level [
33], highlighting notably how important teachers’ knowledge is when implementing such technologies [
34].
Currently, ICTs are developed in a multidimensional way in education, involving multiple uses in a classroom [
35]. That is, they can serve as a tool for acquiring information or a platform for communication and teaching. Ref. [
36] added that the involvement of ICTs has brought about an advance in teaching. An example of this is the “flipped classroom” educational methodology, which is based on learning developed by the student themselves, who through their own means (e.g., videos, audios, and books) self-instructs at home, while the educator has a secondary role that involves the reinforcement and discussion of the knowledge acquired at home [
37].
It is appropriate to emphasize that, in order to effectively take advantage of the virtues of ICTs in education, it is necessary to foster information literacy among students. This concept includes the ability to recognize what type of information is sought, how to access it, as well as the ability to evaluate the data and its sources and, subsequently, to classify, manipulate, and store the selected information [
38].
Currently, the use of social networks has become widespread, growing rapidly around the world [
39]. The most popular networks are Facebook, YouTube, Instagram, Twitter, and LinkedIn [
40]. Added to these is the recent TikTok, which has about 1 billion users and is available in 150 countries [
41]. University students are said to use social networks, such as Facebook, to maintain constant communication with close ones, while building and sustaining new social relationships, i.e., their use is motivated by rewards of a social nature [
42].
Ref. [
29], integrating the ideas of other authors, mentioned that the popularity of social networks in the young population has caused some concern in various authors, especially for the so-called “Facebook depression”, which is conceptualized as a phenomenon where a large exposure to social networks generates depressive symptoms in minors. On the other hand, ref. [
28] provided a positive perspective by mentioning that children and young people who spend much of their time on social networks express their personality, in addition to the development of a sense of identity.
In general, it can be said that the effects of the Internet on people are strongly linked to the specific environment where it occurs and to both the characteristics and specific personal conditions of each individual, which are equally comprised of their own psychological state and their own perception of well-being [
43]. Likewise, personality has a significant influence on the sensations that a stimulus can arouse in an individual; in the same way, it is said that personality serves as a predictor, directly or indirectly, of how people use ICTs [
44].
The impact that ICTs have had on various areas of daily life is evident, even being linked to the mental health of their users. In recent decades, the proliferation of technologies and the Internet has caused the emergence of both benefits and psychological problems linked to online activities [
45]. For example, social networks can have a significant impact on the behavior of their users; they can serve to strengthen social ties that improve self-esteem, but they have also been linked to poor academic performance [
46] and even to a depressive disorder.
The prolonged confinement imposed by the COVID-19 pandemic closures resulted in the imposition of online education for two years. It required a high level of adaptation by most students. Although there was a significant preference for face-to-face approach, yet there was a high level of adaptation by students in reported performance; this highlights the difference between students’ learning styles and the influence of their personality profiles [
47].
The COVID-19 pandemic has caused a notable increase in the use of ICTs by university teachers. In general terms, it can be seen that the digital tools most used during the pandemic period have become the most used after the pandemic, with notable increases in the frequency of use of digital resources for tutorials and discussions with students. On the other hand, the area of knowledge is an influential variable in terms of the impact of the pandemic on ICT usage habits in the Latin American and Caribbean regions, as there is a greater use of ICTs by social sciences teachers compared to other areas of knowledge [
48].
In the Latin American and Caribbean areas, university teachers feel that their digital competence and their ability to adapt to the digital educational environments are intermediate-high. However, they feel that the available technical resources do not allow them to develop easily. It is noted that the level of stress caused by the digital educational environments is intermediate, but it is not conditioned by levels of digital skills or by the global innovation index of the countries of origin; thus, it is thought that there must be socio-demographic, cultural, or political factors that affect this type of stress. Finally, the influence of the demographic characteristics of teachers is highlighted, with females showing greater digital competence and lower digital pandemic stress, while older teachers showing lower levels of digital competence and lower levels of stress; with regard to the area of knowledge, it can be seen that those most affected by digital pandemic stress are teachers in the areas of health and humanities [
49].
Naturally, the transition from traditional to digital teaching has increased the use of ICTs, providing new educational opportunities even with the limitations caused by an unforeseen situation. Among these limitations are how the instructor serves as a guide and a co-producer of the teaching process, the need to analyze educational processes leading to a planned integration of ICTs, the adequacy of the evaluation process to assess the digital environment, and good communication that addresses the gap caused by the absence of a physical classroom [
50].
3. Results
The first step was the detection and elimination of outlier responses. In order to avoid bias in the parameter estimates of the structural model (AFC), the first step was to detect surveys with atypical responses and then remove them from the analysis.
In this case, only one survey was found through an anomaly indicator calculated on the basis of the 28 items of the questionnaire.
Figure 1 shows the distribution of the anomaly index in contrast to the normal distribution, and the anomaly indicator of the outlier survey is far away from that of the right tail.
Table 1 shows the CUTIC-28 model proposed by [
51], including three major dimensions or factors and two sub-dimensions for each factor; this is due to the component of the medium used: computer, laptop, or tablet versus cell phone.
The first column reflects the coding assigned to the items that make up the instrument, expressed as follows:
FCLT = Frequency of use on computer, laptop, or tablet.
FC = Frequency of cell phone use.
BECLT = Behavior/emotion on computer, laptop, or Tablet.
BC = Behavior/emotion on cell phone.
UCLT = Utilization in the educational environment on computer, laptop, or tablet.
UC = Utilization in the educational environment on cell phone.
The internal consistency of the 28 items, calculated as Cronbach’s alpha, indicates that all items are positively correlated, which suggests a unidimensionality of the questionnaire. At this moment, the question is to find out whether this unidimensionality underlies the dimensions representing the study variables (three study variables).
Table 2 shows the cronbach’s alpha for the total number of questions in the questionnaire, reporting a score of 0.863.
Table 3 shows the cronbach’s alpha (0.739) for dimension 1.A. (see
Table 1) with 7 questions.
Table 4 shows the cronbach’s alpha (0.730) for the 7 questions of dimension 1.B.
Table 5 shows the value of cronbach’s alpha (0.653) for the 3 questions of dimension 2. A.
Table 6 shows the value of cronbach’s alpha (0.737) for the 3 questions of dimension 2. B.
Table 7 and
Table 8 present the cronbach’s alpha values (0.895 and 0.931, respectively) for each of the 4 questions of dimensions 3.A. and 3.B. (see
Table 1).
The fact that the Cronbach’s alphas of the subdimensions of the study variables are within the expected range (α > 0.65) and verify the unidimensionality means that the sample data provide evidence that the variables are positively correlated.
Figure 2 and
Figure 3 represent the initial and final confirmatory models, which provide the metrics and indices that are considered appropriate for model fit, testing and empirical sustainability.
To monitor the fit of the data to the AFC model, the fit indices highlighted in
Table 9 are considered. The most important indices are CMIN/DF < 2, TLI and CFI > 0.9, and RMSEA < 0.08.
A model has a tolerable fit if the CMIN/DF values are less than two, even being accepted in some cases with limits up to five. The Tucker–Lewis Index (TLI) ranges from 0 to 1, with values greater than or equal to 0.90 being recommended [
54]. The CFI (Comparative Fit Index) was developed by [
55] from a previous index (BFI) that corrects for values beyond the 0–1 range. The CFI compares the χ
2 of two models: an independent model that claims there is no relationship between the variables in the model, and the model proposed by the researcher. Usually, it is accepted that the CFI should be around 0.90 to consider the model as fitting the data appropriately. The Root Mean Square Error of Approximation (RMSEA) represents the anticipated fit to the total population value and not to the sample. If RMSEA is less than or equal to 0.05, it indicates an error of approximation of the model with reality.
After verifying the good fit of the model, we proceeded to verify whether the sample is able to confirm the latent factors (dimensions and sub-dimensions) of the model.
Table 10 shows that all latent factors of the model are confirmed significantly at the 5% level.
The standardized regression weights represent the factor loadings. The first six rows measure the contribution of the dimensions to their sub-dimensions, and the subsequent rows represent the contribution of the dimensions to the items. The regression weights are greater than 0.50 (except for eight items, which do not condition the result), reaching more than 0.80; this shows the robustness of the model.
As shown in
Table 11, the study variables are positively and significantly correlated at the 5% level, indicating that there is sufficient evidence in the data to support the factor structure of the measurement instrument. The covariances between the constructs are highly significant and positive, as expected. Therefore, the structure is confirmed by the data.
The main objective of this study was to validate and confirm the factorial structure of the constructs proposed in the CUTIC-28, which had already been studied in another context. This study was able to verify the factorial structure in a sample of Peruvian university students, affirming coherence and consistency with the study of [
51] and confirming the initially proposed 28 items. These items are related to the dimensions of frequency of ICT use, behavior/emotion generated by ICT, and perceived usefulness of ICT, by medium or support (computer/laptop or tablet versus cell phone).
Group Analysis
Table 12,
Table 13 and
Table 14 show the sample size of the control variables. This inspection of the sample size is necessary for the confidence of the model parameter estimates. It should be noted that, for samples that are not so large, the fit deteriorates with respect to the fit of the model with the whole sample. In the case of age ranges, where small samples (less than 30) were observed, contiguous ranges were regrouped to achieve greater sample representativeness. For the analysis, this was performed to form the groups from 18 to 21 and from 22 to higher ages.
In the female group, as previously mentioned, the measures of fit deteriorate, but within expectations, which allows us to affirm that a good fit is maintained (CMIN/DF < 2, TLI and CFI > 0.9, and RMSEA < 0.08). In the male group, the measures of fit also deteriorate, but within expectations (CMIN/DF < 2, TLI and CFI very close to 0.9, and RMSEA < 0.08); this can be seen in
Table 15.
In both groups (male and female), it can be seen that all latent factors of the model are confirmed significantly at a level of 5%, and the standardized regression weights represent the factor loadings. The first six rows measure the contribution of the dimensions to their subdimensions at the group level by sex, and the subsequent rows represent the contribution of the dimensions to the items. The regression weights are mostly greater than 0.50 (with the exception of some items, which do not condition the result) and even reach higher than 0.80, which highlights the robustness of the model conditional on the effect or separation of group by sex.
Table 16 shows that in the group of women, a positive and significant correlation at 5% was found between the frequency of ICT use for gaming, messaging, and social networking (RRSS) and the use of ICTs in the educational environment.
Table 17 shows that in the group of men, positive and significant correlations at 5% were verified between all dimensions and subdimensions. Differences in the confirmatory model by sex were observed.
Table 18 shows that the group, Public University, was represented by a sample size of 70, so it was expected that the fit measures would be more deteriorated, as well as the significance of the latent structures, but the fit would still be good. It could even be affirmed that, if the sample were larger, the fit would improve, as well as the significance of the latent factors (CMIN/DF < 2, TLI and CFI close to 0.9, and MSEA < 0.08). On the other hand, in the group, Private University, the fit measures deteriorated, but within what was expected; thus, it can be affirmed that a good fit is maintained (CMIN/DF < 2, TLI and CFI > 0.9, and RMSEA < 0.08).
In both groups (public and private universities), it can be seen that all latent factors of the model are confirmed significantly at a level of 5% (with the exception of the model for the public university in the first dimension), and the standardized regression weights represent the factor loadings. The first six rows measure the contribution of the dimensions to their subdimensions at the group level by university type, and the subsequent rows represent the contribution of the dimensions to the items. The regression weights are mostly greater than 0.50 (with the exception of some items, which do not condition the result) and even reach higher than 0.80, which highlights the robustness of the model conditional on the effect or separation of group by university type.
Table 19 shows that in this group of public university students, a positive and significant correlation at 5% was verified between the frequency of ICT use for gaming, messaging, and social networking (RRSS) and the use of ICTs in the educational environment.
Table 20 shows that in this group of students from private universities, positive and significant correlations at 5% were verified between all dimensions and subdimensions. Differences in the confirmatory model by type of university were observed.
For the group aged 18 to 21 years, as previously mentioned, the fit measures deteriorated, but within expectations, allowing us to state that a good fit is maintained (CMIN/DF < 2, TLI and CFI very close to 0.9, and RMSEA < 0.08), while in the group aged 22 years and older, a good fit is maintained and even improved (CMIN/DF < 2, TLI and CFI > 0.9, and RMSEA < 0.08); as can be seen in
Table 21.
In both groups (18 to 21 years and 22 years and older), it can be seen that all latent factors of the model are confirmed significantly at a level of 5% (except for the model for the 18 to 21 years group in the first dimension), and the standardized regression weights represent the factor loadings. The first six rows measure the contribution of the dimensions to their subdimensions at the age group level, and the subsequent rows represent the contribution of the dimensions to the items. The regression weights are mostly greater than 0.50 (with the exception of some items, which do not condition the result) and even reach higher than 0.80, which highlights the robustness of the model conditional on the effect or age-group separation.
Table 22 shows that in the group of students between 18 and 21 years of age, no significant correlations at 5% were found among all dimensions. No relevance or robustness of the factorial model was observed for this age group.
Table 23 shows that in this group of students aged 22 years and older, positive and significant correlations at 5% were verified between the frequency of ICT use for gaming, messaging, and social networking (RRSS) and the use of ICTs in the educational environment, and the frequency of ICT use for gaming, messaging, and social networking (RRSS) and the behavior/emotion generated by ICTs. Differences were then observed in the confirmatory model by age group.
4. Discussion
The study sought to validate by means of a confirmatory factor analysis the constructs proposed in the CUTIC-28, an instrument proposed by [
51] to measure the frequency and scope of use of ICTs with internet connection. The referred study had a sample of 178 university students studying Social Work at the Complutense University of Madrid, and an exploratory factor analysis was applied, reducing the number of items from 48 items to 28 items that showed better properties; it was concluded that the instrument was a valid and reliable tool to estimate the frequency of use of technology. However, this instrument did not have a confirmation of its theoretical and methodological proposal, so it was imperative to demonstrate the interrelationships between its dimensions and sub-dimensions, and in a new context. In this study, Peruvian university students, of all careers, were recruited for a final sample of 318. Similar to the previous study, the robustness of the 28 proposed items and their dimensions and subdimensions (frequency of ICT use, behavior/emotion generated by ICT, and perceived usefulness of ICT, by medium or support in terms of computer/laptop or tablet versus cell phone) were confirmed, affirming coherence and consistency between the studies with the use of a confirmatory analysis; this implies the finding of consistency between the estimation methods (see
Table 9) and the submitted questionnaire. Thus, the proposed theoretical model reproduces the relationships between variables (dimensions and sub-dimensions), representing, in a new context, the relationships between the full composition of the explored construct, but now with the highest possible fidelity.
The confirmation of the model opens the possibility of verifying its interrelationships with other studies. Specifically, for the dimension of ICT use in the educational setting, similarity is found with the findings of [
9] who, when exploring the various types of ICT applications used and the level of knowledge of nursing students at a South African university, concluded that the use of technology in nursing education is essential when training future nurses, especially in an IT-rich workplace. This is an aspect that is confirmed in this study, even with the subdivisions of university type, gender, and age that present their due particularities, as detailed in the results section.
Similarity is also found with the results of Hu et al. (2018), who examined the relationship between ICT and students’ mathematical, reading, and scientific literacy and concluded that most of the factors related to ICT significantly influence students’ learning outcomes, with the recommendation that ICT should be employed with care in educational environments and that it is essential to adopt new measures to improve the quality of ICT integration in education. The latter echoes with what has been referred to by [
7], who indicates that there are differences in the ease of internet use in rural areas, with the need for a change in the proportion of telecommunication infrastructure to allow greater coverage. This is also the case in the Peruvian context, highlighting the notorious ICT gaps, which have been especially revealed since the beginning of the COVID-19 pandemic.
The above findings also correspond with [
12], who analyzed the factors affecting the perception of ICT policy implementation in education in the empirical context of higher education in Namibia and concluded that the implementation of ICT policy in higher education in Namibia is mainly affected by the lack of ICT literacy and limited access to learning and training content, a factor that should be mapped very carefully and improvement actions should be taken in the studied context.
The findings about the frequency and extent of use of ICTs in this research correspond with what have been reported by [
18,
19,
20], highlighting that ICTs play a very notable role in how people communicate, work, study or spend their free time. These findings clearly reflect how people interact with their social environment, although it is also important to assess the behavior and emotions generated by the use of ICTs, as this could create dependence, isolation, deterioration of family relationships, etc. Even so, the benefits are greater since, undoubtedly, ICTs have the potential to positively influence students’ lives. As reported in [
26], social networks can serve to foster interpersonal relationships with peers, providing important communication and interaction.
From the analysis of the fit indicators of the confirmatory model developed to determine the frequency and extent of ICT use in university students, it is observed that most of them are met (six out of a total of nine, see
Table 9); however, some oscillation is observed in some indicators, This is in line with [
56], who reveals that, overall, the adjustment indexes are not particularly stable, due to the conditioning factors that affect the sample size; thus, he proposes to take into account mainly the RMSEA which has a more stable quality, and, in the present model, it reaches this by being at 0.05.