Next Article in Journal
Identifying the Critical Risks in Railway Projects Based on Fuzzy and Sensitivity Analysis: A Case Study of Belt and Road Projects
Next Article in Special Issue
Embedding Sustainable Development Goals in Education. Teachers’ Perspective about Education for Sustainability in the Basque Autonomous Community
Previous Article in Journal
Game Modelling and Strategy Research on the System Dynamics–Based Quadruplicate Evolution for High–Speed Railway Operational Safety Supervision System
Previous Article in Special Issue
Young Romanians’ Transition from School to Work in a Path Dependence Context
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Sociological Importance and Validation of a Questionnaire for the Sustainability of Personal Learning Environments (PLE) in 8th Grade Students of the Biobío Region in Chile

by
José Luis Carrasco-Sáez
1,*,
Marcelo Careaga Butter
2,3,
María Graciela Badilla-Quintana
2,3,
Laura Jiménez Pérez
4 and
Juan Molina Farfán
5,6
1
Faculty of Education, Universidad Católica de la Santísima Concepción, Concepción 4090541, Chile
2
Educational Informatics and Knowledge Management Unit, Universidad Católica de la Santísima Concepción, Concepción 4090541, Chile
3
CIEDE-UCSC, Universidad Católica de la Santísima Concepción, Concepción 4090541, Chile
4
ICT Nucleus TIC in Educational and Intercultural Contexts, Universidad Católica de la Santísima Concepción; Concepción 4090541, Chile
5
Educational Informatics and Knowledge Management Unit, Faculty of Education, Universidad Católica de la Santísima, Concepción 4090541, Chile
6
Faculty of Education, Universidad Católica de la Santísima Concepción, Concepción 4090541, Chile
*
Author to whom correspondence should be addressed.
Sustainability 2019, 11(5), 1301; https://doi.org/10.3390/su11051301
Submission received: 22 December 2018 / Revised: 23 February 2019 / Accepted: 25 February 2019 / Published: 1 March 2019
(This article belongs to the Special Issue The Importance of Sociology of Education for a Sustainable Future)

Abstract

:
Contemporary society is going through a cultural transition that leads to new conceptions about the ways in which human beings organize socially and communicate. This process of deep social and cultural transformations is characterized by a technological disruption, in which virtuality forms a new dimension that behaves as an extension of human intelligence. This new form of human interaction impacts on the social imagination, demanding one to rethink social and educational paradigms for the two-dimensional citizen. In this context, this research article describes the sociological importance and the process of social adaptation of users to a personal learning environment (PLE). It includes the validation process of an instrument for the study of the PLE of 8th grade students belonging to 15 schools in the Biobío Region of Chile. A PLE is a frame of reference that can help to understand how two-dimensional citizens socially adapt and influence the sustainability of local and global systems. The validation method for this instrument considered four stages: i) Expert judgment: considering the opinions of six educators and experts in information and communication technologies (ICT); ii) a pilot test: that included a non-probabilistic sample of 472 subjects; iii) a principal components analysis (PCA); and iv) a confirmatory factor analysis (CFA). The Questionnaire on Work Habits and Learning for Professional Futures and the Context Questionnaire SIMCE TIC were used as a reference. When performing a psychometric analysis, a Cronbach alpha coefficient of 0.89 was obtained. This confirms that the adaptation of the instrument is good. The results of the dimensional analysis help us define a structure for the new instrument considering three components that explain 55% of the total variance. The results of the confirmatory factor analysis showed adjustment indexes that support the theoretical model proposed for the PLE study. In conclusion, the instrument was composed of three latent variables: Open self-regulated learning (OSRL) with eight questions, information management (IM) with four questions, and creation and transfer of knowledge (CTK) with four questions.

1. Introduction

We are living through a cultural transition characterized by the emergence of information and communication technologies (ICT). There is a social importance related to the role of technologies in the behavior of citizens. The sociological change is important when there are two-dimensional performances, i.e., performed in physical spaces and through digital interactions [1,2,3,4,5,6,7]. The trends of social change are conformed to the technological disruption, because “the technologies and the user environment are constructed in the same process” [8].
Technologies such as data mining, artificial intelligence, and mass open online courses (MOOCs) are affecting the way people understand knowledge [9].
The concept of a two-dimensional citizen refers to the double face-to-face and virtual dimension of postmodern subjects. They are exposed to the demands of technological disruption. Postmodern citizens solve problems by using the time and space categories of modernity, and at the same time, they communicate, relate, manage information, and manage knowledge in virtual environments. This implies that they develop a unique cultural identity as regards the human group to which they belong, as well as a global identity, at the level of culture on a human scale, which leads them to relate to other people or institutions in real spaces and virtual spaces. What is involved is not only the communicational aspect, but is a profound change of identity.
The functioning of institutions and interpersonal relationships is also changing. Two-dimensional citizens are projected in the near future as a phenomenon of technological disruption. They live in intelligent cities and communicate on a global level. As this social trend grows, new needs, associated with the new individual and his/her organizational performance, emerge. However, we observe that the education system is not explicitly incorporating these changes into the curriculum. There is a tendency to teach confined to the epistemological limits of time and space, these being the modern dimensions of knowledge. This shows that the new complexities of learning are still not identified and the difference between being a consumer of information and being a knowledge manager cannot yet be recognized. In these dynamics, unprecedented in human history, the two-dimensional identity of the citizen is configured, which simultaneously performs in the space of places and in the space of information flows [2], without necessarily being able to become a self-regulated manager of their apprenticeships, maintaining very high levels of intellectual dependence on those who teach them. It is necessary to rethink society and education, in order to reconceptualize emerging models of social, educational, and cultural sustainable behavior so that they allow for the analysis and systematization of these two-dimensional realities.
This scenario of transition, which affects the cultural singularities of human groups as they necessarily have to be linked to a global dimension of culture on a human scale, requires a new pyramid of needs as a frame of reference to help understand how the human being, in its new bi-dimensional condition, can contribute to the sustainable development of its local and global environment. This requires a new sociological conceptualization, since cultural processes such as transculturation, acculturation, and endoculturation have become more dynamic. We observe that transculturation shows a more intense communicational contact between human groups than in previous historical periods, transferring cultural features from a singular human group to other cultural groups. In the acculturation process, there is a tendency towards the loss of cultural identity elements and with regards to endoculturation we see an attempt to reaffirm the authentic identity of each cultural group [10].
Bronfenbrenner [11] states that we move within different systems: The microsystem, mesosystem, exosystem, and macrosystem. A two-dimensional citizen, mediated by technologies throughout his/her personal learning environment (PLE), could adapt to the conditions of each system (physical space and virtual space) and extend his/her influence to the social environment with which he interacts, as shown in Figure 1.
The interesting thing about this representation is that the educational system remains only as an additional system of learning experiences. The school ceases to be the exclusive center of learning, since in the mixed reality (real + virtual) the different systems complement each other to generate learning.
This context of change provides us with new ways of thinking about society, education, the way in which information is accessed, and how knowledge is created and transferred [9,13,14,15,16,17]. A concept that has proliferated in international research and helps us to address this challenge is the personal learning environment.
The PLE is more of a strategy or approach than a particular tool. It is created by the individuals themselves, promoting their autonomous and interconnected learning in a digital ecosystem composed of means, tools, and services [18]. In this way, open, formal and informal learning is promoted, decentralized from the rigidity of the training institutions [19]. This PLE can be defined as the "set of tools, sources of information, connections and activities that a person uses assiduously to learn" [20]. Its basic structure is made up of three elements associated with three cognitive processes: tools and reading strategies (to access information sources), tools and strategies for reflection (environments or services where information can be transformed), tools and relationship strategies (environments to interact with other people from whom it is possible to learn), as stated by Attwell [21].
The importance and international relevance of the PLE has converged in a large number of research projects. Gallego-Arrufat and Chaves-Barboza [22] conducted a review of empirical research published since 2009, concluding that some studies are grouped around the theoretical and pedagogical justification of the PLE [22,23,24,25,26,27]. They state that around the concept it is possible to find two lines of significance that are useful for categorizing empirical research. A limited one, which deals with the technological tools of the PLE in order to access new sources of knowledge [28,29,30], and a wide one, which promotes the PLE as a great economic, political, physiological, intellectual, social, physical, and virtual toolbox for learning [31,32].
In summary, research tends to emphasize that the PLE puts the individuals as the leading characters of their own learning process in bi-dimensional contexts [22,24,33], enabling them to assume new roles, setting their own goals, choosing and organizing their content and technological tools, interacting with friends, family, or teachers, and reflecting on their learning objectives [34,35,36,37,38] regardless of geographic location [23,25]. However, the integration of technology does not necessarily ensure a greater control over learning [34], nor over the appropriation of part of the individual about his/her role as a citizen, whose actions impact on him, in his/her local and global environment.
More empirical research is needed that associates the PLE with the improvement of learning [22] in two-dimensional contexts; and with its contribution as a systemic framework of mobility between the two-dimensional citizen and the diverse systems that influence his/her way of acting before the world.
Despite the international evidence, in Chile there is little research on the use of the PLE in both primary and secondary education or higher education. The only empirical reference found so far was a study carried out by the Ministry of Education in the SIMCE TIC (National Measurement System of ICT Competences) [39] performed in 2013 involving 11,185 second-grade students, belonging to 492 state-run, semi-subsidized, and private schools. The results revealed that only 1.8% of these demonstrated an advanced level of performance in the use of ICT for learning in four dimensions (information, communication, ethics and social impact, functional use of ICT).
In this context, the main objective of this paper is to validate an instrument to determinate the dimensions that should be included in a PLE oriented to students and their environment, in an effort to contribute to the contextualization of the educational challenges of the two-dimensional citizen and his/her influence in different physical and virtual environments.

2. Materials and Methods

2.1. Research Design

The research was carried out through a non-experimental, descriptive, and transactional study [40,41] during the second semester of the academic year in 2017. The researchers did not have direct control over the analyzed variables that constituted the first version of the instrument.

2.2. Participants

The selection of subjects involved in the study was made through a non-probabilistic convenience sampling [42]. A non-random sample composed for 472 Chilean 8th grade volunteer students from both primary state-run and private schools was used. The average age of the students who participated in the study was 13 years. The schools, which are located in Concepción, previously authorized the application of the instrument. This was applied to all 8th grade students who were present.
Regarding the size of the sample, there are two positions as regards carrying out a principal components analysis (PCA), according to Lloret-Segura, Ferreres-Traver, Hernández-Baeza, and Tomás-Marco [43]: i) Those that suggest a minimum size (N); and ii) those that define a proportion of people by item (N/p). For the selection of the sample, the recommendations of the authors that suggest a proportion of people per item were followed. These can vary between 5 to 15 subjects per question, with a size of no less than 100 people [44,45,46].

2.3. The Questionnaire

The first version of this instrument was developed taking into consideration two theoretical backgrounds: The Questionnaire on Work Habits and Learning for Professional Futures and the SIMCE TIC. The first one was developed in the context of the CAPPLE project (Competencies for Lifelong Learning based on the use of PLEs), which seeks to study how the personal learning environments of future Spanish university professionals will be [47]. The author carried out the validation of this instrument through three methods: An expert judgment, a round of cognitive interviews, and a pilot test. The final version of this instrument was made up of 48 questions and four dimensions: Self-perception (alpha = 0.863); information management (alpha = 0.946); management of the learning process (alpha = 0.885); and communication (alpha = 0.772).
The second theoretical background was the SIMCE TIC, which is a national assessment of ICT skills for learning applied by the Ministry of Education in Chile [39]. Once the instrument was constructed, the language was adapted and the questions were regrouped.
The first version of the instrument was made up of five dimensions, fourteen categories, and thirty questions. Twenty questions, two dimensions, and eleven categories came from the Questionnaire on Work Habits and Learning for Professional Futures and twelve questions were adapted from the SIMCE TIC questionnaire. Five new questions were added: Q24, Q28, Q13, Q19, and Q23; three dimensions were added: Access information, manage information, and create knowledge; and also three categories were added: Connectivity, digital identity, and transfer (see Table 1).
The operationalization of the variables to be evaluated in dimensions and indicators of the variable serves to determine with precision the points on which to obtain information through the corresponding items of the questionnaire. The first dimension access to information corresponds to the devices and strategies that a person uses to access information sources. The second dimension corresponds to manage information, which refers to the devices and strategies that a person uses to find and organize information. The third dimension is to create knowledge, which is associated with the devices and strategies that a person uses to process data and transfer information. The fourth dimension is to communicate, related to the devices and strategies a person uses to critically analyze information, learn in different contexts, solve problems, and plan their learning; and the fifth dimension, management of the learning processes, refers to the devices and strategies a person possesses for team working, managing his/her digital identity and transferring knowledge.

2.3.1. Validation of the Instrument

The validation method considered four processes: i) The validation of the construct through expert judgment, ii) the pilot test: that included a non-probabilistic sample of 472 subjects; iii) the principal components analysis; and iv) the confirmatory factor analysis (CFA).
Process 1. Expert Judgement
According to Crocker and Algina [48], expert judgment allows the validation of a research instrument, being a useful procedure to realize its content validity [49]. As a result of the difficulty of having all the experts at the same time, expert judgment was performed using the method of individual aggregates. A group of six experts in education and information technology was selected in Chile. Each one received the validation format of the instrument, consisting of a table for each question, identifying the dimension to which they belonged. These experts independently assessed the importance of each questions, according to three criteria: i) Uniqueness of language, to validate that the question was clearly written and does not lead to more than one interpretation, answering Yes or No; ii) relevance of the question with respect to the dimension in which it has been raised, answering Yes or No; iii) importance of each one of the items of the questionnaire, answering a Lickert scale from 1 to 5, where 1 was the Minimum importance, and 5 the Maximum importance. In addition, there was a space for observations so that the evaluators could write the comments they deemed pertinent.
On the basis of the suggestions and comments, nine questions were eliminated from it: Q2, Q3, Q5, Q8, Q11, Q12, Q15, Q18, and Q21, the wording of some items was modified, and some of the questions were regrouped (see Table 2).
The problem solving category was eliminated, and the information processing and ethical processing of information categories were merged into a new category called information processing. The new version of the instrument, used as a pilot test, was finally composed of 5 dimensions, 21 questions, distributed in 12 categories as can be seen in Table 3.
Process 2. Pilot Test
A pilot test was carried out with 472 8th graders, belonging to state-run, subsidized, and private schools in Concepción, Chile. The participants were those students who offered their consent as well as their parents’ or tutors’. In that way the confidentiality of the information was guaranteed. The data collection was carried out during the second semester in 2017 and it was applied as a printed document. A brief explanation of the questionnaire and the process was given to the students before they started answering. An example of the questions was provided in order to help them understand how they should answer the questionnaire. The application time was approximately forty-five minutes.

2.3.2. Statistic Analysis

To carry out the evaluation of the elements that make up the instrument, internal consistency measures were calculated using the Cronbach’s alpha coefficient and correlation, through the Pearson correlation coefficient. In order to determine if a PCA was possible, the Barlett’s sphericity test and the sample adequacy measure (SAM) were used. The principal components analysis was performed and an oblique rotation using the Oblimin technique. The results obtained in this test were only applied to the eighteen questions that had variables of scalar type. For the confirmatory factor analysis, the maximum likelihood (ML) method was used and five indices were considered: X2 (Chi square), RMSEA (mean square error of approximation), CFI (comparative adjustment index), TLI (Tucker Lewis index), and SRMR (root mean square residual standardization). The analyses were performed with the statistical software R, version 3.5.1.

3. Results

3.1. Principal Components Analysis

The first exploration of the data shows that some students did not answer all the questions and they left some empty items (without answering). Therefore, the valid sample consists of 439 subjects, as shown in Table 4. Regarding sex, it could be observed that the proportions are very similar between boys (49%) and girls (51%).
The answers were analyzed according to a Lickert scale from 1 to 7, where 1 was Totally Disagree, and 7 the Totally Agree (Table 5).
The reliability analysis of the instrument yielded a Cronbach’s alpha coefficient =0.89. A Pearson correlation matrix was used to analyze the existing collinearity between the variables. A p < 0.01 value was obtained when applying the determinant of the matrix. This suggests a high level of collinearity in the set of variables of the correlation matrix. For the multicollinearity assumptions, the Bartlett sphericity test was used, which yielded a p value of < 0.0001; and the sample adequacy measure Kaiser–Meyer–Olkin (KMO) test yielded a value of 0.92. According to the results obtained, a principal components analysis was carried out. In order to extract the components, we analyzed two criteria: The parallel analysis (using the function fa.parallel, in the R Studio software), which yielded the suggestion of three components and then we complemented it with the variance percentage criterion that refers to the principal components analysis, taking the variance explained by the three components suggested in the previous analysis. The three components explained 55% of the total variance. Table 6 summarizes the results of the first rotation, using oblique rotation.
Items 2 and 13 scored similarly in more than one dimension, influencing the total variance explained. It was decided to carry out a new rotation of components excluding the mentioned items. The result is presented in Table 7.
On the basis of the results obtained in the validation process, the final version of the instrument was modified and two questions (Q2 and Q13), three dimensions (access to information, communication, management of the learning process), and two categories (connectivity, critical thinking) were eliminated.
The other categories were regrouped into three dimensions. The 16 items left were distributed into three components as follows: Component 1 called "open self-regulate learning” (OSRL) with eight questions; Component 2 called “information management" (IM), with four questions; and Component 3, identified as "creation and transfer of knowledge” (CTK), with four questions. The OSRL dimension refers to the devices and strategies that motivate a person to learn and transfer knowledge in bi-dimensional contexts.
The analysis of the Cronbach’s alpha of each of these components yielded an alpha =0.87 for the OSRL component; an alpha =0.86 for the IM component; and an alpha =0.70 for the CTK component. Out of the 19 questions available in the final version of the questionnaire, 16 correspond to a scale of seven levels, one corresponds to frequency, one to Yes/No and I do not know answer; and a question with answers of the type I learned: alone/with my teachers/with my family/with my friends/I do not know. The final structure composed of three validated dimensions, which explain 55% of the total variance is presented in Table 8.
Regarding the correlations between the components, a weak positive correlation was found between OSRL and IM (rS = 0.42, p <0.001); between OSRL and CTK (rS = 0.48, p <0.001) and a moderate positive correlation between IM and CTK (rS = 0.51, p < 0.001).

3.2. Confirmatory Factor Analysis

To corroborate the results of the psychometric properties obtained in the principal components analysis, a confirmatory factor analysis was carried out, which allows one to represent the relations of the latent variables with their observed or indicator variables [50,51], and confirm that all the questions fit the proposed model [52,53,54].
The analyzed model consists of three components: Open self-regulated learning (OSRL), information management (IM), creation and transfer of knowledge (CTK) that influence a group of observed variables, measured through the questions of a scale [55].
Using the Lavaan package [56], from the statistical software R, we can represent the model to be analyzed in the following way:
Model   <   OSRL = ~   Q 08   +   Q 10   +   Q 11   +   Q 12   +   Q 13 +   Q 14   +   Q 15   +   Q 16 IM   = ~   Q 02   +   Q 03   +   Q 04   +   Q 05 CTK   = ~   Q 01   +   Q 06   +   Q 07   +   Q 09 OSRL ~ ~   IM   +   CTK IM ~ ~   CTK  
where each command is explained as follows:
= ~ allows for the inclusion of regression relations that define a latent variable; ~ relationship between two observable variables; and ~~ that specifies the relationships of variance and covariance [51].
To evaluate the goodness of fit of the model, the maximum likelihood (ML) method was used and five indices were considered (Table 9). The X2 statistic (square Chi), which allows us to identify the best possible fit between the compared matrices [57]. A value of 342.377 (p = 0.000) was obtained, with degrees of freedom (DF) =101. Although the value of p is less than 0.05 (the model and the data do not fit each other), it is suggested not to consider this statistic because of its sensitivity when used in samples with more than two hundred subjects [51,58,59,60].
The other indicators used are less sensitive to differences in the sample size. The mean square error of approximation (RMSEA) obtained was = 0.07, considered to be within the acceptable range as an adequate adjustment of the model [51,61,62,63]. The comparative adjustment index (CFI), which compares the proposed model with a null alternative model [62,64], was 0.91, which means that the model for measuring the questionnaire and the structure of the data reproduces at least 90% of the covariance, considered as the minimum acceptable value [51,63,65]. The SRMR index (standardized version of the RMSR index) obtained a value of 0.04, indicating a good adjustment of the model [51,55]. Finally, the non-regulated adjustment inside (TLI) was considered, whose value was 0.91, considered as a good adjustment of the model [66].

4. Conclusions

The incorporation of the virtual dimension to human activities is causing a cultural transition, characterized by a new generation of citizens that develop both in physical and virtual environments; these were called ‘space of the flows’ by Castells [2] or the ‘resonant interval’ by McLuhan and Powers [3].
The digital citizens of the cultural transition are exposed to profound changes in their human behavior. These tendencies are associated with the technological disruption that we experience and which characterize the so-called fourth industrial revolution, provoking new needs and demanding redefinitions of roles and new scenarios in education. In the near future, the new two-dimensional citizens will overcome the limits of time and space of the traditional modern classroom, actively incorporating cyberspace into more autonomous and self-regulated learning processes.
It is a complex redefinition of a new subject that in its identity needs to be analyzed through three important conceptions: A new human condition; how to access, create, and share knowledge; and the recognition of the new essence of an individual with emerging needs.
During the last century, Maslow [67] was able to recognise the needs of the subject as an individual and its relationship with society, but from a vision located in the modern categories of analysis (time and space). However, new needs have been incorporated, based on a mixed reality that involves the real world and the virtual world, which come from the process of a growing technologization of people, society, and culture. To the extent that a greater number of subjects, understood from the technological perspective as excessively complex and probabilistic natural systems, are related to other people or institutions using automated means of communication, these new communicative interactions are produced in complex patterns of decisions and control for achievement of the purposes. These processes, typical of postmodernity, require new skills and the growing satisfaction of new needs to shape the profile of a two-dimensional citizen. Their levels of complexity and influence increase from the subjects, from the local culture towards the global culture.
These questions pose challenges for education in this cultural transition. It is possible to confirm, according to different authors, that the formal education system continues to be decontextualized before the needs of the subjects in two-dimensional contexts [6,7,9,17]. Incompatibilities arise between the society that learns with the new technologies and the one that learns exclusively with the traditional methods of a school centered in the teacher, in standardized evaluations, and knowledge located only within the limits of the classroom [9,18], without addressing the specific needs of the cultural transition.
In this context, this study describes the process of social adaptation of two-dimensional citizens and the validation of an instrument used with 8th grade students in the Biobío region of Chile. This work will contribute to the study of PLE in similar contexts. A PLE is a frame of reference that can help to understand how two-dimensional citizens adapt in their social interactions and influence the sustainability of local and global systems. Knowing more about students’ PLE will allow teachers in the education system to design training routes that prepare them with knowledge, skills, attitudes, and values to contribute to a vision of sustainable global development [10].
It also provides an instrument to build a reconceptualization of educational sociology, by measuring the new roles of students, preferably engaging with the concepts of open learning, information management, and the creation and transfer of knowledge. [8,68].
A final version made up of 18 questions was obtained based on the work of Prendez-Espinoza et al. [47] and the SIMCE TIC context questionnaire [39]. The questions were grouped into three main components (OSRL, IM, CKT) that explain 55% of the total variance. The validation process included expert judgment, a pilot sample, a principal components analysis, and a confirmatory factor analysis. For the principal components analysis, two psychometric tests were performed: The Bartlett sphericity test (to ensure that the correlation matrix is not the same as the inverse or identity matrix), which yielded a value p < 0.0001 (significant); and the measure of sample adequacy, known as the Kaiser–Meyer–Olkin test (KMO), whose value was 0.92. The total alpha of the instrument was =0.89. To evaluate the fit of the proposed model, five goodness-of-fit indices were used: X2 (Chi square), RMSEA, CFI, TLI, and SRMR. The results were favorable, since it was possible to obtain four acceptable values in the indices described, except in the case of X2.
Despite the international relevance of the PLE concept, there is little research in Chile and Latin America [68,69] that studies in depth the characteristics and students’ perception of their personal learning environments. With this article we hope to contribute with an instrument that can be used by other researchers in different contexts in order to validate the final components associated with PLE described in this incipient research line and to examine in detail the results obtained in this study.
Finally, the authors suggest the final validated version of the instrument that could be used in different contexts and with different groups of people that need to be analyzed in their bi-dimensional interaction.

5. Limitations

It is possible that carrying out a PCA and a CFA could eventually lead to an over-adaptation of the factors [70,71]. Future studies should try to replicate the factor structure found. Likewise, the possibility of collecting new data will allow establishing a nomological network in order to test the new scale with theoretically related constructs, such as success in learning.

Author Contributions

J.L.C.-S and M.C.B conceived the original idea of this research. All authors contributed to the writing of this manuscript. L.J.P supported the review of the writing and final version of data analysis. M.G.B.-Q contributed to the analysis of the conclusions and J.M.F reviewed both the Spanish and the English version of the document. All authors have read and approved the final version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

This work has been written thanks to the support of the National Commission of Scientific and Technological Research, CONICYT, Ministry of Education, Chile, through the Postdoctoral Scholarship Abroad, BECAS CHILE, granted to María Graciela Badilla Quintana [Project No. 74160087] and Doctoral Scholarship in Chile (National Doctorate Scholarship), BECAS CHILE, granted to José Luis Carrasco-Sáez [No. 21171389]. We are grateful for the support of the CIEDE-UCSC Center for Research in Education and Development.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Negroponte, N. Ser Digital, 1st ed.; Ediciones, B.S.A.: Barcelona, Spain, 1995. [Google Scholar]
  2. Castells, M. La era de la información. In Economía, Sociedad y Cultura; Blackwell Inc.: USA, 1996; Volume 1, Available online: http://herzog.economia.unam.mx/lecturas/inae3/castellsm.pdf (accessed on 1 March 2019).
  3. Mcluhan, M.; Powers, B. La aldea global. In Transformaciones en la Vida y los Medios de Comunicación en el siglo XXI; Editorial Gedisa, England; 1989; Available online: https://www.amazon.com/aldea-global-village-Transformaciones-globalizacion/dp/8474324033 (accessed on 1 March 2019).
  4. Siemens, G. Connectivism: A Learning Theory for the Digital Age. 2004. Available online: http://www.elearnspace.org/Articles/connectivism.htm (accessed on 19 November 2018).
  5. De Sousa, B. Para Descolonizar Occidente: Más Allá del Pensamiento Abismal, 1st ed.; Consejo Latinoamericano de Ciencias Sociales—CLACSO, Prometeo Libros: Buenos Aires, Argentina, 2010. [Google Scholar]
  6. Reig, D.; Vílchez, L. Los Jóvenes en la era de la Hiperconectividad: Tendencias, Claves y Miradas; Fundación Telefónica: Madrid, Spain, 2013. [Google Scholar]
  7. Fadel, C.H.; Bialik, N.; Trilling, B. Four-Dimensional Education: The Competencies Learners Need to Succeed; Center for Curriculum Redesign: Boston, MA, USA, 2015. [Google Scholar]
  8. Gusc, J.; Heijes, C. Oh This Learning, what a Thing It Is!”—Putting Sustainability First in Teaching Techniques and in Content. Sustainability 2018, 10, 2803. [Google Scholar] [CrossRef]
  9. Geels, F. From sectoral systems of innovation to socio-technical systems Insights about dynamics and change from sociology and institutional theory. Res. Policy 2004, 33, 897–920. [Google Scholar] [CrossRef]
  10. Carrasco-Sáez, J.; Careaga, M.; Badilla-Quintana, M. The New Pyramid of Needs for the Digital Citizen: A Transition Towards Smart Human Cities. Sustainability 2017, 9. [Google Scholar] [CrossRef]
  11. Bronfenbrenner, U. The Ecology of Human Development; Harvard University Press: Cambridge, UK, 1979. [Google Scholar]
  12. Careaga, M.; Fuentes, C.; Molina, M. The Five R Model. 2018. Available online: http://marcelocareaga.blogspot.com/2018/12/modelo-5r.html (accessed on 23 October 2018).
  13. Gadamer, H-G. La Herencia de Europa; Ediciones Península: Barcelona, España, 1990. [Google Scholar]
  14. Lyotard, J.-F. La Condición Postmoderna, 7th ed.; Ediciones Cátedra: Madrid, Spain, 2000. [Google Scholar]
  15. Morín, E. La cabeza bien puesta. Repensar la reforma. In Reformar el Pensamiento; Nueva Visión: Buenos Aires, Argentina, 2002. [Google Scholar]
  16. Igelmo, J.; Laudo, X. Las teorías de la desescolarización y su continuidad en la pedagogía líquida del siglo XXI. Educ. XXI Fac. Educ. UNED 2014. [Google Scholar] [CrossRef]
  17. Careaga, M.; Avendaño, A. Currículum Cibernético y Gestión del Conocimiento. In Fundamentos y Modelos de Referencia; Editores, R.I.L., Ed.; Editorial UCSC: Santiago, Chile, 2017; ISBN 978-956-01-0397-0. [Google Scholar]
  18. Buchem, I.; Koskinen, T. (Eds.) Personal Learning Environments. In ELearning Papers Special Issue; Barcelona, España, 2013; ISSN 1887-1542. Available online: https://ibuchem.files.wordpress.com/2010/02/editorial-elpapers_issue35_en.pdf (accessed on 1 March 2019).
  19. Cabero, J.; Barroso, J.; Llorente, M.C. El diseño de Entornos Personales de Aprendizaje y la formación de profesores en TIC. Digit. Educ. Rev. 2010, 18, 27–37. [Google Scholar]
  20. Adell, J.; Castañeda, L. Los Entornos Personales de Aprendizaje (PLEs): Una nueva manera de entender el aprendizaje. In Claves Para la Investigación en Innovación y Calidad Educativas; La Integración de las Tecnologías de la Información y la Comunicación y la Interculturalidad en las Aulas, Roig, R., Fiorucci, Y.F., Eds.; Marfil—Roma TRE Universita Degli Studi: Alcoy, Spain, 2010; Available online: http://digitum.um.es/xmlui/bitstream/10201/17247/1/Adell%26Castañeda_2010.pdf (accessed on 10 October 2018).
  21. Attwell, G. Personal Learning Environments—The future of eLearning? Elearningpapers 2007, 2, 1–8. [Google Scholar]
  22. Gallego-Arrufat, M.J.; Chaves-Barboza, E. Tendencias en Estudios Sobre Entornos Personales de Aprendizaje (Personal Learning Environments-PLE-). EDUTEC Rev. Electrón. Tecnol. Educ. 2014, 49, a281. [Google Scholar]
  23. Fiedler, S.; Väljataga, T. Personal Learning Environments: Concept or Technology? PLE Conference 2010. 2010. Available online: http://pleconference.citilab.eu (accessed on 25 September 2018).
  24. Panckhurst, R.; Marsh, D. Utilización de redes sociales para la práctica pedagógica en la enseñanza superior impartida en Francia: Perspectivas del educador y del estudiante. Rev. Univ. y Soc. Conoc. (RUSC) 2011, 8, 233–252. [Google Scholar]
  25. Dabbagh, N.; Kitsantas, A. Personal Learning Environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning. Internet High. Educ. 2012, 15, 3–8. [Google Scholar] [CrossRef]
  26. Chatterjee, A.; Mirza, M. Enhancing Self Regulated Learning Skills for Improved PLE Use a Problem Based Learning Approach. PLE Conference 2012. Available online: http://revistas.ua.pt/index.php/ple/article/view/1433 (accessed on 29 July 2018).
  27. Casquero, O. Composición y estructura de redes personales en entornos de aprendizaje personales. In Entornos Personales de Aprendizaje: Claves Para el Ecosistema Educativo en Red (151–160); Castañeda, L., Adell, J., Eds.; Marfil: Alcoy, Spain, 2013. [Google Scholar]
  28. Halimi, K.; Seridi-Bouchelaghem, H.; Faron-Zucker, C. An enhanced personal learning environment using social semantic web technologies. Interact. Learn. Environ. 2014, 22, 165–187. [Google Scholar] [CrossRef]
  29. Saadatmand, M.; Kumpulainen, K. Content Aggregation and Knowledge Sharing in a Personal Learning Environment: Serendipity in Open Online Networks. IJET 2013, 8, 70–77. [Google Scholar] [CrossRef]
  30. Ros, S.; Hernández, R.; Robles-Gómez, A.; Caminero, A.C.; Tobarra, L.; Ruiz, E.S. Open Service-Oriented Platforms for Personal Learning Environments. IEEE Internet Comput. 2013, 17, 26–31. [Google Scholar] [CrossRef]
  31. Sheffel, M.; Wolpers, M.; Schmidt, M.; Werkle, M. Using PLEs in professional learning scenarios—The Festo case for ROLE. eLearning Pap. 2013, 35, 1–9. [Google Scholar]
  32. Shaikh, Z.A.; Khoja, S.A. Teachers’ Skills set for Personal Learning Environments. In Proceedings of the 10th European Conference on e-Learning, Brighton, UK, 10–11 November 2011. [Google Scholar]
  33. Buchem, I.; Pérez-Sanagustín, M. Personal Learning Environments in Smart Cities: Current Approaches and Future Scenarios. Elearning Pap. 2013. Available online: https://ibuchem.files.wordpress.com/2010/02/buchem-sanaugustin-elearning-papers-2013.pdf (accessed on 10 August 2018).
  34. Attwell, G. Personal Learning Environments for Creating, Consuming, Remixing and Sharing. Service Oriented Approaches and Lifelong Competence Development Infrastructures. In Proceedings of the 2nd TENCompetence Open Workshop, Manchester, UK, 11–12 January 2007; Available online: http://dspace.ou.nl/bitstream/1820/1023/1/Proceedings_TENC_Manchester_11-12jan07.pdf (accessed on 13 July 2018).
  35. Väljataga, T.; Laanpere, M. Learner Control and Personal Learning Environment: A Challenge for Instructional Design. Interact. Learn. Environ. 2010, 18, 277–291. [Google Scholar] [CrossRef]
  36. Chatti, M.A.; Agustiawan, M.R.; Jarke, M.; Specht, M. Toward a Personal Learning Environment Framework. Int. J. Virtual Pers. Learn. Environ. 2010, 1, 66–85. [Google Scholar] [CrossRef]
  37. Johnson, M.W.; Sherlock, D. Beyond the Personal Learning Environment: Attachment and Control in the Classroom of the Future. Interact. Learn. Environ. 2014, 22, 146–164. [Google Scholar] [CrossRef]
  38. Chaves, E.; Trujillo, J.; López, J. Autorregulación del Aprendizaje en Entornos Personales de Aprendizaje en el Grado de Educación Primaria de la Universidad de Granada, España. Form. Univ. 2015, 8, 63–76. [Google Scholar] [CrossRef]
  39. Ministerio de Educación de Chile (MINEDUC). Informe de Resultados SIMCE TIC Segundo año Medio; Centro de Educación y Tecnologías Enlaces: Santiago, Chile, 2013. [Google Scholar]
  40. Kerlinger, F.; Lee, H. Investigación del Comportamiento: Métodos de Investigación en Ciencias Sociales, 4th ed.; McGraw-Hill: Ciudad de México, México, 2002. [Google Scholar]
  41. Hernández, R.; Fernández, C.; Baptista, P. Metodología de la Investigación; McGraw-Hill: Ciudad de México, México, 2004. [Google Scholar]
  42. McMillan, J.; Schumacher, S. Investigación Educativa, 5th ed.; Pearson Educación: Madrid, Spain, 2005. [Google Scholar]
  43. Lloret-Segura, S.; Ferreres-Traver, A.; Hernández-Baeza, A.; Tomás-Marco, I. El Análisis Factorial Exploratorio de los Ítems: Una Guía Práctica, Revisada y Actualizada. An. Psicol. 2014, 30, 1151–1169. [Google Scholar] [CrossRef]
  44. Gorsuch, R.L. Factor Analysis, 2nd ed.; Erlbaum: Hillsdale, NJ, USA, 1983. [Google Scholar]
  45. Velicer, W.F.; Fava, J.L. Effects of variable and subject sampling on factor pattern recovery. Psychol. Methods 1998, 3, 231–251. [Google Scholar] [CrossRef]
  46. Field, A.; Miles, J.; Field, Z. Discovering Statistics Using R.; SAGE Publications: Thousand Oaks, CA, USA, 2012. [Google Scholar]
  47. Prendes-Espinosa, M.P.; Castañeda-Quintero, L.; Solano-Fernández, I.; Roig-Vila, R.; Aguiar-Perera, M.; Serrano-Sánchez, J.L. Validación de un cuestionario sobre hábitos de trabajo y aprendizaje para futuros profesionales: Explorar los Entornos Personales de Aprendizaje. Relieve 2016, 22. [Google Scholar] [CrossRef]
  48. Crocker, L.; Algina, J. Introduction to Classical and Modern Test Theory; Holt, Rinehart and Winston: New York, NY, USA, 1986. [Google Scholar]
  49. Best, J.; Kahn, J. Research in Education; Pearson: Boston, MA, USA, 2006. [Google Scholar]
  50. Bollen, K.A. Structural Equations with Latent Variables; John Wiley & Sons: New York, NY, USA, 1989. [Google Scholar]
  51. Lara, A. Introducción a las Ecuaciones Estructurales en AMOS y R. Universidad de Granada, Granada, España. 2014. Available online: http://masteres.ugr.es/moea/pages/curso201314/tfm1314/tfm-septiembre1314/memoriamasterlarahormigoantonio/! (accessed on 1 March 2019).
  52. Hair, J.; Anderson, R.; Tatham, R.; Black, W. Análisis Multivariante, 5th ed.; Prentice-Hall: Madrid, Spain, 1999. [Google Scholar]
  53. Flora, D.; Curran, P. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 2004, 12, 406–491. [Google Scholar] [CrossRef] [PubMed]
  54. Curran, P.; Bauer, D. Building path diagrams for multilevel models. Psychol. Methods 2007, 12, 283–297. [Google Scholar] [CrossRef] [PubMed]
  55. González-Montesinos, M.J.; Backhoff, E. Validación de un Cuestionario de Contexto Para Evaluar Sistemas Educativos Con Modelos de Ecuaciones Estructurales. Relieve 2010, 16, 1–17. [Google Scholar] [CrossRef]
  56. Rosseel, Y. Lavaan: An R Package for Structural Equation Modelling and More. Version 0.4-9 (BETA). 2011. Available online: http://users.ugent.be/~yrosseel/lavaan/lavaanIntroduction.pdf (accessed on 23 September 2018).
  57. Blalock, H.M. Causal Inference in Non-Experimental Research; University of North Carolina Press: Chapel Hill, NC, USA, 1964. [Google Scholar]
  58. Wheaton, B.; Muthen, B.; Alwin, D.F.; Summers, G. Assessing Reliability and Stability in Panel Models. Sociol. Methodol. 1977, 8, 84–136. [Google Scholar] [CrossRef]
  59. García-Cueto, E.; Gallo, P.; Miranda, R. Bondad de ajuste en el análisis factorial confirmatorio. Psicothema 1998, 10, 717–724. [Google Scholar]
  60. Fujikoshi, Y. Transformations with Improved Chi-Squared Approximations. J. Multivar. Anal. 2000, 72, 249–263. Available online: https://www.sciencedirect.com/science/article/pii/S0047259X99918547 (accessed on 01 November 2018). [CrossRef]
  61. Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 136–162. [Google Scholar]
  62. Hu, L.; Bentler, P. Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  63. Awang, Z. Structural Equation Modeling Using Amos Graphic; UiTM Press: Selangor, Malasia, 2012. [Google Scholar]
  64. Batista-Foguet, J.; Coenders, G.; Alonso, J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med. Clínica 2004, 122, 21–27. [Google Scholar] [CrossRef]
  65. Bentler, P. Comparative fix indexes in structural models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
  66. Bentler, P.M.; Bonett, D.G. Significance tests and goodness of fit in the analysis of covariance structures. Psychol. Bull. 1980, 88, 588–606. [Google Scholar] [CrossRef]
  67. Maslow, A. A theory of human motivation. Psychol. Rev. 1943, 50, 370–396. [Google Scholar] [CrossRef]
  68. Cabero, J. El Aprendizaje Autorregulado Como Marco Teórico Para la Aplicación Educativa de las Comunidades Educativas y Virtuales y los Entornos Personales de Aprendizaje. Rev. Teoría Educ. Educ. Cult. Soc. Inf. 2013, 14, 133–156. Available online: http://revistas.usal.es/index.php/eks/article/view/10217/10626 (accessed on 12 November 2018).
  69. Rosário, P.; Pereira, A.; Högemann, J.; Nunes, A.R.; Figueiredo, M.; Núñez, J.C.; Fuentes, S.; Gaeta, M.L. Autorregulación del aprendizaje: Una revisión sistemática en revistas de la base SciELO. Univ. Psychol. 2014, 13, 781–798. [Google Scholar] [CrossRef]
  70. Fokkema, M.; Greiff, S. How Performing PCA and CFA on the Same Data Equals Trouble. Eur. J. Psychol. Assess. 2017, 33, 399–402. [Google Scholar] [CrossRef]
  71. Horn, J.L. A rationale and test for the number of factors in factor analysis. Psychometrika 1965, 30, 179–185. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Representation of the two-dimensional citizen in interaction with his/her personal learning environment (PLE) (Source: Prepared by the authors based on Bronfenbrenner [11] and the 5R Model [12].
Figure 1. Representation of the two-dimensional citizen in interaction with his/her personal learning environment (PLE) (Source: Prepared by the authors based on Bronfenbrenner [11] and the 5R Model [12].
Sustainability 11 01301 g001
Table 1. Dimensions, categories, and questions of the first version of the Questionnaire for the study of personal learning environments.
Table 1. Dimensions, categories, and questions of the first version of the Questionnaire for the study of personal learning environments.
DimensionCategoryQuestions
Access to informationConnectivityQ24, Q27, Q28
Information managementInformation search
Organization of the information
Q4, Q8, Q18
Q1, Q11, Q14
Create
knowledge
Information processing
Ethical processing of the information
Knowledge creation
Q9
Q12
Q6, Q15
CommunicateTeam work
Digital identity
Knowledge transfer
Q7
Q13
Q5, Q19
Management of the learning processIntrinsic motivation
Critical thinking
Open learning
Problem resolution
Regulation and planning of learning
Q2, Q16
Q10, Q21
Q23, Q25, Q26, Q29, Q30
Q22
Q3, Q17, Q20
Table 2. Regrouped questions based on expert judgment.
Table 2. Regrouped questions based on expert judgment.
Regrouped QuestionsNew Questions
Q2 - Q3Q2
Q5-Q8-Q15Q11
Q11-Q12-18Q5
Q21Q10
Table 3. Dimensions, categories, and questions of the pilot version of the instrument.
Table 3. Dimensions, categories, and questions of the pilot version of the instrument.
DimensionCategoryQuestions
Access to informationConnectivityQ14, Q19, Q20
Manage informationInformation search
Organization of the information
Q2
Q1
Create knowledgeInformation processing
Knowledge creation
Q5, Q8
Q3
CommunicateTeam work
Digital identity
Knowledge transfer
Q4
Q7
Q11
Management of the learning processIntrinsic motivation
Critical thinking
Open learning
Regulation and planning of learning
Q9
Q6
Q15, Q16, Q17, 18, Q21
Q10, Q12, Q13
Table 4. Valid sample of participants.
Table 4. Valid sample of participants.
Type of SchoolBoysGirlsTotal
Private and state-subsidized (PSS)504898
State-subsidized (SS)166175341
TOTAL216223439
Table 5. Types of answers.
Table 5. Types of answers.
MeaningAbbreviationAnswer
Totally Disagree TD1
Strongly Disagree SD2
Disagree D3
Undecided UD4
Agree A5
Strongly AgreeSA6
Totally Agree TA7
Table 6. Matrix of rotated components for the first analysis.
Table 6. Matrix of rotated components for the first analysis.
QuestionsComponents
123
Item_170.83
Item_160.82
Item_180.75
Item_150.68
Item_140.58
Item_110.510.43
Item_90.50 0.32
Item_120.50
Item_130.360.33
Item_4 0.86
Item_3 0.81
Item_5 0.56
Item_6 0.46
Item_2 0.400.34
Item_7 0.86
Item_10 0.51
Item_8 0.50
Item_1 0.45
Table 7. Matrix of rotated components for the second analysis.
Table 7. Matrix of rotated components for the second analysis.
QuestionsComponents
123
Item_170.83
Item_160.81
Item_180.75
Item_150.68
Item_140.57
Item_90.50 0.32
Item_110.490.39
Item_120.49
Item_4 0.84
Item_3 0.80
Item_5 0.59
Item_6 0.47
Item_7 0.86
Item_10 0.52
Item_8Item_1 0.500.46
Table 8. Components, categories, and questions (final version of the instrument).
Table 8. Components, categories, and questions (final version of the instrument).
DimensionCategoryQuestions
Open self-regulated learningOpen learning
Regulation and planning of learning
Intrinsic motivation
Transfer knowledge
Q12, Q14, Q15, Q16
Q11, Q13
Q8
Q10
Information management Search for information
Information processing
Teamwork
Q4, Q5
Q2
Q3
Creation and transfer of knowledge Knowledge creation
Organization of information
Digital identity
Feedback
Q7
Q1
Q6
Q9
Table 9. Indexes of goodness of fit of the model.
Table 9. Indexes of goodness of fit of the model.
Indexes of Goodness of Fit of the ModelX2Df pCFITLIRMSEASRMR
Model342.3771010.0000.920.910.070.04

Share and Cite

MDPI and ACS Style

Carrasco-Sáez, J.L.; Careaga Butter, M.; Badilla-Quintana, M.G.; Jiménez Pérez, L.; Molina Farfán, J. Sociological Importance and Validation of a Questionnaire for the Sustainability of Personal Learning Environments (PLE) in 8th Grade Students of the Biobío Region in Chile. Sustainability 2019, 11, 1301. https://doi.org/10.3390/su11051301

AMA Style

Carrasco-Sáez JL, Careaga Butter M, Badilla-Quintana MG, Jiménez Pérez L, Molina Farfán J. Sociological Importance and Validation of a Questionnaire for the Sustainability of Personal Learning Environments (PLE) in 8th Grade Students of the Biobío Region in Chile. Sustainability. 2019; 11(5):1301. https://doi.org/10.3390/su11051301

Chicago/Turabian Style

Carrasco-Sáez, José Luis, Marcelo Careaga Butter, María Graciela Badilla-Quintana, Laura Jiménez Pérez, and Juan Molina Farfán. 2019. "Sociological Importance and Validation of a Questionnaire for the Sustainability of Personal Learning Environments (PLE) in 8th Grade Students of the Biobío Region in Chile" Sustainability 11, no. 5: 1301. https://doi.org/10.3390/su11051301

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop