Effect of Bring-Your-Own-Device Program on Flipped Learning in Higher Education Students

: The “bring your own device” (BYOD) program is positioned as one of the fastest-emerging methods to solve accessibility problems in the flipped learning methodology. The objective of the study is to analyze the potential of a training plan through inverted learning using the BYOD program compared to inverted learning without BYOD. A quasi-experimental design was carried out on a sample of 118 Higher Education students. A questionnaire was used as an instrument for data collection. The results show that the assessments of the study groups, both control and experimental, are at medium–high levels, which shows a significant incidence of the teaching and learning methodologies applied in both groups. There are only three dimensions in which a distance is observed between the groups’ assessments: motivation and autonomy, which were better valued by the experimental group, and class time, which was better valued by the control group. The study concludes that there are no great differences between the teaching methodologies applied in the groups that were subjected to experimentation, except in terms of motivation and autonomy, making these methodologies reliable for the development of these dimensions.


Introduction
Currently, the number of studies investigating the attitudinal, psychosocial, and academic effects of flipped learning has increased. The latest scientific research describes flipped learning as a methodology capable of developing the teaching and learning process effectively.
In the present investigation, in order to investigate those factors that may affect the instructional process, as well as in the different areas discussed above, the general objective was to analyze the potential of a training plan through flipped learning using the "bring your own device" (BYOD) program over another process of flipped learning without using that program. The following research questions (RQ) arise from this objective with the purpose of specifying and conducting the study: • RQ1: Does the use of the BYOD program influence the motivation of students?
• RQ2: Does the use of the BYOD program influence the interaction of students with the teacher? • RQ3: Does the use or not of the BYOD program influence the interaction of students with didactic contents?
• RQ4: Does the use of the BYOD program influence the interaction between students? • RQ5: Does the use of the BYOD program influence the autonomy of students?
• RQ6: Does the use of the BYOD program influence the collaboration of students?
• RQ7: Does the use of the BYOD program influence the level of content deepening? • RQ8: Does the use of the BYOD program influence the students' degree of problem solving? • RQ9: Does the use of the BYOD program influence the degree of class time by students? • RQ10: Does the use of the BYOD program influence the ratings obtained by students?

Flipped Learning and the BYOD Program: A Binomial for Learning Optimization
The current educational paradigm is based on the need to adapt teaching methods to the particularities of today's students [1,2]. Along this line, the flipped learning methodology manages to use information and communication technologies (ICT) as the main tools of the teaching and learning process [3], granting the role of learning to the student themselves [4]. This methodology was born precisely as a response to the needs of students who had problems attending class regularly. Thanks to the contributions of teachers Aaron Sams and Jonathan Bergmann, these students could receive didactic content through audiovisual means [5]. From the year of its birth in 2012, flipped learning has evolved and adapted to the novelties of the educational context, currently having a large number of users from the teaching community [6,7].
The methodological foundation of flipped learning focuses on turning the learning moment between the classroom and outside the sphere of the classroom [8]. The teacher uses the usual class schedule to guide the students and to carry out practical activities [9]. On the other hand, the student invests their extracurricular period in working with conceptual and procedural content using digital tools [10,11]. In this way, the student stars in the training process [12,13] and adapts access to content autonomously and appropriately to their needs [14,15].
Conceptually, the flipped classroom is the mixed space (physical and digital) in which the flipped learning methodology is carried out in educational contexts, that is, it is characterized by a greater semantic concretion than the concept of flipped learning [5,7]. In contrast to the concept of flipped classroom, flipped learning encompasses its methodological implementation in any teaching-learning process, regardless of the field, discipline, educational level, and type of student. Therefore, the flipped classroom is the practical implementation of the flipped learning methodology within the context of an educational center [5].
Research on flipped learning focuses its benefits on the high degree of motivation and participation of students [16]. Motivation in education is understood as the factors that encourage students to be attentive to the teacher's explanations, to have an interest in asking various questions, and to address all the doubts that they have [17,18]. It also promotes a climate of cooperation and collaboration between them during activities [19]. This context fosters student socialization [20] and the ability to solve problems at the individual and collective level [21]. In this way, the flipped learning methodology enables students to assimilate the contents [22] and achieve the teaching objectives more easily [23] and achieve better grades in the processes of evaluation [24,25].
However, despite all the benefits outlined in flipped learning, this methodology also has some limitations. Some research has found that it is especially problematic with students with low capacity for abstraction [26] and with poor problem solving [21,27]. Likewise, this methodology can cause problems with students who have difficulties in accessibility, in the use of learning platforms or in the availability of technological tools [28,29]. The use of ICT is essential in the application of flipped learning, and sometimes it is difficult for students from low sociocultural contexts to access digital tools [30].
Regarding the latter limitation, flipped learning offers a multitude of variants that allow solving the different problems that the teaching process may generate. One of these variants is the combination of the flipped learning methodology with the "bring your own device" (BYOD) program, a focus on the application of methodologies that is very popular in secondary education and higher education [31]. Although the BYOD program is born in relation to business and the world of work, its application in the educational context involves an organized network in which it is the student who brings their own digital devices and technological tools to the educational center [32], mainly computers, smartphones, and tablets [33].
The use of the BYOD program has a positive impact in the educational context [34], in a way that allows for individualization and flexibility of the teaching and learning process [35]. The fact that students can use their own devices reverts to a positive attitude from both students [36] and teachers towards said model [37]. Likewise, thanks to the connectivity that digital devices allow, collaboration between students and the collective construction of knowledge are encouraged [35]. In this way, the application of the BYOD program in flipped learning optimizes student performance [38], causing an improvement in their grades and promoting collaborative and self-directed learning [39]. Additionally, this combination allows students to carry out activities effectively in any context [24] in a way that is productive, since they are familiar with the configuration of their personal devices [40].
The application of the BYOD program facilitates the storage and recovery of files; however, the portability of the devices causes negative limitations related to weight and size [40]. In addition, the application of this model allows students to understand the concepts more easily and promote understanding collaborative discussions to build learning [41], although it requires adequate teacher training for it to develop appropriately [42]. Positive repercussions are also observed in student learning, which can affect student behavior in the teaching and learning process [34], although many of the student may refuse to use it, due to the possible loss or device damage [43].
On the other hand, the most negative aspects of using the BYOD program in the flipped classroom are related to the lack of support from educational institutions or the parents' group so that students can use their own devices in the classroom [37]. Some students are not comfortable regularly taking their devices to class or sharing them with their classmates [44]. Problems related to the use of technology itself have also been found, such as the availability of internet access, battery power, lack of infrastructure or low professional development of teachers [35].

Research Design
The study was developed using a quantitative research methodology using a quasi-experimental design, following the recommendations of the experts [45,46]. In addition, a reported analysis model of impact studies was used in order to follow an analytical structure validated by the scientific community [7,[47][48][49][50][51][52].
The investigation required the configuration of two study groups (control group and experimental group). Each of them carried out a different flipped learning variant. The control group carried out flipped learning without the BYOD program, and the experimental group carried out flipped learning complemented with the BYOD program. This allowed articulating two study variables. The variant of flipped learning carried out was established as an independent variable. The dependent variable is the incidence originating from the different indicators under study.
In this research process, only one measurement was taken, and it took place at the end of the training plan. Therefore, the design of this experimentation at the instructional level acquires posttest cataloging.

Participants
The sample was made up of a total of 118 Spanish university students. As sociodemographic singularities of these subjects, it was determined that 38.14% are men and the rest are women, with an average age of 19.7 years (SD = 2.1). These participants were chosen using an intentional sampling technique. Impact studies certify that the sample size to carry out this type of research does not condition or limit its performance and subsequent establishment of relevant and pertinent conclusions for the scientific literature [29,53].
The participants were divided into a control group and an experimental group, respecting the class group to which they belong. The type of treatment was applied in a probabilistic way (control group = flipped learning without BYOD; experimental group = flipped learning with BYOD) ( Table  1).

Study Dimensions
To ensure the relevance of the results and delve into the findings presented on the state of the question, the catalog of dimensions used in previous studies indexed in specialized databases with the impact index of Journal Citation Reports (JCR) and Scopus was followed [7,[47][48][49]51,52,54].
The dimensions used are specified below in order to facilitate the interpretation of the results: • Social-educational: includes the items related to sex, age, city, nationality, religion, students' course, and methodological aspects; • Motivation: includes items related to the level of motivation of students during the training process; • Interactions: includes the items related to the different interactions of the students (with the teacher, with the contents and between the different students) during the instruction; • Autonomy: includes the items related to the level of autonomy reached by the students in the displayed training; • Collaboration: includes the items related to collaboration and teamwork carried out by the students in the formative action; • Deepening in the contents: includes the items related to the degree of projection that the contents taught during the teaching and learning process achieve; • Problem resolution: includes the items related to the students' competence to solve the problems arising from the training plan; • Class time: includes the items related to the temporary use of face-to-face sessions developed during the instruction period; • Ratings: includes the items related to the perception of the ratings reached by the students; • Teacher ratings: includes the items related to the ratings registered by the teacher in the assessment tests carried out by the students.

Instrument
The instrument used for data collection was an ad hoc questionnaire. This tool was made after searching and analyzing other instruments on the state addressed by this study, with the purpose of specifying an instrument that is adapted to the particularities of the research context [7,[54][55][56][57]. The designed questionnaire is made up of 35 items, cataloged in the dimensions previously described (socioeducational = 9 items; motivation = 3 items; teacher-student interactions = 2 items; student-content interactions = 2 items; student-student interactions = 2 items; autonomy = 3 items; collaboration = 3 items; deepening in the contents = 2 items; problem resolution = 2 items; class time = 2 items; ratings = 3 items; teacher ratings = 2 items). Most of the questions used a Likert rating scale of 1 to 4 points (from most negative to most positive) and others with a closed choice.
The validation of the questionnaire was first produced by a group of experts in emerging methodologies who carried out a Delphi method. These specialists analyzed each one of the questions in particular and the tool as a whole and issued a favorable judgment (M = 5.02; SD = 0.63; min = 1; max = 6). They also offered different recommendations to improve the instrument. The feedback received was analyzed through the Kappa of Fleiss (K) and W of Kendall (W) statistics, revealing an adequate level of agreement and relevance (K = 0.82; W = 0.84) of the observations of these judges.
Furthermore, the questionnaire was subjected to an exploratory factor analysis with the principal components method. Bartlett's test of sphericity was calculated that reflected dependence between the study variables (2249.51; p < 0.001) and the Kaiser-Meyer-Olkin test that determined an adequate adequacy of the sample (KMO = 0.83). Similarly, the reliability of the instrument in question was decreed by means of different statistics that showed adequate internal consistency (Cronbach's alpha-α = 0.86; compound reliability = 0.84; average variance extracted = 0.81).

Procedure
The experimentation consisted of developing a training plan through the flipped learning methodology from two perspectives: a flipped learning based on the use of digital devices in the classroom and a flipped learning complemented by the BYOD program. The control group students only had the technological resources existing in the educational institution, that is, an interactive whiteboard in the main classroom and a computer in the computer room. By contrast, the control group students could bring their own electronic device to class to use as a personal technological complement, mainly highlighting the use of laptops, smartphones, and tablets. In this case, the teacher had a list of registered devices that had previously been reviewed and that met the technical requirements.
This training program covered 12 sessions, following the proper structure that characterizes this teaching and learning methodology. Specifically, the students, before going to the face-to-face class, had all the audiovisual teaching material stored in a web repository available so that it could be previewed. In this way, the time outside the classroom was allocated to the visualization of the multimedia material to carry out a first approach to the learning contents. The role of the teacher in both study groups focused on the orientation and guidance of the students towards learning. The student played a leading role focused on autonomy, self-regulation, and collaborative learning.
The contents treated during the sessions were the same for the control group and for the experimental group. These contents were related to teaching and the teaching profession, curriculum planning, and the development of the educational curriculum: − Didactic interaction and communication between the teacher and the students; − Curriculum and action plan; − Educational goals and purposes; − Educational content and skills; − Teaching evaluation; − Class direction for teaching; − Teaching-learning models; − Personalization in teaching; − Direct teaching with the whole class; − Teaching through collaborative-cooperative work groups; − Teaching through inquiry and discovery and autonomous work; − Development of creative thinking in the classroom.
Once the instruction process was completed, the measurement phase took place with the application of the questionnaire. All the data collected were processed at the statistical level to allow for the effective achievement of the study objective and to achieve a timely response to each of the questions asked.

Data Analysis
The analysis of the collected data was carried out with the Statistical Package for the Social Sciences (SPSS) v25 (IBM Corp., Armonk, NY, USA, 2017). In this analysis, the mean (M) and standard deviation (SD) were calculated, as well as other tests to determine the distribution trend by means of skewness (Skw) and kurtosis (Kme). The comparison between the group means was carried out with the Student's t-test (tn1+n2-2). The size of the effect caused was determined with Cohen's d and the biserial correlation (rxy). We worked with a p < 0.05 to establish statistically significant differences.

Results
The data collected in the descriptive analysis show that the measures given are even, both in the control group and in the experimental group, with the average being between 2.5 and 3. This shows that the ratings by both groups in relation to the applied flipped learning modalities are similar. The data provide a normal distribution of the sample [58]. The standard deviation in most of the dimensions offers a trend of dispersed response by the students, except in the dimensions or class-time and ratings of the control group, and the dimensions or student-student, autonomy, collaboration, resolution, ratings, and teacher ratings, where the responses are more even. Kurtosis is placid in all the study dimensions, both in the control group and the experimental group (Table 2). The comparison of the means obtained by the control group and the experimental group gives even results, with both groups having an almost identical total mean. Of all the dimensions, motivation and autonomy in the experimental group and class time in the control group stand out, which considerably exceed the totalized mean ( Figure 1). To know the value of independence of the results obtained in flipped learning without BYOD, for the control group, and flipped learning with BYOD, for the experimental group, the Student's t statistic was used for independent samples. The results show that there are only three dimensions that are statistically significant, but with different trends. On the one hand, there are the dimensions of motivation and autonomy, whose statistics show that they are significant, with a negative sign, which gives a higher value to the students in the experimental group than in the control group, with a considerable difference in means. On the other hand, there is the class time dimension, whose values indicate that it is statistically significant, but with a positive sign, indicating that the evaluations have been higher in the control group than in the experimental group. All the significant  (Table 3).

Discussion
Today's teaching is subject to great changes and the proliferation of technology-based appearances that adapt to the vanguard of society. The application of methodologies and models, such as those developed in this experimentation, are mandatory for the development of teaching, to favor the learning of students who increasingly require and request it.
From the study carried out, conclusions can be drawn that consider, only in some aspects and dimensions, its implementation in the context in which it was carried out. The evaluations of the study groups, both in the control group and in the experimental group, are located at medium-high levels. This confirms a significant incidence of the teaching and learning methods applied in both groups, as well as that extracted in other experiments of this type [1,2,6,7,23,59,60].
In the study, three dimensions were observed in which a distance is shown between the evaluations of the groups. Regarding motivation and autonomy, the group that used the flipped learning methodology complemented by the BYOD program obtained positive results, in line with what has been established in other previous studies [12,[16][17][18]21]. Regarding the third aspect mentioned, the class time dimension was better valued by the group that received flipped learning without the BYOD program, finding no agreement with previous studies. However, the measures of the three dimensions considerably exceed the totalized mean, as in previous studies [28,29].
On the other hand, the totalized measurements in all dimensions are at an intermediate level. Furthermore, it is noteworthy that the teacher-student dimensions are located above the totalized measures, both in the control group and in the experimental group.
Regarding the motivational variable, the application of the teaching methodology based on inverted learning and complemented by the BOYD program is effective, involving students in pedagogical dynamics. This method has allowed students to be more attentive, more interested, and more involved in activities in particular and in learning processes in general [17,18].

Conclusions
The measurements carried out in the motivation and autonomy dimensions can be considered significan, due to their impact on the teaching carried out by the group that was subjected to these techniques and methods [61]. The class time dimension is also significant, in this case, as it shows that the methodologies developed by the group that received flipped learning without the BYOD program has a direct impact.
In short, it can be concluded that there are no major differences between the teaching methodologies applied in the control group and those applied in the experimental group, highlighting only motivation and autonomy for the experimental group and class time for the control group. Therefore, the implementation of the flipped learning and the BYOD program are effective for the teaching and learning process, although the incidence of BYOD is limited and does not significantly affect all the skills involved in the teaching and learning process.
The limitations of this study lie in its implementation in a reduced and determined context, which is, however, sufficient to be able to draw reliable and valid conclusions. This study was developed using a quantitative research methodology using a quasi-experimental design. The data collection of the results was carried out quantitatively in all cases, but some of the variables analyzed could be considered under a qualitative perspective. Despite this, this research aims to initiate a path of research on flipped learning with BYOD and deepen it with subsequent more specific research.
The prospective of this research focuses on the controversial debate on the efficacy of complementary programs in active methodologies. The effects of the BYOD program have been studied in detail in recent years, but in many investigations, it is difficult to discern whether the positive effects are caused by BYOD itself or by the implementation of the active methodology (flipped learning, in this case). Therefore, a line of research was started in which it was found that not all the attitudinal, procedural, and aptitude benefits are directly caused by the implementation of the program, since no significant differences were observed between the two study groups.
This study will allow us to continue contributing to the scientific literature of the BYOD program in the specific context of flipped learning, an area in which there is still scope for specific research. Teachers will have a new perspective on the application of the BYOD program in students who experience the flipped learning methodology in the specific context of higher education. Likewise, teachers may have a reference framework to check the effects of its implementation in a combined flipped learning methodology complemented by BYOD on specific attitudes and skills, such as motivation, interaction, autonomy, collaboration, deepening, and problem solving, taking advantage of time and grades.