1. Introduction
The deficiencies and inaccuracies that exist in the student’s prior knowledge cause them to misconfigure the knowledge in their minds. Concept maps are useful tools in assessing students’ prior knowledge, misconceptions, and sustainability of their meaningful learning [
1].
The source of the difficulties that the students experience in concept learning can be classified as being related to the individual and the individual’s environment. Some reasons that are related to the individual are that they have negative attitude, interest, and motivation towards learning, problems in the students’ identification and perception systems, lack of prior knowledge, non-scientific prejudice, and the inability to link new knowledge with prior knowledge [
2]. The reasons that are related to the individual environment include weakness of teacher-student interaction, inadequate technology tools, the simplicity of course materials and books, inadequate teaching methods, and lack of knowledge of the teacher regarding students’ prior knowledge of the subjects [
3]. The misconceptions not only negatively affect students’ complete learning, but they also prevent the reasoning skill, which is an important factor in problem solving [
4]. Because concepts enable the information to be grouped and organized systematically, the relations between the concepts constitute principles and help to solve problems [
5]. Students with misconceptions tend to only identify the correct and unknown variables in the science lessons and find answers by placing variables into formulae [
4,
6].
Concept mapping is the most commonly used technique in teaching concepts and identifying and eliminating the misconceptions in the field of education [
7]. Concept mapping is a graphical presentation of the relations between the concepts using link words and in a hierarchical manner [
8]. The concept mapping technique that was developed by Novak and Gowin (
Figure 1) [
9] is supported by Ausubel’s meaningful learning theory [
10]. Meaningful learning theory claims that, in order for meaningful learning to take place, the learners need to assimilate the new concepts with prior knowledge by associating them into a systematic structure. Concept maps are powerful tools that help in identifying the misconceptions of the students as well as in realizing conceptual change and restructuring the students’ knowledge [
11].
Quality education is considered to be one of the key elements of sustainable development in the world. As the use of technologies in classroom matures it is necessary in examining how technology-enhanced learning can effectively add to teaching and learning and, consequently, to the imperative of quality education and sustainable growth and development [
3]. Technology can be employed to enhance the skills acquisition process, improve critical thinking, engagement, and overall with empowering individuals to seize opportunities and exploit their potential [
12]. For efficiently using concept maps in education, technology-based concept mapping systems have been developed [
13].
Concept maps can be created on paper or they can be technology based. Some advantages of technology-based concept mapping are: easy restructuring, highlighting, comments, presentability, manipulation, dynamic linking, conversion, and storage [
14].
Nevertheless, the use of concept maps is suggested, because they make the students’ thinking visible, especially in problem solving processes [
15]. Although there are studies that emphasize the benefits of using concept mapping as an assistant tool in the process of concept teaching, there is a limited number of studies that use the computer-based concept mapping as a teaching strategy and that report their impact on the students’ problem solving skills [
16,
17,
18]. However, researchers have identified a critical problem in using concept maps to support learning. This problem creates an extra burden for the teachers when evaluating the concept maps that were developed by the students and it can take a long time for the teachers to give feedback on the concept maps that the students have created. The flow of the education process is prevented by this situation [
19,
20].
Studies in the literature focused on the impact of computer-based concept mapping on learning performance [
17,
20]. However, there are limited studies on the effect of computer-based concept mapping on students’ problem solving skills [
7,
17]. Therefore, this study is to address the insufficiency in the literature by providing an empirical study that investigates the possible benefits of computer-based concept maps on students’ problem solving skills.
According to Lin et al., computer-based concept mapping provides visualization and interactive features [
21]. In this context, Google classroom, which is used as the interface in this study, seems to be a suitable platform for computer-based concept mapping. However, there is no study in which computer-based concept mapping tools have been used in the Google Classroom. Moreover, no studies have used the computer-based concept mapping technique within the Google Classroom platform in relation to physics teaching.
To fill this gap in the literature, the computer-based concept mapping technique was integrated into the Google Classroom, and then the effect on physics teaching was examined. In this context, the impact of combining Google Classroom and computer-based concept mapping (CBCM) on correcting the misconceptions of the students’, teaching new concepts correctly and developing their problem solving skills by visualizing their thoughts in the problem solving process have been investigated in this study.
The following research questions were addressed:
Can a computer-based mapping (CBCM) environment combined with Google Classroom reduce the students’ misconceptions?
Can a computer-based mapping (CBCM) environment combined with Google Classroom improve the students’ problem solving skills?
What are the students’ perceptions of the computer-based mapping (CBCM) environment combined with Google Classroom?
3. Methodology
3.1. Research Design
In this study, a pre-test and post-test design with a control group was used. In the first week, each student was randomly assigned to the experimental group or the control group. Additionally, the experimental students’ group was given training on how to create a concept map with the MindMup application and then sample applications were performed.
In the second week, the Physics Concept Test (PCT) and the Problem Solving Inventory (PSI) were applied as a pre-test for the students in both groups. At the end of the experimental processes, PCT and PSI were applied as a post-test for both groups. Furthermore, 17 volunteers from the experimental group were individually interviewed for the CBCM environment that was integrated into Google Classroom. The research design is shown in
Figure 2.
3.2. Participants
A total of 65 first-year engineering students that enrolled in the physics course at Near East University during the fall semester of the 2017–2018 academic year were included in the study. The students were randomly assigned to the experimental (n = 33) and control groups (n = 32). The experimental group students consisted of 20 males and 13 females, while the control group consisted of 17 males and 15 females. In the experimental group, the physics courses were conducted in a computer-based concept mapping environment that was integrated into the Google Classroom, while in the control group, the traditional teaching method was applied together with Google Classroom. Both of the groups attended the general physics class twice a week (90 mins per week). The two groups attended the class on different days.
The students in the experimental group had not used the MindMup application before. Since the researcher was an expert in the field of physics, the lessons were carried out by the researcher. Due to the ethical requirements of the research, the names of the students were kept confidential. The students in the experimental group brought their laptops to the class and the MindMup application was installed on each laptop.
3.3. Concept Mapping Application
In this study, MindMup (
www.mindmup.com), which is a free online concept mapping tool that can be integrated with Google Drive, was used. With the MindMup application, an unlimited number of concept maps can be created and stored, and they can be accessed from a browser or a mobile device independent of time and space. The concept maps can be collaboratively edited, shared, and exported in different formats (e.g., PNG, HTML, FreeMind) with the MindMup application. The application can work on a desktop, tablet, and mobile browsers without any problems.
3.4. Experimental Procedure
The researcher created virtual classes for both the experimental group and the control group for the General Physics-I course in Google Classroom. The virtual class codes that were created were then sent to the students via e-mail. The students used the respective code and then registered to their classes. In the experimental study, the General Physics-I topics that were taught in both groups were the same.
Experimental group: The study design used in the experiment group is presented in
Figure 3.
Stage 1. The instructor using the MindMup application prepared a concept map that consisted of concepts within the subject (Concept Map-A). The concepts were placed on this map, but the relationships between the concepts were left blank. A list of relations that included the relations between the concepts was also prepared. The list of relations and Concept Map-A were shared in a Google Classroom that was created for the experimental group (
Figure 4). The students individually placed the relations between the concepts on the map and then shared it with the instructor through Google Drive before the class by the submission date that had been determined by the instructor. Thus, the instructor learned about the students’ misconceptions and prior knowledge on the subject before the class.
Stage 2. During the class hour, a discussion environment was provided in relation to the concept maps (Concept Map-A) that were completed by the students, and the misconceptions that were determined were corrected. Subsequently, the instructor taught the subject.
Stage 3. In this stage, the instructor shared the second map (concept Map-B) in Google Class in which the concepts were left blank and the relations between the subject were placed on the map to be filled in by the students during the class. The instructor also shared the concept list with students in Google Classroom (
Figure 5). The students placed the concepts and then sent them to the instructor. The instructor analysed the concept maps through drive and then gave appropriate feedback.
Stage 4. (The last 30–40 min of the lesson): In the last hour of the lesson, problem solving activities that were related to the subject were carried out. The problem solutions were performed with the MindMup application (
Figure 6). Each student shared their solutions to the instructor through Google Classroom.
Stage 5. Within two days, the instructor provided feedback to students individually on their problem solving and analysis of the problem with MindMup.
Problem: A 1000-kg car traveling north collides with a 2000-kg truck traveling east. The occupants, wearing seat belts, are uninjured, but the two vehicles move away from the impact point as one. The insurance adjuster asks to find the velocity of the wreckage just after impact. What is the answer? [
50].
Control group: The instructor sent the list of concepts that were found in Concept Map-A, which was shared with the experimental group of students through the Google Classroom that was created for the control group in order to ensure that the students were aware of the concepts before coming to class. Therefore, it was attempted to make the same pre-class preparation with the experimental and with the control group of students.
The courses in the control group were carried out with the traditional teaching method. Problem solving activities comprised the last 30-min of the course.
Concept maps were not used before class, during lectures, or during the problem solving stages.
3.5. Data-Collecting Tools
3.5.1. Physics Concept Test (PCT)
The Physics Concept Test (PCT) was developed by the researcher who is an expert in the field in order to determine the misconceptions of the students. The resource books that were used in the General Physics-I course were examined. A PCT consisting of 30 multiple choice questions was prepared on the topics that were going to be taught in the experimental process. There were five options for each question in the PCT, which was consisted of two stages. In the second stage, the students were asked to give a brief explanation of their answers. Therefore, the test can provide reliable and valid results by reducing student guessing. Three faculty members from the field of Physics education examined the PCT in order to ensure content validity. After the examination, making necessary corrections that are in line with the views of the experts validated the test.
A pilot implementation was carried out in order to perform validity and reliability analyses before the actual implementation of the PCT that had been corrected. The pilot implementation was carried out with the students who had taken the General Physics-I course before and with 60 students in their second year of education. The item difficulty (p) and discrimination (r) of the questions were calculated in order to increase the content validity of the PCT. The item difficulty index (p) is the correct answer rate of the item and it can be any value between 0 and 1, and it can be any value between −1 and +1 of the item discrimination index [
51]. As a result of the analyses, the items with a difficulty index (p) of 0.82 and 0.85 were removed from the test. Therefore, two questions were removed and the PCT that was formed of 34 multiple choice questions was finalized. The Kuder–Richardson coefficient 20 was calculated as 0.82 for the reliability of the measurements that were obtained from the PCT test, in which the item analysis was carried out. A reality coefficient of above 0.70 indicates that the measurement carried out by the test is reliable [
52]. Thus, it has been determined that the PCT that was formed of 30 items was a reliable and valid assessment tool. The PCT that was developed was used as a pre-test before the implementation in order to determine whether the experiment and control group students’ conceptual knowledge was equal and it was subsequently used as a post-test in order to measure the misconceptions after the experimental process. The PCT includes subjects, such as force-movement, repulsion, power, and linear momentum.
3.5.2. Problem Solving Inventory (PSI)
A Problem Solving Inventory (PSI) has been used in this study to determine the effects of physics teaching with CBCM that was integrated with Google Classroom on students’ problem solving skills. A Problem Solving Inventory is a self-assessment scale that measures the self-perception of an individual’s problem solving skills. Heppner and Petersen developed the PSI that has been used in the study [
53], and it was adapted to Turkish by Sahin, Sahin, and Heppner [
54]. PSI is an assessment tool that is formed of 32 items and a six-point Likert scale (1 = never, 2 = rarely, 3 = sometimes, 4 = often, 5 = usually, 6 = always) and the Cronbach’s alpha reliability coefficient of the PSI was calculated as 0.88, while the reliability coefficient was 0.85. There are six sub-dimensions that are found in the PSI, which are: Impulsive (13, 14, 15, 17, 21, 25, 26, 30, 32), Reflective (18, 20, 31, 33, 35), Problem solving Confidence (5, 23, 24, 27, 28, 34), Avoidant style (1, 2, 3, 4, 11), Monitoring (6, 7, 8), and Planfulness (10, 12, 16, 19). The Cronbach’s alpha coefficients of the sub-dimensions are calculated as 0.74, 0.73, 0.72, 0.66, 0.76, and 0.69, respectively. The items that are numbered 9, 22, and 29 have not been included in the calculation. The score range is 32–192. The high level of the total scores on the scale indicates that the individuals perceive themselves as insufficient in problem solving. In short, the problem solving score is inversely proportional to the problem solving skill. PSI was used as a pre-test before the experimental study and as a post-test after the study for the experimental and control group students.
3.5.3. Semi-Structured Interview
The researcher developed a semi-structured interview form in order to determine the students’ views towards the physics teaching with CBCM that was integrated with Google Classroom. While preparing the interview questions, the existing studies on computer-based concept maps in the literature were used [
55,
56] in order to provide content validity. After the interview questions were prepared, they were presented to two educational technology experts and two training program specialists in order to determine the comprehensibility and suitability. The necessary arrangements were made according to the feedback from the four experts to whom the interview questions were presented and then the questions were finalized. The interviews were conducted face to face with 17 volunteer students from the experimental group after the experimental implementation. In order to prevent data loss, the interviews were recorded and then transcribed.
3.6. Data Analysis
During the data analysis, as a first step, a test of normality was applied to the experimental and control group of students, namely the Kolmogorov–Smirnov test. Parametric techniques were used because test scores had a normal distribution.
Individual sample t-test and ANCOVA were conducted in order to determine whether there was a statistically significant difference between the experimental group and control group regarding physics misconceptions and problem solving skills. An alpha level of 0.05 was used for all statistical tests.
The content analysis method was applied to the qualitative data obtained from the semi-structural interviews that were conducted with the experimental group. The interviews with each student had duration of between four and six minutes and all were recorded. The students’ names were marked as S1, S2, S3, … in order to follow the ethical guidelines of the research. The appropriateness of the coding in the study was presented to two experts for peer review. Experts agreed on all codes. In order to increase the reliability of the study, some of the data that were obtained were presented using the direct citation method to present student opinions.
4. Results
A pre-test on Physics concepts and Problem Solving Inventory was conducted before the four-week teaching experiment began, and when the experiment had been completed, a post-test was done on Physics Conceptions and Problem Solving Inventory. Semi-structured interviews were also conducted with the experimental group.
4.1. Physics Conceptions
Before the start of the learning activities, the PCT was applied as a pre-test to determine whether the experimental and control groups were equal regarding their physics misconceptions. Based on the PCT pre-test results of the experimental and control groups, an independent sample
t-test was conducted (
Table 1).
The statistical results revealed that the results of the physics conceptions pre-test did not significantly differ between the control and the experiment groups (t = 1.201, p > 0.05).
This finding indicates that the experimental and control groups were equal regarding physics conceptions information before the experimental implementation. In the study, PCY was applied as a post-test in order to determine whether there were any changes in the level of physics misconceptions of the experimental and control groups after the experimental process had been completed (after four weeks). An independent sample
t-test was conducted on the PCT post-test results of the experimental and control groups (
Table 2).
The statistical results revealed that the results of the physics conceptions post-test significantly differed between the control and the experiment groups (t = 2.245, p < 0.05). According to this result, it can be concluded that the teaching in the CBCM environment integrated to Google Classroom can reduce the students’ misconceptions and provide meaningful learning.
4.2. Problem Solving Skills
ANCOVA was used in this study to examine the effect of the CBCM learning environment that was integrated into Google Classroom on the students’ problem solving skills. The pre-test scores were taken as covariate, while the post-test scores were taken as dependent variables. The normality test, namely the Kolmogorov–Smirnov test, was applied to the data that were obtained from PSI, and it has been found that they exhibited a normal distribution. After the hypothesis of normality, the homogeneity of group variances was checked by the Levene test and no statistically significant difference was observed (
p > 0.05). Descriptive statistics of the PSI pre-test and PSI post-test scores that were applied to the experimental and control groups are presented in
Table 3.
The adjusted means of the pre-test were determined so that the PSI post-test scores of the students of the experimental and control groups could be compared. The average post-test means and the adjusted means of the groups are presented in
Table 4 for comparison.
The results of the ANCOVA test, indicating whether the difference between the adjusted means of the post-test of the groups was significant, have been presented in
Table 5.
According to
Table 5, the results for the experimental and the control groups showed that there was a significant difference between the adjusted post-test means of the groups when the PSI’s pre-test scores of the “Impulsive style” (F
(1,62) = 103.135,
p < 0.05) and “Avoidant style” (F
(1,62) = 101.779,
p < 0.05) dimensions were taken under control. The calculated eta-squared values for the determination of the effect size of this difference were found to be (η
2) 0.602 and (η
2) 0.714, respectively. As these values are greater than 0.14, this shows that the power of the effect is high.
According to these results, there was a significant decrease in the scores for the impulsive style and avoidant style dimensions in the experimental group as compared to the control group. In other words, it can be said that teaching in the CBCM environment integrated into Google Classroom is an effective way of reducing students’ impulsive and avoidant approaches when solving problems.
It has been determined that there was no significant difference between the groups’ adjusted post-test means when the PSI’s “Problem solving confidence” (F(1,62) = 0.029, p < 0.05), “Monitoring” (F(1,62) = 0.63, p < 0.05), and “Planfulness” (F (1,62) = 0.102, p < 0.05) dimensions’ pre-test scores were taken under control. In other words, it can be said that the students who are being taught with CBCM do not have any influence on their problem solving confidence. A significant difference was found between the adjusted post-test means of the groups (F (1,62) = 31.669, p < 0.05) when the pre-test scores of the PSI’s “Reflective style” dimension were controlled. The calculated value of eta squared (η2) was 0.652, which indicates the effect size of this difference. If this value is greater than 0.14, it indicates that the power of influence is high. According to this result, the scores of the experimental group in the “Reflective style” dimension significantly increased when compared to the control group. Based on this finding, it can be said that teaching with CBCM that is integrated into Google Classroom has a positive effect in improving the reflective style of students while solving problems.
4.3. Students’ Perceptions
Semi-structured interviews were conducted with 17 volunteer students in the experimental group to determine their perceptions towards teaching in the CBCM environment integrated with the Google Classroom. The first question asked what the benefits of teaching in this environment were. The second question was about the problems in this environment and the third question was about the suggestions of the students for tackling these problems. The codings that were obtained after examining the qualitative data gathered from the students’ answers and the frequencies of these codings have been presented in
Table 6.
According to the codes under the context of the benefits of the environment, the majority of the students (f = 16) indicated that teaching with CBCM enhanced the sustainability of problem solving activities. Some of the students (f = 14) stated that it enhanced sustainability in meaningful learning, while some of them (f = 13) stated that it enables the correction of old concepts that have been incorrectly learned.
Similarly, a majority of the participants (f = 10) emphasized that CBCM provides a link between prior and new information. The students (f = 7) stated that it provides meaningful learning by embodying abstract concepts and they also stated (f = 7) that it increases their self-confidence towards the course. Some examples from the students’ statements are, as follows:
“It has enabled me to link my prior knowledge and new knowledge. Thus, more meaningful learning has occurred.”
(S11)
“I always memorized information in physics classes. I did not know what the concepts actually meant. I used to solve problems by placing the variables into the formulas. I can understand the concepts with this approach.”
(S4)
“I found out that some of the physics information that I learned in high school was wrong. Therefore, I corrected my wrong knowledge.”
(S9)
It has been revealed from the codings that are related to the context of difficulties experienced in the environment that the majority of the students (f = 13) did not experience any difficulties in the environment. Some of the students (f = 4) indicated that they experienced difficulties in learning the MindMup application, while some of them (f = 3) indicated that they experienced difficulties, because they had never used a concept map before. When the students were asked about recommendations for solutions on the difficulties that are experienced in the CBCM environment integrated with Google Classroom, some students (f = 4) stated that they needed to be trained in the use of MindMup application for a longer time.
5. Discussion and Conclusions
In this study, the impact of the CBCM environment integrated with Google Classroom on students’ existing misconceptions, ability to learn new concepts correctly, and problem solving skills have been investigated. Furthermore, the study examined the effect of CBCM on the sustainability of concept teaching according to student views.
The research results have shown that the CBCM integrated with Google Classroom has enabled the students to learn correctly by adjusting their misconceptions. We believe that result is because every week the instructor prepared and shared Concept Map-A in advance with the students through Google Classroom Concept Map-A. Resultantly, the students had the opportunity to review the old concepts and test their knowledge.
Furthermore, instant feedback to the Concept Map-B in the classroom environment may have prevented the misconceptions. In a similar study [
20], it was stated that providing instant feedback in concept learning had a significant effect on the meaningful learning of difficult concepts. Furthermore, the opportunity for direct access to the information sources contributes to the visualization and analysis of the abstract concepts and events on the concept maps that were created in the computer environment. For instance, if the users do not understand a concept on the computer-based concept mapping, they can access the information explaining the concept by clicking on the map with the mouse. This result of the study is in line with studies that have determined that concept maps are effective in eliminating misconceptions [
57,
58].
According to another result of this study, teaching in the CBCM environment has revealed that the impulse and avoidance tendencies of the students in problem solving have decreased, while their reflective style has increased. It is believed that having discussions regarding concept maps during the concept learning affects the realization of the thinking activities. In support of this finding of the study, Kinchin stated that discussing the concept maps enables students to think about the points that they did not understand before [
59]. Furthermore, it has been stated that the concept maps are effective techniques in initiating the thinking process in problem solving, facilitating the correct definition of problem solving, and directing students to alternative problem solving methods [
22]. Elias and Weissberg emphasized the importance of an effective thinking activity in every stage of problem solving in order for the individual to be able to realize successful problem solving activities [
60]. On the other hand, it is believed that giving individual feedback to the students regarding their concept maps and problem solving on the Google Classroom has a positive effect on their problem solving skills. In support of this finding, Demirel and Karakus Yilmaz emphasized in their studies that feedback and activities were important factors in improving the students’ problem solving skills [
61].
It has been revealed that teaching with CBCM did not have any effect on the students’ problem solving confidence and their tendencies to be evaluative and organized. It is believed that the reason for this result was due to the fact that CBCM teaching was carried out only for a period of four weeks. According to another result of the research, the students indicated that teaching with CBCM enhanced the sustainability of problem solving activities.
On the other hand, when the students’ views towards CBCM integrated with Google Classroom have been analysed, it has been revealed that the students stated that their problem solving performance increased and that they enjoyed the problem solving processes. It is believed that visualizing their thoughts during the problem solving process on the MindMup application had an effect on this result. In addition, the students stated that there was a decrease in their misconceptions. Furthermore, the students also stated that using this application did not cause any difficulties for them. This result is thought to be because the MindMup application is easy to use. Additionally, the students stated that CBCM enhanced sustainability in meaningful learning.
This study has shown that the Google Classroom and computer-based concept mapping techniques can be used together in harmony. Furthermore, the results of this study point toward the importance of supporting a pedagogical and technical environment for technology enhanced learning. Similarly, Varouchas, Sicilia, and Sánchez-Alonso stated that technology-enhanced learning is as a key quality driver in higher education [
62]. Zhuhadar, Yang, and Lytras, in their research, concluded that the Social Multimedia System makes an important contribution to learning and achievement [
63].
6. Limitations and Future Research
This research, as with any other empirical study, has limitations. Firstly, the participants of this study were only formed of students who were studying in a private university in North Cyprus. Thus, the results cannot be nationally generalized. The study can be conducted with students from different universities and with more participants. Secondly, in order to obtain more detailed information, more questions could have been asked in the semi-structural interviews that were carried out with the experimental group. Asking only three questions has reduced the amount of data in the qualitative dimension of the study. In future studies, more detailed questions can be asked to the students regarding the environment. The third limitation of the study was that the experimental process was only four weeks. In future studies, the experimental process could be longer and the impact on the learning outcomes can be analysed. The final limitation of the study was that separate classes were created in Google Classroom, namely the experimental and control group, in order to prevent student interactions during the distant learning processes. However, the interaction among the members of the groups was not analysed. This situation is a limitation of the study. These student interactions can be analysed in further studies.
Future research should shed light on technology enhanced learning area, not only from the perspective of learning outcomes of use of computer-based concept map. In the current study, the concept maps were pre-created and then shared by the instructor. The students filled in the missing parts of the concept maps. However, in order to develop technical knowledge and usage skills, students should create their maps themselves using different digital concept map applications and tools in further studies. For students, academic results are only one part of the technology enhanced learning environment, as the work with digital technologies increases participation in courses and interest in learning. In addition, it is important to understand how the advances in information and communication technologies are effectively employed in the field of education [
64].
Smart cities present a strong technological component. In Technology Enhanced Learning, the role of technology is to facilitate the acquisition of higher-order skills. Current research that is implemented to learn in the cities has focused on two main technological means for learning contents: applications and mobile devices. The present study focused on the learning applications.