1. Introduction
This paper aims to share the resources that we have developed in collaboration with secondary science and technology teachers in Québec to support the teaching of engineering design technology. To this end, we present the assessment tools that were developed by the teachers to elicit their students’ alternative ideas about technology and technological systems. These assessment items were administered to Secondary Cycle One students (grades seven and eight) in Francophone and Anglophone schools in Québec to elicit their alternative ideas about the foundational technology concepts included in the science and technology curriculum in Québec. We hope that science educators will benefit from the tools that their fellow colleagues developed to facilitate the integration of science and technology while teaching the Québec Education Program. This paper is organized into five sections. First, we provide an overview of the Science and Technology program in Quebec. Then, we review the literature on students’ intuitive or alternative conceptions in science. In the subsequent sections, we describe the study methods, present an analysis of the key findings focusing in secondary students’ intuitive conceptions of technological systems, and discuss the pedagogical implications of this work, relative to the literature on conceptual change approaches to science and technology education.
The Québec Education Program (QEP) is a competency-based curriculum divided into six Subject Domains, with Mathematics, Science, and Technology being one of them [
1]. Each subject has competencies that must be developed by the students through Elementary and Secondary school. The discipline-specific and cross-curricular competencies aim to develop students’ intellectual capacities and appropriate social skills that will enable them to respond to complex changes in their environment [
1]. According to the QEP,
One aim of a competency-based program is to ensure that students’ learnings serve as tools for both action and thought, which is a form of action. Unlike a skill, which may be applied in isolation, a competency makes use of several resources and is itself used in fairly complex contexts.
The content for each subject area for each cycle is defined by the QEP and is used to develop the competencies. One of the major changes introduced by the QEP to the curriculum of the science program was the introduction of technology education—to prepare students for modern society [
3,
4]. In fact, all of the compulsory science programs from Secondary One through Secondary Four are now named “Science and Technology”. The QEP emphasizes that science and technology are intimately intertwined in the modern world and due to their intricate connections, it is not easy to draw concrete boundaries between the two domains [
3] (p. 1).
Incorporating technical education into general education was part of a world-wide trend through the 1980s and 90s, supported by United Nations Educational, Scientific and Cultural Organization (UNESCO). Both the Canadian Council of Ministers of Education (CMEC) in their Common Framework of Science Learning Outcomes K to 12 as well as the American Association for the Advancement of Science (AAAS) in their landmark publication, Project 2061, strongly influenced the writing of the Science and Technology programs of the QEP. Prior to this movement, students who pursued technical education were directed to the workplace and those in general education, to higher education [
4]. Using technology to teach science is well-researched—showing that technology-centered classrooms, can lead to effective science learning [
5,
6,
7,
8,
9,
10]. Engineering design is a key theme of QEP technology content [
1]. Prior to the introduction of the QEP, all Secondary Three (grade nine) students took Introduction to Technology (ITT) [
3]. Students worked in a woodworking lab developing engineering designs and building models. The QEP Science and Technology programs specifically integrated the essentials of ITT [
11]. An integrated approach to teaching Science, Technology, Engineering, and Mathematics (STEM) is central to the QEP curriculum [
12]. The STEM approach emphasizes the development of competencies related to mathematics, science, and engineering-based technology to develop students’ scientific reasoning, critical thinking, and conceptual understanding by engaging in experimental inquiries [
3]. Such inquiries encourage students to test their ideas by developing investigable questions, using organized observation, and devising procedures for their investigations. Through this process, they are expected to develop the skills to interpret and analyze their observations while drawing on logical arguments, when appropriate [
3]. Furthermore, the STEM related competencies focus on “discerning patterns and relationships” in the data to understand the evidence that they collect.
The QEP highlights the relevance of science, technology, and mathematics to the evolving needs of society and the ways in which these fields have shaped modern society [
5]. The QEP illuminates the common elements in these subject areas which focus on developing students’ understanding, critical thinking, analytical reasoning, inquiry competency, and communication skills [
3] (p. 186). Moreover, cultivating students’ imagination, creativity and a desire to explore and discover is also emphasized as a significant element of STEM subjects. As explained in the QEP, scientific and technological literacy would enable youth to use scientific knowledge and skills appropriately and productively in their professional and personal lives. Schools are seen as key sites for developing students’ abilities to achieve this key goal of public education in Canada [
3].
The QEP Science and Technology program encompasses five scientific disciplines (chemistry, physics, biology, astronomy, and geology) and “various technological fields (e.g. mechanical design, medical, food and mining technology) studied in the context of cultural references” [
3] (p. 225). This curriculum focuses on the following key competencies at the Secondary Cycle One level (grades seven and eight): (1) “Seeks answers or solutions to scientific or technological problems,” (2) “Makes the most of his/her knowledge of science and technology,” and (3) Communicates in the languages used in science and technology.” The first competency focuses on developing students’ inquiry skills as they actively engage in the process of asking questions and exploring possible solutions through “observations, hands-on activities, measurements, construction or experimentation, be it in a lab, in a workshop or in the real world” [
3] (p. 226). The second competency focuses on the application of knowledge, particularly in real life situations. The students develop a deeper understanding of scientific concepts and technological models by analyzing how technical objects work [
3]. The ability to effectively interpret and communicate scientific and technological knowledge using appropriate language is intimately connected to these competencies
Engineering-based technology provides a useful context for applying content knowledge as students engage in analyzing and designing complex systems [
13,
14,
15,
16]. Engineers are involved in such activities in real life settings when solving complex technological problems, improving manufacturing processes, building infrastructure, designing new devices (e.g., computers, electronic communication tools), and addressing socioenvironmental issues (e.g., waste and recycling management, public transit systems) [
17] (pp. 370–371). The essential concepts and progression of learning goals for engineering-based technology in the QEP for Secondary Cycle One (grades seven and eight) focus on (a) graphical language, (b) mechanical engineering, (c) materials, and (d) manufacturing. Students are expected to learn and to represent the design of a technical object and its functional components. Graphical language focuses on explaining “the operation of a simple technical object by drawing a diagram illustrating the active forces and the resulting motion” [
18]. Technical diagrams illustrate certain principles of simple machines (e.g., a lever or a wedge) and represent the construction of a technical object and the arrangement of its components.
Mechanical engineering for Secondary Cycle One focuses on forces and motion, technological systems, and engineering. Students are expected to learn about different types of motion, effects of a force, simple machines, different types of technological systems, key components of technological systems and their functions, and energy transformations in technological systems. Engineering includes basic mechanical functions of a technical object and motion transmission systems in technical objects.
In addition, students are expected to learn about different types of material resources, such as raw materials used in the industry, materials present in technical objects, the origins of these materials, and the tools that are used to manufacture technical objects. Understanding of the manufacturing process is also important for students at this level. For example, students should observe and critically analyze the structure of a technical object, the specifications involved in the design of that object, and its function in certain social, economic, and industrial environments. This process should enable the students to design and construct a prototype of a technical object or some components of that object [
16]. Research suggests that developing a deeper and more meaningful understanding of students’ scientific and technological concepts and processes requires an understanding of the conceptual models and resources that students bring to the science classroom. Below we discuss the literature on students’ intuitive and alternative frameworks, and their role in science learning.
2. Students’ Intuitive or Alternative Conceptions in Science
Researchers in all areas of science education have noted that students (and adults) often hold common sense beliefs that derive from their perceptual experiences and exploration of the physical world” [
19,
20,
21]. Through a “continuous process of interaction between their cognitive system and the physical and cultural environment, human beings instinctively develop their explanations of natural phenomena” [
22] (p. 553). Researchers argue that children’s ideas are based on general abstractions from common experiences. They use this contextual knowledge to develop explanations in certain situations and in response to particular questions or problems in everyday life [
23,
24,
25,
26]. Children’s intuitive or alternative conceptions tend to be very different from scientific conceptions and may often contradict the abstract scientific models [
27,
28,
29]. Research shows that students’ alternative explanations may persist even after students are exposed to the scientific models during formal instruction and continue to affect students’ science learning [
22,
23,
30,
31,
32,
33,
34]. Indeed, research indicates that deeply held intuitive or common-sense conceptions are fairly stable and cannot be completely replaced by the scientific conceptions through science instruction. Rather, alternative conceptions may co-exist with the scientific models [
28,
29,
35]. Dawson (2014) argues that learners may construct a “conceptual profile” which encompasses their alternative conceptions along with the scientific models [
35] (p. 389).
Ideas firmly held by students will directly impact science teaching and the ability of science instructors to help their students to develop a deeper understanding of accepted scientific models. At the same time, traditional science instruction tends to ignore students’ own ideas and beliefs and is mostly unsuccessful in developing a robust understanding of accepted scientific models [
36,
37]. Recognizing students’ common-sense ideas and the ways in which students use them to make sense of scientific and technological phenomena is of paramount importance in science education [
13,
38,
39]. Therefore, eliciting and attending to students’ alternative conceptions must be an integral component of science instruction.
Inquiry-based approaches to learning science encourage the learners to actively construct and apply scientific knowledge through problem-solving [
40]. In this process, students construct new scientific knowledge by assimilation—adding ideas to their existing framework—or accommodation—restructuring their cognitive frameworks to make sense of and integrate the new concepts [
41]. Thus, it is particularly important for students to examine and compare their own models vis-à-vis the accepted scientific models that they learn in school [
28,
29,
35,
38]. Scientific paradigms must be introduced carefully, especially in those instances where common sense beliefs are at odds with the scientific perspective [
42,
43]. As a consequence, it is vital that we provide teachers and curriculum developers with evidence of commonly held ideas. A variety of anthropological studies have attempted to develop an understanding of student viewpoints [
44], as well as a clear picture of the intersection between alternative conceptions and instruction [
45,
46,
47,
48]. Science teachers need to understand the student perspective before attempting to teach new scientific ideas. Research suggests that the most effective instruction is based on initial consideration of students’ prior conceptions, instructional goals, and careful alignment of pedagogical practice with those goals. Effectiveness of these instructional approaches can be determined through the use of conceptual assessment tools that are aligned to the instructional goals [
46,
49]. Eliciting students’ thinking through formal diagnostic testing or open-ended verbal and pictorial student descriptions can provide very useful information to science teachers how to inform their instruction. In this paper, we share a collaborative project that brought together science and technology teachers and consultants from three school boards and university researchers in Québec to develop assessment tools for use in local schools.
With the implementation of the QEP science and technology programs, many science teachers found themselves unfamiliar with how to integrate technology into the science curriculum [
50]. They needed ongoing professional training and support so that they could teach technology content and encourage their students to engage in technology and engineering design activities. The Québec Ministry of Education sponsored Centre de Developpement Pédagogique (CDP) and the English counterpart, Science and Technology Implementation Committee (STIC) provided teachers with activities so that students and teachers could work with technological objects that are familiar and relevant to students [
51].
The authors were engaged in a collaborative professional development project to support science and technology teachers and to connect research in science education with professional practice in schools in Québec. This project was unique as it was collaboratively developed by science and technology education consultants and university faculty from Francophone and Anglophone sectors in response to science teachers’ professional needs. Science teachers and consultants from three partner school boards (two Anglophone and one Francophone School Board) worked with faculty members from McGill and Université du Québec à Montréal over three years to achieve the following objectives: (1) Professional development of Secondary Cycle One (grades seven and eight) science and technology teachers to promote their students’ conceptual development, technology skills, and problem-solving competencies and (2) Development of appropriate assessment questions to identify students’ alternative conceptions related to science and technology concepts included in the QEP. The project team drew on current developments in science education research and practice to create assessment items and inquiry-based activities to foster students’ engagement and learning. The assessment tools were developed in French and English for teachers from Francophone and Anglophone schools.
Science teachers worked together, in collaboration with the research team, to study and adapt existing assessment items from various sources, such as the American Advancement of Science (AAAS) and other conceptual inventories focusing on different science concepts for instructional purposes. Other practitioners and researchers can access the assessment item bank and the prevalent alternative conceptions in science available on the AAAS site. The assessment items were organized in accordance with the Progression of Learning goals and the four Worlds (i.e., the Material World, the Living World, Earth and Space, and the Technological World) in the QEP. The Ministry of Education has organized the learning content included in the QEP for each school subject. Progression of Learning goals guide teachers’ instructional plans regarding the content that students are required to learn in a particular year. A distinctive feature of our project is that teachers and science education consultants from partner school boards played a key role in adapting existing, and developing new, assessment questions. The content validity of the questions was established by content experts in STEM disciplines. For example, scientists and engineers examined the questions relevant to their expertise in physics, chemistry, biology, technology, and earth and space science. Selected questions were also piloted by the teachers in their classrooms to elicit students’ thinking about different natural phenomena, to ascertain the readability level, and to gather students’ feedback on the clarity of the questions. The questions were further refined in light of this feedback. The questions were developed in French and English and addressed most of the essential concepts in science and technology included in the curriculum.
3. Methods
This paper presents selected technology assessment questions that teachers can to elicit their students’ initial understandings of principles of engineering and technical design and to plan their instruction in response to students’ alternative ideas. Notably, the development of technology items is an innovative contribution of this project. While the literature offers a vast amount of assessment items and conceptual inventories focusing on science (physics, chemistry, biology, geology, astronomy) concepts to diagnose students’ misconceptions and to inform science instruction, there is a dearth of appropriate and efficient assessment tools to examine and track students’ understanding of engineering and technology concepts. Science teachers often rely on rubrics to assess their students’ technology skills during and after instruction. It is essential to gain an understanding of students’ alternative ideas to effectively address their prior ideas through instruction. In this article, we share a set of questions related to specific technology concepts (e.g., forces and motion, simple machines, and technological systems) that were developed by practitioners and academics in science and technology education during our collaborative professional development model.
As noted earlier, the technology assessment items addressed common difficulties that the teachers and technology consultants had encountered while teaching technology concepts and skills to their students. More specifically, the distractors incorporated prevalent misconceptions of students which the teachers had discovered in their classrooms (all questions are in a multiple-choice format). The science teachers and consultants who participated in this collaborative project developed an efficient assessment tool using the multiple-choice format to elicit their students’ intuitive notions. They can use assessment items creatively in their classrooms. For example, teachers could initiate a discussion in the classroom to encourage their students to further explain their reasoning and to become aware of the ideas that they bring to the classroom.
Engineering and technology experts reviewed these assessment items to establish content validity. Furthermore, the project team reviewed, revised, and refined these assessment questions in several face-to-face meetings, item by item, with the aim of achieving consensus about these questions. The technological concepts in these items were aligned with the Progression of Learning goals in the science and technology curriculum in the QEP. Afterwards, all items from the consensus version were translated from English into French by a native French bilingual speaker who was a doctoral student at the Faculty of Education Sciences, Université du Québec à Montréal. The translations were reviewed by two technology education experts who were also bilingual speakers and had extensive experience of teaching science and technology in primary and secondary schools in Québec. The final translations were reviewed once again by the third author to compare and check for any discrepancies in the French and English versions. When differences were noticed, the most appropriate wording for the Québec context was jointly agreed upon by the third author and the technology education experts. The final version was then given to the project team teachers to examine the clarity and appropriateness of these items for secondary students.
The questions that are presented in this paper cover the topics of forces and motion, manufacturing, technological systems, and engineering. These items were administrated to Secondary Cycle One students via GoogleForm in selected public Francophone and Anglophone schools in Quebec. In total, the questions were answered by 126 students in grades seven and eight (37 Francophone and 89 Anglophone students). The technology items and students’ responses are presented below. Importantly, our analysis illuminates students’ intuitive reasoning in relation to basic technology concepts and problems. If these intuitive ideas are not probed and addressed upfront in the classroom, they can continue to interfere with students’ learning. We hope that science teachers and teacher educators can use these questions to elicit their students’ intuitive understandings of technology, to inform their pedagogical decisions to address intuitive or alternative conceptions, and to examine changes in students’ conceptions before and after instruction. These questions will also help teachers assess the ways in which students apply scientific concepts to solve technological problems.
5. Discussion and Implications for Pedagogy
Our analysis revealed that students had a number of alternative ideas about basic concepts of technology. For example, some students did not understand the difference between the objects that exist naturally and those that are designed by human beings. Furthermore, many students thought that only electronic devices, such as a smart phone, are technical objects, whereas commonly used technical objects in our daily lives are not considered technological products. It seems that students’ intuitive perception of technology is influenced by the pervasive use of electronic devices, as many students believed that technical objects need electricity. The majority of these students were intuitively able to understand and make correct predictions about the motion of gears. However, many students had alternative conceptions about the rotational speed of a gear set. While less than one-third of the students understood that the purpose of using different sizes of pulleys in a pulley system is to change the speed of the movement. Nevertheless, the majority of the students were not able understand the relationship between the pulley size and speed. At the same time, many students had alternative conceptions about the concept of mechanical advantage. The findings also suggest that students had difficulties in identifying the differences between different types of motion, such as rectilinear/translation motion and rotational motion. Science and technology teachers need to carefully consider these alternative conceptions while designing and teaching their lessons.
As noted earlier, based on the vast literature on children’s intuitive conceptions and conceptual change approach to science teaching, it is critically important for science educators to elicit and carefully consider the intuitive ideas and conceptual resources that their students bring to learning situations to construct meaningful science learning experiences for students. As diSessa points out, ignoring students’ conceptions and “sense of mechanism in instruction” creates an unwarranted wall between prior knowledge and scientific understanding,” which may lead to alienation of students [
23] (p. 206).
As discussed earlier, students’ existing conceptions seem to be fairly stable and may co-exist with the scientific models that they learn through formal science instruction. Mounting evidence for the co-existence of alternative and scientific conceptions suggests that “abandoning or altering initial conceptions might not necessarily happen during conceptual learning” [
38] (p. 57). Thus, instead of using the “conceptual replacement” approach, science educators need to focus on strengthening students’ understanding of accepted scientific models and supporting students in carefully considering and choosing contextually appropriate models to solve problems [
35] (p. 389). Dawson suggests that developing learners’ “metacognitive abilities” is key to this process [
35]. As Dawson explains:
. . . learners must be made aware that different interpretations of a situation may be possible. They then actively contrast different views by deciding what each would say about a set of phenomena, comparing these predictions and, where possible, testing them against actual outcomes. Importantly, this step is aimed at keeping the views differentiated, with the sphere of application of each being explored and practised. This step aims to develop the metacognitive abilities to select the appropriate view for the context, and inhibit any others, for, as Duschl and Hamilton (1998) concluded from their review of literature, from both the history and philosophy of science and from psychological perspectives, context is fundamental when one is considering new learning and its application.
The conceptual change model proposed by Posner and colleagues [
53,
54] also recognizes the resilience of children’s prior conceptions and focuses on meaningful changes in their prior conceptions by testing them while solving problems, thereby assessing the strengths and limitations of their intuitive conceptions in terms of learning the scientific conceptions, and applying the concepts to comprehend and solve problems. Thus, students must be consciously aware of their intuitive conceptions in the face of complex problem-solving challenges, and use the scientific models to explain, predict, and solve problems [
28,
34].
Building on this approach, Windschitl and colleagues recommend the model-based inquiry (MBI) approach to engage learners in sharing, testing, and revising their intuitive explanatory models through scientific inquiries [
55] (p. 941). The model-based inquiry approach focuses on encouraging students to examine their explanatory models based on evidence, assessing their models in terms of their explanatory adequacy and predictive power, evaluating these models using criteria such as accuracy and plausibility, refining and modifying the explanatory models, and using them to solve new problems [
55,
56]. Importantly, the model-based inquiry approach emphasizes deep connections between scientific models and processes and the nature of science [
57] (p. 42). Engaging students to deeply reflect on their intuitive understandings in relation to accepted scientific concepts may facilitate conceptual change. More specifically, during scientific investigations, students should be encouraged to challenge their intuitive ideas by testing their hypotheses, developing evidence-based explanations by carefully considering the data that they have collected, and deliberatively engaging with their explanations in relation to the accepted models [
58,
59,
60]. As such, authentic scientific and technology inquiries in school science can facilitate active construction and application of scientific knowledge, and also promote a meaningful “understanding of the nature of science” [
55] (pp. 944–945).
Several instructional strategies to promote conceptual change have been reported in the literature, such as discrepant events to expose the limitations of students’ existing models, problem-based learning approaches, and inquiry-based activities to foster student engagement in the active construction of their knowledge [
28,
34,
59]. Evidence suggests that active engagement of students in problem-based STEM inquiries is crucial for developing a deeper understanding of accepted scientific and technological models through inquiry, exploration, and application of knowledge [
37,
46,
61,
62,
63,
64]. Sanger and Greenbow (2000) conducted a study with introductory college chemistry students using the conceptual change model developed by Posner and colleagues to look at the impact of this instructional approach on students’ alternative conceptions about the flow of electrons in aqueous solutions of electrochemical cells [
65]. Students in the conceptual change instruction group were given the opportunity to discuss and test some prevalent alternative explanations about these concepts as well as the scientifically accepted explanation using experimental demonstrations. This study showed that the conceptual change instruction was effective in addressing students’ intuitive notions. Similarly, Weaver’s (1998) study with elementary and secondary students showed that collaborative hands-on experiments combined with dialogue, discussion, and deep reflection on learning can promote conceptual change. K–12, and even college students, face difficulties in distinguishing between pure substances, heterogeneous mixtures, or homogeneous mixtures [
66,
67]. González-Gómez and colleagues (2017) carried out a study with elementary students to investigate the efficacy of conceptual change and laboratory instruction on these intuitive ideas. Students’ intuitive models were elicited using a pre-test to inform subsequent instruction [
66]. An interactive presentation on these concepts was followed by a hands-on lab session in which students worked in small groups to classify various materials, prepared different homogeneous or heterogeneous mixtures classify, and recorded their observations. The teacher guided the students to compare their initial knowledge with scientific explanations. In this process, students recognized that they needed to adapt their intuitive conceptions to develop a coherent scientific model to understand the composition of matter. The researchers argue that the conceptual change instructional approach is useful in promoting the construction and application of scientific models. Thus, teachers need to carefully select effective interventions that address students’ alternative conceptions [
28,
63,
64].
Based on this literature and our work with science and technology teachers during this project, we share the following steps that teachers can use to foster their students’ engagement and learning in STEM. Teachers can use these assessment questions to inform instruction to facilitate the development of a deeper understanding of accepted scientific concepts in students. In particular, the intuitive conceptions that we discovered around technology, technical objects, and simple machines during this study provide useful information to teachers to develop and adapt specific activities to address their students’ alternative conceptions about these foundational technology concepts.
Elicit students’ prior knowledge and initial ideas about natural and technological phenomena.
Discuss students’ responses with them and probe their ideas further to encourage them to articulate and share their explanatory frameworks.
Encourage students to attend to each other’s ideas and explanations.
Choose appropriate inquiry-based activities to address students’ alternative conceptions.
Engage students in inquiries that encourage them to solve specific problems related to technological systems by asking questions, designing experiments to test their hypotheses, collecting data, and developing evidence-based explanations through making sense of data. For example, teachers can encourage students to work with actual technical objects and simple machines to identify their functional components, represent the organization and operation of different components through visual diagrams, analyze the effects of forces acting on different parts of simple machines, and look at the mechanisms that transmit motion.
Support students to compare their intuitive explanatory frameworks to accepted scientific and technological models.
Provide a wide range of opportunities in different contexts to encourage students to apply their emerging understandings of scientific and technological models.
Given the paucity of research on alternative conceptions of technology, this study has explored middle school students’ notions of basic technology concepts. Developing the assessment items to examine these foundational concepts entailed considerable effort on the part of the project team. Therefore, we were not able to explore advanced technology and engineering design related concepts. We only used the multiple-choice assessment questions in this study due to time and curricular constraints in science classrooms. Other creative assessment strategies, such as students’ drawings, demonstrations, and think-aloud interviews with individual or small groups of students were not employed. It is important that future studies investigate the sophisticated and complex concepts included in the technology curriculum. Science educators and researchers can work collaboratively to develop a comprehensive tool using different assessment formats to explore students’ ideas about all the technology concepts that are included in K–12 science curricula. Future research also needs to focus on the effectiveness of interventions that target technology and engineering concepts.