Next Article in Journal
The Irrecoverable Loss in Sleep on Weekdays of Two Distinct Chronotypes Can Be Equalized by Permitting a >2 h Difference in Waking Time
Next Article in Special Issue
Educational Case Studies for Pilot Engineer 4.0 Programme: Monitoring and Control of Discrete-Event Systems Using OPC UA and Cloud Applications
Previous Article in Journal
The Effects of a Natural Polyphenol Extract from Sugarcane (Saccharum officinarum) on the Growth, Survival, and Feed Conversion Efficiency of Juvenile Black Tiger Shrimp (Penaeus monodon)
Previous Article in Special Issue
EXPLORIA, STEAM Education at University Level as a New Way to Teach Engineering Mechanics in an Integrated Learning Process
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Systematic Review on Design Thinking Integrated Learning in K-12 Education

School of Information Technology in Education, South China Normal University, Guangzhou 510631, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(16), 8077; https://doi.org/10.3390/app12168077
Submission received: 12 July 2022 / Revised: 8 August 2022 / Accepted: 8 August 2022 / Published: 12 August 2022
(This article belongs to the Special Issue STEAM Education and the Innovative Pedagogies in the Intelligence Era)

Abstract

:
Design thinking is regarded as an essential way to cultivate 21st century competency and there has been a concomitant rise of needs and interest in introducing K-12 students to design thinking. This study aimed to review high-qualified empirical studies on design thinking integrated learning (DTIL) in K-12 education and explore its future research perspectives. After a systematic search in online database via a keyword search and snowballing approach, 43 SSCI journal papers with 44 studies were included in this review. The results indicate that: (1) There has been a growing popularity of integrating design thinking into K-12 education over the past decade, and most empirical studies target middle school students with small group size and a short period; (2) Studies tend to pay more attention to STEM related curriculum domains by incorporating non-unified design thinking models or processes, and the core concepts of design thinking in K-12 education have been frequently valued and pursued including prototype, ideate, define, test, explore, empathize, evaluate, and optimize; (3) The mostly evaluated learning performances are design thinking, followed by emotional/social aspect, subject learning performance and skill. For evaluation, qualitative assessments are used more frequently with instruments like survey/questionnaire, portfolio, interview, observation, protocol analysis, etc. (4) interventions with non-experimental study, formal classroom setting, collaborative learning, and traditional tools or materials have been mainly applied to the open-ended and challenging activities in real situated DTIL. Overall, the 43 papers suggest that design thinking shows great educational potential in K-12 education, however, the empirical evidence that supports the effectiveness of DTIL is still rather limited. Research gaps and future directions derived from reviewed papers are also discussed.

1. Introduction

Originating from design field, design thinking has attracted considerable interest from practitioners and academics alike, as it offers a novel approach to innovation and problem-solving [1,2]. In the artificial world, design plays an indispensable role in the progress of human society by realizing “the transformation of existing conditions into preferred ones” [3]. In the field of design, design thinking is associated with the understanding of expertise in design, such as what constitutes expertise in design, and how to assist novice students to gain that expertise so that they can become expert and outstanding designers [4]. According to Jonassen’s typology [5], design problems are usually among the most complex and ill-structured kinds of problems that are encountered in practice. Therefore, with their creative ways of solving problems, expert designers are seen as one group of innovative problem solvers, then they and their thinking have something important to offer for wider areas [1].
As an innovative problem-solving method, the concept of design thinking has gradually expanded from a professional concept to a more general one. Nowadays, “Design Thinking” is identified as an exciting new paradigm for dealing with problems in many sectors such as IT, Business, Education and Medicine [6]. Practitioners and researchers have put forward their views on design thinking. For example, in the fast-moving world of business, design thinking is defined as “a discipline that uses the designer’s sensibility and methods to match people’s needs with what is technologically feasible and what a viable business strategy can convert into customer value and market opportunity” [7]. A similar definition was proposed by the Kelley brothers, in which design thinking is seen as “a way of finding human needs and creating new solutions using the tools and mindsets of design practitioners” [8]. Researchers also explore design thinking’s role and teaching in school. According to [9], design thinking is rooted in abductive reasoning and is the next competitive advantage. Some researchers in this cluster advocate that design thinking could (and should) be learned and adopted by non-designers [2]. For this reason, there is a growing interest in teaching design for business or management settings [1,10].
In addition to being valued in the adult world and higher education, design thinking has also been introduced into K-12 education as an innovative teaching approach [11]. K-12 is an American expression for kindergarten to 12th grade school students. For younger students, design thinking is usually introduced by integrating with other subjects, such as science, engineering, technology, STEM, etc. [11,12,13,14]. Consequently, rooted in design thinking, design thinking integrated learning (DTIL) refers to a new paradigm in non-professional design fields that aims to develop students’ innovative problem-solving ability through design practice [15,16]. Through DTIL, students are expected to develop practical and thinking abilities, as well as domain knowledge. Moreover, design thinking is applied to prepare students for their future life and career by fostering competences such as creativity, collaboration, communication, and critical thinking, or the so called 21st century skills [16]. To help students better engage in the design thinking process and understand the core tenets of design thinking, more profound, different design thinking models are employed. Typical models, like the Stanford d.school’s five iterative stages (Empathize, Define, Ideate, Prototype, Test) [17], the IDEO process model (Discovery, Interpretation, Ideation, Experimentation, and Evolution) [18], the four-step Double Diamond model (Discover, Define, Develop and Deliver) [19], etc., have been adopted in education.
Overall, as an innovative methodology, design thinking has been employed within an extensive field as high-leverage practice and K-12 education is no exception. However, there are also some persistent questions, such as the “design-science gap”, whereby projects focus more on building successful design products rather than on the learners and relevant scientific principles [20,21,22], and the question of whether design thinking training can really boost creativity, or just generate unfounded confidence not accompanied by real gains in creativity [23]. More evidence using empirical research is required to show whether ‘design thinking’ is an effective approach for K-12 education and how it is applied in the teaching context. Therefore, a systematic literature review is needed to present the current research status of design thinking in K-12 education.
Some researchers have synthesized the work related to design thinking. Razzouk and Shute [16] identified the features and characteristics of design thinking and discussed its importance in promoting students’ problem-solving skills in the 21st century. By referring to the processes and methods that designers use to approach problems, a design thinking competency model was constructed, but the search in their review was not limited to experimental studies. Micheli et al. [2] concentrated on design thinking in management discourse, by reviewing the knowledge and conceptualizations of design thinking, they identified 10 principal attributes, including abductive reasoning, ability to visualize, blending analysis and intuition, creativity and innovation, gestalt view, interdisciplinary collaboration, iteration and experimentation, problem solving, tolerance for ambiguity and failure, user-centeredness and involvement. Besides, eight tools and methods of design thinking were summarized. Zhang, Markopoulos and Bekker [12] presented a review of literature that referred to K-12 children’s emotion while involving in design related learning activity. Rusmann and Ejsing-Duun [11] summarized the design competence framework in the K-12 school context: reasoning, problem setting, empathy, ideation, modelling, and process management, among which, the skills of reasoning and process management were stated to be needed at every step of the design process. But they did not assess the quality of the reviewed papers and included both review articles and primary theoretical or empirical studies.
Considering these limitations, our study aims to systematically review DTIL research in more detail than previous reviews. In particular, our review focuses specifically on the empirical studies that apply DTIL for the educational levels from kindergarten to secondary education (K-12). The purposes of this study are: (1) to systematically review high-quality empirical studies on DTIL in K-12 education, and (2) to explore future research perspectives of design thinking based on the reviewed papers. The following research questions (RQ) formed the basis of this review:
RQ1:
What is the current research status of DTIL in K-12 education?
RQ2:
What kind of curriculum domains are taught in DTIL?
RQ3:
How to evaluate students’ learning in DTIL?
RQ4:
What intervention approaches are employed in DTIL?

2. Method

In order to conduct a reliable systematic review on this topic, we followed the three-stage guideline provided by Tranfield et al. [24]: stage I—planning the review, stage II—conducting a review, stage III—reporting and dissemination. Additionally, in stage II, we mainly used the snowball method [25] to select relevant studies.
Under stage I, as discussed in the previous section, we identified the need and goal of this review based on the scoping study surrounding the field.
Under stage II, to select useful and high-quality papers, we performed a keyword search in an online bibliographic database ISI Web of Science. The main reasons for selecting this database were: (1) to retrieve authoritative research articles that were of sufficiently high quality for analysis, (2) to draw more representative and reliable conclusions of this systematic literature review.
After the initial search, we utilized a snowball method [25] using the references in the selected articles before 14 March 2022 to search more literature. A snowballing approach refers to using the reference list of a paper or the citations to the paper to identify additional papers for a literature review [25]. The following inclusion criteria were used to select papers:
(a)
Full peer-reviewed English paper published in SSCI journals.
(b)
Empirical study conducted for K-12 students, the term “empirical study”, which means either quantitative or qualitative, and not a literature review, framework, or proposal.
(c)
Papers involved in DTIL (using “design thinking” in any part of the paper, such as title, abstract, keywords, or main text).
(d)
The DTIL featured in the study targets students rather than pre-service/in-service teachers.

2.1. Keyword Search

Considering searching for relevant and mainstream papers that lie within the scope of this study, we used representative search terms to capture articles in the field. The keywords consisted of two clusters: design thinking and K-12. We adopted the keywords such as K-12, middle school, high school, and children, etc., to ensure that the target age levels of this study could be obtained. Initially, we used the search string “design thinking” AND (K-12 OR K12 OR middle school OR high school OR secondary school OR primary school OR elementary school OR kindergarten OR preschool OR children OR child) to identify SSCI journal papers in the ISI Web of Science. The results returned 99 papers. We quickly analysed the titles, abstracts, and methods sections of these papers with reference to the above four inclusion criteria. As a result, 27 papers were left.

2.2. Snowball Approach

After finishing the keyword search, we employed the first-round snowballing approach with the 27 papers as seeds to search papers in the ISI Web of Science. A total of 1485 references from backward snowballing and 236 citations from forward snowballing (a total of 1721 papers) were found. Using the above four inclusion criteria, 12 new papers were selected.
In the second round, 12 papers were identified as new seeds for the snowballing approach from the results of the aforementioned searches. A total of 703 references from backward snowballing and 123 citations from forward snowballing (a total of 826 papers) were examined. As a result, three new papers were singled out.
We then launched the third-round snowballing approach. This time three papers were used as new seeds and we retrieved 186 papers (173 references from backward snowballing and 13 citations from forward snowballing). Only one new paper was selected for review.
At the end, the fourth-round of snowballing was conducted, and no more papers were found, thus the iterative process of snowballing approach could be ended.
After four rounds of the snowballing approach, as depicted in Table 1, 43 papers were selected as samples for the subsequent literature review.
Under stage III, to compare the features of the sample papers, a coding form was created (see Table A1 and Table A2 in Appendix A). To address the above four research questions, information on the author, publishing year, educational level, sample size, duration, subject, and the implemented design thinking model is presented in Table A1. Table A2 summarizes each study’s research design, course type, group size, design task/challenge, learning tools/materials, dependent variable, and evaluation instrument. The coding of the papers was initially done by one author, another author was responsible for checking, and the two authors studied together in ambiguous cases. Finally, the coding was analysed to draw conclusions.

3. Results

3.1. What Is the Current Status of DTIL in K-12 Education?

3.1.1. Distribution of Articles on Design Thinking over Time

The yearly publication distribution of the 43 articles on empirical studies on design thinking illustrated in Figure 1 reveals an upward trend from 2010 till now, consistent with the growing popularity and importance of design thinking [2]. Although we did not limit the publication period of papers in the literature retrieval process, in the K-12 education context, design thinking has attracted increasing attention since about ten years ago. Specifically, only 2 (4.7%) of the 43 papers were published before 2015, and related research has increased year by year. Especially, after 2017, it shows a steady upward trend, and subsequent years’ publications peaked in 2021 (12 or 27.9%).

3.1.2. Sample Group Level, Size, and Duration

Considering one paper included two experiments, we identified a total of 44 studies from the 43 papers. Figure 2 shows the results for the different categories of educational levels. Researchers conducted studies across various educational levels. In total, design thinking in the middle school setting accounted for the largest proportion (23 or 52.3%), or more than half of the reviewed studies. There were 10 (22.7%) studies for elementary school students, seven (15.9%) studies for high school students, two (4.5%) for kindergarten children, and two (4.5%) studies for mixed level students; one is mixed with kindergarten and primary school students, another is middle and high school across categories.
Among the 44 empirical studies, 43 mentioned the number of participants. Nineteen (44.2%) of the papers were for studies that recruited less than 40 participants (see Figure 3). Only 11 (25.6%) of the papers involved more than 100 participants. This indicates that the sample sizes were not large in the K-12 educational research of design thinking. Promisingly, three papers distanced themselves from a small sample size: [26] surveyed 613 high school students who experienced a 16-week engineering design training course; [27] collected data from 576 children that participated in STEM Learning via 3D technology-enhanced makerspaces; [28] analysed data from 350 eighth and ninth graders.
Among the 44 studies, 38 reported duration of the research on design thinking. As can be seen in Figure 4, the largest proportion of studies (9 or 23.7%) were conducted over a duration less than one month. While the second largest proportion of studies (8 or 21.1%) lasted for less than 2 months. Besides, five (13.2%) of the studies were one-off tasks, which lasted for less than 1 day. Only four studies were conducted for more than 6 months. Overall, the duration of most studies was comparatively short (i.e., typically for one semester).

3.2. What Kind of Curriculum Domains Are Taught in DTIL?

3.2.1. Distribution of Studies on Curriculums

We examined the curriculum domains of the reviewed studies. Overall, there were four main categories of curriculum domains involved in the research, including STEM-related, design-related, non-STEM multidisciplinary and other curriculums. As shown in Figure 5, among the 44 studies, 41 reported the subjects or curriculums, and science (11 or 26.8%) was the subject/curriculum matter most often researched, followed by STEM/SETAM in eight (19.5%) studies, and engineering in seven (17.1%) studies. Five (12.2%) studies covered multiple disciplines (non-STEM), three (7.3%) studies mentioned design related subjects/curriculums, such as design, design and research, design, and technology. The technology curriculum also had three (7.3%) studies. And the number for the remaining four curriculums was one (2.4%), including science and engineering, technology and engineering, robotics, and geography. Overall, subjects or curriculums related to STEM, such as Technology and engineering (1), technology (3), STEM/STEAM (8), science and engineering (1), science (11), robotics (1), engineering (7), accounted for the largest proportion (32 or 78.0%). In other words, in the K-12 educational context, design thinking was mostly integrated with STEM/SETAM subjects or curriculums. To compare the application of subjects by different educational levels, the number of empirical papers is shown in Figure 6. This shows that engineering was most popular in the high school level, while science was most popular in the middle school and elementary school levels. Engineering and STEM were applied in kindergarten. STEM/STEAM was applied in the two mixed level papers.

3.2.2. Design Thinking Model Implemented in the Empirical Studies

Among the 44 studies, 37 mentioned the design or design thinking phases or elements. The authors described design thinking in different ways and associated a variety of attributes with the concept, and different terms and sequences of action were also employed [2]. Thus, models varied in the sample of empirical studies. For example, the typical five-stage model proposed by Stanford was adapted to integrate within the K-12 educational context (7 or 18.9%), see for example [29,30,31,32,33]. Some studies drew on other design thinking models, such as the model proposed by IDEO, see for example [27].
There also existed varied vocabulary in expression of the models [11]. For example, prototype was expressed in words as “modelling”, “making”, “create”, “producing”, “building”. Ideate was also described by “brainstorming”, “develop possible solutions”, “generate design ideas”, “product ideation”, etc. Define also meant “clarify problems and constraints”, “identify problem”, “understanding and defining the problem”, “Understand” etc. It was not easy to identify all the models that applied. Despite this, some elements among these were employed more regularly, suggesting a level of concurrence [2]. Therefore, we summarized the mostly mentioned design thinking competences in the selected studies, including prototype, ideate, define, test, explore, empathize, evaluate, and optimize. Explanation and codes are also listed (see Table 2).

3.3. How to Evaluate Students’ Learning in DTIL?

3.3.1. Dependent Variables

All the dependent variables assessed across all the studies are included in Table 3. The measured competences mainly covered four aspects of students’ learning in the DTIL context: subject learning performance, design thinking, emotional/social aspect and skill. (1) Subject concepts like scientific knowledge (e.g., [34,35,36,37]) were discussed. (2) The design thinking concept, such as the understanding of design thinking (e.g., [35,38,39,40]), and design thinking practice, such as the design thinking process (e.g., [21,26,31,41,42,43,44,45,46]) or the design thinking work (e.g., [31,43,45,47,48,49]), were assessed. (3) Emotional/social aspects, like attitude, desire, engagement, or collaboration, etc, were tested in some reviewed studies (e.g., [27,49,50,51,52]). (4) Other skills, such as creativity, productive thinking, problem solving, and critical thinking, were also evaluated (e.g., [23,26,29,34,53,54]).
Among these dependent variables assessed (see Figure 7), 31 (or 70.5%) studies tested the design thinking, 17 (or 38.6%) discussed the emotional/social aspect, nine evaluated the subject learning performance, and eight tested skills (or 18.2%).

3.3.2. Evaluation Instruments

Despite the variability in students’ learning performance assessed for DTIL, multiple measurement instruments emerged from the literature, including the qualitative and quantitative assessment types. The results of each instrument were revealed in Figure 8. Among the 44 studies, 11 (25.0%) just adapted one kind of measurement instrument. Some employed more than one assessment instrument to collect multidimensional evidence of students’ learning performances. Thirteen (29.5%) used two measurement instruments, and twenty (45.5%) combined three or more evaluation methods.
For the measurement instruments, 23 (52.3%) of the studies adopted a survey/questionnaire for measuring the students’ learning performances in the design thinking integrated context, which is the one with the largest proportion (see Figure 8). The second-largest method adopted was portfolios (14, or 31.8%), followed by interview, observation, protocol analysis, and test categories, which all accounted for a frequency of 11 (25.0%). Next was design work evaluation and video recording, and the frequency was 10 (22.7%) for both. Audio recording (6 or 13.6%) and journal (5 or 11.4%) were also included in the measurement instruments. Explanation and examples are also presented in Table 4. Because some studies used a combination of evaluation methods, the sum of the numbers was greater than 44 (or 100%). Overall, qualitative measurement instruments were used more than quantitative ones.

3.4. What Intervention Approaches Were Employed in DTIL?

3.4.1. Study Design

According to the existing taxonomy framework [63], we divided the research designs of these empirical studies into three types: experimental (using random assignment), quasi-experimental (no random assignment but with a control group or multiple measures), and non-experimental (no random assignment, no control group or multiple measures). Among the 44 studies, most used a non-experimental design (31 or 70.5%) (see Figure 9). These studies usually presented one or more cases where an intervention was applied and measured student performance through various instruments. Seven (or 15.9%) studies used quasi-experimental designs, and six (or 13.6%) used experimental designs.

3.4.2. Course Type

Apart from some unclear research contexts, we summarize the course types from 40 studies. Results (see Figure 10) show that 34 (or 85.0%) studies conducted empirical research in the formal K-12 school courses, like the regular or elective courses offered during the conventional teaching schedule. Six (or 15.0%) were conducted in the informal course environment, for example, conducting the experiment during a period of school holidays [23], or the study was conducted as an afterschool program which was not applicable within the conventional school hours [37,53].

3.4.3. Grouping

Twenty-nine of the forty-four studies mentioned grouping in the empirical research. Four studies mentioned that students used group learning but did not specify the size: one study used both individual and collective design activities [64], and students in another three studies were organized in groups [48,55,57]. In the remaining 25 studies (see Figure 11), the group size varied in the research. Six studies employed a group size of 3–4 students per group [30,33,34,39,45,52], five employed a group size of three students per group [21,44,46,51,59], followed by four students per group (4) [29,50,54,61] and individual group (4) (e.g., [41,65]). Next was the size of 2–4 (2) [36,47]. There were also four studies with group sizes of 2–3 [62], 4–5 [38], 4–6 [58], and 5–6 [53], respectively.

3.4.4. Design Thinking Task/Challenge

The design tasks or challenges used in these empirical studies are summarized in Appendix A. It can be found that these tasks or challenges are usually real situated, open-ended, challenging, and cooperative.
On one hand, most of these design activities were based on authentic situations, which are close to the real-life experience of students. Challenges were carried out around topics related to social life, such as to identify and redesign systems that existed at school [38]; the design of an escape room for the local fire department to allow participants to playfully and interactively improve awareness of fire safety in and around the house [30]; working revolved around interviewing senior citizens and creating prototypes that met their needs on the background of the aging society [32]; to create a secure environment for the elderly without taking away their freedom [40]; or designing a heat retaining food container for street food vendors at a taxi depot [46]; designing a water filter system for the city’s wastewater management plant to help prevent the pollution of a local river [34]; to develop sustainable food products for peer group [55]; designing and constructing shoes [21]; the design theme on preventing bullying in the social context of the class [58]; or targeting on more local or social problems that could be solved with new products, services, or other solutions [33,50,66], etc.
On the other hand, for all design activities, there were no unified answers. Students were encouraged to design as many creative solutions as possible and choose the relatively optimal solution to solve the problem. Many tasks were engineering, such as the marshmallow tower activity and the trebuchet design activity [45], the design of toys [39,43], the engineering design activities of musical instrument, simple machines, and bio-inspired flower [47], or the design of water filters, bridges, circuits in maglev vehicles and windmills, and pollinators and knee braces [62], etc. In another study, students were asked to design a 3D model and print a 3D artefact [57].
In addition, the design activities were usually challenging and cooperative. The problems addressed by designers are wicked problems, such as the design of complex systems or environments for living, working, playing, and learning, and the wicked problems theory of design was explained in [67]. In school education, an important goal is to develop cooperative citizens, which helps to equip students with the ability to collaboratively solve wicked problems in social life. Therefore, to help students solve these complex and wicked problems, some activities were game-based and aimed to create interesting design situations for learners. Especially for the younger children, the fun of activity design is especially important. Thus, some activities were role-playing, such as the design of castle according to an imaginary engineering situation [64]; or storytelling, such as reading the narrative content of the books and solving the engineering problems presented in the books, and finally rewriting the story [52]. Others also employed computer games to study students’ learning based on the design process [60,68].

3.4.5. Design Tools and Materials

Among the 44 studies, 20 mentioned the design tools or materials used. Six provided students with conventional design tools or materials, such as paper, pencil, glue, tapes, scissors, etc., [36,42,44,46,50,51]. Specially, one of these studies employed a reverse engineering teaching context, in which students learned from already designed products rather than started from scratch [51]. By dissecting the product’s components and structures, it helps students understanding how those components function and work together, and then students can redesign or build their own product to properly solving a design challenge with micro-innovation or applying the scientific concept they had learned during the learning process.
Fourteen studies employed digital platforms as teaching aids of designing and making in the class. For example, some studies organized design activities with open-source hardware and software. Kim, Seo, and Kim [52] provided students with Arduino Leonardo-based device to solve the engineering problems, by which artifacts can be made through assembly of various blocks with sensors and actuators, and also be driven by the programming language based on Scratch and app inventor. In [49], Raspberry Pi with programmable microelectronics, adapted versions of SNaP and Tiles toolkits, and Google’s Design Sprint Kit techniques were combined to help IoT design across generations. Another platform, such as the mobile telepresence robot called KT, which is controlled over the internet through a web interface, was used to design human-centred robots that served a need in the local environment and allowed remote peers to explore the local spaces [61]. Christensen et al. [40] also explored middle school students’ design literacy who had experience with digital technology in maker settings (e.g., FabLabs).
Lin, Chang, and Li [31] studied virtual reality (VR) teaching application on engineering design creativity. In their study, the junior high school students experienced design teaching with VR devices used as teaching tools. The VR box (for a 360° view), zSpace built-in software Franklin’s Lab (for detailing motor operation), Cyber Sciences-3D (for explaining circuits), and Leopoly-3D (for modelling simulation) (created by zSpace, Inc., San Jose, CA, USA) were used to design an electric model vehicle capable of automatically avoiding obstacles.
There were other tools, meant for prototyping or concept understanding, for example, the 3D design and printing tools, that were employed in some reviewed papers. In [26], the design stage used computer-aided design to create a three-dimensional model of the toy. Forbes et al. [27] studied children’ STEM learning performance in 3D technology-enhanced makerspaces by using iPad and 3D design software and print device (Makers Empire, created by Makers Empire Pty Ltd., Adelaide, Australia). Leinonen et al. [57] discussed the digital fabrication in elementary school education. The 3D model design by Tinkercad software (created by Autodesk, Inc., San Francisco, CA, USA) and 3D artefact printing by Ultimaker printer were adopted to aid the design activities, such as designing and printing a name tag, a floor plan, and a game piece. In [43], the teacher explained the mechanical functions and STEM knowledge via physical and 3D virtual simulation models, and then in the inquiry experiment stage, students were asked to assemble the LEGO to design a movable toy with various mechanical structure types.
Besides 3D modelling tools, other design platforms were also employed. Four studies involved students in the poster design activities, and three of them used poster design games on computer [60,65,68], while another one used WPS Writer® to complete the new year poster design [48].
A tool dedicated to assisting design communication was also mentioned. Won et al. [56] reported on the ways that middle school students appropriated a social networking forum (Edmodo) as a part of the iterative design process in an informal learning environment. In their study, the forum was utilized for the purpose of collaborative design by interaction in progression of the design process.

4. Discussion

4.1. The Current Status of DTIL

4.1.1. Research Trend

Among the selected 43 empirical papers, most were published after 2017 and most (12) in 2021 (see Figure 1). It was concluded that the growing trend of high-quality empirical studies on DTIL in K-12 education was significant in the past five years. “The proper study of mankind is the science of design, not only as the professional component of a technical education but as a core discipline for every liberally educated man” [3]. According to the rapid development of empirical research, we can predict that more evidence-based research will focus on this topic in the future, and the potential value of design thinking in K-12 education will be further explored.

4.1.2. Educational Level

Considering the uneven distribution of the age groups in K-12 education, more research is needed to engage the younger (like kindergarten and primary school students) and older learners (high school students) into DTIL. As shown in Section 3, the research covered students of all levels in K-12 education, aged between 3 and 18 years. Students from kindergarten to high school were all involved, and among them, the papers studied middle school students’ learning accounted for the largest proportion (23 or 52.3%). It shows that the distribution of existing studies was uneven across educational levels. As a methodology for innovative problem solving, the design thinking intelligence is not necessarily something that comes naturally, it needs to be nurtured and developed in pedagogical approach. According to [69], design must be nurtured from early beginnings, as building design capital is a visionary and long-term job. Wells [70] also pointed out that, similar to language learning, design thinking is something that should be carefully nurtured from an early age and be included in all areas of education. However, in comparison with the studies conducted in university or other adult learning scenarios, there is still a lot of room for research in K-12 education.

4.1.3. Samples and Duration

Among the 44 studies extracted from the 43 papers, many selected small samples or short periods to carry out the empirical research. The reason may be that the activities integrating design thinking had higher requirements for teachers and students. First, teachers need to spend more time preparing various sources for class teaching, such as the design tools and materials. Second, during the lesson, support and guidance are required for student activities. Especially in the hands-on activities, teachers are also concerned about the safety of their students. Third, the diversification of evaluation, such as the evaluation of the design process and design works, also requires teachers to spend more time on observation, interviews, surveys, etc., to obtain and analyse multi-dimensional learning data. The limited energy of teachers makes it difficult to carry out large-scale class teaching for a long time. Fourth, for students, the design thinking tasks are usually more challenging, which require a longer cycle to constantly iterate and optimize.
However, for DTIL in K-12 education, empirical studies with longer periods and larger samples are still expected to provide more sufficient and convincing evidence to demonstrate the application effect. Despite the difficulties, researchers and teachers could try to solve these problems with relevant technologies, thereby expanding the sample size and extending the experimental period. For example, teachers could try to use intelligent teaching assistants to assist in monitoring students’ learning, real-time feedback and forewarning of learning, etc., so that they can better communicate with students, guide them according to students’ needs, and realize personalized teaching. Students could use intelligent technologies such as intelligent learning partners to carry out learning, reduce their learning burden and increase their interest, so that they can actively participate in longer-term learning activities. In addition, multiple subjects are encouraged to participate in teaching and research related to DTIL in K-12 education. In addition to research institutions (e.g., university), K-12 schools, and government departments, more social forces are also expected to join, such as communities, science and technology museums, enterprises, etc., to jointly provide support for DTIL, thus ensuring larger scale and longer cycles teaching practice.

4.2. Curriculum Domain in DTIL

4.2.1. Curriculum

More research is needed to explore the integration of design thinking with single or multiple disciplines from a wider subject range. As the social movement of design thinking has called for the involvement of design thinking into K-12 classrooms, we put together the disciplines mentioned in the reviewed empirical studies. The results revealed that the implementation of design thinking in non-design classrooms is increasingly concerned. Although design thinking by its nature originated from design field in an effort to encourage people to think and practice like an expert and prepare future designers [70], it is now become a simplified version of “designerly thinking” or a way of describing a designer’s methods that is integrated beyond the design context [7,9,15]. In addition to design-related courses, most researchers employed the design thinking integrated teaching and learning in the STEM related subjects, such as science, STEM/STEAM, engineering, technology, etc., which is consistent with previous findings [11]. While other researchers have extended design thinking to non-STEM subjects, such as geography [38]. This has a lot to do with the rise of STEM education in recent years. There is societal recognition of the role played by STEM education in preparing students for college and career readiness, and design challenge exactly provides a pathway for the STEM disciplines to work together [14]. Additionally, it has adopted the stance that design and technology should be embedded in various school subjects [71].
How is design thinking integrated into these curriculums? Despite the differences in the curriculums themselves, there are some common threads of DTIL. First, for the purpose of DTIL, it mainly responds to the need for interdisciplinary and innovative talent cultivation in the age of intelligence. Therefore, design thinking is integrated by enabling students to learn and connect multidisciplinary knowledge and skills via involving the design process/skills. Second, for the learning content, it is usually embedded inside the open-ended and authentic problem context, in which students’ learning content stems from real life, not those hypothetical questions. That is, the integration of design thinking provides ideas for the reframing of teaching content or topics. Third, for the organization of learning, the curriculums adapted DTIL are characterized by student-centred and co-creative. Teachers act as coach to enable active learning, while students can communicate and collaborate with peers and even with stakeholders so that be able to solve problems creatively.

4.2.2. Design Thinking Model

The design thinking models should be aligned with the complex teaching situations. It was found that the core concepts of design thinking are valued and pursued in the field of K-12 education. However, in terms of the design thinking model, there is no panacea for all situations, that is, there is no unified framework or process in academic. For example, when talking about the design process and characteristics of a certain design activity (e.g., the technology and engineering design), it does not mean that there is just one process [14]. Researchers have also pointed out that if teachers rely too much on the confined procedural, pre-determined process structure, it may strangle the qualitative forms of intelligence inherent in design thinking [70]. In fact, in the human-made world, different fields or disciplines have their applicable design processes, the process of design thinking is surely not deterministic [44]. Therefore, the key ideas of the existing studies for design thinking provide a foundation for understanding the capabilities related to design. On this basis, teachers can adjust the design thinking model reasonably according to the actual situation.
In this study, based on the evidence of the reviewed empirical papers, it reveals that the highly concerned aspects of design thinking are the following: prototype, ideate, define, test, explore, empathize, evaluate, and optimize. These key elements provide a holistic outline for students to solve problems with design thinking. Overall, the results of this study are consistent with previous studies. For example, ITEEA [14] elaborated eight key ideas of design in the PreK-12 technology and engineering education, including a fundamental human activity, open-ended and can always be improved and refined, iterative, a range of skills, universal principles and elements, making, optimized by criteria and constraint, and diversity of approaches. In [11], design thinking in the K-12 educational context was noticed, and they organized the multiple codes of design thinking competences into six areas, including reasoning, problem setting, empathy, ideation, modelling, and process management.

4.3. Learning Evaluation in DTIL

4.3.1. Dependent Variables

Knowledge, skills, and dispositions are all covered by the dependent variables reported from the reviewed papers. For example, the existing empirical studies measured students’ knowledge of relevant subject concepts, e.g., physics concepts of acceleration, Newton laws of motion, velocity, motion, energy, etc., [37], or the understanding of the mechanical concepts [43]. Some studies also checked students’ understanding of design thinking (e.g., [39]). Various skills, like creativity, productive thinking, problem solving, and critical thinking, are evaluated as crucial learning effects. Except for the concepts and skills, students’ performance on design thinking practice (including the design process and design work) has been paid close attention, and it is the most frequently evaluated one. This exactly confirms the practical orientation of design, or the non-verbal competence [15] that is required. Besides, many studies surveyed students’ dispositions, as there exists a bi-directional relationship between emotion and design-based learning [12]. To sum up, in the DTIL context, design thinking is considered in many studies as both a dependent variable and partly as an independent one. Results of the learning effects indicate optimistic learning outcomes of students; additionally, the competences cultivated by the design thinking activities were often associated with the 21st century skills, like communication, collaboration, creativity, and critical thinking [11,27,29,40].

4.3.2. Evaluation Instruments

Considering the benefits of applying design thinking into other subjects, more objective and apt evaluation instruments need to be developed to emphasize the alignment between design thinking competences and domain knowledge. The evaluation instruments used in the existing empirical studies include survey/questionnaire, portfolio, interview, observation, protocol analysis, design work evaluation, test, video recording, audio recording, and journal. Qualitative and quantitative assessments are both included, and the qualitative assessments are used more frequently. However, it was found that most of them were self-designed measures, such as portfolio, survey, interview, observation, design work evaluation. These assessments were highly subjective. To better serve the trending integration of design thinking into STEM and non-STEM subjects in K-12 education, it calls for more objective and apt design thinking-embedded evaluation instruments that evaluate comprehensive performance for researchers and educators to adapt in their interventions or classrooms. Researchers have pointed out the shortcomings of current evaluation methods, for example, Blom and Bogaers [46] indicated that current verbal protocol analysis methods and theoretical frameworks did not explain how internal and external information sources contribute to novice designers’ moment-to-moment thought processes, and they employed a protocol analysis method—Linkography—to investigate the nature of novice designers’ thought processes. Furthermore, given that DTIL is usually suggested to be involved in the complex problem-solving situations, more timely evaluation and feedback are needed to help students gain a better learning experience. In the era of intelligence, there is also an urgent need to explore assessment supported by various intelligent technologies.

4.4. Interventions in DTIL

4.4.1. Study Design

Most of the studies tended to report the DTIL via non-experimental case study in K-12 context [16], the number of which far surpassed that of the quasi-experimental and experimental studies. In the educational context, samples were usually restricted by the original class settings, therefore, it was relatively more difficult to carry out rigorous experimental research that emphasizes the randomization of samples. In this instance, the application of case studies does have value and facilitates the introduction of concrete practical experiences. However, the problem that ensues is the difficulty in identifying the certain competences can be developed by participating in design thinking integrated activities [11], so that a compromise approach is to conduct quasi-experimental study design. According to [63], a study with no random assignment but a control group, multiple measures can be classified into the type of quasi-experimental design to examine whether such a design thinking integrated intervention, as the independent variable, influences students’ learning, as the dependent variable. In the future, more rigorous research with quasi-experimental or experimental study design is needed to strengthen the learning effect verification.

4.4.2. Course Type

Most studies were conducted in a formal educational context (i.e., classrooms). The high proportion of studies conducted in the formal educational setting appeared to align with the move of involving design thinking into educational context. Besides, it is also consistent with the finding of large number of research conducted in standard courses, such as science, engineering, technology, etc., (see Section 3). In the future, more studies should be conducted for design thinking integrated interventions or activities applied in informal educational scenarios, such as the design workshops or makerspaces, so that it can be a complementary way to highlight the educational value of design thinking.

4.4.3. Grouping

Most research defaults to a collaborative learning approach to design thinking embedded activities. Collaborative learning has the potential to foster students’ understanding of various subject domains, help complex problem solving, and master social skills [58,72]. The group sizes typically employed were between two and four people and were usually randomly grouped or arbitrarily appointed by the teachers. It lacked detailed research to explain the specific reasons or rules. A few studies have looked at the impact of gender differences on design thinking embedded learning [31,34,37]. More in-depth studies are needed to explore applicative collaborative strategies, such as group size, grouping methods like role assignments, dynamic grouping or fixed grouping, gender combination, etc.

4.4.4. Design Thinking Task/Challenge

The design thinking embedded activities were usually comprehensive, transdisciplinary, and integrate a variety of learning methods, such as project-based learning [55], problem-based learning [21], inquiry-based learning [36], game-based learning [60], storytelling [64], etc. It was in line with the characteristics of transdisciplinary learning such as STEM. Additionally, process-oriented design (design-no-make) and product-oriented design (design-and-make) were both adopted to produce various creative solutions, object models, smart products, engineering devices, etc. For example, while involved in the activities of poster design [48,65], playground design [41,42], or the design of smart-things ideas for an outdoor park environment [49], students were encouraged to propose creative ideas to meet certain needs. When participated in the product-oriented design tasks, students were also required to construct artifacts, such as designing and constructing a device that was engineered to provide electricity to a third world community scenario [36]. Results of this study should inspire researchers and teachers to develop design thinking embedded activities that are reality situated, open-ended, challenging, and cooperative, to engage younger students to better develop their domain knowledge and thinking skills, activities that are fun and hand-and-brain on will be in greater need. In future, the integration of design thinking in project-based learning and STEM/STEAM education can be more diverse, and it would be more expected if it can be combined with local cultural characteristics. For example, in one study [73], the “Chinese Wooden Arch Bridges’ Intelligent Monitoring system “ project was developed to explore the integration of cultural education, scientific inquiry and design thinking. In this STEAM project, the integration of design thinking is believed to not only promote transdisciplinary learning, but also help cultural understanding and inheritance.

4.4.5. Learning Tools and Materials

The tools and materials employed are expected to help students formulate and express creative design ideas. For example, the design cards are convenient for students to sort out the design process and carry out reasoning [49]. The 3D design and printing platforms can help students design and visualize prototypes [27,57]. Conventional design and construct tools, as well as the digital fabrication kits, provide students with hands-on opportunities to materialize ideas. According to the reviewed articles, there were more applications of conventional tools and materials than intelligent ones. Researcher argued that the functions of design are making better what is inadequate and delivering a value that has not yet been delivered, thus technology is a key driver of the project as a whole and will play an important role in that [74,75,76], likewise, design can promote technological literacy. Future study could be conducted to further explore the technology-enabled design thinking activities in K-12 context.
Especially, in the emerging digital lean manufacturing paradigm [77], the advent of Industry 4.0 (I4.0) technologies such as Artificial Intelligence (AI), Internet of Things (IoT), Virtual Reality (VR), and Mixed Reality (MR), etc., have provided significant enlightenment to education. On one hand, new technologies can be used to enable better performance. For example, during the COVID-19 pandemic, technologies make such large-scale online teaching activities possible. In particular, for experimental or hands-on courses, the technology application like the online simulation platform (i.e., IRobotQ3D) [78], the integration of VR and motion capture system [79], etc., can solve the problems of interactivity and presence to a certain extent. On the other hand, the essence of I4.0 is also to better meet the needs of users, which coincides with the human-centred concept emphasized by design thinking. As we enter the era of intelligence, customers require new and customised products more and more often, and companies have hence to be able to easily follow these requirements in order to survive in today’s competitive market [79]. The implication for education is that to integrate technology into DTIL activities may help students collect and analyse data more scientifically, open up broader design space, and enrich the ways and forms of design work presenting, so as to promote the cultivation of innovative intelligent manufacturing talents that meet the needs of the era.
In conclusion, the implications and suggestions for DTIL in K-12 context are: (a) The potential value of design thinking in K-12 education needs to be further explored with larger samples and longer durations, in particular, more attention needs to be paid to students at the preK-elementary and high school levels. (b) Design thinking models be aligned with the domain learning situations are needed to expand the application of DTIL in a wider range of disciplines, especially non-STEM disciplines. (c) DTIL is expected to facilitate the acquisition of higher-order learning achievements, correspondingly, more objective and apt evaluation instruments are needed. (d) The educational value of design thinking does not arise spontaneously, more targeted interventions are expected to reach its full potential, such as rigorous study design in the pre-post mode or with control groups, more focus on learning in informal settings, intensive grouping strategies that consider gender, group size, role, etc., pertinent design thinking tasks/challenges what are both fun and challenging, and finally, support design activities with appropriate technical tools or materials.

5. Conclusions and Implication

In the wake of the popularity in design thinking, this literature review analyses 43 high-quality empirical papers on DTIL in K-12 education. The current status and future directions are identified to narrow the gaps. The major findings are summarized as follow.
First, as deduced from the publication trend (see Figure 1), a positive picture of design thinking emerges. However, the empirical evidence to support the effectiveness of DTIL is still rather limited. The results indicate that although samples from preschool to high school are all involved, it shows an uneven distribution of the age groups in K-12 education, which calls for more research to engage the younger learners (like kindergarten and primary school students) into DTIL. If possible, studies with longer periods and larger samples are expected.
Second, DTIL has the potential to deepen students’ learning with diversified models in various subject domains, including that of STEM and non-STEM, while the most mentioned applications are the fields of STEM, which is consistent with the result of previous study [12]. In addition, the design thinking models applied varied among studies, which suggests inconsistency in current perceptions of design thinking. On one hand, a prevailing view was to apply design thinking from a thinking model of designer or designer’s mindsets (e.g., [40,49,50,51,52]), in other words, think of it as a unique problem-solving methodology (e.g., [33,35,37,42,44,48,53]). Our study also supports this view. The theoretical basis of design thinking has been propositioned to be interconnected to Dewey’s notion of pragmatist inquiry and aesthetic experience [23,36]. The corresponding training goals were the abilities required to solve the complex and open-ended problems, such as communication skills, cooperation skills, creativity, and critical thinking, etc. On the other hand, however, there were differences in the focus of studies on the application of design thinking, leading to the emergence of different models or competence frameworks. For example, some studies focused on inquiry and experimentation in the early stages of problem solving (such as discover, define, empathy), others focused on modelling or prototyping during the problem-solving process, and still others discussed the impact of emotions, etc.
How do teachers choose or construct a design thinking model or framework that meets the needs of the teaching situation? In fact, it is difficult to construct a universal design thinking model to deal with a variety of complex educational scenarios. Therefore, to meet the teaching needs of more subject domains, future study needs more exploration of the design thinking models that could be compatible with teaching practice in K-12 education. Referring to the existing empirical research, it may be necessary to comprehensively consider related factors such as students, teachers, and the school environments. In addition, although existing research claims that design thinking has great educational value, it is difficult to cover all aspects at once. Therefore, it is a feasible way to develop various competencies by stages or disciplines. Future study could bring design thinking into both STEM and non-STEM curriculums to further verify how design thinking will help students build knowledge and skills in a wider range of domains. Furthermore, teachers can make targeted combinations or adjustments of elements in a design thinking model or framework to better meet teaching needs.
Third, in response to the many existing design thinking models and subject domains, various dependent variables were measured by different instruments. Mostly, the empirical studies evaluated students’ performance on design thinking, such as the design processes and design works. Another two types of learning performances that were paid close attention were emotional/social aspects and subject concepts. Besides, the design thinking concept and other skills like creativity, problem solving, critical thinking, etc., were also involved in the measured variables. For assessment, qualitative and quantitative assessments were both included, and the qualitative assessments were used more frequently, which highlights the practice-orientation and process-orientation of design thinking.
Implications for instruction include: (1) for the dependent variables, both process performance and learning outcomes should be emphasized. In particular, it is helpful to explore the development process of students’ thinking by analysing the process of students’ design activities. (2) Besides, the culture competency also needs to be included in the assessment. Design was seen as an important force driving the development of the artificial world, so one of the core characteristics of design thinking is that it is human-centred [1,7,32,80,81]. Every citizen should have a certain quality of cultural understanding and inheritance, which emphasizes the practical implementation of these values contained in the excellent culture at the behavioural level [82]. On this basis, we can better solve the problems faced by human beings through design thinking activities, to promote the benign development of human society. (3) To verify the design thinking embedded learning more scientifically and efficiently, more objective and apt evaluation instruments are needed. In addition to conventional subject knowledge and skills, for the evaluation of design thinking, existing research has provided some experience for reference. For the understanding of design thinking concepts, it can be assessed by test [35], survey [39], questionnaire [40], or other qualitative method, such as interview, video/audio recording, etc. [38]. For design thinking, evaluation instruments that can be used are portfolio (e.g., [21,33,42,55,61]), observation (e.g., [45,64]), survey (e.g., [31,33,55,56]), protocol analysis (e.g., [21,42,44,46,59,62]), design work evaluation (e.g., [31,35,45,47,58,60]), interview (e.g., [55]), etc. (4) Furthermore, there is more room for development of relevant evaluation methods supported by technology. In the existing studies, evaluation instruments supported by technology are rarely used. In the future, the application of artificial intelligence technology, multimodal data collection and analysis, real-time evaluation and feedback technology in the classroom still needs to be explored to promote the improvement of teaching quality.
Finally, interventions including study design, course type, grouping, design task/challenge and teaching tools and materials are summarized from the empirical studies. Results show that most research reported DTIL by conducting non-experimental studies in formal classrooms. In the reviewed studies, collaborative learning was frequently used, through which students were usually arranged in groups of 2–4 people. Except for cooperative, the design tasks or challenges employed in the empirical studies were also characterized as real situated, open-ended, and challenging. Moreover, conventional tools or materials were used more often, technical tools and materials were relatively lacking. Overall, at present, the development of design thinking intervention in K-12 education is not sufficient. We are inspired to pay more attention to the application of rigorous study design, balance between formal and informal classrooms, intensive grouping strategies, applicative tasks or challenges, and technical materials in the future. For instruction, because the situations vary among schools, the DTIL intervention should vary accordingly. Moreover, in the selection of design materials or tools, it is also necessary to pay attention to the application of technical materials or tools, to help students understand the technological world in which they live and learn to use technology to innovate and shape the world.

6. Limitations

As this study mainly focuses on students’ learning in a design thinking integrated context of K-12 education, there are some limitations. First, we selected the reviewed papers only from SSCI journals, which ensured the representativeness and quality of sample but lacked comprehensiveness. Second, the school levels were limited to preschool to high school, while colleges and other adult learners were not included, so that the conclusions are only applicable to K-12 education. Third, teachers were considered crucial for learning; separate study is needed to amply elaborate the role of teachers in DTIL. In future, it is expected that more research on teaching, learning and evaluation of DTIL will be carried.

Author Contributions

Conceptualization, T.L. and Z.Z.; methodology, T.L. and Z.Z.; writing—original draft preparation, T.L.; writing—review and editing, T.L. and Z.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was financially supported by Ministry of Education in China Project of Humanities and Social Sciences “The Collaborative Innovation Mechanism for Guangdong-Hong Kong-Macao Greater Bay Area Education based on C-STEAM” (22YJC881901), the Major Project of Social Science in South China Normal University (ZDPY2208), the Major basic research and applied research projects of Guangdong Education Department (#2017WZDXM004). The author gratefully acknowledges the support of “2022 Guangdong-Hong Kong-Macao Greater Bay Area Exchange Programs of SCNU”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. General information of the papers.
Table A1. General information of the papers.
PaperSample SizeEducational LevelDurationCurriculumDesign Thinking Model (Competence)
Aflatoony, Wakkary, Neustaedter (2018) [33]39high school9 weeksdesign and technologyA five-step design process including empathise, define, ideate, prototype and test
Aranda, Lie, Guzey (2020) [54]26middle school6 daysscienceStage 1: plan a design: cognitive memory, divergent thinking, evaluative thinking. Stage 2: redesign: evaluative thinking. Stage 3: communicate to the client: cognitive memory, divergent thinking
Blom and Bogaers (2020) [46]18middle school2 htechnologyN/A
Carroll et al. (2010) [38]24middle school3 weeksgeographyThe components of the design thinking process include the following: understand, observe, point of view, ideate, prototype, test
Chin et al. (2019) [68]197middle school5 weeksmultidisciplinaryN/A
Christensen et al. (2019) [40]246middle school 2 yearsdesignSix phases: (1) design problem; (2) field studies; (3) ideation; (4) fabrication; (5) argumentation; (6) reflection
Cutumisu, Chin, Schwartz (2019) [60]97middle schoolN/AmultidisciplinaryN/A
Cutumisu, Schwartz, Lou (2020) [65]80middle school5 weeksmultidisciplinaryN/A
Derler et al. (2020) [55]117high school2 yearsmultidisciplinaryThree phases: (1) exploration, (2) product ideation, and (3) product prototyping and optimisation
English (2019) [21]34elementary schoolN/ASTEMThe inclusion of design processes involved students in learning through design involving planning, sketching, and testing
Fan, Yu, Lou (2018) [43]103high school15 weekstechnology and engineeringClarify problems and constraints, collect information, develop possible solutions, predictive analysis, selection solutions, modelling, and testing, evaluating and revising, optimization
Fleer (2021) [64]13kindergarten7 weeksengineeringDesigning, making, appraising
Forbes et al. (2021) [27]576Kindergarten and Primary SchoolN/ASTEMFive phases of discovery, interpretation, ideation, experimentation, and evolution to scaffold the ‘design process’ (The IDEO model)
Gennari, Melonio, Rizvi (2021) [49]8middle schoolN/Atechnology(1) exploration and familiarisation, (2) ideation and conceptualisation, (3) programming and prototyping
Gomoll et al. (2018) [61]16middle school5 weeksroboticsAsk questions (define problem), imagine (brainstorm ideas), collect information,develop, and test solutions, improve (how did this work? How can we make it better?)
Guzey and Jung (2021) [34]27middle school15 daysscienceCognitive memory, convergent thinking, divergent thinking, evaluative thinking
Kelley and Sung (2017) [47]91elementary school1 yearscienceN/A
Kelley, Capobianco, Kaluf (2015) [59]21elementary school1–2 weeksscienceCognitive processes identified by Halfin’s (1973) study of high-level designers: Analysing, computing, defining problem(s), designing, interpreting data, modelling, predicting, questions/hypotheses, testing.
Kijima and Sun (2021) [32]26middle school3 daysSTEAMFive iterative stages (Stanford d.school), including: empathise, define (capture needs), ideate (brainstorm solutions), prototype and test (seek feedback)
Kijima, Yang-Yoshihara, Maekawa (2021) [50]97middle and high school3 daysSTEAMFive stages of—from empathy-building to needs—finding, brainstorming, prototyping, and testing
Kim, Seo, Kim, (2022) [52]28elementary school3 weeksengineeringExplore, empathize, ideate, create, test
Ladachart et al. (2021) [51]38middle school4 weeksSTEMSix aspects of design thinking, namely (1) collaboratively working with diversity, (2) being confident and optimistic to use creativity, (3) orientation to learning by making and testing, (4) mindfulness to process and impacts on others, (5) being comfortable with uncertainty and risks, and (6) human-centeredness
Leinonen et al. (2020) [57]64elementary school2 monthsmultidisciplinaryN/A
Lin et al. (2020) [48]62middle school7 weekstechnologyThree phases: Inspiration: real-world problem, ideation: design scheme, implementation: digital work
Lin, Chang, Li (2020) [31]169middle school8 weeksengineeringFive stages of engineering design thinking (empathize, define, ideate, prototype, and test)
Marks and Chase (2019) [35]78middle school4 weeksscienceIterative make-test-think process
Marks and Chase (2019) [35]89middle school3 weeksscienceIterative make-test-think process
Mentzer, Becker, Sutton (2015) [42]59high school3 hengineering8 stages: problem definition,information gathering, idea generation, modelling, feasibility, evaluation, decision making, communication
Mentzer, Huffman, Thayer (2014) [41]20high school3 hengineeringProblem definition, gathering information, generating ideas, modelling, feasibility, evaluation, decision, communication
Nichols et al. (2021) [36]159elementary school12 weeksscienceDefining, designing, producing, evaluating
Parikh, Maddulety, Meadows (2020) [53]70middle school5 monthsN/AN/A
Rao, Puranam, Singh (2022) [23]195middle school4 daysscienceFour stages called ‘feel’, ‘imagine’, ‘do’ and ‘share’
Simeon, Samsudin, Yakob (2022) [37]89high school3 monthsscienceThe five-stage model proposed by the Hasso Plattner Institute of Design at Stanford: empathy, define (the problem), ideate, prototype, and test
Sung and Kelley (2019) [44]27elementary school1 yearscienceIdentify problem, share and develop a plan, create, and test, communicate results and gather feedback, improve and retest
Tsai and Wang (2021) [28]350middle schoolN/ASTEAMFour phases: empathize, define, ideate and prototype
Van Mechelen et al. (2019) [58]49elementary school1 dayN/AThe Collaborative Design Thinking (CoDeT): introduction, sensitizing, scaffolding collaboration, defining a design goal, reflection on collaboration, ideation, grouping and selection, elaboration through making, presentation and peer jury, iteration or wrap up
Wendell, Wright, Paugh (2017) [62]N/Aelementary school 1 dayscienceReflective decision making: articulate multiple solutions, evaluate pros and cons, intentionally select solution, retell performance of solution, analyse solution according to specific evidence, purposefully choose improvements
Won et al. (2015) [56]44middle school N/ASTEMArticulation of the learning phenomenon, design, data collection, actual construction, redesign
Yalcin and Erden (2021) [29]39kindergarten8 weeksSTEMFive stages used by the Hasso Platter Institute at Stanford: Empathize, Define, Ideate, Prototype, Test
Yu, Wu, Fan (2020) [26]613high school16 weeksengineeringObserving, predicting, creating, analysing, and evaluating
Zhang et al. (2022) [30]30middle school3 monthsDesign & ResearchEmpathize Design User (EDU), Define Design Problem (DDP), Ideate Design Solution (IDS), Make Prototype (MP), Test Prototype (TP)
Zhou et al. (2017) [39]24middle school 2 weeksscience and engineeringNine coding categories: sketching, prototyping, design goals, inference/predictions about design, generate design ideas, design of structure, design of system/process, materials, and collaboration
Zhou et al. (2021) [45]27middle school2 weeksengineeringDesign cycle of planning, building, and testing
Zupan, Cankar, Cankar (2018) [66]146elementary school17.5 weeksN/AThe process was divided into five interrelated phases: understanding and defining the problem, observation, ideation, prototyping and testing, implementation
Note: N/A—Not available.
Table A2. Study design and intervention.
Table A2. Study design and intervention.
PaperCourse TypeTask/ChallengeTools and MaterialsGroupingStudy DesignStudy TypeDependent VariableMeasurement Instrument
Aflatoony, Wakkary, Neustaedter (2018) [33]formalTo use design to change their communitiesN/A3–4Non-experimental: design thinking based pedagogy in the context of interaction designO X ODesign thinking Observation, survey, portfolio
Aranda, Lie, Guzey (2020) [54]formalDesign a process to both prevent and test for cross-pollination of non-GMO fields from GMO fields. (Genetically Modified Organisms, GMOs)N/A4Non-experimental: engineering design as a tool to improve student science learningX OSkillProtocol analysis
Blom and Bogaers (2020) [46]N/ADesign a heat retaining food container for street food vendors at a taxi depotBasic stationary items, including pens, pencils, safety rulers, post-it notes, coloured pencils, paper, paper clips, felt-tip pens and highlighters.3Non-experimental: STEM design taskX ODesign thinkingProtocol analysis, video recording
Carroll et al. (2010) [38]formalTo identify and redesign systems that existed at the schoolN/A4–5Non-experimental: introducing students both to the design process and to systems in geographyX ODesign thinking, emotional/social aspectJournal, audio recording, video recording, portfolio, interview
Chin et al. (2019) [68]formalDesign digital postersComputer design games1Experimental:
EG1: Feedback design-thinking strategies treatment;
EG2: Explore design-thinking strategies treatment
R O X1 O
R O X2 O
Design thinking Test
Christensen et al. (2019) [40]formalTo create a secure environment for the elderly without taking away their freedomDigital technologyN/AQuasi-experimental:
EG: students who had already received design education in their school (FabLab group);
CG: without intervention
X1 O
X2 O
Design thinking, emotional/social aspectQuestionnaire
Cutumisu, Chin, Schwartz (2019) [60]formalDesign digital postersComputer design games1Non-experimental: digital poster design game (Posterlet)X ODesign thinking, subject learning performanceTest, design work evaluation
Cutumisu, Schwartz, Lou (2020) [65]formalDesign digital postersComputer design games1Non-experimental: digital poster design game (Posterlet)O X ODesign thinking Test
Derler et al. (2020) [55]formalTo develop sustainable food products for peer groupN/AGroupNon-experimental: Project-Based Learning focused on the development of sustainable food productsX ODesign thinking Portfolio, journal, survey, interview
English (2019) [21]formalDesign and construct shoesN/A3Non-experimental: problem solving activities (shoes design)X ODesign thinking Portfolio, protocol analysis
Fan, Yu, Lou (2018) [43]formalTo design a movable toy with various mechanical structure types Physical and 3D virtual simulation models, LEGO N/ANon-experimental: project-based engineering design programO X OSubject learning performance, design thinking, emotional/social aspectTest, questionnaire, design work evaluation, survey, observation
Fleer (2021) [64]formalDesign castle according to an imaginary engineering situation of Sherwood forestN/AIndividual and collectiveNon-experimental: designerly playX ODesign thinking Observation
Forbes et al. (2021) [27]formal3D design and printing: Floatable boats, shadow puppets, Headphone cable holders, Spinning tops, Playground sculptures, Habitat for hermit crabs, Herb markers, Designing keyrings, Bag tags3D design and printing technologies (Ipad and 3D design software and print device)N/ANon-experimental: STEM-focussed curricula in 3D technology based makerspaceX OSubject learning performance, design thinking, skill, emotional/social aspectInterview, survey, journal, observation
Gennari, Melonio, Rizvi (2021) [49]N/AGenerate smart-things ideas for an outdoor park environmentCard-based toolkits, microelectronics components: Raspberry Pi, Google’s Design Sprint Kit N/ANon-experimental: IoT design workshop X ODesign thinking, emotional/social aspectPortfolio, questionnaire, observation, interview
Gomoll et al. (2018) [61]formalDesign a robot that served a need in their local environment and allowed remote peers to explore their local spacesA mobile telepresence robot that we called KT, controlled over the Internet through a web interface4Non-experimental: human-centred robotics curriculumX ODesign thinking Portfolio, audio recording, video recording
Guzey and Jung (2021) [34]formalDesign a water filter system for the city’s wastewater management plant to help prevent the pollution of a local riverN/A3–4Non-experimental: engineering design task in teamsO X OSkill, subject learning performanceAudio recording, protocol analysis, test
Kelley and Sung (2017) [47]formal3 engineering design activities: Musical Instrument, Simple Machines, and bio-inspired flowerN/A2–4Quasi-experimental:
EG1: pretreatment on basic engineering design sketching strategies before the three design activities;
EG2: delayed treatment before the third design activity
X1 O
X2 O
Design thinking Design work evaluation
Kelley, Capobianco, Kaluf (2015) [59]formalTo work in teams to build a prototype for a prosthetic leg to function like a human leg joint and strike the ball; paper football kickerN/A3Non-experimental: engineering design activityX ODesign thinking Protocol analysis, video recording
Kijima and Sun (2021) [32]N/AWork revolved around interviewing senior citizens and creating prototypes that met their needs on the background of Japan’s aging societyN/AN/ANon-experimental: design thinking workshopO X O Emotional/social aspectSurvey
Kijima, Yang-Yoshihara, Maekawa (2021) [50]N/ADesign local solutions addressing global issuesUsing basic prototyping materials such as recycled plastic bottles and cardboards, glue, tapes, scissors,4Non-experimental: design thinking and STEAM workshop O X O Emotional/social aspectQuestionnaire, interview
Kim, Seo, Kim, (2022) [52]formalReading the narrative content of the books and solving the engineering problems presented in the books, and finally rewrite the storyCOBL-S (Arduino Leonardo-based device, supported programming language was developed based on Scratch and app inventor)3–4Quasi-experimental:
EG: Class activities according to the NE-Maker instructional model;
CG: Normal software education class according to the textbook.
O X1 O
O X2 O
Emotional/social aspectQuestionnaire, journal, interview
Ladachart et al. (2021) [51]formalReverse engineering project: to design a bimetal thermostatA dissected bimetal thermostat, metal, tape, and scissors3Non-experimental: design-based reverse engineeringO X OEmotional/social aspectQuestionnaire, video recording, protocol analysis
Leinonen et al. (2020) [57]formal3D model design and 3D artefact printing3D model design by Tinkercad software and 3D artefact printing by Ultimaker printergroupNon-experimental: 3D design and printing activitiesX OSubject learning performance, skill, design thinkingObservation, interview, questionnaire, portfolio
Lin et al. (2020) [48]formalDesign digital documents for new year party (e.g., to make posters for party promotion)WPS Writer®groupQuasi-experiment:
EG: using the design thinking approach (class a: project);
CG: using traditional teaching methods (class b, according to the textbook)
O X1 O
O X2 O
Subject learning performanceDesign work evaluation
Lin, Chang, Li (2020) [31]formalDesign an electric model vehicle capable of automatically avoiding obstacles was developedThe experimental group experienced design teaching with VR devices used as teaching toolsN/AExperimental:
EG: engineering design teaching with VR
CG: conventional engineering design teaching
R O X1 O
R O X2 O
Design thinking Survey, design work evaluation
Marks and Chase (2019) [35]formalDrop challenge, playground challenge, and a post-design challenge (the boat challenge)N/AN/AExperimental:
EG: iterative prototyping (Prototype);
CG: content-focused design (Content)
R O X1 O
R O X2 O
Design thinking, emotional/social aspectTest, survey, design work evaluation
Marks and Chase (2019) [35]formalBase-line tower design task,drop challenge, playground challenge, and a post-design challenge (the boat challenge)N/AN/AExperimental:
EG: design thinking intervention focused on effective iterative prototyping (Prototype);
CG: content-focused intervention (Content)
R O X1 O
R O X2 O
Design thinking, emotional/social aspectTest, survey, design work evaluation
Mentzer, Becker, Sutton (2015) [42]formalTo design a playgroundA calculator, ruler, a small note pad, graph paper, white paper, pencil, highlighter, sticky notes, and a piece of paper identifying the design task were placed on the table before the student entered the roomN/AQuasi-experimental:
EG1: high school freshmen starting the sequence of engineering courses;
EG2: high school seniors who had taken multiple engineering courses;
CG: engineering experts
X1 O
X2 O
X3 O
Design thinking Audio recording, video recording, protocol analysis, portfolio
Mentzer, Huffman, Thayer (2014) [41]formalPlayground designN/A1Non-experimental: Engineering design challengeX ODesign thinking, Emotional/social aspectObservation, protocol Analysis, video recording, audio recording, portfolio, interview, survey
Nichols et al. (2021) [36]formalTo design and construct a device that is engineered to provide electricity to a third world community scenarioMaterials like LED, water2–4Quasi-experimental:
EG: design task embedded in an inquiry science unit and a community of inquiry (CoI);
CG: design task embedded in an inquiry science unit (Non-CoI)
O X1 O
O X2 O
Design thinking, subject learning performanceProtocol analysis, video recording, test, interview
Parikh, Maddulety, Meadows (2020) [53]informalDesign prototypes for solving a Design Thinking challengeN/A5–6Quasi-experiment:
EG: Design Thinking training spread over two action research cycles;
CG: received no intervention
O X1 O X2 O
O X3 O X4 O
SkillPortfolio, test
Rao, Puranam, Singh (2022) [23]informalThree key design thinking exercises: ’Bag Exercise’, ’Cartographer’, ‘Be a Detective’N/AN/AExperimental:
EG: design thinking training programme;
CG: usual hands-on science education curriculum
R X1 O
R X2 O
SkillTest
Simeon, Samsudin, Yakob (2022) [37]informalZip line delivery challenge,truss bridge challengeN/AN/ANon-experimental: STEM- Design thinking modulesO X OSubject learning performance Test
Sung and Kelley (2019) [44]formalDesign a Doggie Door AlarmNormal design tools, such as paper, pencil3Non-experimental: engineering design activity for science learningX ODesign thinking Audio recording, video recording, protocol analysis
Tsai and Wang (2021) [28]formalDesign a robot for solving some problems related to natural science or ecological environmental issuesN/AN/ANon-experimental: project-based STEAM curriculumX OEmotional/social aspectQuestionnaire
Van Mechelen et al. (2019) [58]formalThe design theme on preventing bullying in the social context of the classN/A4–6Non-experimental: design activities on the theme of preventing bullying in the social context of the classX OEmotional/social aspect, design thinkingObservation, portfolio, design work evaluation
Wendell, Wright, Paugh (2017) [62]formalDesign water filters, bridges, circuits in, maglev vehicles and windmills, and pollinators and knee bracesN/A2–3Non-experimental: engineering design tasksX ODesign thinking Video recording, portfolio, protocol analysis
Won et al. (2015) [56]informalDesign of lights powered through motionSocial media technologiesN/ANon-experimental: integrating learning technologies such as social networking forum (SNF) into design-based learning activities X ODesign thinking Survey, portfolio
Yalcin and Erden (2021) [29]formalDesign thinking STEM activitiesN/A4Experimental:
EG: design thinking STEM activities
CG: non-STEM activities
R O X1 O
R O X2 O
SkillSurvey, journal
Yu, Wu, Fan (2020) [26]formalDesign mechanical toyThe design stage used computer-aided design to create a three-dimensional model of the toyN/ANon-experimental: engineering project X OSubject learning performance, design thinking, skillQuestionnaire, design work evaluation, portfolio
Zhang et al. (2022) [30]formalDesign an escape room for the local fire department to allow participants to playfully and interactively improve awareness of fire safety in and around the houseN/A3–4Non-experimental: DBL (design-based learning) activitiesX ODesign thinking, emotional/social aspectQuestionnaire, observation, interview
Zhou et al. (2017) [39]informalA total of five toy design activitiesN/A3–4Non-experimental: toy design workshopO X OEmotional/social aspect, design thinkingQuestionnaire, survey
Zhou et al. (2021) [45]informalMarshmallow tower activity and the trebuchet design activityN/A3–4Non-experimental: design workshopX ODesign thinking Observation, design work evaluation
Zupan, Cankar, Cankar (2018) [66]formalIdentify and define a local or social problem that could be solved with a new product, service, or other solutionN/AN/ANon-experimental:
use the design thinking method to develop the entrepreneurial mindset
X OEmotional/social aspectInterview, observation
Note: N/A—Not available.

References

  1. Kimbell, L. Rethinking Design Thinking: Part I. Des. Cult. 2011, 3, 285–306. [Google Scholar] [CrossRef]
  2. Micheli, P.; Wilner, S.J.; Bhatti, S.H.; Mura, M.; Beverland, M.B. Doing design thinking: Conceptual review, synthesis, and research agenda. J. Prod. Innov. Manag. 2019, 36, 124–148. [Google Scholar] [CrossRef]
  3. Simon, H.A. The Sciences of the Artificial; MIT Press: Cambridge, MA, USA, 1969. [Google Scholar]
  4. Cross, N. Expertise in design: An overview. Des. Stud. 2004, 25, 427–441. [Google Scholar] [CrossRef]
  5. Jonassen, D.H. Toward a design theory of problem solving. Educ. Technol. Res. Dev. 2000, 48, 63–85. [Google Scholar] [CrossRef]
  6. Dorst, K. The core of ‘design thinking’and its application. Des. Stud. 2011, 32, 521–532. [Google Scholar] [CrossRef]
  7. Brown, T. Design thinking. Harv. Bus. Rev. 2008, 86, 84–92. Available online: https://pubmed.ncbi.nlm.nih.gov/18605031/ (accessed on 9 June 2022).
  8. Kelley, T.; Kelley, D. Creative Confidence: Unleashing the Creative Potential Within Us All; Crown Business: New York, NY, USA, 2013. [Google Scholar]
  9. Martin, R.; Martin, R.L. The Design of Business: Why Design Thinking is the Next Competitive Advantage; Harvard Business Press: Boston, MA, USA, 2009. [Google Scholar]
  10. Brenner, W.; Uebernickel, F.; Abrell, T. Design thinking as mindset, process, and toolbox. In Design Thinking for Innovation; Springer: Berlin, Germany, 2016; pp. 3–21. [Google Scholar] [CrossRef]
  11. Rusmann, A.; Ejsing-Duun, S. When design thinking goes to school: A literature review of design competences for the K-12 level. Int. J. Technol. Des. Educ. 2021. [Google Scholar] [CrossRef]
  12. Zhang, F.; Markopoulos, P.; Bekker, T. Children’s Emotions in Design-Based Learning: A Systematic Review. J. Sci. Educ. Technol. 2020, 29, 459–481. [Google Scholar] [CrossRef]
  13. Zhou, D.; Gomez, R.; Wright, N.; Rittenbruch, M.; Davis, J. A design-led conceptual framework for developing school integrated STEM programs: The Australian context. Int. J. Technol. Des. Educ. 2020, 32, 383–411. [Google Scholar] [CrossRef]
  14. International Technology and Engineering Educators Association. Standards for Technological and Engineering Literacy: The Role of Technology and Engineering in STEM Education. Available online: https://www.iteea.org/STEL.aspx (accessed on 9 June 2022).
  15. Johansson-Sköldberg, U.; Woodilla, J.; Çetinkaya, M. Design thinking: Past, present and possible futures. Creat. Innov. Manag. 2013, 22, 121–146. [Google Scholar] [CrossRef]
  16. Razzouk, R.; Shute, V. What is design thinking and why is it important? Rev. Educ. Res. 2012, 82, 330–348. [Google Scholar] [CrossRef]
  17. Hasso Plattner Institute of Design at Stanford University. Design Thinking Bootleg. Available online: https://dschool.stanford.edu/resources/design-thinking-bootleg (accessed on 9 June 2022).
  18. IDEO. Design Thinking for Educators Toolkit (2nd ed.). Available online: https://designthinkingforeducators.com/toolkit/ (accessed on 9 June 2022).
  19. Design Council. The Double Diamond: A Universally Accepted Depiction of the Design Process. Available online: https://www.designcouncil.org.uk/our-work/news-opinion/double-diamond-universally-accepted-depiction-design-process/ (accessed on 9 June 2022).
  20. Burghardt, M.D.; Hacker, M. Informed design: A contemporary approach to design pedagogy as the core process in technology. Technol. Teach. 2004, 64, 6–8. [Google Scholar]
  21. English, L.D. Learning while designing in a fourth-grade integrated STEM problem. Int. J. Technol. Des. Educ. 2018, 29, 1011–1032. [Google Scholar] [CrossRef]
  22. Chase, C.C.; Malkiewich, L.; Kumar, A.S. Learning to notice science concepts in engineering activities and transfer situations. Sci. Educ. 2018, 103, 440–471. [Google Scholar] [CrossRef]
  23. Rao, H.; Puranam, P.; Singh, J. Does design thinking training increase creativity? Results from a field experiment with middle-school students. Innovation 2021, 24, 315–332. [Google Scholar] [CrossRef]
  24. Tranfield, D.; Denyer, D.; Smart, P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. Br. J. Manag. 2003, 14, 207–222. [Google Scholar] [CrossRef]
  25. Wohlin, C. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering, London, UK, 13 May 2014; pp. 1–10. [Google Scholar] [CrossRef]
  26. Yu, K.C.; Wu, P.H.; Fan, S.C. Structural Relationships among High School Students’ Scientific Knowledge, Critical Thinking, Engineering Design Process, and Design Product. Int. J. Sci. Math. Educ. 2020, 18, 1001–1022. [Google Scholar] [CrossRef]
  27. Forbes, A.; Falloon, G.; Stevenson, M.; Hatzigianni, M.; Bower, M. An Analysis of the Nature of Young Students’ STEM Learning in 3D Technology-Enhanced Makerspaces. Early Educ. Dev. 2020, 32, 172–187. [Google Scholar] [CrossRef]
  28. Tsai, M.-J.; Wang, C.-Y. Assessing Young Students’ Design Thinking Disposition and Its Relationship With Computer Programming Self-Efficacy. J. Educ. Comput. Res. 2020, 59, 410–428. [Google Scholar] [CrossRef]
  29. Yalcin, V.; Erden, S. The Effect of STEM Activities Prepared According to the Design Thinking Model on Preschool Children’s Creativity and Problem-Solving Skills. Think. Ski. Creat. 2021, 41, 100864. [Google Scholar] [CrossRef]
  30. Zhang, F.; Markopoulos, P.; Bekker, T.; Paule-Ruíz, M.; Schüll, M. Understanding design-based learning context and the associated emotional experience. Int. J. Technol. Des. Educ. 2020, 32, 845–882. [Google Scholar] [CrossRef]
  31. Lin, H.-C.; Chang, Y.-S.; Li, W.-H. Effects of a virtual reality teaching application on engineering design creativity of boys and girls. Think. Ski. Creat. 2020, 37, 100705. [Google Scholar] [CrossRef]
  32. Kijima, R.; Sun, K.L. ‘Females Don’t Need to be Reluctant’: Employing Design Thinking to Harness Creative Confidence and Interest in STEAM. Int. J. Art Des. Educ. 2020, 40, 66–81. [Google Scholar] [CrossRef]
  33. Aflatoony, L.; Wakkary, R.; Neustaedter, C. Becoming a Design Thinker: Assessing the Learning Process of Students in a Secondary Level Design Thinking Course. Int. J. Art Des. Educ. 2017, 37, 438–453. [Google Scholar] [CrossRef]
  34. Guzey, S.S.; Jung, J.Y. Productive Thinking and Science Learning in Design Teams. Int. J. Sci. Math. Educ. 2021, 19, 215–232. [Google Scholar] [CrossRef]
  35. Marks, J.; Chase, C.C. Impact of a prototyping intervention on middle school students’ iterative practices and reactions to failure. J. Eng. Educ. 2019, 108, 547–573. [Google Scholar] [CrossRef]
  36. Nichols, K.; Musofer, R.; Fynes-Clinton, L.; Blundell, R. Design thinking and inquiry behaviours are co-constituted in a community of inquiry middle years’ science classroom context: Empirical evidence for design thinking and pragmatist inquiry interconnections. Int. J. Technol. Des. Educ. 2021. [Google Scholar] [CrossRef]
  37. Simeon, M.I.; Samsudin, M.A.; Yakob, N. Effect of design thinking approach on students’ achievement in some selected physics concepts in the context of STEM learning. Int. J. Technol. Des. Educ. 2020, 32, 185–212. [Google Scholar] [CrossRef]
  38. Carroll, M.; Goldman, S.; Britos, L.; Koh, J.; Royalty, A.; Hornstein, M. Destination, Imagination and the Fires Within: Design Thinking in a Middle School Classroom. Int. J. Art Des. Educ. 2010, 29, 37–53. [Google Scholar] [CrossRef]
  39. Zhou, N.; Pereira, N.; George, T.T.; Alperovich, J.; Booth, J.; Chandrasegaran, S.; Tew, J.D.; Kulkarni, D.M.; Ramani, K. The Influence of Toy Design Activities on Middle School Students’ Understanding of the Engineering Design Processes. J. Sci. Educ. Technol. 2017, 26, 481–493. [Google Scholar] [CrossRef]
  40. Christensen, K.S.; Hjorth, M.; Iversen, O.S.; Smith, R.C. Understanding design literacy in middle-school education: Assessing students’ stances towards inquiry. Int. J. Technol. Des. Educ. 2018, 29, 633–654. [Google Scholar] [CrossRef]
  41. Mentzer, N.; Huffman, T.; Thayer, H. High school student modeling in the engineering design process. Int. J. Technol. Des. Educ. 2014, 24, 293–316. [Google Scholar] [CrossRef]
  42. Mentzer, N.; Becker, K.; Sutton, M. Engineering Design Thinking: High School Students’ Performance and Knowledge. J. Eng. Educ. 2015, 104, 417–432. [Google Scholar] [CrossRef]
  43. Fan, S.C.; Yu, K.C.; Lou, S.J. Why do students present different design objectives in engineering design projects? Int. J. Technol. Des. Educ. 2018, 28, 1039–1060. [Google Scholar] [CrossRef]
  44. Sung, E.; Kelley, T.R. Identifying design process patterns: A sequential analysis study of design thinking. Int. J. Technol. Des. Educ. 2018, 29, 283–302. [Google Scholar] [CrossRef]
  45. Zhou, N.; Pereira, N.; Chandrasegaran, S.; George, T.T.; Booth, J.; Ramani, K. Examining Middle School Students’ Engineering Design Processes in a Design Workshop. Res. Sci. Educ. 2019, 51 (Suppl. 2), 617–646. [Google Scholar] [CrossRef]
  46. Blom, N.; Bogaers, A. Using Linkography to investigate students’ thinking and information use during a STEM task. Int. J. Technol. Des. Educ. 2018, 30, 1–20. [Google Scholar] [CrossRef]
  47. Kelley, T.R.; Sung, E. Sketching by design: Teaching sketching to young learners. Int. J. Technol. Des. Educ. 2017, 27, 363–386. [Google Scholar] [CrossRef]
  48. Lin, L.; Shadiev, R.; Hwang, W.-Y.; Shen, S. From knowledge and skills to digital works: An application of design thinking in the information technology course. Think. Ski. Creat. 2020, 36, 100646. [Google Scholar] [CrossRef]
  49. Gennari, R.; Melonio, A.; Rizvi, M. From children’s ideas to prototypes for the internet of things: A case study of cross-generational end-user design. Behav. Inf. Technol. 2021. [Google Scholar] [CrossRef]
  50. Kijima, R.; Yang-Yoshihara, M.; Maekawa, M.S. Using design thinking to cultivate the next generation of female STEAM thinkers. Int. J. STEM Educ. 2021, 8, 1–15. [Google Scholar] [CrossRef]
  51. Ladachart, L.; Cholsin, J.; Kwanpet, S.; Teerapanpong, R.; Dessi, A.; Phuangsuwan, L.; Phothong, W. Ninth-grade students’ perceptions on the design-thinking mindset in the context of reverse engineering. Int. J. Technol. Des. Educ. 2021. [CrossRef]
  52. Kim, J.-Y.; Seo, J.S.; Kim, K. Development of novel-engineering-based maker education instructional model. Educ. Inf. Technol. 2022, 27, 7327–7371. [Google Scholar] [CrossRef]
  53. Parikh, C.; Maddulety, K.; Meadows, C. Improving creative ability of base of pyramid (BOP) students in India. Think. Ski. Creativity 2020, 36, 100652. [Google Scholar] [CrossRef]
  54. Aranda, M.L.; Lie, R.; Guzey, S.S. Productive thinking in middle school science students’ design conversations in a design-based engineering challenge. Int. J. Technol. Des. Educ. 2019, 30, 67–81. [Google Scholar] [CrossRef]
  55. Derler, H.; Berner, S.; Grach, D.; Posch, A.; Seebacher, U. Project-Based Learning in a Transinstitutional Research Setting: Case Study on the Development of Sustainable Food Products. Sustainability 2019, 12, 233. [Google Scholar] [CrossRef]
  56. Won, S.G.; Evans, M.A.; Carey, C.; Schnittka, C.G. Youth appropriation of social media for collaborative and facilitated design-based learning. Comput. Hum. Behav. 2015, 50, 385–391. [Google Scholar] [CrossRef]
  57. Leinonen, T.; Virnes, M.; Hietala, I.; Brinck, J. 3D Printing in the Wild: Adopting Digital Fabrication in Elementary School Education. Int. J. Art Des. Educ. 2020, 39, 600–615. [Google Scholar] [CrossRef]
  58. Van Mechelen, M.; Laenen, A.; Zaman, B.; Willems, B.; Abeele, V.V. Collaborative Design Thinking (CoDeT): A co-design approach for high child-to-adult ratios. Int. J. Human-Computer Stud. 2019, 130, 179–195. [Google Scholar] [CrossRef]
  59. Kelley, T.R.; Capobianco, B.M.; Kaluf, K.J. Concurrent think-aloud protocols to assess elementary design students. Int. J. Technol. Des. Educ. 2014, 25, 521–540. [Google Scholar] [CrossRef]
  60. Cutumisu, M.; Chin, D.B.; Schwartz, D.L. A digital game-based assessment of middle-school and college students’ choices to seek critical feedback and to revise. Br. J. Educ. Technol. 2019, 50, 2977–3003. [Google Scholar] [CrossRef]
  61. Gomoll, A.; Tolar, E.; Hmelo-Silver, C.E.; Šabanović, S. Designing human-centered robots: The role of constructive failure. Think. Ski. Creat. 2018, 30, 90–102. [Google Scholar] [CrossRef]
  62. Wendell, K.B.; Wright, C.G.; Paugh, P. Reflective Decision-Making in Elementary Students’ Engineering Design. J. Eng. Educ. 2017, 106, 356–397. [Google Scholar] [CrossRef]
  63. Trochim, W.M.K.; Donnelly, J.P. Research Methods Knowledge Base (3rd ed.). Available online: http://www.socialresearchmethods.net/kb/ (accessed on 9 June 2022).
  64. Fleer, M. The genesis of design: Learning about design, learning through design to learning design in play. Int. J. Technol. Des. Educ. 2022, 32, 1441–1468. [Google Scholar] [CrossRef]
  65. Cutumisu, M.; Schwartz, D.L.; Lou, N.M. The relation between academic achievement and the spontaneous use of design-thinking strategies. Comput. Educ. 2020, 149, 103806. [Google Scholar] [CrossRef]
  66. Zupan, B.; Cankar, F.; Cankar, S.S. The development of an entrepreneurial mindset in primary education. Eur. J. Educ. 2018, 53, 427–439. [Google Scholar] [CrossRef]
  67. Buchanan, R. Wicked Problems in Design Thinking. Des. Issues 1992, 8, 5–21. [Google Scholar] [CrossRef]
  68. Chin, D.B.; Blair, K.P.; Wolf, R.C.; Conlin, L.D.; Cutumisu, M.; Pfaffman, J.; Schwartz, D.L. Educating and Measuring Choice: A Test of the Transfer of Design Thinking in Problem Solving and Learning. J. Learn. Sci. 2019, 28, 337–380. [Google Scholar] [CrossRef]
  69. Csikszentmihalyi, M. Good Business: Leadership, Flow, and the Making of Meaning; Viking: New York, NY, USA, 2004. [Google Scholar]
  70. Wells, A. The importance of design thinking for technological literacy: A phenomenological perspective. Int. J. Technol. Des. Educ. 2012, 23, 623–636. [Google Scholar] [CrossRef]
  71. International Technology Education Association. Standards for Technological Literacy. Content for the Study of Technology (3rd ed.). Available online: https://www.iteea.org/42511.aspx (accessed on 9 June 2022).
  72. Laal, M.; Ghodsi, S.M. Benefits of collaborative learning. Procedia-Soc. Behav. Sci. 2012, 31, 486–490. [Google Scholar] [CrossRef]
  73. Wu, Q.; Lu, J.; Yu, M.; Lin, Z.; Zhan, Z. Teaching Design Thinking in a C-STEAM Project: A Case Study of developing the Wooden Arch Bridges’ Intelligent Monitoring system. In Proceedings of the 13th International Conference on E-Education, E-Business, E-Management, and E-Learning (IC4E), Tokyo, Japan, 14–17 January 2022; pp. 280–285. [Google Scholar] [CrossRef]
  74. De Bono, E. New Thinking for the New Millennium; Viking Adult: New York, NY, USA, 1999. [Google Scholar]
  75. Australian Curriculum, Assessment, and Reporting Authority. The Australian Curriculum: Technology. Available online: https://www.australiancurriculum.edu.au/umbraco/Surface/Download/Pdf?subject=Digital%20Technologies&type=F10 (accessed on 9 June 2022).
  76. Australian Curriculum, Assessment, and Reporting Authority. ACARA STEM Connections Project Report. Available online: https://www.australiancurriculum.edu.au/media/3220/stem-connections-report.pdf (accessed on 9 June 2022).
  77. Peron, M.; Alfnes, E.; Sgarbossa, F. Learning Through Action: On the Use of Logistics4.0 Lab as Learning Developer. In Proceedings of the 7th European Lean Educator Conference, ELEC 2021, Online, 25–27 October 2021; Powell, D.J., Alfnes, E., Holmemo, M.D., Reke, E., Eds.; Springer: Trondheim, Norway, 2021; Volume 610, pp. 205–212. [Google Scholar] [CrossRef]
  78. Zhan, Z.; Zhong, B.; Shi, X.; Si, Q.; Zheng, J. The design and application of IRobotQ3D for simulating robotics experiments in K-12 education. Comput. Appl. Eng. Educ. 2021, 30, 532–549. [Google Scholar] [CrossRef]
  79. Simonetto, M.; Arena, S.; Peron, M. A methodological framework to integrate motion capture system and virtual reality for assembly system 4.0 workplace design. Saf. Sci. 2021, 146, 105561. [Google Scholar] [CrossRef]
  80. Carlgren, L.; Rauth, I.; Elmquist, M. Framing Design Thinking: The Concept in Idea and Enactment. Creativity Innov. Manag. 2016, 25, 38–57. [Google Scholar] [CrossRef]
  81. Buchanan, R. Human Dignity and Human Rights: Thoughts on the Principles of Human-Centered Design. Des. Issues 2001, 17, 35–39. [Google Scholar] [CrossRef]
  82. Yan, L.; Xiaoying, M.; Jian, L.; Rui, W.; Lihong, M.; Guanxing, X.; Qiuling, G. Cultural Competence: Part I of the 5Cs Framework forTwenty-first Century Key Competences. J. East China Norm. Univ. Educ. Sci. 2020, 38, 29–44. [Google Scholar] [CrossRef]
Figure 1. The publication year of design thinking papers.
Figure 1. The publication year of design thinking papers.
Applsci 12 08077 g001
Figure 2. The educational level of design thinking papers.
Figure 2. The educational level of design thinking papers.
Applsci 12 08077 g002
Figure 3. Sample size in the reviewed papers.
Figure 3. Sample size in the reviewed papers.
Applsci 12 08077 g003
Figure 4. Duration of the reviewed papers.
Figure 4. Duration of the reviewed papers.
Applsci 12 08077 g004
Figure 5. Curriculum of the reviewed papers.
Figure 5. Curriculum of the reviewed papers.
Applsci 12 08077 g005
Figure 6. The number of empirical papers by educational level and curriculum.
Figure 6. The number of empirical papers by educational level and curriculum.
Applsci 12 08077 g006
Figure 7. Dependent variables of the reviewed empirical studies.
Figure 7. Dependent variables of the reviewed empirical studies.
Applsci 12 08077 g007
Figure 8. Measurement instruments adopted in the empirical studies.
Figure 8. Measurement instruments adopted in the empirical studies.
Applsci 12 08077 g008
Figure 9. Study design of the reviewed empirical studies.
Figure 9. Study design of the reviewed empirical studies.
Applsci 12 08077 g009
Figure 10. The frequency of studies by course type.
Figure 10. The frequency of studies by course type.
Applsci 12 08077 g010
Figure 11. Group size of the empirical studies.
Figure 11. Group size of the empirical studies.
Applsci 12 08077 g011
Table 1. Results of paper search.
Table 1. Results of paper search.
Selection StrategyPapers Resulting from the SearchSelected
Keyword search9927
First-round snowballing approach172112
Second-round snowballing approach8263
Third-round snowballing approach1861
Fourth-round snowballing approach370
Total286943
Table 2. The frequently mentioned design thinking competences among the empirical studies.
Table 2. The frequently mentioned design thinking competences among the empirical studies.
Design Thinking CompetenceFrequency in the Data SetCodesExplanation
Prototype32Prototype
Modelling
Build
Create
Make
Fabrication
Creating the original or early solution model, it can be a sketch, or other physical or virtual structure that designed.
Ideate31Ideate
Design
Brainstorming
develop possible solutions
Generating alternative ideas that may lead to solutions.
Define18Define
Understand
Problem definition
Identify problem
Clarify problems and constraints
Actionable problem statement based on insights into the problem situation.
Test15Test Experimenting and gathering feedbacks.
Explore14Explore
Collect information
Data collection
Discovery
Field Studies
Observe
Questioning and collecting information to gain deep understanding of the problem.
Empathize13Empathize
Human-centeredness
Needs-finding
Sensitizing
Feel
Carrying out design around the needs of users, highlighting human-centred design.
Evaluate9Evaluating
Appraising
Checking if the design meets the user’s needs.
Optimize8Optimization
Improve
Evolution
Iteration
Redesign
Refining solution based on user’s feedbacks.
Table 3. Dependent variables evaluated in the empirical studies.
Table 3. Dependent variables evaluated in the empirical studies.
Dependent VariablesConstruct
Subject learning performanceSubject concept
Subject skill
Design thinkingDesign thinking concept
Design thinking process
Design thinking work
Emotional/social aspectAttitude
Interest
Satisfaction
Desire
Acceptance
collaboration
SkillCreativity
Critical thinking
Problem solving
Productive thinking
Table 4. Measurement instruments adopted in the empirical studies.
Table 4. Measurement instruments adopted in the empirical studies.
Measurement InstrumentExplanation and Examples
Survey/QuestionnaireSurveys or questionnaires are often used for investigating skills or emotional/social dispositions towards DTIL (e.g., [27,32,35,55,56]).
PortfolioCollecting and evaluating students’ design products purposefully and systematically (e.g., [26,33,52]).
InterviewResearcher adopted interview to probe participants’ understanding of DTIL (e.g., [30,41,57]).
ObservationObservation is usually employed to explore participants’ procedural performance in greater detail (e.g., [33,41,58]).
Protocol analysisProtocol analysis is often adopted to understand the thought process of individual or groups in a natural way, the object of its analysis includes the coded verbal communication, or the thought process being asked to speak out (e.g., [41,46,59]).
TestTo estimate students’ mastery of relevant knowledge, test or examination is usually adopted (e.g., [23,35,43,60]).
Design work evaluationDesign work is seen as a direct way to reflect students’ learning outcome, and it is widely implemented in the evaluation of DTIL (e.g., [31,35,48]).
Video recording/Audio recordingIn DTIL, researcher recorded the design activities by video or audio so that to understand the participants’ learning process more fully (e.g., [38,44,61,62]).
JournalJournals or diaries from participants is analysed to help understand the process by which learning occurs (e.g., [27,29,38]).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, T.; Zhan, Z. A Systematic Review on Design Thinking Integrated Learning in K-12 Education. Appl. Sci. 2022, 12, 8077. https://doi.org/10.3390/app12168077

AMA Style

Li T, Zhan Z. A Systematic Review on Design Thinking Integrated Learning in K-12 Education. Applied Sciences. 2022; 12(16):8077. https://doi.org/10.3390/app12168077

Chicago/Turabian Style

Li, Tingting, and Zehui Zhan. 2022. "A Systematic Review on Design Thinking Integrated Learning in K-12 Education" Applied Sciences 12, no. 16: 8077. https://doi.org/10.3390/app12168077

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop