An Innovative and Interactive Teaching Model for Cultivating Talent’s Digital Literacy in Decision Making, Sustainability, and Computational Thinking

: In the modern era, talent cultivation plays an essential role in the transition process to sustainable development. The emerging direction of talent cultivation is intended to achieve global competence in computational thinking and digital literacy; however, there is still a gap in Taiwan. Scholars and educators have identiﬁed the contents of digital literacy, which include statistical concepts, data analysis skills, and critical thinking. To ﬁll this gap, this study proposed an innovative educational teaching method that integrates data visualization techniques and critical thinking training to improve students’ decision-making literacy. An experiment on the curriculum with a one-group pre-test and post-test design was conducted for 79 participants. The data consisted of a geographical data map, visualized data diagrams, and a statistical test; the scores for critical thinking, academic self-conﬁdence, and academic performance were separated into high, middle, and low achievement groups. For data analysis, the bootstrapping method (resampled 1000 times), paired sample t -test, and ANCOVA were applied for data analysis to compare the difference between each independent group. The results showed that the post-test scores (statistic test M = 9.59, infographic test M = 6.09, map test M = 5.02) were higher than the pre-test scores (statistic test M = 7.15, infographic test M = 3.46, map test M = 3.13). The most signiﬁcant implication is the innovative teaching approach based on integrated data visualization and critical thinking. It plays a very signiﬁcant role in enhancing decision-making abilities.


Introduction
Developed countries are promoting their talents in digital literacy through curriculum design and educational programs. The internet is full of mass information and data, which include both factual and fake messages that confuse users and even impact societal development; thus, digital literacy should be promoted to enhance users' ability to handle information and communication technology (ICT) usage. Therefore, digital literacy has emerged as a way to deal with the digital challenges caused by developing trends in ICT and internet usage [1]. Obviously, COVID-19 has dramatically changed our work and lifestyle in the direction of using ICTs and the internet [2]. Hence, the utility of the internet and online sources has become more and more important worldwide. However, there is a lack of related digital literacy training for undergraduates, except for science majors. Thus, judgment skills and critical thinking related to the use of ICTs and the internet will impact learning and work outcomes [3]. Based on strengths in computing and hardware data processing capabilities, evidence-based decision-making has become mainstream in government, industry, and education applications. As a consequence, the larger reliance on the internet or ICTs in dealing with work and learning tasks without appropriate digital literacy training will cause more risks in the use of online information, messages, open data, and uncertain applications. Decision-making quality is impacted not only at the organizational level, but also on the group level and individual levels. However, a global survey, "The International Computer and Information Literacy Study" (ICILS), reported that around 17% of young people failed to meet the basic digital literacy requirements [4]. This demonstrated that young peoples' digital literacy was insufficient and needs to be improved in the short-term. Educators have argued that the relevant aspects of computational thinking include numerical concepts, statistical concepts, data analysis skills, and critical thinking [5]. Furthermore, these aspects are associated with digital decision-making literacy. Hence, they have become the focus for the cultivation of digital literacy, which is a current education goal in developed countries, especially Taiwan. Further, the goals of computational thinking and critical thinking affect not only productivity but also the sustainability of the development of individuals and organizations [6]. Thus, the ecological systems of the enterprises can survive continuously when these goals are met. Moreover, the traditional lecture and test teaching model is still the predominant teaching method in current classrooms. An innovative teaching method is required in order to improve learning efficiency and promote learning outcomes [7]. Hence, it is critical to equip students with computational thinking, digital literacy, and decision-making skills for sustaining the development of firms.
In addition, there is insufficient training and education for cultivating digital decisionmaking literacy. Therefore, this study designed an experimental curriculum to examine the validity of an innovative digital decision-making literacy teaching model with designed materials, lectures, teaching methods, and assessments for Taiwanese subjects.

Theoretical Basis
According to scholars, fostering digital literacy via education should receive more attention. This study is intended to cultivate the digital literacy of social art major undergraduates through the incorporation of a teaching strategy in a selected professional course. The data visualization aspect of the course involved high-level concepts which included data mining, infographic-style selection, cross-analysis principles, mixed graphics, and interactive settings. These concepts should be involved in the cultivation of digital literacy; thus, this study developed materials for an experimental course in order to verify the effectiveness of the designed teaching model. This program will guide the cultivation of evidence-based decision-making skills. In the evaluation of the designed course, scholars suggested that the teaching assessment could be conducted after the course was finished [8]. Therefore, the researchers designed a survey to evaluate the teaching method, learning efficacy, the usefulness of the knowledge, and self-assessment of learning performance.
In general, decision making based on evidence is an important skill. Thus, cultivating critical thinking skills to deal with the mass information and data on the internet is a priority in higher education. Fostering digital literacy and decision-making skills on the basis of critical thinking is the goal of this study. The designed experimental curriculum was applied to verify the efficacy of the innovated teaching model in this study. The relevant research factors are explained below.

Digital Literacy
The term "literacy" is not a new concept and reflects the degree of an individual's social status which is used to connect with other people or organizations. It can be treated as a form of cultural learning [9]. This perspective originated in 2001 with the "No Child Left Behind" act in the US [10]. It changed educators' focus from competency cultivation to literacy development [11]. Literacy education has played a core role in modern education hereafter. Facing the dramatic development of ICTs, information literacy has been promoted as a new target for education goals [12]. There are different meanings and contexts between information literacy and digital literacy. Koltay defined information literacy as involving the user's behavior regarding internet searching, hypertext navigation, knowledge assembly, and content evaluation [11]. Meanwhile, digital literacy reflects the user's awareness, attitude, and ability to use digital tools appropriately, and to identify, access, control, integrate, evaluate, analyze, and synthesize all of the digital resources. Based on this, the user will construct new knowledge, create media expressions, and even strengthen their decision making [13]. Thus, the individual's decision-making process is part of digital literacy.

Data Visualization
Prior to the popularization of special-purpose software for data analysis and visualization, the information capability and performance of traditional statistical charts and tables had been limited and contained static information only. Meanwhile, the readers or audiences could simply receive limited and segmented information [14]. However, in the era of information, traditional infographics no longer suffice [15]. Scholars agree that the infographic design should including three essential elements such as data information, the details of the information presented; core concepts, the information that the producer wants to deliver to the audiences; and presentation style, using visual design methods, symbols, and patterns to enrich information and meaning [16]. Quantitative graphics thus require us to combine different charts, graphics, or figures, e.g., bar charts, pie charts, line graphs, or curve diagrams. They may also include timelines, geographical information, and mass texts-most important is that the infographic presents a dynamic visual narrative [17]. The main function of data visualization is to provide an interactive visual narrative to show information both in the static and dynamic style, allowing the user to interact with and explore the intrinsic meanings using graphic function settings.

Decision Making
Following the development of society, scholars in the fields of humanities, society, nature, engineering, etc. began to study and explore the systematical decision-making theory, method, and model. The Concept of Decision Making applied this practice, establishing the theoretical bases and becoming a subject of scientific study [18]. The meaning of decision making can be defined as a process by which people select from optional solutions. Out of some optional solutions, there is an optimal solution, and decision making is the process of problem-solving to find this solution [19]. The decision-making process consists of a five-step feedback loop involving problem identification, information collection, solution selection, conduct decision, and outcome assessment [19]. Those development trends show that decision-making science is key in determining human behavior at an individual level and the performance of people at the organizational level. Furthermore, a high level of decision-making competency is essential for managers. Evidence-based decision making is common in the medical field, and Ciliska, Pinelli, DiCens, and Cullum provide a five-stage procedure for this: specify the question, search for related evidence systematically, judge the evidence from the literature review, integrate the most powerful evidence for decision making, and evaluate the outcome [20]. In the initial stage, a PICO (Population, Issue, Comparison, and Outcome) model can be applied for question identification [21]. In the second stage, the four actions that can be used to search or collect the related evidence are "Define the Scope of Database and Searching Condition", "Use the Correct Terms for Searching", "Decide the Searching Strategy and Action", and "Modify Searching Terms Depending on the Feedback". In the third stage, to verify the validity of search information that includes review and comment the evidence, the comments are reviewed and compared, and the evidence is then classified.

Critical Thinking
In the rapidly changing environment caused by information and communication technology, information sources are easy to search. Therefore, the question of how to select information more effectively and transfer it to knowledge via critical thinking ability is a foundational skill for modern workers [22]. This pushes human beings to improve the environment constantly via critical thinking, and the main reason for this is that they apply these skills to conduct a continual dialectical process until the truth is revealed [23]. Scholars agree that digital learning will inspire learners' critical thinking skills [20]. Hence, a digitalized teaching strategy is the most useful method to cultivate students' critical thinking ability. They can deal with future uncertainties and stand out in the global competitive environment using this ability [24]. This viewpoint was an important US educational policy focus under former President Obama, demonstrating that critical thinking is considered a core competency for the next generation [25].

Research Hypotheses
To deal with the challenge of cultivating talents in computational thinking and digital literacy, this study designed an experimental curriculum consisting of basic statistics concepts and data visualization skills: map and infographic knowledge and skill training. The following research hypotheses were assumed.
Hypothesis 1 (H1). The course will affect learners' ability; thus, the basic statistics concepts of the post-test mean score higher will be higher than the pre-test mean score.
Hypothesis 2 (H2). The course will affect learners' ability; thus, the data visualization skill map post-test mean score was higher than the pre-test mean score.

Hypothesis 3 (H3)
. The course will affect learners' ability; thus, the data visualization skill infographic mean score was higher than the pre-test mean score.

Experimental Design
The one-group pre-test and post-test of the quasi-experimental design were employed in this study as in Figure 1. The observation O 1 was a pre-test of prior knowledge that included basic statistical concepts and mapping and infographic data visualization software skills. Intervention X is an 8-week incorporation teaching strategy in the curriculum for undergraduates. The O 2 was a post-test of learned basic statistical concepts and mapping and infographic data visualization software skills.

Teaching Strategy
The LPC Strategy was applied for incorporating a teaching strategy that consisted of three parts: Lecture, Practice, and Competition [26]. The incorporated teaching subjects involved basic statistical concepts and data visualization software operation skills for maps and infographics. Based on the LPC Strategy, the lecturer explained the subjects,

Teaching Strategy
The LPC Strategy was applied for incorporating a teaching strategy that consisted of three parts: Lecture, Practice, and Competition [26]. The incorporated teaching subjects involved basic statistical concepts and data visualization software operation skills for maps and infographics. Based on the LPC Strategy, the lecturer explained the subjects, then assigned data visualization software operation practice for two knowledge points represented by infographics and geographic map data from a map. The designed curriculum units are summarized in Table 1. Practice: Discussion and software operation with practical marketing data. 12th Competition: Data visualization software operation skills and interpretation of the meaning of produced infographics.

Post-test:
• Basic statistical concept. • Data visualization software operation skills.
The curriculum design followed the ADDIE model, an instructional development procedure including the following components: Analysis, Design, Development, Implement and Evaluation [27]. The strengths and weaknesses of undergraduates' basic statistical concepts and data visualization software operation skills for maps and infographics were first analyzed. Next, the material, supplemental data, and teaching model were designed and developed accordingly. The implementation step was used the LPC strategy. Then, the evaluation took place upon the final competition of the testing. In addition, the interactive software "Kahoot!" was used as a pre-test and post-test tool prior to the course and before ending the course to inspire students' learning motivation and concentration [28]. Then, the records and scores of "Kahoot!" were statistically processed to estimate students' learning performance.

Participants
A total of 79 undergraduates participated in this experimental course-49 females and 30 males. They were sophomores pursuing the Bachelor of Arts in Business Administration from a technological university located in Northern Taiwan. The incorporation teaching course was in the 3-credit "Marketing Management" course.

Quiz
The lecturer generated the quiz, and the scope contained basic statistical concepts and data visualization software operation skills regarding maps and infographics. Each quiz consisted of 10 items, and the reliability measurement applied Kuder-Richardson 20 (KR-20), which ranged from 0.81 to 0.87. The data visualization software applied Microsoft Power BI. The critical thinking quiz consisted of 30 multiple-choice questions adapted from Beaton [29] and translated into Chinese via a back-translation procedure to confirm the original context of translated items [30]. This produced the critical thinking training material.

Questionnaire
The questionnaire explored the academic performance of the previous semester and 3 items pertaining to the confidence of the subject with respect to learning, adapted from Fogarty, Cretchley, Arman, llerton, and Konki [31]. Furthermore, the learning confidence of map and infographic were rated before and after the quasi-experimental curriculum. In addition, 13 items for evaluating the overall course design and students' self-assessment were added to the questionnaire.

ADDIE Model as Useful Curriculum Development Strategy
This study followed the ADDIE model [26] to develop the curriculum and the overall curriculum design as in Figure 2. In the analysis stage, the researchers observed that participants had no organized digital literacy and decision-making skills. Therefore, the researchers conducted a small interview highlighting the importance of digital literacy in the first and second weeks. Then, as the second and third stage, the research team developed the appropriate teaching project and materials. During this stage, the research team decided on additional subjects, knowledge, and skills to teach. To ensure the quality and usability of the material, the research team invited three scholars to review the designed materials. Hereafter, the LPC (learning, practice, and competition) teaching method was implemented in the experimental curriculum as the fourth stage. Prior to the experimental course, the assessment tool was designed accordantly. The final stage evaluated the performance of the designed course, including teaching efficiency and learning outcomes. Thus, the pre-and post-testing of basic statistical concepts and data visualization software operation skills regarding maps and infographics were conducted to assess learning. A course teaching evaluation using the designed survey was conducted to collect student feedback. course teaching evaluation using the designed survey was conducted to collect student feedback.

Paired Sample t-Test
A paired sample t-test was used to examine the mean test scores. Thus, the pre-test mean scores and post-test mean scores were compared to explore differences between the experimental and control groups. This study used the paired sample t-test method to check the differences in mean scores between the pre-and post-tests of basic statistical concepts and data visualization software operation skills regarding maps and infographics.

ANCOVA
The ANCOVA method was used to verify the result of the quasi-experimental design. It was constrained to the pre-test mean scores as the control variable then compared to the adjusted post-test mean scores to observe the results. This study used ANCOVA to explore the differences between the adjusted post-test mean scores of basic statistical concepts and data visualization software operation skills regarding maps and infographics. The equation of ANCOVA is: The variables are: y i 1 = pre-test scores; y i 2 = post-test scores; x i = 1 is the experimental group; x i = 0 is the control group; i = participants.

The Effect Check
The formula of effect size was developed by Hedges and Olkin [32] and originally presented by Cohen [33] to check the power and effect of the quasi-experimental design [34] as in Equation (2) (2)

The Background of Participants
The results are shown in Table 2. There were 49 female (62.0%) and 30 male (38.0%) participants from two classes (34 and 45 separated). The mean score of academic confidence (AC) was 3.11 on Likert's 5-point scale (SD = 0.734), that of academic performance (AP) was 3.56 (SD = 0.944), and that of critical thinking (CT) was 15.67 out of 30 points (SD = 3.787).

The Effects of Experimental Curriculum
The sample size of this study was small, so the Bootstrapping method was employed to eliminate the bias and non-normal distribution data [35]. Thus, the 1000-times resampling Bootstrapping method was conducted during the statistical analysis. The paired samples t-test analysis results are listed in Table 3. All of the post-test mean scores were higher than the pre-test mean scores. The post-test score of the statistic test (M = 9.59, SD = 2.146) was higher (t = −7.692, p < 0.001) than that of the pre-test (M = 7.15, SD = 1.908). The Infographic post-test test score (M = 6.09, SD = 0.732) was higher (t = −22.739, p < 0.001) than the pre-test score (M = 3.46, SD = 0.698); and the post-test Map test score (M = 5.02, SD = 1.276) was higher (t = −11.352, p < 0.001) than the pre-test score (M = 3.13, SD = 0.865).

The Pure Effects of Learning Outcome
Analysis of covariance (ANCOVA) is designed to control for covariates when groups are randomly assigned against naturally occurring group differences [36]. In this study, selected research samples were distributed into different groups depending on their term and purpose overseas. A total of 79 valid samples were then put into the ANCOVA analysis process. The homogeneity of within-regression assumption should be tested prior to ANCOVA analysis. Bump [36] argued that a non-significant test result of homogeneity within-regression reflects a linear relationship between the dependent variable and covariance; thus, the covariance analysis process could be continuous. Table 4 shows that the test result did not reject the null hypothesis. The dependent variable and covariance have a linear relationship. The course units, Map (F (2,73) = 0.217; p > 0.05), Infographic (F (2,73) = 0.878; p > 0.05), and Statistic (F (2,73) = 0.938; p > 0.05), did not reached the significant level. Therefore, the ANCOVA analysis was continued. The samples were separated into high, middle, and low achievement groups by the different mean scores of basic statistical concepts and data visualization software operation skills regarding maps and infographics. The results of three groups of Academic Confidence failed to reach the significant level in the Map (F (2,75) = 0.221, p > 0.05), Infographic (F (2,75) = 0.497, p > 0.05), and Statistic (F (2,75) = 1.290, p > 0.05) measures. This suggested that the Academic Confidence levels of students will not impact their learning achievement in Map, Infographic, and Statistic learning.
The results of three Critical Thinking groups did not reach the significance level (see Table 5) in Map (F (2,75) = 0.0399 p > 0.05) and Infographic (F (2,75) = 0.815, p > 0.05) measurements. Thus, differences in Critical Thinking levels will not impact learning regarding Map, Infographic, and Statistic learning. However, the analysis result of Statistic learning reached a significant level (F (2,75) = 3.952, p < 0.05) showing that a discrepancy occurred between different levels of Critical Thinking. Furthermore, the power of Critical Thinking was found to be 0.693, and the effect size was 0.324.

Teaching Assessment
The survey was conducted after the course was finished to assess teaching performance. Students responded the designed course could help them learn new things about marketing management (see Table 6), linking between theory and practical marketing data and data visualization to simulate managerial decision making. Students reportedly enjoyed the learning process and felt it easy to learn new knowledge and skills in this course. The overall evaluated of the course 88% -Results show that students' basic statistical concepts and data visualization software operation skills regarding Map and Infographic learning had been raised. This was determined via a paired sample t-test of the pre-test and post-test mean score differentiation. The designed quasi-experimental curriculum was found to significantly enhance learning via the ADDIE strategy for curriculum development, incorporation of the teaching method for the additional subject, and the LPC strategy with Kahoot! This finding agrees with previous studies [21,27,35]. A similar opinion raised by Brunette [37] noted that the critical thinking concept will impact an individual's basic statistical competencies. Interactive application implementation significantly inspired learning motivation in the credit course.
Thus, the designed curriculum and teaching model could affect computational thinking and digital decision-making literacy via the implementation of the experimental course and designed materials. In addition, a limitation of this study was that the subjects were selected from one department of a university in Taiwan, which will constrain the generalizability and applicability of the findings. Therefore, we suggest including a greater diversity of disciplines in a newly designed experimental curriculum to verify the validity and reliability of the results.

Conclusions
The experimental curriculum was designed based on credit courses to teach students skills that are highly relevant to the subject of the credit course in which they were enrolled. This study, designed as an innovative teaching model, involved elements of computational thinking and digital literacy in the designed curriculum. These elements were more comprehensive than those used in some previous studies. Furthermore, the subjects of related studies were focused on undergraduates majoring in science or K-12 students, whereas this study focused on undergraduates majoring in social science. The developed materials complied with the purpose of the curriculum. Thus, this study represents progress and significantly supports the efficiency of the studied teaching outcomes. In the designed course, the credit subject took up 60% to 70% of class time and the incorporated teaching subject took up 30% to 40%. Based on this design, students could have learned the course-required professional knowledge and the additional knowledge simultaneously. Moreover, this design can significantly inspire the motivation and concentration of students with respect to their learning. The ANCOVA test results demonstrated that the students' level of academic confidence and past academic performance have no influence on basic statistical concepts and data visualization software operation skills regarding maps and infographics. Neither the student's achievement nor confidence will affect their learning regarding the designed subjects. However, critical thinking will impact students' basic competencies in statistics significantly. Furthermore, critical thinking is an important factor affecting digital literacy. In this study, the goal of cultivating digital literacy by fostering critical thinking skills is supported by the quasi-experimental design and innovative teaching model.  Data Availability Statement: All subjects gave their informed consent for inclusion before they participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of MOE.