Next Article in Journal
UniText: A Unified Framework for Chinese Text Detection, Recognition, and Restoration in Ancient Document and Inscription Images
Previous Article in Journal
Research on Improving the Accuracy of Wearable Heart Rate Measurement Based on a Six-Axis Sensing Device Integrating a Three-Axis Accelerometer and a Three-Axis Gyroscope
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on the Effectiveness of Tool Box Meeting Educational Materials Based on Information Quantity

1
Department of Safety Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul 01811, Republic of Korea
2
Samsung C&T Corporation, Tower B, 26, Sangil-ro 6-gil, Gangdong-gu, Seoul 04514, Republic of Korea
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2025, 15(14), 7650; https://doi.org/10.3390/app15147650
Submission received: 18 April 2025 / Revised: 15 June 2025 / Accepted: 1 July 2025 / Published: 8 July 2025

Abstract

This study analyzed the effects of various educational materials used in Tool Box Meetings conducted prior to work at construction sites on educational effectiveness. Specifically, the study examined the impact of changes in information quantity, linguistic explanation, and the number of educational materials on the cognitive load of construction workers. The study involved 345 construction workers. Group A utilized visual materials with higher information quantity compared to Group B. Group B, in turn, used visual materials that simplified the information to match linguistic explanations provided for Group A’s materials. Group C conducted the education meeting by reducing the number of educational materials from 13 to 8 after using Group B’s materials. Cognitive load, based on recall counts and recall rates, was then analyzed. In Group A, the use of visual educational materials with high information quantity was associated with reduced learning effectiveness, likely due to increased cognitive load. Meanwhile, in Group B, using educational materials that simplified information to match linguistic explanations resulted in an increase in recall counts and recall rates. In Group C, reducing the number of educational materials resulted in no difference in recall counts compared to Group B; however, there was an increase in the overall recall rate. Based on these research findings, it was concluded that utilizing visually simplified materials aligned with linguistic explanations and considering the cognitive load of workers to establish an appropriate number of educational materials are effective approaches in Tool Box Meeting education.

1. Introduction

Figure 1 presents a graphical representation of industrial accident statistics in South Korea from 2012 to 2021. During this period, the fatality rate in the construction industry ranged from 2.01‱ to 2.32‱ per 10,000 workers, consistently higher than the overall industry average of 1.07‱ to 1.47‱ [1]. As of 2021, the fatality rate in construction was 2.17 times higher than the national industrial average and 1.8 times higher than that of the manufacturing sector. That year, a total of 122,713 workers were injured in industrial accidents, with 2080 fatalities, of which 551 cases (26.5%) occurred in the construction industry (Table 1).
Safety training has become more important in the construction industry to prevent accidents. However, challenges, like short duration trainings for temporary workers, one-time sessions, and difficulty in assessing work environments, persist. To address these, South Korean construction companies have implemented on-site Tool Box Meetings (TBM) to provide training.
At construction sites, TBM typically lasts 10 to 15 min, with about 5 min allocated for safety and health training. Despite the short duration, the training often includes a wide range of information, which can lead to cognitive overload. Cognitive load refers to the total amount of mental effort required to perform a cognitive task. It interacts with the limited capacity of working memory, such that excessive cognitive load can overwhelm working memory and reduce learning effectiveness in processing and storing information simultaneously [2]. When the amount of information exceeds this capacity, it can either fail to be processed effectively or cause overload [3]. Cognitive overload occurs when the cognitive resources required to perform a task exceed the capacity of the cognitive structure [4]. According to cognitive load theory, working memory consists of multiple processing channels; information from sensory registers, such as visual and auditory inputs, is temporarily stored in working memory before being transferred to long-term memory [5].
This theory has been expanded through research in multimedia learning. According to Mayer (2001), learners understand and retain information more effectively when verbal and visual materials are presented together in a coherent and well-aligned format [6]. Sweller et al. (2011) emphasized that reducing extraneous cognitive load—by simplifying visuals and removing unnecessary information—enhances working memory performance and learning efficiency [7]. Moreno and Mayer (2007) further suggested that segmenting complex information and aligning visuals with corresponding verbal explanations help to reduce overload and promote effective learning [8]. These principles are particularly relevant in TBM training, which requires the efficient delivery of safety content in a limited time.
Cognitive load can be divided into three types: germane, extraneous, and intrinsic. Germane cognitive load is beneficial for learning, promoting content organization, schema formation, and automatic processing. It can enhance motivation and engagement. Extraneous cognitive load arises from irrelevant information or distractions that do not contribute to learning objectives, negatively affecting learning outcomes. Intrinsic cognitive load is related to the complexity of the task or content, which depends on the connections between elements and the learner’s prior knowledge or expertise [9,10].
Memory is the cognitive process of encoding, storing, and retrieving information, which is fundamental to learning and behavior [11]. According to the multi-store memory model, memory processing occurs in three stages: sensory memory, short-term memory, and long-term memory. Information briefly resides in sensory memory, is transferred to short-term memory, and, through rehearsal, moves into long-term storage [12]. Ebbinghaus’ forgetting curve highlights that memory decay is most rapid shortly after learning: approximately 58% of information is retained after 19 min; only 21% remains after a month [13].
Based on these insights, this study aimed to explore effective TBM training methods for construction workers, focusing on cognitive load and the effects of varying visual complexity and the number of training items. To do so, three versions of training materials were developed: A-type included 13 visually dense items, B-type presented the same items with simplified visuals and aligned verbal cues, and C-type featured 8 essential items derived from the B-type set (Table 2).
Therefore, the aim of this study is to examine how the complexity of visual information and the number of educational items used in Tool Box Meeting (TBM) materials affect the cognitive load and memory retention of construction workers. Based on this analysis, the study seeks to suggest strategies to enhance the effectiveness of on-site safety training.
To address this aim, recall experiments were conducted to investigate the effects of visual complexity and the number of training items on learning performance and cognitive load.
Accordingly, the study is guided by the following research questions:
RQ1. 
Does the visual complexity of TBM training materials affect the recall performance of construction workers?
RQ2. 
Does reducing the number of TBM training items improve workers’ memory retention?
The following hypotheses were developed:
H1. 
TBM materials with high visual complexity will result in lower recall performance than simplified materials;
H2. 
A reduced number of TBM training items will increase the recall rate of construction workers.

2. Worker Safety Training

2.1. Legal Safety Training

Safety training is a proactive approach aimed at reducing the risks of accidents and maintaining a healthy lifestyle by addressing safety threats. The goal is to implement measures to minimize the impact of potential accidents and prevent injuries, fatalities, or property damage [14]. Effective safety training is essential for establishing a safe construction site and managing safety programs. It is a core component of construction safety strategies [15], with trained workers being more effective at preventing accidents [16].
In South Korea, legal safety training includes regular training, hiring training, training for job changes, special training, and basic safety and health training. For temporary workers, the regulations require at least 1 h of training at hiring or when tasks change, and 2 h for special training. Full-time workers must complete at least 8 h of training at hiring, 2 h for task changes, and 16 h for special training (Table 3) [17,18,19].
Most construction workers are employed on a wage or salary basis; however, daily workers or those with short-term contracts receive significantly shorter training durations. This lack of awareness about work-related risks increases the likelihood of accidents among temporary workers, who make up the majority of construction site staff. As shown in Table 3, temporary workers have fewer and shorter training sessions.

2.2. TBM

As construction progresses, reinforcing safety education for daily workers becomes challenging due to emerging hazards. To address this, many construction companies conduct TBM before work each day. TBM is a brief meeting, often with a tool box, held before work or during shift changes, and is known by various names such as Take 5 Talk, Pre-Start Safety, and OSHA Tool Box Talk [20].
Floyd [21] described TBM as an informal training session led by skilled individuals, lasting 10 to 15 min. Kaskutas [22] stated that TBM improves communication, reduces injuries, and enhances safety. Harrington [23] noted that TBM is vital for raising workers’ risk awareness and promoting safe habits. TBM improves safety by increasing awareness, participation, and preparedness, while ensuring compliance with safety regulations, ultimately enhancing construction site safety.
In South Korea, TBM are not legally mandated by the Industrial Safety and Health Act; there are no standardized procedures or methods explicitly outlined for their implementation. However, construction companies have established their own procedures for conducting TBM in order to reduce accidents.
Table 4 presents an example of the procedures for TBM implementation in a domestic construction company.
Of the 8 steps, steps 5–7 correspond to safety education. TBM is conducted for approximately 10 to 15 min, with around 5 min dedicated to safety education, using paper and tablets. The safety education is composed of work stoppage, accident cases, and safety standards, and includes visual items that convey a large amount of information. Examples of TBM training items are shown in Figure 2, Figure 3 and Figure 4.
According to cognitive load theory, the effectiveness of training is heavily influenced by the way information is structured and delivered. In the context of TBM safety education, where time is limited and workers are exposed to a high volume of visual materials in a short period, managing cognitive load becomes especially critical. When educational content exceeds the working memory capacity of construction workers, it can result in cognitive overload, which may impair learning and recall.
Therefore, applying cognitive load theory to safety education means structuring materials in a way that minimizes extraneous load, manages the intrinsic load according to worker experience, and enhances germane load to support meaningful learning. By simplifying visual content, aligning it with verbal explanations, and reducing the number of presented items, educators can improve comprehension and memory retention among workers, particularly those with limited experience or lower technical expertise. This approach is essential for increasing the effectiveness of brief, high-impact sessions like TBM.

3. Materials and Methods

3.1. Experimental Design

In the current domestic regulatory environment, there is no systematic safety and health education system for daily workers. To address this, TBM sessions have become an important tool; however, they are brief, typically lasting 10 to 15 min, with only 5 min dedicated to safety education, which may reduce effectiveness. This study aims to identify effective TBM components by analyzing cognitive load in daily workers. Recall experiments will examine the impact of visual information complexity and the number of educational items.
Three recall tests were conducted with different educational items: A-type, which included items with high visual information complexity; B-type, which contained items with less visual information complexity than A-type; and C-type, which consisted of 8 items, reducing the 13 items used in B-type (Figure 5, Figure 6 and Figure 7).
The instructional materials used in each group differed in both the amount of visual information and the alignment between images and verbal explanations.
A-type materials displayed 13 safety items on a single slide, with densely packed icons and small text. The visuals were complex; the text was not always aligned clearly with the images.
B-type materials also used 13 items; however, the layout was simplified. Icons were spaced out more clearly and the verbal explanations were positioned next to each corresponding image.
C-type materials included only 8 items, reducing visual overload. Each item had a larger icon and matching verbal explanation, which made it easier to focus on and understand.
The study, conducted from 3 November to 4 November 2022, involved 345 workers at a construction site in Pyeongtaek, analyzing the correlation between recall rates and the number of items presented.

3.2. Participants

As of 2021, there were 1.38 million workers in the construction industry, with 513,280 daily workers [1]. A sample of 345 daily workers from this total, with a 95% confidence level and a 5% margin of error, was used for the experiment. Each of the three groups had 115 workers; they were assigned based on the educational items received. Recall counts and rates were tested; the results are shown in Table 5.
To analyze differences in recall performance across groups, a one-way ANOVA was conducted, followed by Scheffé’s post hoc test to identify specific group differences. Significance was determined at p < 0.05. For key outcome variables (recall count and recall rate), 95% confidence intervals were calculated to quantify the precision of group means.
Chi-squared analysis, along with Fisher’s exact test, were used to examine demographic differences. The tests showed no significant differences in nationality (χ2 = 0.000, p = 1.000), gender (χ2 = 0.302, p = 0.860), age (χ2 = 4.724, p = 0.803), construction experience (χ2 = 15.534, p = 0.114), or accident experience (χ2 = 5.008, p = 0.286).
A priori power analysis was conducted using G*Power 3.1 to determine the required sample size for ANOVA with the three groups. Assuming a medium effect size (f = 0.25), alpha = 0.05, and power = 0.80, the minimum required sample size was calculated to be 159 participants (53 per group). The actual sample size of 345 participants (115 per group) exceeded this requirement, ensuring adequate statistical power for the analyses.

3.3. Materials and Procedure

The educational items used in this experiment were categorized into three types based on the visual complexity of the information and quantity commonly used in current TBM. The items were as follows: A-type educational items, which had a high level of visual complexity, consisted of 2 work stoppage cases, 4 accident cases, and 7 safety standards; B-type items, which had a lower visual complexity compared to A-type, included the same number of 2 work stoppage cases, 4 accident cases, and 7 safety standards; and C-type items, which were a reduced version of the B-type, consisting of 1 work stoppage case, 2 accident cases, and 5 safety standards.
The educational items for A-type used in this experiment were sourced from items provided by the construction company in the Pyeongtaek area, to which the participants belonged. These items excluded notices and other items, and instead focused on work stoppage cases, accident cases, and safety standards. Detailed examples of these items are shown in Figure 5, Figure 6 and Figure 7. After the training, which used each of the three types of educational items, a recall test was conducted to measure the recall frequency and recall rate.
Each type of educational item was presented for 5 min and 35 s (A and B-type) or 3 min and 34 s (C-type), with consistent content across all types, delivered in a multimedia format with the same recorded audio. TBM was conducted at 7:00 AM.; the recall test was given 40 to 50 min later. Workers were informed that the study aimed to assess recall effectiveness and were instructed to mark “no recollection” if they couldn’t remember.
For recall evaluation, workers were considered to have successfully recalled items if they explained both the work stoppage case and accident cause. They were asked to write down all details they could recall for the work stoppage and accident cases, and provide correct answers for safety standards, with questions prompting answers not covered in the training.

4. Recall Test Results

Prior to conducting the ANOVA, assumptions of normality and homogeneity of variance were tested. Normality was assessed using the Shapiro–Wilk test, which showed no significant deviation from normality across groups (p > 0.05). Homogeneity of the variances was verified using Levene’s test, which confirmed equal variances across groups (p > 0.05), validating the use of one-way ANOVA.
The recall count and rate for different educational item types are summarized in Table 6. ANOVA was used to examine differences; the Scheffe test was applied for post-verification. The recall count was 3.02 for A-type, 4.46 for B-type, and 4.14 for C-type, with a statistically significant difference (F = 10.441, p < 0.001, η2 = 0.057), indicating a medium effect size. For recall rates, the recall rate was 0.23 for A-type, 0.34 for B-type, and 0.52 for C-type, with a statistically significant difference (F = 61.884, p < 0.001, η2 = 0.27), indicating a large effect size. The F-value for the recall rate was 61.884, indicating a significant difference.

4.1. Impact of Visual Information Complexity

As shown in Figure 8 and Figure 9, B-type had a higher recall count than A-type, except for item 6, which had a 1.5 times higher recall count and rate. These results suggest that highly complex visual information increases cognitive load, reducing educational effectiveness. Simplifying visual information rather than overwhelming workers with excessive details would improve TBM effectiveness.

4.2. Impact of Number of Educational Items

As shown in Table 5, the average recall count for B-type (4.46) and C-type (4.16) was higher for B-type; however, there was no statistically significant difference. However, the recall rate for B-type was 34%, while C-type had a recall rate of 52%, showing a 1.5 times improvement. C-type, which consisted of eight randomly selected items from B-type, demonstrated higher recall counts for all items (Figure 10 and Figure 11). This suggests that reducing the number of educational items to eight or fewer improves the effectiveness of TBM safety training.

4.3. Effect of Individual Characteristics

4.3.1. Age

ANOVA analysis was conducted to examine the differences in variables by age across the three types, followed by Scheffe post-verification. The results indicated that there were no statistically significant differences in the recall count and rate (Table 7).

4.3.2. Work Experience

ANOVA analysis and the Scheffe test revealed differences in recall based on work experience. As shown in Table 8, in A-type, workers with 3–5 years of experience recalled more content than those with less than 1 year. In B-type, workers with 5–10 years of experience recalled more than those with less than 1 year. However, in C-type, no significant differences were found. Figure 12 and Figure 13 show that workers with less than one year of experience had lower recall counts and rates across all types, likely due to the impact of experience on learning and memory. Overall, B-type had a higher average recall rate than A-type; C-type had a higher recall rate than B-type.

4.3.3. Job Position

ANOVA analysis and post-verification using the Scheffe method showed no statistically significant differences in the recall count and overall recall rate (Table 9), based on job title (team leaders, skilled workers, and unskilled workers). However, Figure 14 and Figure 15 reveal that non-skilled workers had lower recall counts and rates compared to skilled workers across all three types. The recall rates for B-type were higher than A-type, and C-type had higher recall rates than B-type, with the gap between skilled and non-skilled workers narrowing. This suggests that educational items with a balanced number of items and low visual complexity are particularly important for non-skilled workers.

4.3.4. Accident Experience

The ANOVA analysis and Scheffe’s method showed no statistically significant differences in recall count and rate (Table 10) based on accident experience. Workers with direct or indirect accident experience, and those with no accident-related experience, all had similar recall performance. This indicates that direct or indirect experience with accidents did not impact the effectiveness of the education. Direct experience refers to personally encountering an accident, while indirect experience refers to witnessing or hearing about an accident.

5. Discussion

This study examined how the complexity and quantity of TBM training materials affect cognitive load and recall performance among construction workers. The findings indicated that simplifying visual materials and reducing the number of items led to improved recall, particularly for less experienced and non-technical workers. These results align with cognitive load theory, which suggests that instructional design should minimize extraneous cognitive load and optimize intrinsic and germane load to support learning.
The superior recall performance in Group B and C supports previous research by Mayer (2001) and Sweller et al. (2011), emphasizing that well-aligned, simplified multimedia content can significantly enhance memory retention in high-risk, time-constrained settings [6,7]. This suggests that even short safety briefings, like TBMs, can be made more effective when designed according to evidence-based learning principles.
Moreover, the study has practical implications beyond the construction industry. Fields, such as manufacturing, logistics, and healthcare, where fast-paced environments require quick and effective safety communication, may benefit from the same principles. Adopting simplified, segmented training materials may enhance training outcomes across diverse sectors.
However, the study has limitations. Variables, such as literacy level, language comprehension, and prior exposure to training content, were not fully controlled. Future studies should explore how cognitive capacity and educational background interact with material design. Additionally, while recall performance was tested shortly after training, the long-term retention effects were not measured.
These findings provide a foundation for improving the effectiveness of TBM and similar training formats by integrating cognitive science principles into content design.
This study contributes to the theoretical development of cognitive load theory by applying it to the field of occupational safety training, specifically within the time-constrained environment of construction TBM sessions. By demonstrating how simplified, visually aligned, and limited-scope materials improve learning outcomes, the study shows how CLT can be operationalized in real-world safety education settings. This expands the applicability of CLT beyond classroom or multimedia environments into short-format, high-risk, and field-based training programs. Moreover, it offers a structured framework for developing safety training materials that reduce extraneous load, adapt to intrinsic task complexity, and enhance germane load—making safety communication more effective and cognitively efficient for diverse worker populations.

6. Conclusions

This study investigated the effectiveness of safety education conducted in during TBM in consideration of cognitive load, The results are as follows:
First, when using educational items with high visual complexity (A-type) in TBM, the effectiveness of the training was found to decrease in terms of cognitive load. The recall count for the A-type items was 3.02; the recall rate was 23.2%. In contrast, the B-type educational items, which have low visual complexity, showed a recall count of 4.46 and a recall rate of 34.3%, which is an increase of about 1.5 times compared to A-type.
Second, as a result of analyzing the cognitive load according to the number of TBM training items, there was no significant difference in the recall count between B-type items (4.46) and C-type items (4.15). However, in terms of the overall recall rate, C-type items had a significantly higher rate at 52%, compared to 34% for B-type items. This finding indicates that focusing training on 8 key items, which are considered most important for accident prevention out of the 13 items, can enhance the effectiveness of the training content for accident prevention. It also indicates that simply spreading a large number of training items does not necessarily result in better training outcomes.
Third, the analysis of individual characteristics revealed no significant differences based on age, job position, or accident experience. However, when comparing new workers with less than one year of experience to other worker groups, it was found that reducing visual complexity and limiting the number of educational items allows for more effective delivery of training content to new workers. Additionally, when reducing visual complexity and providing the appropriate number of educational items, non-technical workers benefitted more from the training than technical workers.
Fourth, the findings of this study align with the principles of cognitive load theory and multimedia learning. According to Mayer’s cognitive theory of multimedia learning [6], people learn better from words and pictures than from words alone, particularly when information is presented in a coherent, integrated format. This supports the study’s finding that simplified visual materials aligned with verbal explanations led to better recall performance.
Furthermore, previous studies have shown that reducing extraneous load and segmenting information in multimedia learning environments enhances working memory efficiency [7,8]. The current results, demonstrating the benefits of reducing visual complexity and limiting the number of educational items, are consistent with these multimedia learning principles and further validate their application in high-risk, time-limited training settings like TBM.
Finally, this study has certain limitations that should be considered. While the demographic variables, such as age, work experience, and job type, were statistically analyzed, the study did not fully account for how differences in literacy levels, prior training exposure, or language comprehension may have affected participants’ cognitive load or memory performance. Particularly in construction settings, workers may have diverse educational backgrounds, which could influence how they process visual or textual training materials. Future research should incorporate assessments of literacy and cognitive capacity to better tailor safety education to worker characteristics.
These findings may also have broader applicability beyond construction settings. Industries, such as manufacturing, logistics, and healthcare, where workers often receive brief, routine safety training under time constraints, could benefit from the same principles. Simplifying training materials, reducing cognitive load, and aligning visuals with verbal instructions can improve training effectiveness in various high-risk or fast-paced work environments. Adapting the TBM framework using cognitive load principles may support better learning and retention across diverse sectors.
In conclusion, TBM training items should utilize resources that simplify the complexity of visual information; the appropriate number of items should be selected in order of importance, considering the limits of cognitive load. When a large amount of information is delivered in a short time, the effectiveness of the training is diminished due to cognitive overload. Therefore, rather than overwhelming trainees with excessive information, it would be more effective to prioritize and deliver the most critical training items for accident prevention, reflecting the characteristics of the field. This approach is believed to contribute towards conducting effective training for accident prevention.
Furthermore, it is necessary to develop effective TBM training items that take into account the characteristics of cognitive load by varying the complexity of visual information and the number of items. Such an approach can contribute to implementing effective TBM for accident prevention.

Author Contributions

Data curation, D.C.C.; formal analysis, D.C.C. and D.P.B.; investigation, D.C.C., D.P.B., J.Y.P. and Y.B.K.; methodology, D.C.C., D.P.B. and J.Y.P.; resources, D.C.C.; supervision, J.Y.P.; writing—original draft, D.P.B. and Y.B.K.; writing—review and editing, J.Y.P. and Y.B.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding authors.

Conflicts of Interest

Author Doo Chun Choi was employed by Samsung C&T Corporation. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. National Statistics Portal. Overall Accident Status and Analysis—By Industry (Subcategories of Industry). Available online: https://kosis.kr/statHtml/statHtml.do?orgId=118&tblId=DT_11806_N000&conn_path=I3 (accessed on 3 February 2025).
  2. Chandler, P.; Sweller, J. Cognitive load theory and the format of instruction. Cogn. Instr. 1991, 8, 293–332. [Google Scholar] [CrossRef]
  3. Sweller, J. Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 1994, 4, 295–312. [Google Scholar] [CrossRef]
  4. Moreno, R.; Mayer, R. Cognitive principles of multimedia learning: The role of modality and contiguity. J. Educ. Psychol. 1999, 91, 358–368. [Google Scholar] [CrossRef]
  5. Baddeley, A. The magic number and the episodic buffer. Behav. Brain Sci. 2001, 24, 117–118. [Google Scholar] [CrossRef]
  6. Mayer, R.E. Multimedia Learning; Cambridge University Press: Cambridge, UK, 2001. [Google Scholar]
  7. Sweller, J.; Ayres, P.; Kalyuga, S. Cognitive Load Theory; Springer: New York, NY, USA, 2011. [Google Scholar]
  8. Moreno, R.; Mayer, R.E. Interactive multimodal learning environments. Educ. Psychol. Rev. 2007, 19, 309–326. [Google Scholar] [CrossRef]
  9. Jalani, N.H.; Sern, L.C. The example-problem-based learning model: Applying cognitive load theory. Procedia Soc. Behav. Sci. 2015, 195, 872–880. [Google Scholar] [CrossRef]
  10. Park, Y.H. The Impact of Cognitive Load of Instructional Items, Presentation Methods, and Working Memory Capacity on Young Children’s Learning Outcomes. Master’s Thesis, Seoul National University, Seoul, Republic of Korea, 2021; pp. 31–34. [Google Scholar]
  11. Cherry, K. What Is Memory? Verywell Mind. Available online: https://www.verywellmind.com/what-is-memory-2795006 (accessed on 4 July 2025).
  12. Atkinson, R.C.; Shiffrin, R.M. Human memory: A proposed system and its control processes. In Psychology of Learning and Motivation; Spence, K.W., Spence, J.T., Eds.; Academic Press: New York, NY, USA, 1968; pp. 89–195. [Google Scholar]
  13. Ebbinghaus, H. Memory: A Contribution to Experimental Psychology. Ann. Neurosci. 2013, 20, 155–156, Original Work Published 1885. [Google Scholar] [CrossRef] [PubMed]
  14. Baddeley, A.; Eysenck, M.W.; Anderson, M.C. Memory, 2nd ed.; Psychology Press: New York, NY, USA, 2015. [Google Scholar]
  15. Haupt, T.C. A study of management attitudes to a performance approach to construction worker safety. J. Constr. Res. 2003, 4, 87–100. [Google Scholar] [CrossRef]
  16. Becker, P.; Morawetz, J. Impacts of health and safety education: Comparison of worker activities before and after training. Am. J. Ind. Med. 2004, 46, 63–70. [Google Scholar] [CrossRef] [PubMed]
  17. Ministry of Employment and Labor. Safety and Health Training Guide. Available online: https://www.moel.go.kr/policy/policydata/view.do?bbs_seq=20220200966 (accessed on 3 February 2025).
  18. Ministry of Employment and Labor. Enforcement Rules of the Industrial Safety and Health Act. Appendix 4: Training Hours by Safety and Health Education Program. Available online: https://www.law.go.kr/법령별표서식/(산업안전보건법%20시행규칙,20230928,별표4) (accessed on 3 February 2025).
  19. Ministry of Employment and Labor. Regulations on Safety and Health Education [Notice No. 2022-71 of the Ministry of Employment and Labor]; Ministry of Employment and Labor: Gwacheon, Republic of Korea, 2022.
  20. Kumar, M.N.; Kannan, B.; Thangaraj, G. Developing the safety culture through risk assessment by implementing MS-5 in toolbox talk. Int. J. Adv. Trends Eng. Technol. 2019, 65–72. [Google Scholar]
  21. Peters, R.H. (Ed.) Strategies for Improving Miners’ Training; Mining Publication: London, UK, 2002; Report No. 2002-156; pp. 1–54. [Google Scholar]
  22. Kaskutas, V.; Jaegers, L.; Dale, A.M.; Evanoff, B.A. Tool box talks: Insights for improvement. Prof. Saf. 2016, 61, 33–37. [Google Scholar]
  23. Harrington, D.; Materna, B.; Vannoy, J.; Scholz, P. Conducting effective tailgate trainings. Health Promot. Pract. 2009, 10, 359–369. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Death rate per 10,000 people by year (2012–2021).
Figure 1. Death rate per 10,000 people by year (2012–2021).
Applsci 15 07650 g001
Figure 2. Example of TBM training items for work stoppage.
Figure 2. Example of TBM training items for work stoppage.
Applsci 15 07650 g002
Figure 3. Example of TBM training items for accident case study.
Figure 3. Example of TBM training items for accident case study.
Applsci 15 07650 g003
Figure 4. Example of TBM training items for safety standards.
Figure 4. Example of TBM training items for safety standards.
Applsci 15 07650 g004
Figure 5. A-type educational items (high visual complexity).
Figure 5. A-type educational items (high visual complexity).
Applsci 15 07650 g005
Figure 6. B-type of educational items (low visual complexity).
Figure 6. B-type of educational items (low visual complexity).
Applsci 15 07650 g006
Figure 7. C-type educational items (B-type with 13 items reduced to 8).
Figure 7. C-type educational items (B-type with 13 items reduced to 8).
Applsci 15 07650 g007
Figure 8. Recall count of each item for A and B-type.
Figure 8. Recall count of each item for A and B-type.
Applsci 15 07650 g008
Figure 9. Average recall count for A- and B-type.
Figure 9. Average recall count for A- and B-type.
Applsci 15 07650 g009
Figure 10. Recall rate of each item for B- and C-type.
Figure 10. Recall rate of each item for B- and C-type.
Applsci 15 07650 g010
Figure 11. Average recall rate for B- and C-type.
Figure 11. Average recall rate for B- and C-type.
Applsci 15 07650 g011
Figure 12. Average recall count based on work experience.
Figure 12. Average recall count based on work experience.
Applsci 15 07650 g012
Figure 13. Average recall rate based on work experience.
Figure 13. Average recall rate based on work experience.
Applsci 15 07650 g013
Figure 14. Average recall count based on job position.
Figure 14. Average recall count based on job position.
Applsci 15 07650 g014
Figure 15. Average recall rate based on job position.
Figure 15. Average recall rate based on job position.
Applsci 15 07650 g015
Table 1. Accident occurrence by industry in 2021. (Unit: persons).
Table 1. Accident occurrence by industry in 2021. (Unit: persons).
IndustryNumber of EmployeesNumber of Work Injury CasesNumber of Fatalities
Construction industry2,378,75129,943551
Manufacturing industry3,959,78031,709512
Mining industry10,2573336349
Other industries12,957,77757,725668
Total19,306,565122,7132080
Table 2. Summary of instructional styles and material characteristics for Groups A, B, and C.
Table 2. Summary of instructional styles and material characteristics for Groups A, B, and C.
GroupNumber of ItemsVisual ComplexityExplanation Style
A13HighVisual-focused materials with dense information
B13Medium (Simplified from A)Simplified visuals matched with verbal guidance
C8Medium (Same as B)Reduced number of items for focused delivery
Table 3. Training duration and frequency based on the safety education curriculum.
Table 3. Training duration and frequency based on the safety education curriculum.
CurriculumTarget GroupDurationFrequency
Regular trainingOffice workersMore than 3 hPer quarter
Workers other than office workersWorkers directly engaged in salesMore than 3 hPer quarter
Workers other than those directly engaged in salesMore than 6 hPer quarter
ManagerMore than 16 hPer year
Recruitment trainingTemporary workersMore than 1 hPer occurrence
Permanent workerMore than 8 hPer occurrence
Training for changes in work tasksTemporary workersMore than 1 hPer occurrence
Permanent workerMore than 2 hPer occurrence
Special trainingTemporary workers engaged in specified tasksMore than 2 hPer occurrence
Temporary workers engaged in tower crane signaling workMore than 8 hPer occurrence
Workers, excluding temporary workers, engaged in specified tasksMore than 16 h
For short-term or intermittent tasks, at least 2 h.
Per occurrence
Basic safety and health training for the construction industryTemporary workersMore than 4 hOnly once
Table 4. Example of TBM procedures.
Table 4. Example of TBM procedures.
StepContent
1GatheringMeeting at the work site by work team (up to 15 people)
2Greetings and stretchingMutual salutation, checking physical condition, warming up, etc
3Personal protective equipment (PPE) checkCheck the condition of personal protective equipment
4Emergency Evacuation proceduresCheck emergency evacuation routes, emergency contact network, and AED location
5Hazard prevention TrainingCommunicate work details, hazards, and safety measures
6Hazardous work demonstrationExplain hazards or demonstrate safe work methods
7Hazard identificationClearly specify and identify hazardous factors
8Notification deliveryAll notices, conflicts with other tasks, and other necessary items
Table 5. Differences between groups A, B, and C.
Table 5. Differences between groups A, B, and C.
Group of PeopleTotalχ2
ABC(p)
NationalityLocalPersons1151121133400.000
(1.000)
%100100100100
ForeignerPersons0000
%0000
GenderMalePersons1071041023130.302
(0.860)
%93.092.091.192.1
FemalePersons891027
%7.08.08.97.9
AgeTwentiesPersons212522684.724
(0.803)
%18.422.119.520.0
ThirtiesPersons33252381
%28.922.120.423.8
FortiesPersons25252474
%21.922.121.221.8
FiftiesPersons343843115
%29.833.638.133.8
60 and abovePersons1012
%0.90.00.90.6
Construction experienceLess than one yearPersons28354310615.534
(0.114)
%24.631.038.131.2
Less than 1 to 2 yearsPersons1816943
%15.814.28.012.6
Less than 2 to 3 yearsPersons891128
%7.08.09.78.2
Less than 3 to 5 yearsPersons12182050
%10.515.917.714.7
Less than 5 to 10 yearsPersons26241666
%22.821.214.219.4
More than 10 yearsPersons22111447
%19.39.712.413.8
Accident experienceIndirect experiencePersons4351451395.008
(0.286)
%37.745.139.840.9
Direct experiencePersons94316
%7.93.52.74.7
No experiencePersons625865185
%54.451.357.554.4
Table 6. Post-verification and variance analysis.
Table 6. Post-verification and variance analysis.
VariableTypeAverageStandard DeviationFpPost-Verification
Recall countA3.022.51710.4410.000 **B,C > A
B4.462.623
C4.142.064
Total3.872.485
Recall rateA0.230.19161.8840.000 **C > B > A
B0.340.202
C0.520.258
Total0.350.257
** p < 0.01.
Table 7. The mean and standard deviation of the educational items by age.
Table 7. The mean and standard deviation of the educational items by age.
VariableTypeAgeAverageStandard DeviationFpPost-Verification
Recall countATwenties (a)2.862.4354.2950.003 **d > b
Thirties (b)1.791.916
Forties (c)3.362.871
Fifties (d)4.152.376
60 and over (e)2.000.000
Total3.042.520
BTwenties3.562.0221.5690.201n/a
Thirties4.442.709
Forties4.482.903
Fifties5.032.726
Total4.452.646
CTwenties3.951.5880.9590.433n/a
Thirties4.352.347
Forties4.422.185
Fifties3.881.966
60 and over1.000.000
Total4.082.032
Recall rateATwenties (a)0.180.1734.7580.001 **d > b,e
Thirties (b)0.100.145
Forties (c)0.200.213
Fifties (d)0.290.186
60 and over (e)0.100.000
Total0.190.191
BTwenties0.270.1551.5720.200n/a
Thirties0.340.210
Forties0.350.224
Fifties0.390.211
Total0.340.204
CTwenties0.500.1990.9550.436n/a
Thirties0.550.293
Forties0.550.273
Fifties0.490.246
60 and over0.130.000
Total0.510.254
** p < 0.01. Means sharing the same letter are not significantly different at p < 0.05 (post hoc test).
Table 8. Mean and standard deviation of educational item types based on work experience.
Table 8. Mean and standard deviation of educational item types based on work experience.
VariableTypeWork ExperienceAverageStandard DeviationFpPost-Verification
Recall countALess than one year (a)1.861.9003.9360.003 **d > a
Less than 1 to 2 years (b)3.222.669
Less than 2 to 3 years (c)2.132.295
Less than 3 to 5 years (d)4.752.800
Less than 5 to 10 years (e)2.692.223
More than 10 years (f)4.142.624
Total3.032.526
BLess than one year (a)3.172.2163.2140.010 *e > a
Less than 1 to 2 years (b)4.251.732
Less than 2 to 3 years (c)5.112.205
Less than 3 to 5 years (d)5.062.999
Less than 5 to 10 years (e)5.632.975
More than 10 years (f)4.732.724
Total4.452.646
CLess than one year3.561.8031.4970.197n/a
Less than 1 to 2 years4.671.658
Less than 2 to 3 years3.641.963
Less than 3 to 5 years4.802.016
Less than 5 to 10 years4.502.394
More than 10 years4.142.349
Total4.082.032
Recall rateALess than one year0.100.1323.9310.003 **d > a
Less than 1 to 2 years0.210.204
Less than 2 to 3 years0.110.189
Less than 3 to 5 years0.320.217
Less than 5 to 10 years0.170.165
More than 10 years0.280.205
Total0.190.191
BLess than one year (a)0.240.1713.1800.010 *e > a
Less than 1 to 2 years (b)0.330.133
Less than 2 to 3 years (c)0.390.170
Less than 3 to 5 years (d)0.390.232
Less than 5 to 10 years (e)0.430.231
More than 10 years (f)0.360.210
Total0.340.204
CLess than one year0.450.2251.4920.198n/a
Less than 1 to 2 years0.580.208
Less than 2 to 3 years0.460.244
Less than 3 to 5 years0.600.251
Less than 5 to 10 years0.560.300
More than 10 years0.520.294
Total0.510.254
* p < 0.05, ** p < 0.01. Means sharing the same letter are not significantly different at p < 0.05 (post hoc test).
Table 9. Mean and standard deviation of educational items by job position.
Table 9. Mean and standard deviation of educational items by job position.
VariableTypePositionAverageStandard DeviationFpPost-Verification
Recall countATeam leader3.462.8831.8970.155n/a
Technical position3.122.286
Non-technical position2.232.338
Total3.032.526
BTeam leader4.452.2960.7790.461n/a
Technical position4.662.805
Non-technical position3.932.344
Total4.452.646
CTeam leader3.892.8040.5440.582n/a
Technical position4.252.071
Non-technical position3.831.807
Total4.062.033
Recall rateATeam leader0.220.2162.0220.137n/a
Technical position0.200.178
Non-technical position0.130.171
Total0.190.191
BTeam leader0.340.1760.7740.464n/a
Technical position0.360.217
Non-technical position0.300.181
Total0.340.204
CTeam leader0.490.3500.5480.580n/a
Technical position0.530.259
Non-technical position0.480.226
Total0.510.254
Table 10. The mean and standard deviation of the educational items by accident experience.
Table 10. The mean and standard deviation of the educational items by accident experience.
VariableTypeAccident ExperienceAverageStandard DeviationFpPost-Verification
Recall countAIndirect3.372.5820.9640.384n/a
Direct3.443.046
No2.732.410
Total3.032.526
BIndirect4.922.7412.3940.096n/a
Direct5.753.202
No3.952.460
Total4.452.646
CIndirect4.312.0760.6150.543n/a
Direct3.333.215
No3.951.964
Total4.082.032
Recall rateAIndirect0.220.1950.9510.389n/a
Direct0.220.228
No0.170.184
Total0.190.191
BIndirect0.380.2122.4130.094n/a
Direct0.450.246
No0.300.190
Total0.340.204
CIndirect0.540.2590.6030.549n/a
Direct0.420.403
No0.500.246
Total0.510.254
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bang, D.P.; Kwon, Y.B.; Choi, D.C.; Park, J.Y. A Study on the Effectiveness of Tool Box Meeting Educational Materials Based on Information Quantity. Appl. Sci. 2025, 15, 7650. https://doi.org/10.3390/app15147650

AMA Style

Bang DP, Kwon YB, Choi DC, Park JY. A Study on the Effectiveness of Tool Box Meeting Educational Materials Based on Information Quantity. Applied Sciences. 2025; 15(14):7650. https://doi.org/10.3390/app15147650

Chicago/Turabian Style

Bang, Dae Pyeong, Young Beom Kwon, Doo Chun Choi, and Jong Yil Park. 2025. "A Study on the Effectiveness of Tool Box Meeting Educational Materials Based on Information Quantity" Applied Sciences 15, no. 14: 7650. https://doi.org/10.3390/app15147650

APA Style

Bang, D. P., Kwon, Y. B., Choi, D. C., & Park, J. Y. (2025). A Study on the Effectiveness of Tool Box Meeting Educational Materials Based on Information Quantity. Applied Sciences, 15(14), 7650. https://doi.org/10.3390/app15147650

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop