Using Expert Panel Data to Guide Youth Agricultural Safety and Health Training Resources in the US

Abstract

The US Department of Labor (US DOL) oversees the Agricultural Hazardous Occupations Orders (AgHOs), which identifies specific tasks that youth are prohibited from performing for hire on American farms and ranches. An educational exemption from this public policy is currently in place that allows youth, 14–15 years old, to complete a certification program prior to engaging in agricultural work involving tractors and machinery. However, limited guidance is provided in the legislation regarding the format or content of the tractor and machinery certification exemption. Four AgHOs (tractor and machinery) studies were identified and included in this meta-analysis publication. The research goals of this analysis were to determine basic trends of learning outcomes, and identify educational content to be delivered as a result of these studies. Within each of the four studies, expert panels were used to identify educational learning outcomes. The analysis revealed that 48.0% (n = 184) of all learning outcome items fell within the Tractor-based (Tractor) learning outcome category, 29.8% (n = 114) within General Safety and Health (General), and 22.2% (n = 85) of items in the Machinery-based (Machinery) category. Ultimately, sound educational methods and understanding of fundamental student competence are essential components for any training program, including youth who complete AgHOs tractor and machinery certification programs.

1. Introduction

Since 1970, the US Department of Labor (US DOL) has provisions in the Fair Labor Standards Act (FLSA) to oversee child labor where it applies to farms and ranches [1]. This public policy is known as the Agricultural Hazardous Occupations Orders (AgHOs). Although agricultural practices and technology have changed, the AgHOs have remained largely unchanged since their inception.

The AgHOs identify eleven tasks deemed too hazardous for youth employment. These eleven tasks, listed in Figure 1 can be categorized as work completed with the following systems: 1. Tractor; 2. General Machinery; 3. Specialized Machinery; 4. Livestock; 5. Woodlot; 6. Ladder and Scaffold; 7. Transport; 8. Toxic Atmosphere; 9. Chemicals; 10. Blasting; and 11. Fertilizers.

Figure 1. Employment of youth in agriculture: The law, training programs, and tasks classified as hazardous. Source: agsafety4youth.info [2].

The US DOL has allowed three exemptions to their federal ruling for allowing youth to work in areas of agriculture identified as hazardous. The three exemptions include:

(a)

Youth working on an operation owned by their parent or legal guardian are allowed unrestricted employment opportunities (AgHOs 1-11)

(b)

Youth enrolled in a high school agricultural education program (i.e., formerly vocational agriculture) are permitted to be employed, providing that certain documentation requirements are met (AgHOs 1-6), or

(c)

Youth who complete an education training program, commonly known as a tractor and machinery certification course, offered through the federal Extension service or by agricultural education are eligible for employment (AgHOs 1-2).

The scope of this paper will focus around exemption number three in which youth, ages 14–15 years old, are required to complete a training program and become certified prior to operating tractors and/or machinery for hire. Traditionally, these tractor and machinery training programs were state or locally based and often guided by either the 4-H Petroleum Power Program booklet [3] or the Safe Operation of Agricultural Equipment [4], commonly referred to as the HOBAR manual, which identifies the publisher of this book. The 4-H booklet has since been discontinued, while the HOBAR manual has been republished with minor edits related to its content over the past two decades [5].

There is very little documentation, and no formal reporting system, of tractor and machinery training programs being conducted across the US. Anecdotally, agricultural safety and health professionals are aware of these programs offered by both state and local auspices; however, the number of instructors and the specific content being taught in these programs is usually unknown outside of each professional’s home state. The lack of compliance standards requiring instructors to register their programs has resulted in difficulty tracking the number and types of training being offered [6].

A review of the literature revealed four studies aimed specifically at identifying learning outcomes for tractor and machinery certification programs. These four studies are described below and provide the basis for this research paper. The authors acknowledge other certification programs may be available on a localized level, however, such programs were not included in this publication because documentation of their research methods and/or curriculum development process was not found in the literature.

1.1. Wisconsin Safe Operation of Tractor and Machinery (WI-SOTM)

Subsequent to the 4-H book and HOBAR manual, the earliest documented study was undertaken following state legislation in the early 1990s. Shortly after Wisconsin Act 455 [7], the Wisconsin Safe Operation of Tractor and Machinery certification program (WI-SOTM) was developed by the National Institute for Occupational Safety and Health (NIOSH) supported Wisconsin Center for Agricultural Safety and Health [8]. An expert panel consisting of both agricultural safety and health experts and Extension educators was used to reaffirm state and federal requirements for child labor in agriculture to develop the WI-SOTM curriculum. This expert panel identified 42 learning objectives from which the WI-SOTM curriculum was developed.

1.2. National Safe Tractor and Machinery Operation Program (NSTMOP)

In 2001, the United States Department of Agriculture, National Institute for Food and Agriculture (USDA-NIFA), funded a project to develop an educational safety program titled the National Safe Tractor and Machinery Operation Program (NSTMOP) [9]. The project was led by Pennsylvania State University, with additional curriculum developers at Ohio State University and National Safety Council. A segment of this study was to convene a panel of agricultural safety and health experts that identified minimum core content areas or learning outcomes for a new curriculum. This study identified over 275 concepts that eventually lead to the development of 77 educational safety task sheets with 48 of those being designated “core” or critical to youth’s understanding prior to employment in agriculture occupations [10].

1.3. Gearing Up for Safety (Gearing Up)

A research effort sponsored by the Centers for Disease Control and Prevention—National Institute for Occupational Safety and Health (CDC–NIOSH) in the late 1990s identified core competencies to explore the effectiveness of a computer-based curriculum [11]. The primary aim of this effort was to focus on the most critical cognitive and skill related competencies that youth need to acquire in order to be safe workers and operators of agricultural tractors. The literature depicts collecting validity evidence for competencies through use of an expert panel and a final review from end user groups, in this case high school agricultural educators and high school aged youth. The result was an outline for 12 educational units containing 170 competencies. USDA-NIFA successively funded additional projects that translated the competencies into the Gearing Up for Safety (Gearing Up) curriculum [12]. During a subsequent project, 157 cognitive based competencies were utilized for development of exam items (i.e., test questions) to be used in the tractor and machinery certification process [13].

1.4. National Assessment of Tractor and Machinery Certification Programs (NA-TMCP)

Jepsen conducted an independent study in 2006 to determine program goals and students competencies for the tractor and machinery certification programs [14]. The National Assessment of Tractor and Machinery Certification Programs (NA-TMCP) study used a mixed-mode approach by surveying both community-based instructors and agricultural safety and health professionals. Using a modified Delphi method, a panel of experts identified eight overarching program objectives and 117 student competencies [14] (p. 190). This data was verified using a frame of 467 program instructors in 33 US states [14] (pp. 161–162).

1.5. Other Supporting Effort—North American Guidelines for Children’s Agricultural Tasks

Research conducted by the National Children’s Center for Rural and Agricultural Health and Safety identified age appropriate tasks for youth, ages 7–16 years old, working in agriculture [15]. The primary focus of this consensus document entitled North American Guidelines for Children’s Agricultural Tasks (NAGCAT) was not to develop teaching materials, but rather to assist parents with assigning specific age appropriate tasks to children working on agricultural operations, and have since been updated to reflect more recent trends in agricultural injury data [16]. Due to the fact that NAGCAT did not identify learning outcomes nor develop training materials, this effort was not included in the analysis of this publication.

2. Methods

Expert panels have been used in the areas of agricultural education, extension, and agricultural safety and health to identify learning outcomes, develop curriculum, and provide a form of consensus for making training recommendations [6,14,17,18,19,20,21,22,23,24,25]. Based on a review of literature, four studies that identified learning outcomes specifically for tractor and machinery certification were utilized for analysis in this paper. Three of these studies translated their research into development of up-to-date educational curricula while the fourth focused only on identification of learning outcomes. For this reason, any of the collective four studies will now be referred to as programs or studies instead of curriculum.

The four programs identified from the literature include: Wisconsin Safe Operation of Tractor and Machinery certification program (WI-SOTM), National Safe Tractor and Machinery Operation Program (NSTMOP), Gearing Up for Safety (Gearing Up), and a National Assessment of Tractor and Machinery Certification Programs (NA-TMCP).

2.1. Overview

Independent expert panels were utilized in the development of the 383 learning outcomes collectively identified from the four programs. The learning outcomes from these four programs served as the basis for analysis of this paper. The learning outcomes are summarized by program and type of outcome in Table 1.

Table 1. Summarization of Learning Outcomes by Program and Type.

	WI-SOTM	NSTMOP	NA-TMCP	Gearing Up	TOTAL
	42	48	117	176	383
Outcome Type	Objectives	Minimum Core Content Areas	Competencies	Competencies

2.2. Categorization of Learning Outcomes

Organization of learning outcomes into subcategories was necessary as two of the studies identified competencies, one identified core content areas, and another program developed objectives. A database was established, combining the learning outcomes from each of the four programs into a single Microsoft Excel spreadsheet.

The initial stage of categorization was to separate the learning outcomes into three broad primary categories: General Safety and Health-related, Tractor-related, and Machinery-related learning outcome items. Each item was classified based on terminology and information contained in the lesson plan or chapter of each respective study. The learning outcomes were then subcategorized into 20 more specific secondary classifications as shown in Table 2.

Table 2. Secondary Sub-Classification System.

General Safety and Health	Tractor	Machine
G1—Regulations and Laws	T1—Regulations and Laws	M1—Regulations and Laws
G2—Identification (ID) of Hazard Agents	T2—ID of Hazard Agents	M2—ID of Hazard Agents
G3—Injury Prevention Devices/Methods	T3—Injury Prevention Devices/Methods	M3—Injury Prevention Devices/Methods
G4—All-Terrain Vehicles (ATVs)	T4—Rollover Protective System (ROPS)	M4—Falling Objective Protection Structure (FOPS)
	T5—Preventative Maintenance and Pre-Operational Checks	M5—Preventative Maintenance and Pre-Operational Checks
	T6—Tractor Controls, Functions, and Symbols	M6—Stationary vs. Mobile Equipment
	T7—Connecting Implements	M7—Connecting Implements
	T8—Tractor Operation	M8—Machinery Operation

The three main classifications were labeled G (General), T (Tractor), and M (Machinery), based on language from the federal legislation. The individual programs were placed in the spreadsheet starting with the lowest number of learning outcomes. The secondary classification system was structured beginning with the WI-SOTM program since this program had the fewest number of broadly defined learning outcomes.

After scanning all four educational programs for common trends in learning outcome content, the secondary abbreviation G1—Regulations and Laws was created based on WI-SOTM objective number 1—Youth will increase their knowledge of regulations regarding child labor laws and youthful operators of tractors and farm machinery and NSTMOP task sheet number 1.2—Safety and Health Regulations. Each secondary subcategory included an option for outcomes to be classified as “Too Broad or Too Specific to be Subcategorized”. This initial organization method worked well as the programs with fewer learning outcomes were predominantly general in scope. The outcomes were then further sub-classified into tertiary categories with a goal to maintain mutually exclusive categories, allowing each learning outcome to fit only into one category, which provided specific trends of the learning outcomes. Tertiary classifications for G1—Regulations and Laws mentioned above include G1.1—Federal Regulations, and G1.2—State Regulations. An abbreviated example of this classification process is depicted in Figure 2.

Figure 2. Learning Outcome Hierarchical Classification Example.

Using the abbreviated classification system shown in Figure 2, outcomes were then subcategorized again into 116 specific, tertiary classifications as shown in Table 3.

Table 3. Select Tertiary Sub-Classification Categories.

General Safety and Health	Tractor	Machine
G1.0—Too Broad or Specific to be Subcategorized	T1.0—Too Broad or Specific to be Subcategorized	M1.0—Too Broad or Specific to be Subcategorized
G1.1—Federal Regulations	T1.1—Federal Regulations	M1.1—Federal Regulations
G1.2—State Regulations	T1.2—State Regulations	M1.2—State Regulations
G2.2—Chemicals/Pesticides	T2.2—Obstacles	M2.2—Obstacles
G3.1—Personal Protective Equipment (PPE)	T3.1—Personal Protective Equipment (PPE)	M3.1—Personal Protective Equipment (PPE)
G3.7—Using Senses to Detect Hazards	T3.7—Roll-Over Protective System (ROPS)	M3.7—Falling Object Protective Structure (FOPS)
G4.1—[ATV] Hazards	T8.3—Starting and Stopping	M8.3—Powering Down Implements

2.3. Statistical Analysis

Descriptive analyses were conducted to generate frequency and percentage, in addition to basic correlation analyses using cross-tabulations with chi-square tests. The cross-tabulation with chi-square test was chosen over other methods as the data were categorical rather than 2 × 2, and were descriptive rather than experimental. Minitab 16 was used for these analyses [26]. The overarching goals were to compare the four studies and determine basic trends of learning outcomes across the three main classifications; G (General), T (Tractor), and M (Machinery).

3. Results

The content contained in the four tractor and machinery programs allowed natural breaks within three primary categories. Overall, 29.8% (n = 114) of all learning outcomes fell within the General Safety and Health (General) primary category, 48.0% (n = 184) within Tractor-Based (Tractor), and 22.2% (n = 85) of outcomes in the Machinery-Based (Machinery) category. Figure 3 provides a pictorial representation of the distribution of data among the four programs.

Figure 3. Distribution of Primary Categories across the Four Programs.

Across the four programs, the National Safety Tractor and Machinery Operation Program (NSTMOP) and Gearing up for Safety (Gearing Up) studies placed the greatest emphasis on General items (39.6% and 38.1% respectively). The Wisconsin Safe Operation of Tractors and Machinery (WI-SOTM) program and the National Assessment of Tractor and Machinery Certification Programs (NA-TMCP) place the greatest emphasis on Tractor related learning outcomes (66.7% and 63.3% respectively). Table 4 provides a detailed summary of the count and percentage of learning outcomes within each primary category.

Table 4. Learning Outcome Count and Percentage within the Primary Categories. (n = 383). (p-value < 0.001, Alpha = 0.05, Chi-Square = 34.710).

Primary Categories	Program/Study				Overall
	WI-SOTM	NSTMOP	NA-TMCP	Gearing Up
General Safety and Health (%)	8 (19.1)	19 (39.6)	20 (17.1)	67 (38.1)	114 (29.8)
Tractor (%)	28 (66.7)	22 (45.8)	74 (63.3)	60 (34.1)	184 (48.0)
Machinery (%)	6 (14.3)	7 (14.6)	23 (19.7)	49 (27.8)	85 (22.2)
Total (%)	42 (100)	48 (100)	117 (100)	176 (100)	383 (100)

The Gearing Up Tractor category provided the highest contribution to the Pearson chi-square value of 34.710. Factors that were significant include Gearing Up Tractor Χ²(6, n = 60) = 7.130, p < 0.01, followed by NA-TMCP General Χ²(6, n = 20) = 6.311, p < 0.01, and NA-TMCP Tractor Χ²(6, n = 22) = 5.631, p < 0.01. Each cell’s contribution to the chi-square value is summarized in Table 5.

Table 5. Contribution of Each Cell to Chi-Square Independence Test (Χ²).

Category	Program/Study
	WI-SOTM	NSTMOP	NA-TMCP	Gearing Up
General	1.621	1.555	6.311	4.077
Tractor	3.033	0.049	5.631	7.130
Machinery	1.183	1.252	0.339	2.530

The analysis of secondary sub-classified outcomes revealed significance at the p < 0.01 level, Χ²(42, n = 112) = 118.19. The initial evaluation was for all learning outcomes among the four programs, in order to identify trends among the outcomes. The ten most prevalent outcomes, ordered by study and highest percent were: WI-SOTM T8, NSTMOP G2, NA-TMCP T8, and T5, Gearing Up G3, G2, M2, M3, T3, and T8. The frequency, percent of total, and contribution to chi-square value is reported for these ten learning outcomes, along with a description of each outcome in Table 6.

Table 6. Secondary Learning Outcomes with Highest Frequency, by Program.

Frequency	Percent of Total	Contribution to Χ2	Category Abbrev.	Program—Description of Category
32	8.355	7.927	T8	NA-TMCP—Tractor Operation
28	7.311	1.601	G3	Gearing Up—Injury Prevention Devices/Methods
24	6.266	0.2672	G2	Gearing Up—Identification of Hazard Agents
23	6.005	9.5114	T5	NA-TMCP—Preventative Maintenance and Pre-Op Checks
20	5.222	2.8011	M2	Gearing Up—Identification of Machinery Hazards
16	4.178	6.0516	M3	Gearing Up—Machinery Injury Prevention Devices/Methods
15	3.926	2.366	T3	Gearing Up—Tractor Injury Prevention Devices/Methods
13	3.394	9.156	T8	Gearing Up—Tractor Operation
12	3.133	3.536	T8	WI-SOTM—Tractor Operation
11	2.872	4.432	G2	NSTMOP—Identification of Hazard Agents

The analysis of secondary learning outcomes revealed many cells with less than five values: this is an indicator that the chi-square values may not provide a valid comparison and should be interpreted with caution. Based on this finding, data for all programs were combined and analyzed by secondary category. When looking at the secondary category level, the five most prevalent outcomes, ordered highest percent of total outcomes were: T8-Tractor Operation, G3-Injury Prevention Devices/Methods, G2-ID of Hazards Agents, T5-Preventative Maintenance and Pre-Operational Checks, and M2-Identification of Machinery Hazards. The five most common categories comprised 229 learning outcomes, or 59.8% of all outcomes. The frequency, percent of total, and contribution to chi-square value is reported for these five categories, along with a description of each category in Table 7.

Table 7. Secondary Learning Outcomes with Highest Frequency, by Category.

Frequency	Percent of Total	Contribution to Χ2	Category Abbrev.	Description of Category
64	16.710	20.749	T8	Tractor Operation
48	12.533	3.801	G3	Injury Prevention Devices/Methods
47	12.272	7.952	G2	Identification of Hazard Agents
40	10.444	15.230	T5	Preventative Maintenance and Pre-Op
30	7.833	5.945	M2	Identification of Machinery Hazards
154	40.208	64.509	-	All Other Learning Outcomes
383	100.000	118.187	-	TOTAL

The analysis of tertiary sub-classified learning outcomes revealed significance Χ²(42, n = 448) = 118.19, p < 0.01. Similar to previous sub-classification analysis, many cells had values less than five. This result was expected as the classification into mutually exclusive categories spread the 383 outcomes across more cells and reduced the average number of items per cell.

From a comparison of tertiary sub-categories, seven of the 448 comparisons resulted in a frequency greater than 10. T8.6—Operating on Public Roadways was the most common tertiary item. The frequency and description of the ten most referenced tertiary learning outcomes by program are provided in Table 8.

Table 8. Tertiary Learning Outcomes with Highest Frequency, by Program.

Cumulative Frequency	WI-SOTM	NSTMOP	NA-TMCP	Gearing Up	Category Abbrev.	Description
20	5	2	9	4	T8.6	Operating on Public Roadways
14	2	7	1	4	T6.1	Controls, Gauges, and Instrument Panel
13	0	1	1	11	G3.4	First Aid
13	0	1	11	1	T5.2	Inspections and General Maintenance
10	0	4	0	6	G2.4	Confined Spaces
10	1	2	4	3	G3.1	Personal Protective Equipment (PPE)
10	1	1	4	4	T8.3	Starting and Stopping
293	33	30	87	143	-	All Other Learning Outcomes
383	42	48	117	176	-	TOTAL

4. Discussion

The Agricultural Hazardous Occupations Orders (AgHOs) certification exemption contained in Title 29, Part 570, Subpart E-1 of the Code of Federal Regulations identifies the hours of instruction required by youth who are enrolled a tractor and machinery certification program. The regulations require youth to complete a 24-h training program that emphasizes tractor-related content for 10 h (representing 41.7% of the total training contact hours), machinery for 10 h (41.7%) and four hours of general farm safety and health (16.6%). The federal regulations specifically identify hours of instruction as the primary rubric for training, with little guidance for establishing educational content and student competence beyond a generalized testing procedure to include a written exam and driving test.

Curriculum development educators of four different programs relied on expert panels and personal field experience to develop certification programs to be used on the national level. These four studies identified learning outcomes based on the three primary categories outlined in tractor and machinery certification, but did not predetermine or limit the percentage of learning outcome items for each category.

From this descriptive research study, the strongest emphasis across all four programs was the Tractor (48.0%). The tractor is a common item found on a majority of US farms and continues to be the leading fatality agent for farms and agribusiness [27,28]. Weighted by proportion, this overall average of curriculum content (48.0%) aligns closely with the federal exemption recommendation of 41.7% for tractor training contact time.

The largest discrepancy between the four studies and the federal recommendations is in regards to the General Safety and Health category. The four programs placed more emphasis on general safety and health knowledge with 29.8% distribution of all items compared to a recommended 16.6% of total contact time (i.e., hours of instruction) outlined in the regulations. The tertiary general safety and health items identified by highest combined frequency across all four studies included; First Aid and actions taken in the event of emergencies (item G3.4, n = 13), Confined Spaces (i.e., grain bins, manure storage, and fruit storage) (item G2.4, n = 10), and Personal Protective Equipment-PPE (item G3.1, n = 10). The learning outcomes in these three specific tertiary categories included work practices that could be applied to other agricultural tasks, not just tractor and machinery operation.

Based on the federal recommendations, machinery related content requires the same level of instruction as the tractor (41.6%). However, this area received the lowest proportion across the four studies (22.2%). Several observed key points from the specific training material (i.e., lighting and marking concerns and use of a universal color coding system for controls and components) was included in the tractor section of most programs. While the concepts such as displaying a Slow Moving Vehicle (SMV) emblem and proper coloring of controls can easily be applied from tractors to machinery, the program developers decided not to duplicate material in most instances.

In September 2011, the US DOL posted a Notice of Proposed Rulemaking (NPRM) in the Federal Register [29]. The proposal sought to update the plus 40-year old legislation language in the AgHOs, as well as provide stricter regulation, or enhanced protection for youth working in agriculture. The NPRM suggested removing the “24-h” training exemption and placing responsibility solely on high school agricultural education programs when training was provided. The US DOL proposed that students complete 90 h of systematic instruction at or above the eighth-grade level prior to being eligible to perform certain agricultural tasks. At the conclusion of the public comment period, the NPRM was withdrawn, leaving the 1970 AgHOs in place.

At the same time as the US DOL NPRM discussion, a national study of tractor and machinery certification programs found instructors to be more interested in student competence than total hours of instruction [30]. This study of 330 course instructors (both Extension and high school agricultural education teachers) reported spending a total time-weighted average of 30.05 h of instruction towards Tractor, Machinery, and General Safety and Health topics. This amount of time was higher than the current US DOL program requirements and merely one third of the 90 contact hours proposed in the NPRM. Regardless of the hours spent on student instruction, teachers felt strongly that priority be given to standardized teaching materials as well as up-dated teaching materials, and not focus on hours of student instruction. These instructors also identified key programmatic factors that play a role in the successful delivery of the tractor and machinery training, such as instructors’ awareness of the federal certification program requirements, their amount of administrative support to offer training programs, and their available time and flexibility to address subject matter outside of their state performance standards.

In 2013, the US Department of Agriculture, National Institute of Food and Agriculture (NIFA) funded the Safety in Agriculture for Youth (SAY) initiative [31]. This national project sought to improve and increase safety education resources for youth. Such resources were categorized and placed into an electronic, accessible National Clearinghouse, for access by formal and non-formal program instructors. A significant contribution of this effort was to develop a process that aligned curricula and resources to current nationally recognized learning outcomes that educators could also match to their state educational standards or guidelines. Specifically, content on the National Clearinghouse was aligned to the National Agriculture, Food, and Natural Resources (AFNR) Career Cluster Standards, developed by The National Council for Agricultural Education (NCAE) [32].

The overtones of these external factors surrounding the US DOL’s NPRM support the research performed in this descriptive analysis. Understanding the legislation, the youth training exemptions, instructors’ preference for competency based curricula, and the recent initiative to increase training materials that meet the NCAE’s AFNR Career Cluster Standards, are key implications of a viable training program for US youth working in agriculture.

This descriptive study did not evaluate student competence, or instruments for assessment of student competence (i.e., tests/exams). A plausible next step would be evaluation of exam items (i.e., test questions) for alignment to the learning outcomes described in this document.

5. Conclusions

This descriptive analysis of four different studies provides readers with a synopsis of the learning outcome development research conducted in a specialized area of youth training. Likewise, these data assist curriculum designers and local instructors of tractor and machinery certification programs to meet current training requirements of the regulations, and provide additional guidance on specific educational topics that should be addressed by their respective program.

The expert panels used in these four national studies were consistent in identifying learning outcomes with a focus on agricultural tractors. Specific learning outcomes relating to Tractor Operation (T8), and Preventative Maintenance and Pre-Operation Checks were the most frequently identified learning outcomes. Tractor operation, specifically operation on public roadways, was an item of importance to the collective body of experts in these studies. The Gearing Up and NA-TMCP panels felt strongly about the importance of All-Terrain Vehicles (ATV) (G4) education in these training programs. This ranking placed heavy emphasis on the importance for youth to be trained on the safe operation of these vehicles.

The use of expert panels in consensus building is a well-established practice in the area of agricultural safety and health [6,14,17,18,19,20,21,22,23,24,25]. Future certification programs and enhancements of current programs can be analyzed utilizing expert panel methods. The findings from this research were designed to assist individuals with involvement in public policy, curriculum design, youth development, and agricultural training programs. Ultimately, sound educational methods and understanding of fundamental student competence are essential components for satisfying exemptions to the US Department of Labor’s Agricultural Hazardous Occupations Orders (AgHOs), in addition to similar certification programs for youth.