Comprehensive Validation of the TrAI4Nel Simulator for Nelore Artificial Insemination Training: A Controlled Study
Abstract
Simple Summary
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design
2.2. Data Collection and Tools
- Informed Consent: The informed consent process used a binary response system where affirmative responses (‘Yes’) granted access to the questionnaire, while negative responses (‘No’) triggered automatic survey termination.
- Personal Information and Prior Knowledge: This section captured participant demographics including gender, age, and educational background, along with professional experience in livestock management and bovine artificial insemination procedures.
- Training Experience with Biological Models: The first question in this section served as a screening tool to distinguish between experimental and control groups, directing participants to the appropriate subsequent sections. Additionally, it assessed participant perceptions regarding the use of biological reproductive tracts obtained from abattoirs for practical training. Evaluation criteria included perceived realism, ease of manipulation, and educational efficacy for skill acquisition. Control group participants completed the questionnaire at this juncture.
- Training Experience with the Simulator: Participants in the experimental groups, who received exposure to both the TrAI4Nel simulator and biological models, were asked to evaluate their simulator experience and provide comparative assessments relative to biological reproductive models and live animal procedures. This section assessed perceived realism, procedural consistency, and educational utility of the simulation platform.
- Final Evaluation and Perceived Competence: This concluding section incorporated comprehensive assessments of participant satisfaction, self-perceived confidence for independent AI performance, and perceived significance of simulation-based training in procedural skill development.
2.3. Study Population
2.4. Validation Constructs
2.5. Statistical Analysis
3. Results
3.1. Participant Characteristics and Response Rates
3.2. Validity Assessment
3.2.1. Face Validity
3.2.2. Physical Fidelity
3.2.3. Content Validity
3.2.4. Construct Validity
3.2.5. Concurrent Validity
3.2.6. User Satisfaction
3.3. Training Effectiveness
3.3.1. Training Sequence Comparison: “Simulator-First” vs. “Reproductive Tracts-First”
3.3.2. Overall Success Rate Comparison: Control vs. Simulator Groups
3.3.3. Detailed Three-Group Analysis
4. Discussion
4.1. Validation Construct Analysis
4.2. The TrAIN4Nel Effectiveness for Translating Training to Practice
5. Study Limitations and Future Directions
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Braid, H.R. The Use of Simulators for Teaching Practical Clinical Skills to Veterinary Students—A Review. Altern. Lab. Anim. 2022, 50, 184–194. [Google Scholar] [CrossRef]
- Read, E.; Hecker, K. The development and delivery of a systematic veterinary clinical skills education program at the University of Calgary. J. Vet. Sci. Technol. 2013, S4, 004. [Google Scholar] [CrossRef]
- Annandale, A.; Holm, D. A variety of teaching interventions to improve bovine transrectal palpation training. Clin. Theriogenology 2023, 15, 17–24. [Google Scholar] [CrossRef]
- Valliyate, M.; Robinson, N.G.; Goodman, J.R. Current concepts in simulation and other alternatives for veterinary education: A review. Vet. Med. 2012, 57, 325–337. [Google Scholar] [CrossRef]
- Noyes, J.A.; Carbonneau, K.J.; Matthew, S.M. Comparative Effectiveness of Training with Simulators Versus Traditional Instruction in Veterinary Education: Meta-Analysis and Systematic Review. J. Vet. Med. Educ. 2022, 49, 25–38. [Google Scholar] [CrossRef] [PubMed]
- Tuijthof, G.J.; Visser, P.; Sierevelt, I.N.; Van Dijk, C.N.; Kerkhoffs, G.M. Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin. Orthop. Relat. Res. 2011, 469, 1701–1708. [Google Scholar] [CrossRef]
- Baillie, S.; Mellor, D.J.; Brewster, S.A.; Reid, S.W. Integrating a bovine rectal palpation simulator into an undergraduate veterinary curriculum. J. Vet. Med. Educ. 2005, 32, 79–85. [Google Scholar] [CrossRef] [PubMed]
- Dejescu, C.A.; Bel, L.V.; Melega, I.; Muresan, S.M.C.; Oana, L.I. Approaches to Laparoscopic Training in Veterinary Medicine: A Review of Personalized Simulators. Animals 2023, 13, 3781. [Google Scholar] [CrossRef]
- Casimir, R.; Linn, L.; King, H.; McKenzie, D.; Thompson, M.; Perry, R.L. Simulation models: Another approach to teaching and learning. J. Am. Vet. Med. Assoc. 2022, 261, 47. [Google Scholar] [CrossRef] [PubMed]
- Bossaert, P.; Leterme, L.; Caluwaerts, T.; Cools, S.; Hostens, M.; Kolkman, I.; de Kruif, A. Teaching transrectal palpation of the internal genital organs in cattle. J. Vet. Med. Educ. 2009, 36, 451–460. [Google Scholar] [CrossRef]
- Azuaga Filho, H.; Colaço, B.; Payan-Carreira, R. The usefulness of models and simulators for training practical bovine artificial insemination skills. Front. Vet. Sci. 2023, 10, 1240978. [Google Scholar] [CrossRef]
- Annandale, A.; Fosgate, G.T.; Bok, H.; Holm, D.E. Ability of a bovine transrectal palpation objective structured clinical examination to predict veterinary students’ pregnancy diagnosis accuracy. Vet. Rec. 2019, 185, 171. [Google Scholar] [CrossRef]
- Read, E.K.; Baillie, S. Using cognitive task analysis to create a teaching protocol for bovine dystocia. J. Vet. Med. Educ. 2013, 40, 397–402. [Google Scholar] [CrossRef]
- Bienstock, J.; Heuer, A. A review on the evolution of simulation-based training to help build a safer future. Medicine 2022, 101, e29503. [Google Scholar] [CrossRef]
- Torres, K.; Evans, P.; Mamcarz, I.; Radczuk, N.; Torres, A. A manikin or human simulator-development of a tool for measuring students’ perception. PeerJ 2022, 10, e14214. [Google Scholar] [CrossRef] [PubMed]
- Saleem, M.; Khan, Z. Healthcare Simulation: An effective way of learning in health care. Pak. J. Med. Sci. 2023, 39, 1185–1190. [Google Scholar] [CrossRef]
- Azuaga Filho, H.; Colaço, B.; Payan-Carreira, R. Development of a New Simulator for Training Nelore Artificial Insemination. Simul. Gaming 2025, 56, 307–325. [Google Scholar] [CrossRef]
- Veenema, N.J.; Hierck, B.P.; Bok, H.G.J.; Salvatori, D.C.F. Links between learning goals, learning activities, and learning outcomes in simulation-based clinical skills training: A systematic review of the veterinary literature. Front. Vet. Sci. 2024, 11, 1463642. [Google Scholar] [CrossRef] [PubMed]
- Jaśkowski, J.M.; Sobolewski, J.; Wieczorkiewicz, M.; Gehrke, M.; Herudzińska, M. Modern techniques of teaching bovine rectal palpation: Opportunities, benefits and disadvantages of new educational devices. Med. Weter. 2020, 76, 5–10. [Google Scholar] [CrossRef]
- Silva Júnior, A.R.; Cardoso, A.; Lamounier Júnior, E.A.; de Mattos Faro, A. The Use of Virtual Reality for Simulation and Training of Bovine Artificial Insemination with Haptic Devices. In Proceedings of the 14th Symposium on Virtual and Augmented Reality, Rio de Janeiro, Brazil, 28–31 May 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 66–73. [Google Scholar]
- Massoth, C.; Röder, H.; Ohlenburg, H.; Hessler, M.; Zarbock, A.; Pöpping, D.M.; Wenk, M. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med. Educ. 2019, 19, 29. [Google Scholar] [CrossRef]
- Azuaga Filho, H.; Payan-Carreira, R.; Colaço, B. Exploring Morphometric Features of the Female Reproductive Tract in Brazilian Pantanal Cattle. Int. J. Morphol. 2024, 42, 795–804. [Google Scholar] [CrossRef]
- Sawyer, T.; White, M.; Zaveri, P.; Chang, T.; Ades, A.; French, H.; Anderson, J.; Auerbach, M.; Johnston, L.; Kessler, D. Learn, see, practice, prove, do, maintain: An evidence-based pedagogical framework for procedural skill training in medicine. Acad. Med. 2015, 90, 1025–1033. [Google Scholar] [CrossRef] [PubMed]
- Motola, I.; Devine, L.A.; Chung, H.S.; Sullivan, J.E.; Issenberg, S.B. Simulation in healthcare education: A best evidence practical guide. AMEE Guide No. 82. Med. Teach. 2013, 35, e1511–e1530. [Google Scholar] [CrossRef]
- Fletcher, D.J.; Militello, R.; Schoeffler, G.L.; Rogers, C.L. Development and evaluation of a high-fidelity canine patient simulator for veterinary clinical training. J. Vet. Med. Educ. 2012, 39, 7–12. [Google Scholar] [CrossRef]
- Smeak, D.D.; Hill, L.N.; Beck, M.L.; Shaffer, C.A.; Birchard, S.J. Evaluation of an autotutorial-simulator program for instruction of hollow organ closure. Vet. Surg. 1994, 23, 519–528. [Google Scholar] [CrossRef] [PubMed]
- Hamstra, S.J.; Brydges, R.; Hatala, R.; Zendejas, B.; Cook, D.A. Reconsidering fidelity in simulation-based training. Acad. Med. 2014, 89, 387–392. [Google Scholar] [CrossRef] [PubMed]
- Allen, J.A.; Hays, R.T.; Buffardi, L.C. Maintenance Training Simulator Fidelity and Individual Differences in Transfer of Training. Hum. Factors 1986, 28, 497–509. [Google Scholar] [CrossRef]
- Lefor, A.K.; Harada, K.; Kawahira, H.; Mitsuishi, M. The effect of simulator fidelity on procedure skill training: A literature review. Int. J. Med. Educ. 2020, 11, 97–106. [Google Scholar] [CrossRef]
- Brydges, R.; Carnahan, H.; Rose, D.; Rose, L.; Dubrowski, A. Coordinating progressive levels of simulation fidelity to maximize educational benefit. Acad. Med. 2010, 85, 806–812. [Google Scholar] [CrossRef]
- Kneebone, R.L.; Scott, W.; Darzi, A.; Horrocks, M. Simulation and clinical practice: Strengthening the relationship. Med. Educ. 2004, 38, 1095–1102. [Google Scholar] [CrossRef]
- Langebæk, R.; Eika, B.; Jensen, A.L.; Tanggaard, L.; Toft, N.; Berendt, M. Anxiety in veterinary surgical students: A quantitative study. J. Vet. Med. Educ. 2012, 39, 331–340. [Google Scholar] [CrossRef] [PubMed]
- Dejyong, K.; Sunghan, J.; Chutijiratthitikan, N.; Jatchavala, C. A study on stress-induced by anaesthesia and surgery training using live animals in a veterinary school. Thai J. Vet. Med. 2023, 53, 119–129. [Google Scholar] [CrossRef]
- Knight, A. The effectiveness of humane teaching methods in veterinary education. ALTEX 2007, 24, 91–109. [Google Scholar] [CrossRef] [PubMed]
- Modell, J.H.; Cantwell, S.; Hardcastle, J.; Robertson, S.; Pablo, L. Using the human patient simulator to educate students of veterinary medicine. J. Vet. Med. Educ. 2002, 29, 111–116. [Google Scholar] [CrossRef]
- Wichtel, J.; Zur Linden, A.; Khosa, D.; Singh, A.; Sears, W.; Phillips, J. Validation of a Novel Ultrasound Simulation Model for Teaching Foundation-Level Ultrasonography Skills to Veterinary Students. J. Vet. Med. Educ. 2022, 49, 473–483. [Google Scholar] [CrossRef]
- Kappers, W.M.; Cutler, S.L. Simulation to application: The use of computer Simulations to improve real-world application of learning. Comput. Educ. J. 2016, 16, 64–74. [Google Scholar]
- Dalton, J.C.; Robinson, J.Q.; Price, W.J.; DeJarnette, J.M.; Chapwanya, A. Artificial insemination of cattle: Description and assessment of a training program for veterinary students. J. Dairy Sci. 2021, 104, 6295–6303. [Google Scholar] [CrossRef]
- da Silva, C.B.; Pinto, E.M. Efficacy validation of a low-cost handmade simulator (SIMCA-COW) in palpation, ultrasonography evaluation, and artificial insemination in cows. Vet. World 2023, 16, 144–148. [Google Scholar] [CrossRef]
Participants | Groups | n | Mean ± SD | Median | Min | Max |
---|---|---|---|---|---|---|
Trainees | Gp C | 19 | 28.32 ± 2.72 | 26 | 16 | 53 |
Gp 1 | 19 | 23.16 ± 1.50 | 20 | 17 | 39 | |
Gp 2 | 23 | 28.87 ± 2.19 | 27 | 17 | 54 | |
Experts | 14 | 34.43 ± 11.27 | 29 | 24 | 62 |
Groups | Education Level | Frequency | Percentage |
---|---|---|---|
Gp C (n = 19) | Grade school | 1 | 5.26 |
High school | 15 | 78.95 | |
College incomplete | 1 | 5.26 | |
College complete | 2 | 10.53 | |
Gp 1 (n = 19) | Grade school | 0 | 0.00 |
High school | 14 | 73.68 | |
College incomplete | 1 | 5.26 | |
College complete | 4 | 21.05 | |
Gp 2 (n = 23) | Grade school | 0 | 0.00 |
High school | 11 | 47.83 | |
College incomplete | 4 | 17.39 | |
College complete | 8 | 34.78 |
Occupational Activities | Groups | |||
---|---|---|---|---|
GpC (n, %) | Gp1 (n, %) | Gp2 (n, %) | Total | |
Unemployed | 2 (10.53%) | 5 (26.32%) | 1 (4.35%) | 8 |
Self-employed | 1 (5.26%) | 1 (5.26%) | 4 (17.39%) | 6 |
Administrative assistant | 1 (5.26%) | 2 (10.53%) | 6 (26.09%) | 9 |
Entrepreneur | 1 (5.26%) | 0 (0.00%) | 3 (13.04%) | 4 |
Student | 5 (26.32%) | 3 (15.79%) | 4 (17.39%) | 12 |
Livestock worker/cattle herder | 2 (10.53%) | 2 (10.53%) | 1 (4.35%) | 5 |
Rural producer/Farmer | 6 (31.58%) | 5 (26.32%) | 1 (4.35%) | 12 |
Public servant | 1 (5.26%) | 1 (5.26%) | 0 (0.00%) | 2 |
Homemakers | 0 (0.00%) | 0 (0.00%) | 2 (8.70%) | 2 |
Zootechnician | 0 (0.00%) | 0 (0.00%) | 1 (4.35%) | 1 |
Totals | 19 | 19 | 23 | 61 |
Success Assessment | Gp1 | Gp2 | p-Value |
---|---|---|---|
Attempt 1 (%; counts:n) | 5.3 (1:19) | 8.7 (2:23) | 0.664 |
Attempt 2 (%; counts:n) | 5.3 (1:19) | 8.7 (2:23) | 0.664 |
Attempt 3 (%; counts:n) | 10.5 (2:19) | 43.5 (10:23) | 0.037 |
Mean number of attempts until success during training (±SEM) [min; max] | 7.95 ± 0.96 [1, 15] | 4.00 ± 0.74 [1, 13] | <0.001 |
Never successful during training (%; counts:n) | 0.00 (0:19) | 8.69 (2:23) | 0.191 |
Mean overall success during training attempts | 38.3 (134:350) | 34.8 (128:368) | 0.449 |
Assessment success | 84.2 (16:19) | 73.9 (17:23) | 0.414 |
Successful Assessment (%) | GpC | Experimental Groups (Gp1 and Gp2) | p-Value |
---|---|---|---|
Attempt 1 (%; counts:n) | 26.3 (5:19) | 7.14 (3:42) | 0.040 |
Attempt 2 (%; counts:n) | 8.7 (2:19) | 7.14 (3:42) | 0.662 |
Attempt 3 (%; counts:n) | 15.8 (3:19) | 28.6 (12:42) | 0.269 |
Mean number of attempts until success during training (±SEM) [min; max] | 5.29 ± 1.12 [1, 17] | 5.93 ± 0.65 [1, 15] | <0.001 |
Never successful during training (%; counts:n) | 5.00 (1:19) | 4.76 (2:42) | 0.997 |
Mean overall success during training attempts | 37.5 (161:429) | 36.5 (262/718) | 0.724 |
Assessment success | 52.6 (10:19) | 78.6 (33:42) | 0.043 |
Success Assessment | GpC | Gp1 | Gp2 | p-Value |
---|---|---|---|---|
Attempt 1 (%; counts:n) | 26.3 (5:19) | 5.3 (1:19) | 8.7 (2:23) | 0.130 |
Attempt 2 (%; counts:n) | 8.7 (2:19) | 5.3 (1:19) | 8.7 (2:23) | 0.830 |
Attempt 3 (%; counts:n) | 15.8 (3:19) a | 10.5 (2:19) a | 43.5 (10:19) b | 0.027 |
Mean number of attempts until success during training (±SEM) [min; max] | 5.29 ± 1.12 a [1, 17] | 7.95 ± 0.96 b [1, 15] | 4.00 ± 0.74 c [1, 13] | <0.001 |
Never successful during training (%; counts:n) | 5.00 (1:19) | 0.00 (0:19) | 8.69 (2:23) | 0.430 |
Mean overall success during training attempts | 37.5 (161:429) | 38.3 (134:350) | 34.8 (128:368) | 0.586 |
Assessment outcome/success | 52.6 (10:19) a | 84.2 (16:19) b | 73.9 (17:23) c | <0.001 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Azuaga-Filho, H.; Santos, A.; Colaço, B.; Payan-Carreira, R. Comprehensive Validation of the TrAI4Nel Simulator for Nelore Artificial Insemination Training: A Controlled Study. Animals 2025, 15, 2982. https://doi.org/10.3390/ani15202982
Azuaga-Filho H, Santos A, Colaço B, Payan-Carreira R. Comprehensive Validation of the TrAI4Nel Simulator for Nelore Artificial Insemination Training: A Controlled Study. Animals. 2025; 15(20):2982. https://doi.org/10.3390/ani15202982
Chicago/Turabian StyleAzuaga-Filho, Heitor, Alexandre Santos, Bruno Colaço, and Rita Payan-Carreira. 2025. "Comprehensive Validation of the TrAI4Nel Simulator for Nelore Artificial Insemination Training: A Controlled Study" Animals 15, no. 20: 2982. https://doi.org/10.3390/ani15202982
APA StyleAzuaga-Filho, H., Santos, A., Colaço, B., & Payan-Carreira, R. (2025). Comprehensive Validation of the TrAI4Nel Simulator for Nelore Artificial Insemination Training: A Controlled Study. Animals, 15(20), 2982. https://doi.org/10.3390/ani15202982