Research on Predictive Control Algorithm of Vehicle Turning Path Based on Monocular Vision
Abstract
:1. Introduction
- The turning path predictive control algorithm of animal husbandry machinery can provide theoretical reference for accurate navigation control under other path guidance modes.
- The imaging model was built, and the turn path location parameters were calculated according to the camera imaging position relationship to determine the turn path location information.
- On the basis of the vehicle motion model, structure size, and front wheel adjustment parameters, we predicted the vehicle turning trajectory, and the relative position of the vehicle trajectory was measured while the turning point was determined on the basis of the CCD camera.
2. Materials and Methods
2.1. Camera Distortion Correction
2.2. Camera Imaging Model Construction and Turning Path Location
2.2.1. Camera Imaging Model Construction
2.2.2. Position Measurements of Turning Path
2.3. Vehicle Movement Model and Turn Control Algorithm Design
2.3.1. Vehicle Motion Model Establishment
2.3.2. Design of Turning Control Algorithm
3. Results
4. Discussion
- (1)
- Aiming at the navigation path position measurement problem, firstly, we corrected the camera’s distortion. The imaging model was constructed, and the path position acquisition function was established according to the camera imaging position relationship in order to realize the measurement of path position parameters of working pavement.
- (2)
- Aiming at the steering point prediction, firstly, we established the vehicle motion model according to the vehicle steering mode, predicted the vehicle turning trajectory according to the vehicle structure size and front-wheel adjustment parameters, and distinguished the steering point according to the path position parameters.
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- He, D.; Liu, D.; Zhao, K. Advances in Intelligent Perception and Behavior Detection of Animal Information in Precision Animal Husbandry. Trans. CSAM 2016, 47, 231–244. [Google Scholar] [CrossRef]
- Dai, D.-L.; Liu, Z.-H.; Zhao, C.; Qin, Q.; Zhang, C.-Y. Progress of Artificial Intelligence Technology in Animal Husbandry. Anim. Husb. Feed. Sci. 2021, 42, 112–119. [Google Scholar] [CrossRef]
- Yang, S.; Liang, S.; Zheng, Y.; Tan, Y.; Xiao, Z.; Li, B.; Liu, X. Integrated Navigation Models of a Mobile Fodder-Pushing Robot Based on a Standardized Cow Husbandry Environment. Trans. ASABE 2020, 63, 221–230. [Google Scholar] [CrossRef]
- Ting, Z.; Lai, W. Aircraft Pastoral Operational Navigation Monitoring System Based on GNSS. Electron. World 2016, 15, 114–116. [Google Scholar] [CrossRef]
- Yunyong, D. Research on Mapping and Navigation of Environment Inspection Robot in Animal Husbandry Farm. Master’s Thesis, Jiangxi University of Science and Technology, Jiangxi, China, 2020. [Google Scholar]
- Nitsche, M.A.; Cristóforis, P.D. Real-Time On-Board Image Processing Using an Embedded GPU for Monocular Vision-Based Navigation; Springer: Berlin/Heidelberg, Germany, 2012. [Google Scholar]
- Chen, M.; Tang, Y.; Zou, X.; Huang, K.; Huang, Z.; Zhou, H.; Wang, C.; Lian, G. Three-Dimensional Perception of Orchard Banana Central Stock Enhanced by Adaptive Multi-Vision Technology. Comput. Electron. Agric. 2020, 174, 105508. [Google Scholar] [CrossRef]
- Gehrig, D.; Rüegg, M.; Gehrig, M.; Hidalgo-Carrió, J.; Scaramuzza, D. Combining Events and Frames Using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction. IEEE Robot. Autom. Lett. 2021, 6, 2822–2829. [Google Scholar] [CrossRef]
- Zhang, Z.; Cao, Y.; Ding, M.; Zhuang, L.; Tao, J. Monocular Vision Based Obstacle Avoidance Trajectory Planning for Unmanned Aerial Vehicle. Aerosp. Sci. Technol. 2020, 106, 106199. [Google Scholar] [CrossRef]
- Xu, C.; Liu, Z.; Li, Z. Robust Visual-Inertial Navigation System for Low Precision Sensors Under Indoor and Outdoor Environments. Remote Sens. 2021, 13, 772. [Google Scholar] [CrossRef]
- Huang, L.; Wu, G.; Tang, W.; Wu, Y. Obstacle Distance Measurement Under Varying Illumination Conditions Based on Monocular Vision Using a Cable Inspection Robot. IEEE Access 2021, 99, 55955–55973. [Google Scholar] [CrossRef]
- Venkateswaran, N.; Hans, W.J.; Padmapriya, N. Deep Learning Based Robust Forward Collision Warning System with Range Prediction. Multimed. Tool Appl. 2021, 8, 1–19. [Google Scholar] [CrossRef]
- Xu, D.; Han, L.; Tan, M.; Li, Y.F. Ceiling-Based Visual Positioning for an Indoor Mobile Robot with Monocular Vision. IEEE Trans. Ind. Electron. 2009, 56, 1617–1628. [Google Scholar] [CrossRef]
- Guo, Y.; Xiao, Z.; Chen, H.; Huang, L. Planar-Based Visual Positioning for a Mobile Robot with Monocular Vision. In Proceedings of the International Conference on Cloud Computing and Security, Nanjing, China, 16–18 June 2017. [Google Scholar]
- Han, Y.-X.; Zhang, Z.-S.; Dai, M. Monocular Vision System for Distance Measurement Based on Feature Points. Opt. Precis. Eng. 2011, 19, 1082–1087. [Google Scholar] [CrossRef]
- Nie, J.; Wang, N.; Li, J.; Wang, K.; Wang, H. Meta-learning prediction of physical and chemical properties of magnetized water and fertilizer based on LSTM. Plant Methods 2021, 17, 1–13. [Google Scholar] [CrossRef]
- Nie, J.; Li, Y.; She, S.; Chao, X. Magnetic shielding analysis for arrayed Eddy current testing. J. Magn. 2019, 24, 328–332. [Google Scholar] [CrossRef]
- Li, Y.; Yang, J. Few-shot cotton pest recognition and terminal realization. Comput. Electron. Agric. 2020, 169, 105240. [Google Scholar] [CrossRef]
- Wang, P.; Xiao, X.; Zhang, Z.; Sun, C. Study on the Position and Orientation Measurement Method with Monocular Vision System. Chin. Opt. Lett. 2010, 8, 55–58. [Google Scholar] [CrossRef]
- Royer, E.; Lhuillier, M.; Dhome, M.; Lavest, J. Monocular Vision for Mobile Robot Localization and Autonomous Navigation. Int. J. Comput. Vis. 2007, 74, 237–260. [Google Scholar] [CrossRef] [Green Version]
- Wang, M.D.; Han, B.L.; Luo, Q.S. Binocular Visual Navigation and Obstacle Avoidance of Mobile Robots Based on Speeded-Up Robust Features. Comput. Aid. Draft. Des. Manuf. 2013, 23, 22–28. [Google Scholar]
- Zhang, Y.; Wang, X.; Astronautics, S.O. Landmark Fixed High-Precision Binocular Visual Navigation Method. J. Beijing Univ. Aeronaut. Astronaut. 2014, 40, 1305–1311. [Google Scholar]
- Wang, L.; Zhen, L.; Zhang, Z. An On-Line Calibration Algorithm for External Parameters of Visual System Based on Binocular Stereo Cameras. Proc. SPIE Int. Soc. Opt. Eng. 2014, 9301. [Google Scholar] [CrossRef]
- Chen, Q.; Miao, X.; Jiang, H.; Wang, L.; Chen, J. Measurement of Tree Barriers in Transmission Line Corridors Based on Binocular Stereo Vision. In Proceedings of the 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, China, 13–15 December 2018; Volume 2018. [Google Scholar]
- Zhao, L.; Peng, T.; Zhao, Y.; Xia, P.; Xie, Y. Features Extraction of Flotation Froth Based on Equivalent Binocular Stereo Vision. IFAC PapersOnLine 2016, 49, 90–95. [Google Scholar] [CrossRef]
- Shen, T.; Liu, W.; Wang, J. Distance Measurement System Based on Binocular Stereo Vision. In Proceedings of the First IITA International Joint Conference on Artificial Intelligence, Hainan Island, China, 25–26 April 2009. [Google Scholar]
- Zhang, C. Binocular Vision Navigation Method of Marine Garbage Cleaning Robot in Unknown Dynamic Scene. J. Coast. Res. 2020, 103, 864. [Google Scholar] [CrossRef]
- Cheng, L.; Dai, Y.; Peng, R.; Nong, X. Positioning and Navigation of Mobile Robot with Asynchronous Fusion of Binocular Vision System and Inertial Navigation System. Int. J. Adv. Robot. Syst. 2017, 14, 172988141774560. [Google Scholar] [CrossRef] [Green Version]
- Li, Y.; Nie, J.; Chao, X. Do we really need deep CNN for plant diseases identification? Comput. Electron. Agric. 2020, 178, 105803. [Google Scholar] [CrossRef]
- Li, Y.; Chao, X. ANN-Based Continual Classification in Agriculture. Agriculture 2020, 10, 178. [Google Scholar] [CrossRef]
- Li, Y.; Yang, J. Meta-learning baselines and database for few-shot classification in agriculture. Comput. Electron. Agric. 2021, 182, 106055. [Google Scholar] [CrossRef]
- Wu, J.; Snáel, V.; Abraham, A. A Vision-Based Navigation System of Mobile Tracking Robot. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Taipei, Taiwan, 18–21 August 2010; Volume 2010. [Google Scholar]
- Zhang, Z.; Gong, M.; Peng, T. A New Non-Parallel Binocular Stereo Vision Ranging System Using Combinations of Linear and Nonlinear Methods. In Proceedings of the Sixth International Conference on Optical and Photonic Engineering, Shanghai, China, 8–11 May 2018. [Google Scholar]
- Nishat, A. Design of PID Controller for High-Order Process via IMC Scheme in Frequency Domain. In International Conference on Computational and Characterization Techniques in Engineering and Sciences; Department of Electrical Engineering—National Institute of Technology: Telengana, India, 2018. [Google Scholar]
- Zhou, H.; Chen, R.; Zhou, S.; Liu, Z. Design and Analysis of a Drive System for a Series Manipulator Based on Orthogonal-Fuzzy PID Control. Electronics 2019, 8, 1051. [Google Scholar] [CrossRef] [Green Version]
- Urrea, C.; Muñoz, J. Path Tracking of Mobile Robot in Crops. J. Intell. Robot. Syst. 2015, 80, 193–205. [Google Scholar] [CrossRef]
- Netto, S.M. Nested PID Steering Control for Lane Keeping in Autonomous Vehicles. Control Eng. Pract. 2011, 19, 1459–1467. [Google Scholar]
- Dai, A.; Zhou, X.; Liu, X. Design and Simulation of a Genetically Optimized Fuzzy Immune PID Controller for a Novel Grain Dryer. IEEE Access 2017, 5, 14981–14990. [Google Scholar] [CrossRef]
- Li, Y.; Chao, X. Semi-supervised few-shot learning approach for plant diseases recognition. Plant Methods 2021, 17, 1–10. [Google Scholar] [CrossRef] [PubMed]
- Li, Y.; Yang, J.; Wen, J. Entropy-based redundancy analysis and information screening. Digit. Commun. Netw. 2021. In press. [Google Scholar] [CrossRef]
- Hui, L.; Xingqiao, L.; Jing, L. The Research of Fuzzy Immune Linear Active Disturbance Rejection Control Strategy for Three-Motor Synchronous System. CEAI 2015, 17, 50–58. [Google Scholar]
- Li, S.; Xu, H.; Ji, Y.; Cao, R.; Zhang, M.; Li, H. Development of a Following Agricultural Machinery Automatic Navigation System. Comput. Electron. Agric. 2019, 158, 335–344. [Google Scholar] [CrossRef]
- Li, Y.; Chao, X. Toward Sustainability: Trade-Off Between Data Quality and Quantity in Crop Pest Recognition. Front. Plant Sci. 2021, 12, 811241. [Google Scholar] [CrossRef]
- Li, Y.; Chao, X. Distance-Entropy: An effective indicator for selecting informative data. Front. Plant Sci. 2022, 12, 3167. [Google Scholar] [CrossRef]
- Xuan, H.V.; Ivanov, V.E.; Dinh, T.N. Using signals from GLONASS/GPS navigation systems to correct the readings of a digital magnetic compass. ITM Web Conf. 2019, 30, 03006. [Google Scholar] [CrossRef]
- Zhang, M.; Ji, Y.; Li, S.; Cao, R.; Xu, H.; Zhang, Z. Research progress of agricultural machinery navigation technology. Trans. CSAM 2020, 51, 1–18. [Google Scholar] [CrossRef]
- Xiuri, P. Application of RTK GPS system in intelligent agricultural machinery and equipment. Nan Fang Nong Ji 2021, 52, 84–86. [Google Scholar] [CrossRef]
- Yang, Y.; Tiange, W.; Miao, W. Design of unmanned vehicle navigation system based on GPS and four wire lidar. J. Shenyang Univ. Technol. 2020, 39, 13–17, 34. [Google Scholar] [CrossRef]
- Yang, R.; Wang, G.; Gao, W.; Sun, Q.; Zhang, Y. An anti-interference MIMU/GPS vehicle integrated navigation algorithm based on IDNN-EKF. In Proceedings of the Position, Location and Navigation Symposium IEEE, Savannah, GA, USA, 11–14 April 2016. [Google Scholar]
- Wu, D.; Wang, L. Research on autonomous navigation and positioning agricultural machinery equipment based on GPS and machine vision. J. Agric. Mech. Res. 2018, 40, 221–225. [Google Scholar] [CrossRef]
- Lingyu, M.; Lei, M.; Tao, Z. Full integrated navigation based on INS/GPS/magnetometer. Sens. Microsyst. 2019, 38, 33–35, 39. [Google Scholar] [CrossRef]
- Zhang, T.; Li, H.; Chen, D.; Huang, P.; Zhuang, X. Agricultural vehicle path tracking and navigation system based on multi-source sensor information fusion. Trans. CSAM 2015, 46, 37–42. [Google Scholar] [CrossRef]
- Beijing Torch Sensor Tech. Co., Ltd. Available online: http://www.tcsensor.com/product/?12-1.html (accessed on 7 January 2022).
Camera Calibration Parameters | |
---|---|
k1 | −0.345128826247987 |
k2 | 0.191077749729993 |
p1 | 2.450580059939514 × 10−4 |
p2 | −1.939065402701762 × 10−4 |
Range | 360° Measure, Sinusoidal Output | Repeatability | ±0.05% |
---|---|---|---|
Linear range | ±45° ±30° ±20° | Sensitivity | ≈40 mV/1° (Vin = 5 V) |
Working voltage | DC 5 V (DC 3.8~8 V) | Working current | <20 mA |
Output | 1~4 V | Rotation mode | Continuous rotation |
Temperature range | 0~95% RH | Service temperature | −25° C~+75° C |
Lateral to Turn the Path | Measuring Position | Actual Location | Path Measurement Error | Steering Accuracy | |||
---|---|---|---|---|---|---|---|
α | β | α | β | α | β | ||
A | 1.5469 | −6.641 | 1.5589 | −6.7395 | −0.012 | 0.0985 | 0.093 |
B | 1.8290 | −8.130 | 1.8298 | −8.2493 | −0.008 | 0.1193 | 0.075 |
C | 2.356 | −8.7432 | 2.3600 | −8.8118 | −0.004 | 0.0686 | 0.061 |
The average | 1.9106 | −7.8381 | 1.9162 | −7.9335 | −0.006 | 0.0955 | 0.084 |
The maximum | 2.356 | −8.7432 | 2.36 | −8.8118 | −0.004 | 0.1193 | 0.093 |
Lateral to Turn the Path | Measuring Position | Actual Location | Path Measurement Error | Steering Accuracy | |||
---|---|---|---|---|---|---|---|
α | β | α | β | α | β | ||
A | 1.5165 | −6.353 | 1.5179 | −6.3795 | −0.014 | 0.0265 | 0.085 |
B | 1.7982 | −7.980 | 1.8102 | −8.2325 | −0.012 | 0.2525 | 0.072 |
C | 2.314 | −8.135 | 2.320 | −8.1785 | −0.006 | 0.0435 | 0.083 |
The average | 1.8648 | −7.4893 | 1.8737 | −7.7175 | −0.011 | 0.1075 | 0.08 |
The maximum | 2.285 | −8.135 | 2.293 | −8.356 | −0.014 | 0.2525 | 0.085 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Li, Y.; Li, J.; Yao, Q.; Zhou, W.; Nie, J. Research on Predictive Control Algorithm of Vehicle Turning Path Based on Monocular Vision. Processes 2022, 10, 417. https://doi.org/10.3390/pr10020417
Li Y, Li J, Yao Q, Zhou W, Nie J. Research on Predictive Control Algorithm of Vehicle Turning Path Based on Monocular Vision. Processes. 2022; 10(2):417. https://doi.org/10.3390/pr10020417
Chicago/Turabian StyleLi, Yufeng, Jingbin Li, Qingwang Yao, Wenhao Zhou, and Jing Nie. 2022. "Research on Predictive Control Algorithm of Vehicle Turning Path Based on Monocular Vision" Processes 10, no. 2: 417. https://doi.org/10.3390/pr10020417
APA StyleLi, Y., Li, J., Yao, Q., Zhou, W., & Nie, J. (2022). Research on Predictive Control Algorithm of Vehicle Turning Path Based on Monocular Vision. Processes, 10(2), 417. https://doi.org/10.3390/pr10020417