Automatic Vehicle License Plate Extraction Using Region-Based Convolutional Neural Networks and Morphological Operations
Abstract
:1. Introduction
2. Related Works
3. Proposed Methods
3.1. Vehicle Detection
3.2. Vehicle Tracking
3.3. License Plate Extraction
4. Experimental Results
5. Conclusions
Funding
Conflicts of Interest
References
- Donald, L.F.; Maura, L.; David, M.; Eric, D.N.; John, K.P. Humans and Intelligent Vehicles: The Hope, the Help, and the Harm. IEEE Trans. Intell. Veh. 2016, 1, 56–67. [Google Scholar] [Green Version]
- Todd, L. Autonomous Vehicle Implementation Predictions: Implications for Transport Planning; Victoria Transport Policy Institute: Victoria, BC, Canada, 2019. [Google Scholar]
- Ryosuke, O.; Yuki, K.; Kazuaki, T. A survey of technical trend of ADAS and autonomous driving. In Proceedings of the International Symposium on VLSI Technology, Systems and Application, Hsinchu, Taiwan, 28–30 April 2014; pp. 1–4. [Google Scholar]
- Vipin, K.K.; Jordan, T.; Sudeep, P.; Thomas, B. Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles. IEEE Consum. Electron. Mag. 2018, 7, 18–25. [Google Scholar]
- Seyed, M.I.; Hossein, N.M.; Hadi, K.; Yaser, P.F. An Adaptive Forward Collision Warning Framework Design Based on Driver Distraction. IEEE Trans. Intell. Transp. Syst. 2018, 19, 3925–3934. [Google Scholar]
- Vijay, G.; Shashikant, L. Lane Departure Identification for Advanced Driver Assistance. IEEE Trans. Intell. Transp. Syst. 2015, 16, 910–918. [Google Scholar]
- Kim, J.B. Efficient Vanishing Point Detection for Advanced Driver Assistance System. Adv. Sci. Lett. 2017, 23, 4115–4118. [Google Scholar] [CrossRef]
- Kim, J.B. Detection and recognition of road markings for advanced driver assistance system. LNEE 2015, 354, 325–331. [Google Scholar]
- Kim, J.B. Traffic Lights Detection Based on Visual Attention and Spot-Lights Regions Detection. J. Inst. Electron. Eng. Korea 2014, 51, 1260–1270. [Google Scholar] [CrossRef]
- Vehicle Black-Box Related Investigation. Available online: https://trendmonitor.co.kr/tmweb/trend/allTrend/detail.do?bIdx=1549&trendType=CKOREA (accessed on 1 July 2019).
- Zitnick, C.L.; Dollár, P. Edge boxes: Locating object proposals from edges. Comput. Vis. ECCV Springer 2014, 391–405. [Google Scholar] [CrossRef]
- Ross, G.; Jeff, D.; Trevor, D.; Jitendra, M. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 24–27 June 2014; pp. 580–587. [Google Scholar]
- Ross, G. Fast r-cnn. In Proceedings of the IEEE International Conference on Computer Vision, Las Condes, Chile, 11–18 December 2015; pp. 1440–1448. [Google Scholar]
- Shaoqing, R.; Kaiming, H.; Ross, G.; Jian, S. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [Green Version]
- Wenzhen, N.; Pengyu, L.; Kebin, J.; Huimin, L.; Xunping, H. Taxi License Plate Block Detection Based on Complex Environment. In Proceedings of the IEEE 3rd International Conference on Image, Vision and Computing, Chongqing, China, 27–29 June 2018; pp. 81–85. [Google Scholar]
- Chuin, M.W.; Jian, H.L. License plate recognition system. In Proceedings of the Conference on Fuzzy Systems and Knowledge Discovery, Zhangjiajie, China, 15–17 August 2015; pp. 1708–1710. [Google Scholar]
- Naiguo, W.; Xiangwei, Z.; Jian, Z. License Plate Segmentation and Recognition of Chinese Vehicle Based on BPNN. In Proceedings of the Conference on Computational Intelligence and Security, Wuxi, China, 16–19 December 2016; pp. 403–406. [Google Scholar]
- Chi, T.N.; Thanh, B.N.; Sun, T.C. Reliable detection and skew correction method of license plate for PTZ camera-based license plate recognition system. In Proceedings of the Conference on Information and Communication Technology Convergence, Jeju, Korea, 28–30 October 2015; pp. 1013–1018. [Google Scholar]
- Yiwen, L.; Yu, L.; Shaobing, H.; Fangjian, H. Multiple Chinese Vehicle License Plate Localization in Complex Scenes. In Proceedings of the IEEE 3rd International Conference on Image, Vision and Computing, Chongqing, China, 27–29 June 2018; pp. 745–749. [Google Scholar]
- Bai, H.; Liu, C. A hybrid license plate extraction method based on edge statistics and morphology. In Proceedings of the Pattern Recognition, Cambridge, UK, 26 August 2004; pp. 831–834. [Google Scholar]
- Hsi, J.L.; Si, Y.C.; Shen, Z.W. Extraction and recognition of license plates of motorcycles and vehicles on highways. In Proceedings of the Conference on Pattern Recognition, Cambridge, UK, 23–26 August 2004; pp. 356–359. [Google Scholar]
- Kaushik, D.; Hyun, U.C.; Kang, H.J. Vehicle license plate detection method based on sliding concentric windows and histogram. J. Comput. 2009, 4, 771–777. [Google Scholar]
- Kaushik, D.; Kang, H.J. A vehicle license plate detection method for intelligent transportation system applications. Int. J. Cybern. Syst. 2009, 40, 689–705. [Google Scholar]
- Chen, Z.X.; Liu, C.Y.; Chang, F.L.; Wang, G.Y. Automatic license plate location and recognition based on feature salience. IEEE Trans. Veh. Technol. 2009, 58, 3781–3785. [Google Scholar] [CrossRef]
- Herbert, B.; Tinne, T.; Luc, V.G. SURF:Speeded Up Robust Features. LNCS 2006, 3951, 404–417. [Google Scholar]
- Anishiya, P.; Joans, S.M. Number plate recognition for indian cars using morphological dilation and erosion with the aid of ocrs. Int. Conf. Inf. Netw. Technol. 2011, 4, 115–119. [Google Scholar]
- Kim, J.B. MSER and SVM-Based Vehicle License Plate Detection and Recognition System, Communications in computer and information. LNCS 2012, 310, 529–535. [Google Scholar]
- Croce, A.I.; Musolino, G.; Rindone, C.; Vitetta, A. Transport system models and big data: Zoning and graph building with traditional surveys. Int. J. Geoinf. 2019, 8, 187. [Google Scholar] [CrossRef]
1. Convert the detected vehicle region into gray. |
2. Select the lower half region of the detected vehicle region. |
3. Calculate vertical edge pixels using a Sobel edge mask [−1 0 1; −2 0 2; −1 0 1]. |
4. Normalize the vertical edge pixels to [0 1]. |
5. Obtain the binary image using Otsu’s threshold method. |
6. Calculate the horizontal edge histogram. |
7. Set a threshold if (horizontal edge histogram >= 0.7) to 1 otherwise 0. |
8. Apply the vertical and horizontal dilation morphological operation using [80, 4] and [4, 80] rectangle mask |
9. Extract overlapped region from the morphological operation results. |
10. Fill holes using dilation with [4, 10] rectangle mask and erosion with [20] line mask. |
11. Extract the biggest binary region. |
12. Extend the region by 5 pixels. |
Image | VD Rate (%) | LPE Rate (%) | Time (sec.) | ||
---|---|---|---|---|---|
Success | Miss | Success | Miss | ||
Highway | 94 | 12 | 85 | 15 | 0.89 |
City road | 91 | 18 | 83 | 19 | 0.91 |
© 2019 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kim, J. Automatic Vehicle License Plate Extraction Using Region-Based Convolutional Neural Networks and Morphological Operations. Symmetry 2019, 11, 882. https://doi.org/10.3390/sym11070882
Kim J. Automatic Vehicle License Plate Extraction Using Region-Based Convolutional Neural Networks and Morphological Operations. Symmetry. 2019; 11(7):882. https://doi.org/10.3390/sym11070882
Chicago/Turabian StyleKim, JongBae. 2019. "Automatic Vehicle License Plate Extraction Using Region-Based Convolutional Neural Networks and Morphological Operations" Symmetry 11, no. 7: 882. https://doi.org/10.3390/sym11070882
APA StyleKim, J. (2019). Automatic Vehicle License Plate Extraction Using Region-Based Convolutional Neural Networks and Morphological Operations. Symmetry, 11(7), 882. https://doi.org/10.3390/sym11070882