Diving Deep: A Survey of Deep Learning Techniques for Anomaly Detection in Automatic Vehicle Number Plate Recognition Systems
| International Journal of Electrical and Electronics Engineering |
| © 2024 by SSRG - IJEEE Journal |
| Volume 11 Issue 8 |
| Year of Publication : 2024 |
| Authors : Bhawana Srivastava, Poonam Chahal |
10.14445/23488379/IJEEE-V11I8P124
How to Cite?
Bhawana Srivastava, Poonam Chahal, "Diving Deep: A Survey of Deep Learning Techniques for Anomaly Detection in Automatic Vehicle Number Plate Recognition Systems," SSRG International Journal of Electrical and Electronics Engineering, vol. 11, no. 8, pp. 264-274, 2024. Crossref, https://doi.org/10.14445/23488379/IJEEE-V11I8P124
Abstract:
Automatic Vehicle Number Plate Recognition (AVNPR) has witnessed a transformative journey from rule-based methods to deep learning techniques, reshaping its efficacy in diverse applications. This comprehensive review outlines the application of CNNs and RNNs in key aspects of AVNPR, including license plate localization, character segmentation, and recognition. The importance of high-quality datasets in training these models is emphasized. While deep learning has greatly enhanced accuracy, challenges such as computational intensity and privacy concerns require careful consideration. This paper gives the roadmap for researchers, practitioners, and policymakers, delineating the current landscape and ethical considerations. AVNPR technology, which identifies vehicles through their number plates, faces challenges related to non-standardized formats, complex scenes, and environmental conditions, necessitating additional hardware for optimal deployment despite the use of advanced algorithms. Beyond traditional plate recognition, this system integrates anomaly detection to enhance its capabilities in diverse real-world scenarios. Incorporating anomaly detection techniques allows the system to identify and report irregularities, outliers, and unexpected events, ensuring heightened accuracy and reliability. This research aims to pay attention to the deep learning algorithms by reviewing prior work, analyzing extraction, segmentation, and recognition techniques, and offering insights into upcoming trends in this domain.
Keywords:
Anomaly detection, AVNPR, CNN, Deep learning, RNN.
References:
[1] Samiul Azam, and Md Monirul Islam, “Automatic License Plate Detection in Hazardous Conditions,” Journal of Visual Communication and Image Representation, vol. 36, pp. 172-186, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Ashutosh Kumar Bachchan, Apurba Gorai, and Phalguni Gupta, “Automatic License Plate Recognition using Local Binary Pattern and Histogram Matching,” Intelligent Computing Theories and Application, Lecture Notes in Computer Science, pp. 22-34, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Bada Kim et al., “Anomaly Detection for Deep-Learning-Based License Plate Recognition in Real-Time Video,” Proceedings of the Conference on Research in Adaptive and Convergent Systems, pp. 123-124, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Lin Zhu et al., “Urban Link Travel Time Estimation using Traffic States‐Based Data Fusion,” IET Intelligent Transport Systems, vol. 12, no. 7, pp. 651-663, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Tawanda Mushiri, Charles Mbohwa, and Simbarashe Sarupinda, “Intelligent Control of Vehicles’ Number Plates on Toll Gates in Developing Nations,” Computer Vision: Concepts, Methodologies, Tools, and Applications, pp. 1023-1071, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Saurabh Shah et al., “Automated Indian Vehicle Number Plate Detection,” Soft Computing: Theories and Applications, Advances in Intelligent Systems and Computing, pp. 453-461, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Miguel Molina-Moreno, Iván González-Díaz, and Fernando Díaz-de-María, “Efficient Scale-Adaptive License Plate Detection System,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 6, pp. 2109-2121, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Pretty Joy, and Linda Sebastian, “Advanced Traffic Management System using Automatic Number Plate Recognition System,” International Research Journal of Engineering and Technology, vol. 6, no. 6, pp. 3515-3524, 2019.
[Google Scholar] [Publisher Link]
[9] M. Chaitanya Sai, Deepesh Chandwani, and Saravana Bhava, “Advanced Vehicle Monitoring System with Multi-Object Automatic Number Plates Detection,” 2019 Global Conference for Advancement in Technology (GCAT), Bangalore, India, pp. 1-4, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Zuhaib Akhtar, and Rashid Ali, “Automatic Number Plate Recognition using Random Forest Classifier,” SN Computer Science, vol. 1, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Naaman Omar, Abdulkadir Sengur, and Salim Ganim Saeed Al-Ali, “Cascaded Deep Learning-Based Efficient Approach for License Plate Detection and Recognition,” Expert Systems with Applications, vol. 149, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Zied Selmi et al., “DELP-DAR System for License Plate Detection and Recognition,” Pattern Recognition Letters, vol. 129, pp. 213-223, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Nur‑A‑Alam et al., “Intelligent System for Vehicle Number Plate Detection and Recognition Using Convolutional Neural Networks,” Technologies, vol. 9, no. 1, pp. 1-18, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Tanim Ahmed et al., “Design and Development of Lane Management and Automatic Toll Collection System,” 2021 2nd International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), DHAKA, Bangladesh, pp. 629-634, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Ahmed Abdelmoamen Ahmed, and Sheikh Ahmed, “A Real-Time Car Towing Management System Using ML-Powered Automatic Number Plate Recognition,” Algorithms, vol. 14, no. 11, pp. 1-16, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Ishita Swami, and Anil Suthar, “Smart Vehicle Tracker for Parking System,” Innovations in Computational Intelligence and Computer Vision, Advances in Intelligent Systems and Computing, vol. 1189, pp. 455-462, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Faridah Abdul Aiyelabegan et al., “Proposed Automatic Number Plate Recognition System Using Machine Learning,” 2022 IEEE Nigeria 4th International Conference on Disruptive Technologies for Sustainable Development (NIGERCON), Lagos, Nigeria, pp. 1-5, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Nor Azlina Abd Rahman et al., “Secure Parking and Reservation System Integrated with Car Plate Recognition and QR Code,” 2022 IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), Ballari, India, pp. 1-7, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Rajeev Kumar Chauhan, and Kalpana Chauhan, “Intelligent Toll Collection System for Moving Vehicles in India,” Intelligent Systems with Applications, vol. 15, pp. 1-8, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Rajdeep Adak et al., “Automatic Number Plate Recognition (ANPR) with YOLOv3-CNN,” arXiv, pp. 1-29, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Bhavya Hingorani et al., “Automated Toll System Using License Plate Identification,” International Conference on Information and Communication Technology for Intelligent Systems, Lecture Notes in Networks and Systems, pp. 577-586, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Anuj S. Tote, Sujit S. Pardeshi, and Abhishek D. Patange, “Automatic Number Plate Detection using TensorFlow in Indian Scenario: An Optical Character Recognition Approach,” Materials Today: Proceedings, vol. 72, no. 3, pp. 1073-1078, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[23] P. Sai Kiran et al., “Automatic Toll Collection using Vehicle Number Recognition System,” 2023 3rd International Conference on Pervasive Computing and Social Networking (ICPCSN), Salem, India, pp. 5-10, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[24] M.A. Jawale et al., “Implementation of a Number Plate Detection System for Vehicle Registration using IOT and Recognition using CNN,” Measurement: Sensors, vol. 27, pp. 1-13, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Tharaa Aqaileh, and Faisal Alkhateeb, “Automatic Jordanian License Plate Detection and Recognition System Using Deep Learning Techniques,” Journal of Imaging, vol. 9, no. 10, pp. 1-28, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Crystal Dias, Astha Jagetiya, and Sandeep Chaurasia, “Anonymous Vehicle Detection for Secure Campuses: A Framework for License Plate Recognition using Deep Learning,” 2019 2nd International Conference on Intelligent Communication and Computational Techniques (ICCT), Jaipur, India, pp. 79-82, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Naaman Omar et al., “Fused Faster RCNNs for Efficient Detection of the License Plates,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 19, no. 2, pp. 974-982, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Yonten Jamtsho, Panomkhawn Riyamongkol, and Rattapoom Waranusast, “Real-Time License Plate Detection for Non-Helmeted Motorcyclist using YOLO,” ICT Express, vol. 7, no. 1, pp. 104-109, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Hendry, and Rung-Ching Chen, “Automatic License Plate Recognition via Sliding-Window Darknet-YOLO Deep Learning,” Image and Vision Computing, vol. 87, pp. 47-56, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Waqar Riaz et al., “YOLO Based Recognition Method for Automatic License Plate Recognition,” 2020 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA), Dalian, China, pp. 87-90, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Reda Al-batat et al., “An End-to-End Automated License Plate Recognition System using YOLO-based Vehicle and License Plate Detection with Vehicle Classification,” Sensors, vol. 22, no. 23, pp. 1-17, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Wei Liu et al., “SSD: Single Shot Multibox Detector,” Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, Netherlands, pp. 21-37, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[33] Ninad Awalgaonkar, Prashant Bartakke, and Ravindra Chaugule, “Automatic License Plate Recognition System using SSD,” 2021 International Symposium of Asian Control Association on Intelligent Robotics and Industrial Automation (IRIA), Goa, India, pp. 394-399, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[34] Muhammad Naim Abdullah, Chan Jia Zhen, and Nor Azlinah Md Lazam, “Enhancing the Development of Android Vehicle License Plate Recognition System via Mobile Net SSD,” AIP Conference Proceedings, vol. 2808, no. 1, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Gülsüm Çiğdem Çavdaroğlu, and Mehmet Gökmen, “A Character Segmentation Method to Increase Character Recognition Accuracy for Turkish Number Plates,” Preprints, pp. 1-20, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[36] Md. Amzad Hossain et al., “Number Plate Recognition System for Vehicles Using Machine Learning Approach,” International Conference on Innovative Computing and Communications, Advances in Intelligent Systems and Computing, pp. 799-814, 2021.
[CrossRef] [Google Scholar] [Publisher Link]