YOLOv8m: A Deep Learning Approach to Traffic Sign Recognition in CARLA and Speed control of Autonomous Vehicles
DOI:
https://doi.org/10.52783/jns.v14.3446Keywords:
Traffic sign detection, occlusions, Makesense platform, Autonomous vehicles, Computer version, YOLOv8m model, CARLAAbstract
Traffic sign detection acts as the eyes for autonomous vehicles, employing computer vision to decipher road signs for safe and compliant navigation. This technology tackles challenges like variable lighting and occlusions by leveraging deep learning models trained on diverse datasets. By interpreting signs accurately, autonomous vehicles can navigate roads confidently, paving the way for a safer future. Traffic sign detection in real-world scenarios faces a confluence of challenges: varying lighting and weather conditions can degrade sign visibility, partial or complete occlusions by other objects can hinder detection, and the sheer diversity of traffic signs across regions necessitates robust models capable of generalizability. The research utilizes a combined real-world (65%) and simulated (CARLA, 35%) dataset for training a YOLOv8m model for speed limit sign detection (30, 60, 90 km/h) in autonomous vehicles. Image augmentation and collaborative annotation via Makesense platform enrich the dataset. The model has achieved 98% accuracy rate in detecting speed limits on the road side, even in difficult situations. The model is evaluated in the CARLA simulator for controlled testing before real-world implementation
Downloads
Metrics
References
S. Mozaffari, O. Y. Al-Jarrah, M. Dianati, P. Jennings and A. Mouzakitis, "Deep learning-based vehicle behavior prediction for autonomous driving applications: A review", IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 1, pp. 33-47, 2020.
Gibbs G, Jia H, Madani I, "Obstacle Detection with Ultrasonic Sensors and Signal Analysis Metrics", Transp Res Procedia., 28 (2017), pp. 173-182
S. Khalid, J. H. Shah, M. Sharif, M. Rafiq and G. S. Choi, "Traffic sign detection with low complexity for intelligent vehicles based on hybrid features, Computers, Materials & Continua 2023, 76(1), 861-879. https://doi.org/10.32604/cmc.2023.035595
A. Mogelmose, M. M. Trivedi and T. B. Moeslund, "Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey," in IEEE Transactions on Intelligent Transportation Systems, vol. 13, no. 4, pp. 1484-1497, Dec. 2012, doi: 10.1109/TITS.2012.2209421.
L. Aziz, M. S. B. Haji Salam, U. U. Sheikh and S. Ayub, "Exploring Deep Learning-Based Architecture, Strategies, Applications and Current Trends in Generic Object Detection: A Comprehensive Review," in IEEE Access, vol. 8, pp. 170461-170495, 2020, doi: 10.1109/ACCESS.2020.3021508.
M. Rohith, A. Sunil and Mohana, "Comparative Analysis of Edge Computing and Edge Devices: Key Technology in IoT and Computer Vision Applications," 2021 International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT), Bangalore, India, 2021, pp. 722-727, doi: 10.1109/RTEICT52294.2021.9573996.
N. Jain, S. Yerragolla, T. Guha and Mohana, "Performance Analysis of Object Detection and Tracking Algorithms for Traffic Surveillance Applications using Neural Networks," 2019 Third International conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India, 2019, pp. 690-696, doi: 10.1109/I-SMAC47947.2019.9032502.
A. Sunil, M. H. Sheth, S. E and Mohana, "Usual and Unusual Human Activity Recognition in Video using Deep Learning and Artificial Intelligence for Security Applications," 2021 Fourth International Conference on Electrical, Computer and Communication Technologies (ICECCT), Erode, India, 2021, pp. 1-6, doi: 10.1109/ICECCT52121.2021.9616791.
Krizhevsky, Alex et al. “ImageNet classification with deep convolutional neural networks.” Communications of the ACM 60 (2012): 84 - 90.
V. Rajesh, U. P. Naik and Mohana, "Quantum Convolutional Neural Networks (QCNN) Using Deep Learning for Computer Vision Applications," 2021 International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT), Bangalore, India, 2021, pp. 728-734, doi: 10.1109/RTEICT52294.2021.9574030.
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016). End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316.
A. Agafonov and A. Yumaganov, "3D Objects Detection in an Autonomous Car Driving Problem," 2020 International Conference on Information Technology and Nanotechnology (ITNT), Samara, Russia, 2020, pp. 1-5, doi: 10.1109/ITNT49337.2020.9253253.
D. R. Niranjan, B. C. VinayKarthik and Mohana, "Deep Learning based Object Detection Model for Autonomous Driving Research using CARLA Simulator," 2021 2nd International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India, 2021, pp. 1251-1258, doi: 10.1109/ICOSEC51865.2021.9591747.
N. Rao and S. Sundaram, "Spatio-Temporal Look-Ahead Trajectory Prediction using Memory Neural Network," 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 2021, pp. 1-8, doi: 10.1109/IJCNN52387.2021.9534209.
Shen, Y.; Wijayaratne, N.; Du, P.; Jiang, S.; Driggs-Campbell, K. AutoPreview: A Framework for Autopilot Behavior Understanding. In Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8–13 May 2021; pp. 1–6.
A. Mangawati, Mohana, M. Leesan and H. V. R. Aradhya, "Object Tracking Algorithms for Video Surveillance Applications," 2018 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 2018, pp. 0667-0671, doi: 10.1109/ICCSP.2018.8524260.
Mohana and HV Ravish Aradhya, “Object Detection and Tracking using Deep Learning and Artificial Intelligence for Video Surveillance Applications” International Journal of Advanced Computer Science and Applications(IJACSA), 10(12), 2019. http://dx.doi.org/10.14569/IJACSA.2019.0101269
H. V. Ravish Aradhya, Mohana and Kiran Anil Chikodi, "Notice of Removal: Real time objects detection and positioning in multiple regions using single fixed camera view for video surveillance applications," 2015 International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO), Visakhapatnam, India, 2015, pp. 1-6, doi: 10.1109/EESCO.2015.7253654
Megalingam, R. K., Thanigundala, K., Musani, S. R., Nidamanuru, H., & Gadde, L. (2023). Indian traffic sign detection and recognition using deep learning. International Journal of Transportation Science and Technology, 12(3), 683-699. https://doi.org/10.1016/j.ijtst.2022.06.002
A. Agnihotri, P. Saraf and K. R. Bapnad, "A Convolutional Neural Network Approach Towards Self-Driving Cars," 2019 IEEE 16th India Council International Conference (INDICON), Rajkot, India, 2019, pp. 1-4, doi: 10.1109/INDICON47234.2019.9030307
M. D. RADU, I. M. COSTEA and V. A. STAN, "Automatic Traffic Sign Recognition Artificial Inteligence - Deep Learning Algorithm," 2020 12th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Bucharest, Romania, 2020, pp. 1-4, doi: 10.1109/ECAI50035.2020.9223186.
Y. Sun, P. Ge and D. Liu, "Traffic Sign Detection and Recognition Based on Convolutional Neural Network," 2019 Chinese Automation Congress (CAC), Hangzhou, China, 2019, pp. 2851-2854, doi: 10.1109/CAC48633.2019.8997240.
Handoko, J. H. Pratama, and B. W. Yohanes, “Traffic sign detection optimization using color and shape segmentation as preprocessing system,” Telkomnika (Telecommunication Computing Electronics and Control), vol. 19, no. 1, pp. 173–181, 2021, doi: 10.12928/TELKOMNIKA.V19I1.16281.
M. Çetinkaya and T. Acarman, "Traffic Sign Detection by Image Preprocessing and Deep Learning," 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2021, pp. 1165-1170, doi: 10.1109/ICICCS51141.2021.9432088.
H. Gholamalinejad and H. Khosravi, "Irvd: A large-scale dataset for classification of iranian vehicles in urban streets", Journal of AI and Data Mining, vol. 9, no. 1, pp. 1-9, 2021, [online] Available: https://jad.shahroodut.ac.ir/article1789.html.
U. P. Naik, V. Rajesh, R. K. R and Mohana, "Implementation of YOLOv4 Algorithm for Multiple Object Detection in Image and Video Dataset using Deep Learning and Artificial Intelligence for Urban Traffic Video Surveillance Application," 2021 Fourth International Conference on Electrical, Computer and Communication Technologies (ICECCT), Erode, India, 2021, pp. 1-6, doi: 10.1109/ICECCT52121.2021.9616625
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
Terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
