Identify Vessels in UAV Data by Dynamic Multi-Label Image Classification
DOI:
https://doi.org/10.63682/jns.v14i12S.3263Abstract
To improve the monitoring and operational control of maritime traffic and nearby marine environments, this study investigates the use of Unmanned Aerial Vehicles (UAVs) and drones for improved surveillance, mapping, and remote sensing. UAVs offer real-time, high-resolution data that can help with more precise tracking of traffic patterns and vessel movements across large sea areas. The study suggests employing Convolutional Neural Networks (CNNs), which are very good at handling and decipheringcomplicatedpicturedata,toprocessthedatagatheredbytheseUAVs.This method overcomes the shortcomings of current tracking and monitoring systems by utilizing CNNs to improve object detection skills, particularly in accurately detecting andcategorizingshipfeatures.Identifyingshipsfromaerialphotosisacrucial problem in UAV-basedsurveillance,whichfrequentlycallsonanalyzingminutecharacteristics and patterns. Because it facilitates more effective monitoring of marine activity and helps manage the ecological impact of sea traffic, the project focuses on large-scale object detection in aerial photography, a field with important commercial and environmental ramifications.
The study presents sampling equivariant algorithms and other optimization-based techniques designed to enhance detection for the particular requirements of aerial images. The sampling equivariant technique is especially helpful for detecting small ship items, which can appear on different scale sand orientations and frequently have a hazy or deteriorating appearance. This method improves ship detection accuracy in difficult situations by reliably identifying these objects despite scale and viewpoint alterations. Furthermore, optimization-based tactics improve feature extraction accuracy by using grayscale sampling approaches to distinguish ships from their backgrounds in high-noise or low-contrast environments. Together, these methods enable the efficient tracking, classification, and prediction of ship motions and directions by extracting important ship properties from UAV photos. By monitoring traffic in environmentally sensitive locations, this predictive capability helps manage maritime safety, expedite emergency response times, and promote environmental conservation.
The results of this study demonstrate the value of UAV Surveillance when paired with cutting-edge CNN algorithms. The suggested methods greatly improve operational safety, environmental monitoring, and the commercial management of marine traffic by enabling more reliable detection of small, far-off objects in complicated, variable situations. This work provides a scalable method to meet the increasing demand for precise and efficient marine surveillance by improving airborne object detection capabilities.
Downloads
Metrics
References
Seung-Taek Kim and Hyo Jong Lee. Lightweight stacked hourglass network for human pose estimation. Applied Sciences, 10(18):6497, 2020.
[2]TongHe,ZhiZhang,HangZhang,ZhongyueZhang,JunyuanXie,andMuLi.Bag of tricks for image classification with convolutional neural networks. CoRR, abs/1812.01187, 2018.
[3]Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28:91–99, 2015.
[4]GowriShankarV,ArunKumarS,Dr.BalikaJChelliah,“MultipleObjectDetection Using Mask R-CNN in Deep Neural Network”.
[5]Gui-Song Xia, Xiang Bai, JianDing, Zhen Zhu, SergeBelongie, Jiebo Luo, Mihai Datcu,MarcelloPelillo,andLiangpeiZhang.Dota:Alarge-scaledatasetforobject detectioninaerialimages.InTheIEEEConferenceonComputerVisionandPattern Recognition (CVPR), June 2018.
[6]Q. Ming, Z. Zhou, L. Miao, H. Zhang, and L. Li, “Dynamic anchor learning for arbitrary-oriented object detection,” in Association for the Advancement of Artificial Intelligence (AAAI), 2021, pp. 2355–2363.
[7]Ramakrishnan,Nitesh,AnandhanarayananKamalakannan,BalikaJ.Chelliah,and GovindarajRajamanickam."ComputerVisionFrameworkforVisualSharpObject Detection using Deep Learning Model."International Journal of Engineering and Advanced Technology (IJEAT)ISSN: 2249-8958, Volume-8 Issue-4, April 2019
[8]J. Cao, H. Cholakkal, R. M. Anwer, F. S. Khan, Y. Pang, and L. Shao. D2det: Towards high quality object detection and instance segmentation. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11482–11491, 2020
[9]T.-Y.Lin,P.Goyal,R.Girshick,K.He,andP.Dollar,“Focallossfor´denseobject detection,” in International Conference on Computer Vision (ICCV), 2017, pp. 2980–2988.
[10]A. Bochkovskiy, C. Wang, and H. M. Liao. Yolov4: Optimal speed and accuracy of object detection. CoRR, abs/2004.10934, 2020.
[11]H.Liuetal.,"DeepLearningforUnmannedAerialVehicle-BasedObjectDetection and Tracking: A Survey,"IEEE Access, vol. 9, pp. 11924–11942, 2021. doi: 10.1109/ACCESS.2021.3051125.
[12]Z. Shao et al., "Ship Detection in High-Resolution Satellite Images via Shape and ContextualFeatures,"IEEEGeoscienceandRemoteSensingLetters,vol.19,2022. doi: 10.1109/LGRS.2021.3098676.
[13]F.Lietal.,"AerialImageAnalysisUsingDeepLearningforShipDetection,"IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–14, 2022. doi: 10.1109/TGRS.2021.3086875.
[14]Y.Zhangetal.,"Multi-ScaleShipDetectionforRemoteSensingImagesBasedon CNN Features and Saliency Analysis,"IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 2, pp. 876-889, 2022. doi: 10.1109/TITS.2021.3051032.
[15]C. Peng and R. Zhang, "Advanced UAV-Based Remote Sensing Techniques for Maritime Surveillance,"IEEE Access, vol. 10, pp. 3440–3452, 2022. doi: 10.1109/ACCESS.2022.3145461.
[16]A.Krizhevsky, I. Sutskever,and G. E.Hinton, "ImageNet classification with deep convolutional neural networks,"Commun. ACM, vol. 60, no. 6, pp. 84–90, Jun. 2017.
[17]S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detectionwithregionproposalnetworks,"IEEETrans.PatternAnal.Mach.Intell., vol. 39, no. 6, pp. 1137–1149, Jun. 2017.
[18]H.C.Goh,A.F.Lim,andD.Hsu,"Convolutionalneuralnetworkforshipdetection fromaerialimages,"in Proc.Int.Conf.Adv.Robot., HongKong,China,2020,pp. 34–39.
[19]K. K. Mantripragada and P. A. Dhebar, "Optimization-based ship detection using UAV imagery for maritime monitoring," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Jul. 2021, pp. 4585–4590.
[20]Y. Zou, Z. Xiong, and C. Shi, "Object detection in maritime environments using UAVs and CNNs,"IEEE Access, vol. 9, pp. 46755–46765, 2021.
[21]S.S.KhanandS.Qayyum,"UAV-enabledremotesensingforlarge-scalemaritime traffic monitoring," in Proc. IEEE Int. Conf. Remote Sens. GIS (ICRSGIS), Mar. 2022, pp. 125–132.
[22]W.Liuetal.,"Shipdetectionincomplexmarineenvironmentsusingdeeplearning techniques,"IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 13, pp. 5331–5342, 2020.
[23]Z. Li, X. Zhang, and S. Zhang, "Hybrid reward-based cooperative reinforcement learningformaritimeUAVsurveillance,"IEEE Trans.Cybern.,vol.52, no.2,pp. 991–1003, Feb. 2022.
[24]L. Pan, W. Zhang, and X. Wang, "Multi-scale object detection in aerial images using a deep learning framework," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2021, pp. 245–253.
[25]C. Lu,S. Zhu,and S. Duan, "Enhancing maritime object detection with CNNs and adaptive sampling strategies,"IEEE Trans. Intell. Transp. Syst., vol. 23, no. 8, pp. 11422–11432, Aug. 2022.
[26]Q.Xuetal.,"RobustdetectionofsmallobjectsinUAVimageryusingequivariant algorithms,"IEEE Trans. Image Process., vol. 30, pp. 3323–3335, Apr. 2021.
[27]J.Shi,J.Zhang,andJ.Tan,"ImprovingUAVsurveillanceformaritimesafetyusing feature extraction techniques," in Proc. IEEE Global Ocean Observ. Syst. Symp. (GOOS), Sep. 2020, pp. 89–95.
[28]T.NguyenandT.Le,"Grayscalesamplingtechniquesforhigh-noiseshipdetection in UAV-based systems,"IEEE Access, vol. 8, pp. 62147–62158, 2020.
[29]A.KumarandP.S.Rao,"PredictivemodelingforUAV-basedmaritimemonitoring using deep reinforcement learning,"IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 1, pp. 17–26, Jan. 2023.
R. Gupta and V. Jain, "Environmental conservation in marine areas using UAV- enabled object detection,"IEEE Trans. Geosci. Remote Sens., vol. 60, pp. 1–13, 2022
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
Terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.