FEDERATED LEARNING FOR SHIP DETECTION IN REMOTE SENSING IMAGERY: CURRENT PROGRESS AND FUTURE DIRECTIONS
DOI:
https://doi.org/10.4108/tsoe.13253Abstract
Ship detection plays a vital role in maritime surveillance by enabling vessel traffic monitoring, maritime security, the prevention of illegal fishing, and search-and-rescue operations. Advances in deep learning, transformer-based architectures, and multimodal remote sensing have substantially improved ship detection performance in both optical and synthetic aperture radar (SAR) imagery. Nevertheless, practical maritime monitoring systems often rely on distributed data sources managed by various organizations, complicating centralized data sharing due to privacy, security, and regulatory constraints. Federated Learning (FL) has emerged as a promising approach that facilitates collaborative model training without the need to exchange raw data. This article provides a comprehensive review of ship detection and federated learning within the context of privacy-preserving maritime surveillance. The evolution of ship detection technologies, key federated learning algorithms, and recent applications of federated learning in remote sensing are systematically examined. In addition, current challenges such as data heterogeneity, communication overhead, computational complexity, and limited benchmark availability are discussed. Potential research directions for developing scalable, privacy-preserving, and distributed ship detection systems are also identified. This review serves as a structured reference for researchers and practitioners seeking to integrate federated learning with maritime remote sensing applications.
Downloads
References
[1] M. Kang, K. Ji, X. Leng, and Z. Lin, "Contextual region-based convolutional neural network for SAR ship detection," IEEE Geosci. Remote Sens. Lett., vol. 14, no. 8, pp. 1318–1322, 2017.
[2] S. Sun et al., "CFAR-based SAR ship detection under complex sea conditions," Remote Sensing, vol. 12, no. 21, p. 3521, 2020.
[3] S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137–1149, 2015.
[4] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," in Proc. CVPR, 2016, pp. 779–788.
[5] W. Liu, D. Anguelov, D. Erhan et al., "SSD: Single shot multibox detector," in Proc. ECCV, 2016, pp. 21–37.
[6] Y. Wang et al., "Multimodal ship detection using optical and SAR imagery," Remote Sensing, vol. 14, no. 20, p. 5220, 2022.
[7] N. Carion et al., "End-to-End Object Detection with Transformers," in Proc. ECCV, 2020, pp. 213–229.
[8] [8] Z. Liu et al., "Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows," in Proc. ICCV, 2021, pp. 10012–10022.
[9] B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. Aguera y Arcas, "Communication-efficient learning of deep networks from decentralized data," in Proc. AISTATS, 2017.
[10] P. Kairouz, H. B. McMahan, B. Avent et al., "Advances and open problems in federated learning," Found. Trends Mach. Learn., vol. 14, no. 1–2, pp. 1–210, 2021.
[11] Q. Yang, Y. Liu, T. Chen, and Y. Tong, "Federated machine learning: Concept and applications," ACM Trans. Intell. Syst. Technol., vol. 10, no. 2, pp. 1–19, 2019.
[12] T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, "Federated optimization in heterogeneous networks," in Proc. MLSys, 2020.
[13] X. Xu et al., "Federated learning for remote sensing image classification," Remote Sens. Lett., vol. 12, no. 11, pp. 1085–1094, 2021.
[14] Y. Liu et al., "Federated learning for remote sensing scene classification," IEEE Trans. Geosci. Remote Sens., vol. 59, no. 12, pp. 10563–10575, 2021.
[15] Y. Chen et al., "Federated learning for remote sensing image analysis," IEEE J. Sel. Topics Appl. Earth Obs. Remote Sens., vol. 15, pp. 4330–4342, 2022.
[16] Y. Zhang et al., "Federated object detection for distributed environments," IEEE Access, vol. 10, pp. 23567–23579, 2022.
[17] T. Nguyen et al., "Federated deep learning for maritime monitoring systems," IEEE Access, vol. 11, pp. 12450–12462, 2023.
[18] Z. Wang et al., "Federated Learning for Distributed Vision Tasks," IEEE Trans. Artif. Intell., vol. 5, no. 3, pp. 1104–1116, Mar. 2024.
[19] J. Geng et al., "Deep learning-based ship detection in high-resolution remote sensing imagery," IEEE Access, vol. 9, pp. 56214–56226, 2021.
[20] A. Guna et al., "YOLO-based ship detection using UAV imagery," IEEE Access, vol. 9, pp. 145012–145025, 2021.
[21] X. Yang et al., "R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object Detection," in Proc. AAAI Conf. Artif. Intell., 2021, pp. 3163–3171.
[22] J. Han, J. Ding, J. Li, and G.-S. Xia, "ReDet: A Rotation-Equivariant Detector for Aerial Object Detection," in Proc. CVPR, 2021, pp. 2786–2795.
[23] C. Xie, Z. Yan, K. Zhu, and G.-S. Xia, "Oriented R-CNN for Object Detection," in Proc. ICCV, 2021, pp. 3520–3529.
[24] [24] J. Ding, N. Xue, Y. Long, G.-S. Xia, and Q. Lu, "Learning RoI Transformer for Oriented Object Detection in Aerial Images," in Proc. CVPR, 2019, pp. 2849–2858.
[25] Y. Xu et al., "Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 4, pp. 1452–1459, 2021.
[26] X. Zhang, X. Zhu, S. Wang, and C. Zhang, "ShipRSImageNet: A Large-Scale Benchmark Dataset for Ship Detection in Remote Sensing Images," IEEE J. Sel. Topics Appl. Earth Obs. Remote Sens., vol. 16, pp. 1240–1255, 2023.
[27] Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V. Chandra, "Federated learning with non-IID data," arXiv preprint arXiv:1806.00582, 2018.
[28] S. P. Karimireddy et al., "SCAFFOLD: Stochastic Controlled Averaging for Federated Learning," in Proc. ICML, 2020.
[29] H. Wang et al., "Federated learning with normalized averaging (FedNova)," in Proc. NeurIPS, 2020.
[30] D. A. E. Acar et al., "Federated learning based on dynamic regularization," in Proc. ICLR, 2021.
[31] X. Li et al., "FedBN: Federated learning on non-IID features via local batch normalization," in Proc. ICLR, 2021.
[32] S. J. Reddi et al., "Adaptive federated optimization," in Proc. ICLR, 2021.
[33] T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, "Federated Learning: Challenges, Methods, and Future Directions," IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, 2020.
[34] Q. Li et al., "A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection," IEEE Trans. Knowl. Data Eng., 2023, doi: 10.1109/TKDE.2021.3124599.
Published
Issue
Section
License
Copyright (c) 2026 Manh Duong Tan
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open access article distributed under the terms of the CC BY-NC-SA 4.0, which permits copying, redistributing, remixing, transformation, and building upon the material in any medium so long as the original work is properly cited.
