Ship AIS Trajectory Prediction Algorithm Based on Federated Learning

doi:10.19678/j.issn.1000-3428.0067829

Abstract

Abstract:

Federated learning, a distributed machine learning method, effectively addresses the data island problem in environments with weak communication. This study introduces an algorithm for predicting ship trajectories, employing the Fedves federated learning framework and a Convolutional Neural Network-Gated Recurrent Unit(CNN-GRU) model, called E-FVTP. The Fedves framework standardizes dataset sizes and client regularization terms, mitigating the influence of non-independent and identically distributed features on the global model. This approach preserves original client data features, thereby accelerating the convergence speed. In maritime scenarios with limited communication resources, the CNN-GRU model utilizes Automatic Identification System(AIS) data to overcome the computational limitations of vessel terminals. Experimental evaluations on the open-source MarineCadastre and Zhoushan marine ship navigation AIS datasets demonstrate that E-FVTP reduces prediction error by 40% compared to centralized training methods. It also achieves a 67% faster convergence rate and reduces communication costs by 76.32%. These advancements enable accurate vessel trajectory predictions in complex maritime settings, significantly ensuring maritime traffic safety.

Key words: federated learning, ship trajectory prediction, Automatic Identification System(AIS), deep learning, Non Independent and Identically Distributed(Non-IID)

摘要：

联邦学习是一种可以在弱通信环境下有效解决数据孤岛问题的分布式机器学习方法。针对海上船舶轨迹实时预测问题，提出基于Fedves联邦学习框架与卷积神经网络-门控循环单元(CNN-GRU)模型的船舶轨迹预测算法(E-FVTP)。根据Fedves联邦学习框架，通过规范客户端数据集规模以及客户端正则项，在保持原有客户端数据特征的前提下，减小数据非独立同分布特征对全局模型的影响，加快收敛速度。面向海洋通信资源短缺场景，建立基于船舶自动识别系统(AIS)数据的CNN-GRU船舶轨迹预测模型，解决了船舶终端设备计算能力不足的问题。在MarineCadastre开源和舟山海洋船舶航行AIS数据集上的实验结果表明，E-FVTP在预测误差比集中式训练降低40%的情况下，收敛速度提升67%、通信代价降低76.32%，可实现复杂海洋环境中船舶轨迹的精确预测，保障海上交通安全。

关键词: 联邦学习, 船舶轨迹预测, 自动识别系统, 深度学习, 非独立同分布

Chenjun ZHENG, Yan ZENG, Junfeng YUAN, Jilin ZHANG, Xin WANG, Meng HAN. Ship AIS Trajectory Prediction Algorithm Based on Federated Learning[J]. Computer Engineering, 2024, 50(2): 298-307.

郑晨俊, 曾艳, 袁俊峰, 张纪林, 王鑫, 韩猛. 基于联邦学习的船舶AIS轨迹预测算法[J]. 计算机工程, 2024, 50(2): 298-307.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0067829

https://www.ecice06.com/EN/Y2024/V50/I2/298

Figures/Tables 10

Fig.1 Structure of CNN-GRU ship trajectory prediction model

Fig.2 Structure of ship trajectory prediction framework based on Fedves

Fig.3 Comparison of loss values during the training process

Fig.4 Comparison of training times

Fig.5 Impact of sampling rate on E-FVTP training

References 26

1	MCMAHAN H B, MOORE E, RAMAGE D, et al. Communication-efficient learning of deep networks from decentralized data[EB/OL]. [2023-05-11]. https://arxiv.org/abs/1602.05629.
2	HAMER J, MOHRI M, SURESH A T. FedBoost: communication-efficient algorithms for federated learning[C]//Proceedings of the 37th International Conference on Machine Learning. New York, USA: ACM Press, 2020: 3973-3983.
3	LI T, SAHU A K, ZAHEER M, et al. Federated optimization in heterogeneous networks[EB/OL]. [2023-05-11]. https://arxiv.org/abs/1812.06127.
4	KARIMIREDDY S P, KALE S, MOHRI M, et al. SCAFFOLD: stochastic controlled averaging for on-device federated learning[C]//Proceedings of the 37th International Conference on Machine Learning. New York, USA: ACM Press, 2019: 5132-5143.
5	LIU L, ZHANG J, SONG S H, et al. Client-edge-cloud hierarchical federated learning[C]//Proceedings of 2020 IEEE International Conference on Communications. Washington D. C., USA: IEEE Press, 2020: 1-6.
6	HAMMEDI W, BRIK B, SENOUCI S M. Toward optimal MEC-based collision avoidance system for cooperative inland vessels: a federated deep learning approach. IEEE Transactions on Intelligent Transportation Systems, 2023, 24 (2): 2525- 2537. doi: 10.1109/TITS.2022.3154158
7	LI Q B, DIAO Y Q, CHEN Q A, et al. Federated learning on Non-IID data silos: an experimental study[C]//Proceedings of the 38th International Conference on Data Engineering. Washington D. C., USA: IEEE Press, 2022: 965-978.
8	RISTIC B, LA SCALA B, MORELANDE M, et al. Statistical analysis of motion patterns in AIS data: anomaly detection and motion prediction[C]//Proceedings of the 11th International Conference on Information Fusion. Washington D. C., USA: IEEE Press, 2008: 1-7.
9	PERERA L P, OLIVEIRA P, SOARES C G. Maritime traffic monitoring based on vessel detection, tracking, state estimation, and trajectory prediction. IEEE Transactions on Intelligent Transportation Systems, 2012, 13 (3): 1188- 1200. doi: 10.1109/TITS.2012.2187282
10	SHENG P, YIN J B. Extracting shipping route patterns by trajectory clustering model based on automatic identification system data. Sustainability, 2018, 10 (7): 2327. doi: 10.3390/su10072327
11	WANG L H, CHEN P F, CHEN L Y, et al. Ship AIS trajectory clustering: an HDBSCAN-based approach. Journal of Marine Science and Engineering, 2021, 9 (6): 566. doi: 10.3390/jmse9060566
12	LEE H T, LEE J S, YANG H, et al. An AIS data-driven approach to analyze the pattern of ship trajectories in ports using the DBSCAN algorithm. Applied Sciences, 2021, 11 (2): 799. doi: 10.3390/app11020799.2020.03.01614
13	QIAN L, ZHENG Y Z, LI L, et al. A new method of inland water ship trajectory prediction based on long short-term memory network optimized by genetic algorithm. Applied Sciences, 2022, 12 (8): 4073. doi: 10.3390/app12084073
14	SUO Y F, CHEN W K, CLARAMUNT C, et al. A ship trajectory prediction framework based on a recurrent neural network. Sensors, 2020, 20 (18): 5133. doi: 10.3390/s20185133
15	CHUNG J, GULCEHRE C, CHO K, et al. Empirical evaluation of gated recurrent neural networks on sequence modeling[EB/OL]. [2023-05-11]. https://arxiv.org/abs/1412.3555.
16	CHEN X A, LIU Y C, ACHUTHAN K, et al. A ship movement classification based on Automatic Identification System(AIS) data using convolutional neural network. Ocean Engineering, 2020, 218, 108182. doi: 10.1016/j.oceaneng.2020.108182
17	LU J E, LIU A J, DONG F, et al. Learning under concept drift: a review. IEEE Transactions on Knowledge and Data Engineering, 2019, 31 (12): 2346- 2363.
18	ZHU Z D, HONG J Y, ZHOU J Y. Data-free knowledge distillation for heterogeneous federated learning[EB/OL]. [2023-05-11]. https://arxiv.org/abs/2105.10056.
19	SATTLER F, MULLER K R, SAMEK W. Clustered federated learning: model-agnostic distributed multitask optimization under privacy constraints. IEEE Transactions on Neural Networks and Learning Systems, 2021, 32 (8): 3710- 3722. doi: 10.1109/TNNLS.2020.3015958
20	WU X, PEI J, HAN X H, et al. FedFog: federated learning architecture for Non-IID data. Expert Systems with Applications, 2024, 237, 121390. doi: 10.1016/j.eswa.2023.121390
21	陈乃月, 金一, 李浥东, 等. 基于区块链的公平性联邦学习模型. 计算机工程, 2022, 48 (6): 33- 41. URL
	CHEN N Y, JIN Y, LI Y D, et al. Federated learning model with fairness based on blockchain. Computer Engineering, 2022, 48 (6): 33- 41. URL
22	KAMP M, FISCHER J, VREEKEN J. Picking daisies in private: federated learning from small datasets[EB/OL]. [2023-05-11]. https://openreview.net/forum?id=GVD wiINkMR.
23	MENDIETA M, YANG T, WANG P, et al. Local learning matters: rethinking data heterogeneity in federated learning[C]//Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2022: 8387-8396.
24	LUO R C, HU S B, YU L Q. Rethinking client reweighting for selfish federated learning[EB/OL]. [2023-05-11]. https://paperswithcode.com/paper/rethinking-client-reweighting-for-selfish.
25	CHEN S J, LI B C. Towards generalizable personalized federated learning with adaptive local adaptation[EB/OL]. [2023-05-11]. https://openreview.net/forum?id=EFSctTwY4xn.
26	温依霖, 赵乃良, 曾艳, 等. 基于本地模型质量的客户端选择方法. 计算机工程, 2023, 49 (6): 131- 143. URL
	WEN Y L, ZHAO N L, ZENG Y, et al. Client selection method based on local model quality. Computer Engineering, 2023, 49 (6): 131- 143. URL

[1]	ZHANG Tianpeng, HAN Jing, LÜ Xueqiang. Super-Resolution-Aided Small-Target Detection Based on Multi-Task Learning [J]. Computer Engineering, 2024, 50(9): 304-312.
[2]	GAO Yubao, WEN Zhicheng. Dual Decoder Image Denoising Method Based on Attention Mechanism [J]. Computer Engineering, 2024, 50(9): 324-332.
[3]	PAN Enyuan, ZHONG Yuan, LI Ping. Semi-Supervised Cervical Spine MRI Segmentation Model in Federated Heterogeneous Data [J]. Computer Engineering, 2024, 50(9): 367-376.
[4]	ZHU Kai, LI Li, ZHANG Tong, JIANG Sheng, BIE Yiming. Multi-Stage Motion Blur Image Restoration Network Based on Transformer [J]. Computer Engineering, 2024, 50(9): 276-285.
[5]	WEI Wei, DING Xiangxiang, GUO Mengxing, YANG Zhao, LIU Hui. Review of Text Similarity Calculation Methods [J]. Computer Engineering, 2024, 50(9): 18-32.
[6]	Hongjiao LI, Baojin WANG, Zhaohui WANG, Renhao HU. Dual-Client Selection Algorithm Based on Model Similarity and Local Loss [J]. Computer Engineering, 2024, 50(8): 153-164.
[7]	Wei GAO, Shuailong LI, Lin MAO, Lei WANG, Yingying LI, Lin HAN. One Acceleration Strategy for Operator Generation Based on TVM [J]. Computer Engineering, 2024, 50(8): 353-362.
[8]	Yu WANG, Qi QI, Chun WANG, Cai XU. High-Precision Fault Diagnosis Method for Energy Storage Inverter Signals [J]. Computer Engineering, 2024, 50(8): 389-396.
[9]	Huaqing ZHANG, Zhangtao XIA, Xiaoqing LU, Jijun TONG. Named Entity Recognition of Vascular Surgery Based on Glyph Features [J]. Computer Engineering, 2024, 50(8): 13-21.
[10]	Yazhou ZHANG, Yu HE, Lu RONG, Xiangkai WANG. Depression Detection Based on Contextual Knowledge Enhanced Transformer Network [J]. Computer Engineering, 2024, 50(8): 75-85.
[11]	Ci XIAO, Yang XU, Yongdan ZHANG, Mingwen FENG, Yiqian HUANG. Nighttime Semantic Segmentation with Attention and Low-Light Enhancement [J]. Computer Engineering, 2024, 50(7): 271-281.
[12]	Shijing ZHANG, Xutao MO, Xing ZHAO, Yanglin DONG. Internal Thread Defect Detection Based on Spherical Catadioptric Imaging and YOLOv7 [J]. Computer Engineering, 2024, 50(7): 282-292.
[13]	Ruiting NUI, Tianfeng YAN, Rui GAO, Yingzhi WANG. Deep Learning TCNN-MobileNet-Based Modulation Recognition Under Low Signal-to-Noise Radio [J]. Computer Engineering, 2024, 50(7): 204-215.
[14]	XU Mingliang, LI Fangyuan, MA Haoran, HE Fei. Spike Sorting Algorithms for Large-Scale Neural Recording [J]. Computer Engineering, 2024, 50(6): 1-34.
[15]	WEI Zhuoyi, LUO Mai, LI Wenbing, ZENG Yuansong, YU Weijiang, YANG Yuedong. Intelligent Single-Cell Classification Based on Multisource Domain Adaptation [J]. Computer Engineering, 2024, 50(6): 48-55.

Please choose a citation manager

Content to export