Multi-Dimensional Data Calculation and Few-Shot Learning for Intelligent Transportation Based on Tensor Calculation

doi:10.19678/j.issn.1000-3428.0069223

Abstract

Abstract:

A comprehensive model combining tensor calculation and few-shot learning is proposed to address the problem of limited and difficult-to-obtain samples in intelligent transportation scenarios such that the issue of unsatisfactory training effect caused by insufficient samples in the target domain can be solved. A multi-dimensional computing model is constructed based on tensor calculation, multi-dimensional heterogeneous data in intelligent transportation scenarios are processed, fused data tensors are obtained based on the spatio-temporal correlation of the data, fused data are used as input data, training is performed using few-shot learning models, and the performances of tensor few-shot learning models based on different tensor calculation schemes and ablation experimental results are compared and analyzed. Simulation results show that compared with two metric-based few-shot learning models, i.e., the prototype network and matching network, the combination of a meta-learning-based few-shot learning model and a tensor calculation model presents higher credibility. Moreover, by adopting different tensor-fusion schemes, the accuracy and F1 values of the meta-learning model improved to varying degrees. The model based on the inverse-decomposition tensor-fusion scheme offers a maximum accuracy of 0.95, which renders it superior to the CANDECOMP/PARAFAC Decomposition (CPD) fusion scheme in terms of performance.

Key words: intelligent transportation, tensor calculation, data fusion, few-shot learning, meta-learning

摘要：

针对智慧交通场景中样本较少且难以获取的问题, 提出一种张量计算与小样本学习相结合的综合模型, 从而应对目标域样本不足导致训练效果差的情况。构建基于张量计算的多维计算模型, 处理智慧交通场景中的多维异构数据, 基于数据的时空相关性获得融合数据张量, 将融合数据作为输入数据, 经由小样本学习模型进行训练, 最终根据消融实验结果比较分析基于不同张量计算方案和小样本学习方法的张量小样本学习模型性能。仿真结果表明, 相较于2种基于度量的小样本学习模型: 原型网络和匹配网络, 基于元学习的小样本学习模型和张量计算模型相结合后的可信度更高, 并且基于不同的张量融合方案, 元学习模型的准确率和F1值得到了不同程度的提升, 其中基于逆分解张量融合方案的模型准确率可达0.95, 性能优于平行因子分解(CPD)融合方案。

关键词: 智慧交通, 张量计算, 数据融合, 小样本学习, 元学习

Mingyue SI, Bin QI, Wensheng ZHANG, Lei ZHANG. Multi-Dimensional Data Calculation and Few-Shot Learning for Intelligent Transportation Based on Tensor Calculation[J]. Computer Engineering, 2024, 50(4): 41-49.

司明悦, 齐斌, 张文胜, 张雷. 基于张量计算的智慧交通多维数据计算与小样本学习[J]. 计算机工程, 2024, 50(4): 41-49.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0069223

http://www.ecice06.com/EN/Y2024/V50/I4/41

Figures/Tables 9

Fig.1 Structure of prototype network

Fig.2 Structure of the comprehensive model

Fig.3 Parameter tuning results of the prototype network

Fig.4 Parameter tuning results of the matching network

Fig.5 Parameter tuning results of MAML

Fig.6 Experimental results among differnet methods

Fig.7 Accuracy of MAML model based on different tensor fusion schemes

Fig.8 F1 values of MAML model based on different tensor fusion schemes

References 38

1	范文卓, 吴涛, 许俊平, 等. 基于多分辨率特征融合的任意尺度图像超分辨率重建. 计算机工程, 2023, 49 (9): 217- 225. URL
	FAN W Z, WU T, XU J P, et al. Super-resolution reconstruction of arbitrary scale images based on multi-resolution feature fusion. Computer Engineering, 2023, 49 (9): 217- 225. URL
2	HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2016: 770-778.
3	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. [2023-12-10]. https://www.arxiv.org/pdf/1409.1556.pdf.
4	LAKE B, SALAKHUTDINOV R, GROSS J, et al. One shot learning of simple visual concepts[C]//Proceedings of Cognitive Science Society Annual Conference. Boston, USA: The Cognitive Science Society Press, 2011: 2568-2573.
5	LAMPERT C H, NICKISCH H, HARMELING S. Attribute-based classification for zero-shot visual object categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36 (3): 453- 465. doi: 10.1109/TPAMI.2013.140
6	JANKOWSKI N, GRABCZEWSKI K. Universal meta-learning architecture and algorithms[M]//JANKOWSKI N, DUCH W, GRA̧BCZEWSKI K. Meta-learning in computational intelligence. Berlin, Germany: Springer, 2011: 1-76.
7	SNELL J, SWERSKY K, ZEMEL R. Prototypical networks for few-shot learning[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2017: 4080-4090.
8	LAKE B M, SALAKHUTDINOV R, TENENBAUM J B. Human-level concept learning through probabilistic program induction. Science, 2015, 350 (6266): 1332- 1338. doi: 10.1126/science.aab3050
9	ALTAE-TRAN H, RAMSUNDAR B, PAPPU A S, et al. Low data drug discovery with one-shot learning. ACS Central Science, 2017, 3 (4): 283- 293. doi: 10.1021/acscentsci.6b00367
10	YE X H, ZHANG X M, HE B C, et al. Rolling bearing fault diagnosis with variable load and few samples based on multifeature fusion meta-learning[C]//Proceedings of the CAA Symposium on Fault Detection, Supervision and Safety for Technical Processes. Washington D. C., USA: IEEE Press, 2023: 1-6.
11	FINN C, ABBEEL P, LEVINE S. Model-agnostic meta-learning for fast adaptation of deep networks[C]//Proceedings of the 34th International Conference on Machine Learning. New York, USA: ACM Press, 2017: 1126-1135.
12	VINYALS O, BLUNDELL C, LILLICRAP T, et al. Matching networks for one shot learning[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2016: 3637-3745.
13	RAVI S, LAROCHELLE H. Optimization as a model for few-shot learning[C]//Proceedings of International Conference on Learning Representations. Toulon, France: OpenReview Press, 2017: 1-6.
14	HITCHCOCK F L. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematics and Physics, 1927, 6 (1/2/3/4): 164- 189.
15	CICHOCKI A, MANDIC D, DE LATHAUWER L, et al. Tensor decompositions for signal processing applications: from two-way to multiway component analysis. IEEE Signal Processing Magazine, 2015, 32 (2): 145- 163. doi: 10.1109/MSP.2013.2297439
16	SIDIROPOULOS N D, DE LATHAUWER L, FU X, et al. Tensor decomposition for signal processing and machine learning. IEEE Transactions on Signal Processing, 2017, 65 (13): 3551- 3582. doi: 10.1109/TSP.2017.2690524
17	FROLOV E, OSELEDETS I. Tensor methods and recommender systems. WIREs Data Mining and Knowledge Discovery, 2017, 7 (3): e1201. doi: 10.1002/widm.1201
18	WANG J H, ZHANG W S, CHEN Y F, et al. Time-varying channel estimation scheme for uplink MU-MIMO in 6G systems. IEEE Transactions on Vehicular Technology, 2022, 71 (11): 11820- 11831. doi: 10.1109/TVT.2022.3192902
19	ZHOU Z, LIU L J, XU J R. Harnessing tensor structures—multi-mode reservoir computing and its application in massive MIMO. IEEE Transactions on Wireless Communications, 2022, 21 (10): 8120- 8133. doi: 10.1109/TWC.2022.3164203
20	KALIYAR R K, GOSWAMI A, NARANG P. DeepFakE: improving fake news detection using tensor decomposition-based deep neural network. The Journal of Supercomputing, 2021, 77 (2): 1015- 1037. doi: 10.1007/s11227-020-03294-y
21	KOLDA T G, BADER B W. Tensor decompositions and applications. SIAM Review, 2009, 51 (3): 455- 500. doi: 10.1137/07070111X
22	OSELEDETS I V. Tensor-train decomposition. SIAM Journal on Scientific Computing, 2011, 33 (5): 2295- 2317. doi: 10.1137/090752286
23	ZHAO Q B, ZHOU G X, XIE S L, et al. Tensor ring decomposition[EB/OL]. [2023-12-10]. https://arxiv.org/abs/1606.05535.
24	SONG Q Q, GE H C, CAVERLEE J, et al. Tensor completion algorithms in big data analytics. ACM Transactions on Knowledge Discovery from Data, 2019, 13 (1): 6.
25	LIU J, MUSIALSKI P, WONKA P, et al. Tensor completion for estimating missing values in visual data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35 (1): 208- 220. doi: 10.1109/TPAMI.2012.39
26	SEKAR K, DEVI K S, SRINIVASAN P. Compressed tensor completion: a robust technique for fast and efficient data reconstruction in wireless sensor networks. IEEE Sensors Journal, 2022, 22 (11): 10794- 10807. doi: 10.1109/JSEN.2022.3169226
27	YOKOTA T, ZHAO Q B, CICHOCKI A. Smooth PARAFAC decomposition for tensor completion. IEEE Transactions on Signal Processing, 2016, 64 (20): 5423- 5436. doi: 10.1109/TSP.2016.2586759
28	ZHOU P, LU C Y, LIN Z C, et al. Tensor factorization for low-rank tensor completion. IEEE Transactions on Image Processing, 2018, 27 (3): 1152- 1163. doi: 10.1109/TIP.2017.2762595
29	BENGUA J A, PHIEN H N, TUAN H D, et al. Efficient tensor completion for color image and video recovery: low-rank tensor train. IEEE Transactions on Image Processing, 2017, 26 (5): 2466- 2479. doi: 10.1109/TIP.2017.2672439
30	CUBUK E D, ZOPH B, SHLENS J, et al. Randaugment: practical automated data augmentation with a reduced search space[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Washington D. C., USA: IEEE Press, 2020: 3008-3017.
31	GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2014: 2672-2680.
32	DIXIT M, KWITT R, NIETHAMMER M, et al. AGA: attribute-guided augmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2017: 3328-3336.
33	刘鑫鹏, 栾悉道, 谢毓湘, 等. 迁移学习研究和算法综述. 长沙大学学报, 2018, 32 (5): 28-31, 36. URL
	LIU X P, LUAN X D, XIE Y X, et al. Transfer learning research and algorithm review. Journal of Changsha University, 2018, 32 (5): 28-31, 36. URL
34	WANG H. Research review on transfer learning. Computer Knowledge and Technology, 2017, 13 (32): 203- 205.
35	刘鑫, 周凯锐, 何玉琳, 等. 基于度量的小样本分类方法研究综述. 模式识别与人工智能, 2021, 34 (10): 909- 923. URL
	LIU X, ZHOU K R, HE Y L, et al. Survey of metric-based few-shot classification. Pattern Recognition and Artificial Intelligence, 2021, 34 (10): 909- 923. URL
36	陈良臣, 傅德印. 面向小样本数据的机器学习方法研究综述. 计算机工程, 2022, 48 (11): 1- 13. URL
	CHEN L C, FU D Y. Survey on machine learning methods for small sample data. Computer Engineering, 2022, 48 (11): 1- 13. URL
37	SANTORO A, BARTUNOV S, BOTVINICK M, et al. One-shot learning with memory-augmented neural networks[C]//Proceedings of International Conference on Machine Learning. New York, USA: ACM Press, 2016: 2740-2753.
38	MUNKHDALAI T, YU H. Meta networks[C]//Proceedings of International Conference on Machine Learning. New York, USA: ACM Press, 2017: 2554-2563.

[1]	Guanrong WU, Yuanxiang LI, Yilin WANG, Yuhan LU, Xiuhua CHEN. Few-Shot Metal Surface Defect Classification Based on Contrastive Learning [J]. Computer Engineering, 2024, 50(3): 36-43.
[2]	Jinshuo LIU, Daichen WANG, Juan DENG, Lina WANG. Classification of Harmful Information on Internet Based on Long-Tailed Classification Algorithm [J]. Computer Engineering, 2023, 49(8): 13-19, 28.
[3]	Haoxin LIU, Chao DONG, Zhinan GOU, Kai GAO. Few-Shot Relation Extraction Method Fusing with Hybrid Representation [J]. Computer Engineering, 2023, 49(8): 63-68.
[4]	Yuyan WANG, Jiapeng ZHAO, Jinqiao SHI, Liyan SHEN, Hongmeng LIU, Yanyan YANG. User Identity Information Aggregation Method for Darknet Web Page [J]. Computer Engineering, 2023, 49(11): 187-194, 210.
[5]	FENG Siyun, SHI Zhenquan, CAO Yang. Urban Road Network Traffic Speed Prediction Model Based on Global Spatio-Temporal Characteristics [J]. Computer Engineering, 2022, 48(5): 112-117.
[6]	PENG Tongxin, HAN Yong, WANG Cheng, ZHANG Zhihao. Hybrid Deep-learning Model for Short-term Metro Passenger Flow Prediction [J]. Computer Engineering, 2022, 48(5): 297-305.
[7]	SUN Qixiang, HE Ning, ZHANG Congcong, LIU Shengjie. Human Skeleton Action Recognition Method Based on Lightweight Graph Convolution [J]. Computer Engineering, 2022, 48(5): 306-313.
[8]	WU Pengxiang, LI Fanzhang. A Metric Meta-Learning Algorithm Based on Group Equivariant Convolution [J]. Computer Engineering, 2022, 48(2): 72-78.
[9]	HU Bin, WANG Xiaojun, ZHANG Lei. A Semi-Supervised Adversarial Robust Model-Agnostic Meta-Learning Method [J]. Computer Engineering, 2022, 48(12): 112-118.
[10]	QIU Zhen, XI Xuefeng, CUI Zhiming, SHENG Shengli, HU Fuyuan. Few-Shot Image Classification Based on Multi-Resolution Self-Distillation Network [J]. Computer Engineering, 2022, 48(12): 232-240.
[11]	CHEN Liangchen, FU Deyin. Survey on Machine Learning Methods for Small Sample Data [J]. Computer Engineering, 2022, 48(11): 1-13.
[12]	LI Wei, HUANG Heming, WU Fengying, ZHANG Huiyun. Adaptive CNN-based Image Classification Algorithm Based on Deep Fusion of Multi-Feature [J]. Computer Engineering, 2021, 47(9): 235-239,251.
[13]	FAN Xing, LIU Zhanwen, LIN Shan, DOU Ruijuan. Fatigue Driving Detection Model Fusing with Human Eye Features and Deep Learning [J]. Computer Engineering, 2021, 47(8): 243-250.
[14]	WANG Huiyong, LU Chao, ZHANG Xiaoming. Image Caption Model Based on Few-Shot Learning and Semantic Information [J]. Computer Engineering, 2021, 47(8): 260-270.
[15]	WANG Ronggui, TANG Mingkong, YANG Juan, XUE Lixia, HU Min. Semantic Matching Network for Few-Shot Learning [J]. Computer Engineering, 2021, 47(5): 244-250,259.

Please choose a citation manager

Content to export