联合集成学习与EfficientNet的光学遥感图像场景分类

doi:10.19678/j.issn.1000-3428.0059128

摘要/Abstract

摘要： 深度学习能够提高光学遥感图像场景分类的准确率和效率，但光学遥感图像语义丰富，部分场景仍存在易误分类的情况，同时由网络模型规模扩大带来的硬件要求过高、时间成本消耗过大等问题制约着深度学习网络模型的推广应用。为此，提出一种基于轻量化网络模型的光学遥感图像场景分类方法。通过EfficientNet网络提取图像特征，对图像特征进行复合提取以生成语义信息更丰富的新特征，利用多个子分类器构建集成学习模块解析新特征得到预分类结果，集成加权预分类结果以获得最终的分类结果。在AID和NWPU-RESISC45数据集上的实验结果表明，即使只训练20%的数据样本，该方法也能分别达到94.32%和93.36%的准确率，相对D-CNNs、CNN-CapsNet等方法，所提方法对易误分类场景有更好的分类效果，且参数量和浮点运算量大幅减少。

关键词: 光学遥感图像, 场景分类, 深度学习, 集成学习, EfficientNet网络

Abstract: Deep learning has improved the accuracy and efficiency of scene classification for optical remote sensing images, but some scenes are easily misclassified due to the rich semantic information in the images.At the same time, the hardware requirements and time overhead are increasing with the size of scaling network models, which restricts the application of deep learning models.To address the problem, a method for classifying the scenes in optical remote sensing images is proposed based on a lightweight network model.The method employs EfficientNet to extract image features, and then new features with richer information are generated from the extracted features.Multiple sub-classifiers are used to construct an ensemble learning module to analyze the new features, and get the pre-classification results.Finally, the pre-classification results are weighted to obtain the final classification results.The experimental results show that even if only 20% of data samples are used for training, the proposed method still exhibits an accuracy of 94.32% on the AID data set and 93.36% on the NWPU-RESISC45 data set.Compared with D-CNNs, CNN-CapsNet and other methods, the proposed method provides better classification performance with the number of parameters and amount of floating operations greatly reduced.

Key words: optical remote sensing image, scene classification, deep learning, ensemble learning, EfficientNet network

中图分类号:

TP751

宝音图, 刘伟, 牛朝阳, 李润生, 张浩波. 联合集成学习与EfficientNet的光学遥感图像场景分类[J]. 计算机工程, 2021, 47(10): 226-235.

BAO Yintu, LIU Wei, NIU Chaoyang, LI Runsheng, ZHANG Haobo. Scene Classification of Optical Remote Sensing Images Joint Ensemble Learning and EfficientNet[J]. Computer Engineering, 2021, 47(10): 226-235.

http://www.ecice06.com/CN/Y2021/V47/I10/226

图/表 12

20211016174547

20211016174550

20211016174556

20211016174559

20211016174603

20211016174607

20211016174611

20211016174615

20211016174619

20211016174623

20211016174627

20211016174631

参考文献

[1] CHENG G, XIE X, HAN J, et al.Remote sensing image scene classification meets deep learning:challenges, methods, benchmarks, and opportunities[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13:3735-3756.
[2] ZHANG W, TANG P, ZHAO L.Remote sensing image scene classification using CNN-CapsNet[J].Remote Sensing, 2019, 11(5):494-495.
[3] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision, 2004, 60(2):91-110.
[4] OJALA T, PIETIKAINEN M, MAENPAA T.Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J].IEEE Transactions on Pattern Analysis & Machine Intelligence, 2002, 24(7):971-987.
[5] DALAL N, TRIGGS B.Histograms of oriented gradients for human detection[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2005:886-893.
[6] 余东行, 张保明, 赵传, 等.联合卷积神经网络与集成学习的遥感影像场景分类[J].遥感学报, 2020, 24(6):717-727. YU D H, ZHANG B M, ZHAO C, et al.Scene classification of remote sensing image using ensemble convolutional neural network[J].Journal of Remote Sensing, 2020, 24(6):717-727.(in Chinese)
[7] LI F.A Bayesian hierarchical model for learning natural scene categories[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2005:523-531.
[8] OLSHAUSEN B A, FIELD D J.Sparse coding with an overcomplete basis set:a strategy employed by V1?[J].Vision Research, 1997, 37(23):3311-3325.
[9] KRIZHEVSKY A, SUTSKEVER I, HINTON G E.ImageNet classification with deep convolutional neural networks[J].Communications of the ACM, 2017, 60(6):84-90.
[10] SIMONYAN K, ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[C]//Proceedings of 2014 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2014:123-125.
[11] SZEGEDY C, LIU W, JIA Y, et al.Going deeper with convolutions[C]//Proceedings of 2015 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2015:1-9.
[12] HE K, ZHANG X, REN S, et al.Deep residual learning for image recognition[C]//Proceedings of IEEE Conference on Computer Vision & Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:770-778.
[13] 章毓晋.图像工程(中册)图像分析(第四版)[M].北京:清华大学出版社, 2018. ZHANG Y J.Image engineering(Ⅱ) image analysis[M].Fourth Edition.Beijing:Tsinghua University Press, 2018.(in Chinese)
[14] 梁文韬, 康雁, 李浩, 等.基于复杂度聚类的自适应遥感场景分类[J].计算机工程, 2020, 46(12):254-261, 269. LIANG W T, KANG Y, LI H, et al.Adaptive remote sensing scene classification based on complexity clustering[J].Computer Engineering, 2020, 46(12):254-261, 269.(in Chinese)
[15] 乔婷婷, 李鲁群.结合数据增广和迁移学习的高分辨率遥感影像场景分类[J].测绘通报, 2020(2):37-42. QIAO T T, LI L Q.Scene classification of high-resolution remote sensing image combining data augmentation and transfer learning[J].Bulletin of Surveying and Mapping, 2020(2):37-42.(in Chinese)
[16] 章晨, 夏凯, 杨垠晖, 等.改进残差网络的遥感图像场景分类[J].测绘科学, 2020, 8:151-156. ZHANG C, XIA K, YANG Y H, et al.Remote sensing scene classification algorithm based on improved residual network[J].Science of Surveying and Mapping, 2020, 8:151-156.(in Chinese)
[17] REDMON J, DIVVALA S, GIRSHICK R, et al.You only look once:unified, real-time object detection[C]//Proceedings of 2016 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:779-788.
[18] TAN M, LE Q V.EfficientNet:rethinking model scaling for convolutional neural networks[C]//Proceedings of International Conference on Machine Learning.Washington D.C., USA:IEEE Press, 2019:6105-6114.
[19] HOWARD A G, ZHU M L, CHEN B, et al.MobileNets:efficient convolutional neural networks for mobile vision applications[EB/OL].[2020-06-05].https://pdfs.semanticscholar.org/3647/d6d0f151dc05626449ee09cc7bce55be497e.pdf.
[20] 董洪义.深度学习之PyTorch物体检测实战[M].北京:机械工业出版社, 2020. DONG H Y.PyTorch object detection practice of deep learning[M].Beijing:China Machine Press, 2020.(in Chinese)
[21] 唐进民.深度学习之PyTorch实战计算机视觉[M].北京:电子工业出版社, 2018. TANG J M.Practical computer vision of deep learning by PyTorch[M].Beijing:Publishing House of Electronics Industry, 2018.(in Chinese)
[22] BERMAN M, TRIKI A R, BLASCHKO M B.The Lovšsz-Softmax loss:a tractable surrogate for the optimization of the intersection-over-union measure in neural networks[C]//Proceedings of 2018 International Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:4413-4421.
[23] XIA G, HU J, HU F, et al.AID:a benchmark data set for performance evaluation of aerial scene classification[J].IEEE Transactions on Geoence and Remote Sensing, 2017, 55(7):3965-3981.
[24] CHENG G, HAN J W, LU X Q.Remote sensing image scene classification:benchmark and state of the art[J].Proceedings of the IEEE, 2017, 105(10):1865-1883.
[25] CHENG G, YANG C, YAO X, et al.When deep learning meets metric learning:remote sensing image scene classification via learning discriminative CNNs[J].IEEE Transactions on Geoence and Remote Sensing, 2018, 56(3):2811-2821.

选择文件类型/文献管理软件名称

选择包含的内容