Research and Improvement of Dynamic Routing Based on Capsule Network

doi:10.19678/j.issn.1000-3428.0062928

Abstract

Abstract: Capsule Network(CapsNet) has the advantage of compensating for the loss of spatial information and rotation invariance in convolutional neural networks.Therefore, they have been widely used in many fields such as image classification, target detection, and text detection.However, capsule networks still face some problems, such as having a large amount of parameters and low classification accuracy.This paper proposes a novel capsule network classification model that uses the dot-product attention mechanism to construct the graph convolutional layer, thereby selecting high-quality features to facilitate correct classification of the image.To obtain the spatial dependence between capsules within the same layer, the dot-multiplication attention mechanism is used to construct a fully connected graph between capsules of the same levels.The predicted capsules with large influencing factors are then used for feature clustering.In this way, the proposed model can reduce the number of parameters and improve model performance.At the same time, the residual network is added to the feature extraction process for the extraction of higher-dimensional features in order to optimize the quality of the capsule, which can not only improve the feature expression ability of the model but also restrain its size.The experimental results prove that when the number of parametersis less thanthat the number of multiple capsule network variants, the proposed model achieves 99.74%, 95.02%, 91.78% and 95.65% accuracy on the MNIST, FashionMNIST, CIFAR10, and SVHN datasets, respectively, making the proposed model more accurate than MS-CapsNet, TextCaps, AR CapsNet, FSc-CapsNet, and DA-CapsNet models.

Key words: Capsule Network(CapsNet), dynamic routing, dot-product attention mechanism, graph convolution, image classification

摘要： 胶囊网络具有弥补卷积神经网络空间信息丢失和旋转不变性差的优点，已被广泛应用于图像分类、目标检测以及文本检测等多个领域，但胶囊网络仍存在参数量大且分类精确度低的问题。提出基于点乘注意力图卷积路由的胶囊网络分类模型。在同级胶囊之间构建连通图，通过注意力机制获取胶囊间的依赖关系，利用影响因素大的预测胶囊进行特征聚类，改变使用迭代更新高低胶囊层间耦合系数的动态路由方式，降低参数量并提升模型的分类准确率。此外，在特征提取部分加入残差网络提取更高维的特征以优化胶囊质量，在提升模型特征表达能力的同时可抑制模型过大。实验结果表明，在参数量小于多个胶囊网络变体的情况下，该模型在MNIST、FashionMNIST、CIFAR10和SVHN数据集上的精度分别达到99.74%、95.02%、91.78%和95.65%，均高于MS-CapsNet、TextCaps、AR CapsNet、FSc-CapsNet、DA-CapsNet等对比模型。

关键词: 胶囊网络, 动态路由, 点乘注意力机制, 图卷积, 图像分类

CLC Number:

TP391

CHEN Shan, SUN Rencheng, SHAO Fengjing, SUI Yi. Research and Improvement of Dynamic Routing Based on Capsule Network[J]. Computer Engineering, 2022, 48(5): 208-214.

陈珊, 孙仁诚, 邵峰晶, 隋毅. 基于胶囊网络的动态路由研究与改进[J]. 计算机工程, 2022, 48(5): 208-214.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0062928

http://www.ecice06.com/EN/Y2022/V48/I5/208

Figures/Tables 6

References

[1] KRIZHEVSKY A, SUTSKEVER I, HINTON G E.ImageNet classification with deep convolutional neural networks[J].Communications of the ACM, 2017, 60(6):84-90.
[2] HE K M, GKIOXARI G, DOLLÁR P, et al.Mask R-CNN[C]//Proceedings of 2017 IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2017:2980-2988.
[3] CONNEAU A, SCHWENK H, BARRAULT L, et al.Very deep convolutional networks for text classification[C]//Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics:Volume 1, Long Papers.Stroudsburg, USA:Association for Computational Linguistics, 2017:213-224.
[4] SABOUR S, FROSST N, HINTON G E.Dynamic routing between capsules[EB/OL].[2021-04-20].https://arxiv.org/abs/1710.09829.
[5] DE JESUS D R, CUEVAS J, RIVERA W, et al.Capsule networks for protein structure classification and prediction[EB/OL].[2021-04-20].https://arxiv.org/abs/1808.07475.
[6] KIM Y, WANG P, ZHU Y F, et al.A capsule network for traffic speed prediction in complex road networks[C]//Proceedings of 2018 Sensor Data Fusion:Trends, Solutions, Applications.Bonn, Germany:Springer, 2018:1-6.
[7] AFSHAR P, MOHAMMADI A, PLATANIOTIS K N.Brain tumor type classification via capsule networks[C]//Proceedings of the 25th International Conference on Image Processing.Athens, Greece:[s.n.], 2018:3129-3133.
[8] JIMÉNEZ-SÁNCHEZ A, ALBARQOUNI S, MATEUS D.Capsule networks against medical imaging data challenges[C]//Proceedings of Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis.Berlin, Germany:Springer, 2018:150-160.
[9] MANDAL B, SARKHEL R, GHOSH S, et al.Two-phase dynamic routing for micro and macro-level equivariance in multi-column capsule networks[J].Pattern Recognition, 2021, 109:107595.
[10] TSAI Y H H, SRIVASTAVA N, GOH H, et al.Capsules with inverted dot-product attention routing[EB/OL].[2021-04-20].https://arxiv.org/abs/2002.04764.
[11] XIANG C Q, ZHANG L, TANG Y, et al.MS-CapsNet:a novel multi-scale capsule network[J].IEEE Signal Processing Letters, 2018, 25(12):1850-1854.
[12] EDRAKI M, RAHNAVARD N, SHAH M.SubSpace capsule network[J].Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(7):10745-10753.
[13] LALONDE R, KHOSRAVAN N, BAGCI U.Deformable capsules for object detection[EB/OL].[2021-04-20].https://arxiv.org/abs/2104.05031.
[14] SUN K, YUAN L M, XU H X, et al.Deep tensor capsule network[J].IEEE Access, 2020, 8:96920-96933.
[15] BAHADORI M T.Spectral capsule networks[EB/OL].[2021-04-20].https://gitee.com/saber5433/awesome-capsule-networks/blob/master/README.md.
[16] GU J D, TRESP V, HU H.Capsule network is not more robust than convolutional network[C]//Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Nashville, USA:IEEE Press, 2021:14304-14312.
[17] WANG D L, LIU Q.An optimization view on dynamic routing between capsules[EB/OL].[2021-04-20].https://openreview.net/pdf?id=HJjtFYJDf.
[18] ZHAO Z, KLEINHANS A, SANDHU G, et al.Capsule networks with max-min normalization[EB/OL].[2021-04-20].https://arxiv.org/abs/1903.09662.
[19] VASWANI A, SHAZEER N, PARMAR N, et al.Attention is all you need?[EB/OL].[2021-04-20].https://arxiv.org/abs/1706.03762.
[20] SALVETTI F, MAZZIA V, KHALIQ A, et al.Multi-image super resolution of remotely sensed images using residual attention deep neural networks[J].Remote Sensing, 2020, 12(14):2207.
[21] HUANG W K, ZHOU F B.DA-CapsNet:dual attention mechanism capsule network[J].Scientific Reports, 2020, 10(1):11383.
[22] WOO S, PARK J, LEE J Y, et al.CBAM:convolutional block attention module[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:3-19.
[23] JAYASUNDARA V, JAYASEKARA S, JAYASEKARA H, et al.TextCaps:handwritten character recognition with very small datasets[C]//Proceedings of 2019 IEEE Winter Conference on Applications of Computer Vision. Washington D.C., USA:IEEE Press, 2019:254-262.
[24] CHOI J, SEO H, IM S, et al.Attention routing between capsules[C]//Proceedings of 2019 IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:1981-1989.
[25] HAN T H, SUN R C, SHAO F J, et al.Feature and spatial relationship coding capsule network[J].Journal of Electronic Imaging, 2020, 29:1-10.

Please choose a citation manager

Content to export