基于嵌套U-型结构的电路板组件分割

doi:10.19678/j.issn.1000-3428.0068881

摘要/Abstract

摘要：

作为重要的现代电子元器件, 高度集成的印刷电路板(PCB)的组件分割属于典型的小物件图像分割。由于复杂背景的过度引入, PCB图像的组件分割面临着边界感知能力不足等挑战。为了提高PCB分割组件边界感知能力, 提出一种外部协调的嵌套U-型网络结构(U²ECNet)。U²ECNet的主干网络为嵌套U-型结构, 在编解码体系中使用外部扩张模块, 有效学习全局和局部信息, 并关注组件区域中的边缘和角细节; 使用引导细化模块, 通过多尺度特征映射聚合全局语义信息, 从而优化模型的分割精度, 同时提高对PCB组件分割的效果; 制作新的图像分割数据集PCB_SOD, 其包含5 608张训练图像和2 403张测试图像, 用于执行分割任务, 并在所提网络中进行训练。在DUTS和PCB_SOD数据集上的实验结果表明, U²ECNet在平均绝对误差(MAE)和maxF_β上分别达到0.045、86.1%和0.027、87.2%, 相较于其他方法, U²ECNet的MAE更低, maxF_β更高, 整体分割性能达到最佳。此外, 所提外部协调的嵌套U-型结构提升了PCB组件分割的精度, 在复杂背景中表现出良好的鲁棒性, 生成了准确的显著性分割图。

关键词: 显著性分割, U-型网络结构, PCB_SOD数据集, 边界感知, 引导细化

Abstract:

As an important modern electronic component, component segmentation of highly integrated Printed Circuit Boards (PCB) is a typical small-object image segmentation task. Owing to the excessive introduction of complex backgrounds, component segmentation of PCB images faces challenges such as insufficient boundary-awareness capability. To improve the boundary-awareness capability, an externally coordinated nested U-shape network structure called U²ECNet is proposed. Specifically, the backbone network of the algorithm is a nested U-shape structure, and an external expansion module is used in the coding and decoding system to efficiently learn global and local information and focus on the edge and corner details in the component region. A bootstrap refinement module is used to optimize the segmentation accuracy of the model and improve the segmentation effect of PCB components by aggregating the global semantic information through multi-scale feature mapping. PCB_SOD, a new image segmentation dataset containing 5 608 training images and 2 403 test images, was used to perform the segmentation task and trained in the proposed network. Experiments on the DUTS and PCB_SOD datasets show that the network model achieved a Mean Absolute Error (MAE) of 0.045 and 0.027 and max F_β of 86.1% and 87.2%, respectively, demonstrating reduced MAE and improved max F_β, achieving the best overall segmentation performance compared to other methods. The proposed externally coordinated nested U-shape structure improves the accuracy of PCB component segmentation, exhibits good robustness in complex backgrounds, and generates the most accurate saliency segmentation graph.

Key words: significance segmentation, U-shape network structure, PCB_SOD dataset, boundary perception, guiding refinement

李致金, 范小真, 闫金凤. 基于嵌套U-型结构的电路板组件分割[J]. 计算机工程, 2024, 50(12): 367-375.

LI Zhijin, FAN Xiaozhen, YAN Jinfeng. Segmentation of Printed Circuit Board Components Based on Nested U-shape Structures[J]. Computer Engineering, 2024, 50(12): 367-375.

https://www.ecice06.com/CN/Y2024/V50/I12/367

图/表 10

图1 本文算法框架

Fig.1 The framework of the algorithm in this paper

图2 EC-RSU模块

Fig.2 EC-RSU module

图3 外部扩张模块

Fig.3 External expansion module

图4 协调注意模块和引导细化模块

Fig.4 Coordinate attention module and guide refinement module

图5 PCB_SOD数据集的RGB图像和掩膜图像示例

Fig.5 Example of RGB and mask images in PCB_SOD dataset

图6 不同方法的视觉比较

Fig.6 Visual comparison of different methods

图7 Precision-Recall曲线

Fig.7 Precision-Recall curves

参考文献 36

1	ADIBHATLA V A , CHIH H C , HSU C C , et al. Applying deep learning to defect detection in printed circuit boards via a newest model of you-only-look-once. Mathematical Biosciences and Engineering, 2021, 18 (4): 4411- 4428. doi: 10.3934/mbe.2021223
2	FEL J T , ELLIS C T , TURK-BROWNE N B . Automated and manual segmentation of the hippocampus in human infants. Developmental Cognitive Neuroscience, 2023, 60, 101203. doi: 10.1016/j.dcn.2023.101203
3	HARRISON K , PULLEN H , WELSH C , et al. Machine learning for auto-segmentation in radiotherapy planning. Clinical Oncology, 2022, 34 (2): 74- 88. doi: 10.1016/j.clon.2021.12.003
4	LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington D.C., USA: IEEE Press, 2015: 3431-3440. URL
5	CHEN L C, ZHU Y K, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[EB/OL]. [2023-10-05]. https://arxiv.org/abs/1802.02611.
6	RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[EB/OL]. [2023-10-05]. https://arxiv.org/abs/1505.04597.
7	DOU Z W , YE D , WANG B Y . AutoSegEdge: searching for the edge device real-time semantic segmentation based on multi-task learning. Image and Vision Computing, 2023, 136, 104719. doi: 10.1016/j.imavis.2023.104719
8	PRISACARIU V A , REID I . 3D hand tracking for human computer interaction. Image and Vision Computing, 2012, 30 (3): 236- 250. doi: 10.1016/j.imavis.2012.01.003
9	ZAITOUN N M , AQEL M J . Survey on image segmentation techniques. Procedia Computer Science, 2015, 65, 797- 806. doi: 10.1016/j.procs.2015.09.027
10	LEMPITSKY V, VEDALDI A, ZISSERMAN A. A pylon model for semantic segmentation[EB/OL]. [2023-10-05]. https://proceedings.neurips.cc/paper/2011/file/fe8c15fed5f808006ce95eddb7366e35-Paper.pdf. URL
11	景庄伟, 管海燕, 彭代峰, 等. 基于深度神经网络的图像语义分割研究综述. 计算机工程, 2020, 46 (10): 1- 17. doi: 10.3778/j.issn.1002-8331.2001-0320
	JING Z W , GUAN H Y , PENG D F , et al. Survey of research in image semantic segmentation based on deep neural network. Computer Engineering, 2020, 46 (10): 1- 17. doi: 10.3778/j.issn.1002-8331.2001-0320
12	LIU W, RABINOVICH A, BERG A C. ParseNet: looking wider to see better[EB/OL]. [2023-10-05]. http://arxiv.org/abs/1506.04579v2. URL
13	CHEN L C, PAPANDREOU G, SCHROFF F, et al. Rethinking atrous convolution for semantic image segmentation[EB/OL]. [2023-10-05]. http://arxiv.org/abs/1706.05587v3. URL
14	ZHANG G, LU X, TAN J R, et al. RefineMask: towards high-quality instance segmentation with fine-grained features[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D.C., USA: IEEE Press, 2021: 6861-6869. URL
15	LI X T, XU J L, ZHANG Y J, et al. TCCNet: temporally consistent context-free network for semi-supervised video polyp segmentation[EB/OL]. [2023-10-05]. https://www.ijcai.org/proceedings/2022/155.
16	WANG W G , LAI Q X , FU H Z , et al. Salient object detection in the deep learning era: an in-depth survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (6): 3239- 3259. doi: 10.1109/TPAMI.2021.3051099
17	ZHAO Q J , SHENG T , WANG Y T , et al. M2Det: a single-shot object detector based on multi-level feature pyramid network. Proceedings of the AAAI Conference on Artificial Intelligence, 2019, 33 (1): 9259- 9266. doi: 10.1609/aaai.v33i01.33019259
18	DENG Z J, HU X W, ZHU L, et al. R³Net: recurrent residual refinement network for saliency detection[C]// Proceedings of the 27th International Joint Conference on Artificial Intelligence. Washington D.C., USA: IEEE Press, 2018: 684-690. URL
19	WAN W K, GENG H R, LIU Y, et al. UniDexGrasp++: improving dexterous grasping policy learning via geometry-aware curriculum and iterative generalist-specialist learning[EB/OL]. [2023-10-05]. http://arxiv.org/abs/2304.00464v2. URL
20	SUN Y J, WANG S, CHEN C, et al. Boundary-guided camouflaged object detection[EB/OL]. [2023-10-05]. http://arxiv.org/abs/2207.00794v1.
21	HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington D.C., USA: IEEE Press, 2016: 770-778. URL
22	QIN X B, FAN D P, HUANG C Y, et al. Boundary-aware segmentation network for mobile and web applications[EB/OL]. [2023-10-05]. http://arxiv.org/abs/2101.04704v2. URL
23	ZHAO Z R, XIA C Q, XIE C X, et al. Complementary trilateral decoder for fast and accurate salient object detection[C]// Proceedings of the 29th ACM International Conference on Multimedia. New York, USA: ACM Press, 2021: 4967-4975. URL
24	ZHOU X F , FANG H , LIU Z , et al. Dense attention-guided cascaded network for salient object detection of strip steel surface defects. IEEE Transactions on Instrumentation Measurement, 2022, 71, 3132082. doi: 10.1109/TIM.2021.3132082
25	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. [2023-10-05]. http://arxiv.org/abs/1409.1556v6. URL
26	ZHENG P , FU H , FAN D P , et al. GCoNet+: a stronger group collaborative co-salient object detector. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45 (9): 10929- 10946. doi: 10.1109/TPAMI.2023.3264571
27	ZHOU X , SHEN K , WENG L , et al. Edge-guided recurrent positioning network for salient object detection in optical remote sensing images. IEEE Transactions on Cybernetics, 2023, 53 (1): 539- 552. doi: 10.1109/TCYB.2022.3163152
28	LI G , LIU Z , ZENG D , et al. Adjacent context coordination network for salient object detection in optical remote sensing images. IEEE Transactions on Cybernetics, 2023, 53 (1): 526- 538. doi: 10.1109/TCYB.2022.3162945
29	PIAO Y R, WANG J, ZHANG M, et al. MFNet: multi-filter directive network for weakly supervised salient object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Washington D.C., USA: IEEE Press, 2021: 4136-4145. URL
30	SANDLER M, HOWARD A, ZHU M L, et al. MobileNetV2: inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D.C., USA: IEEE Press, 2018: 4510-4520. URL
31	LIN Y H, SUN H, LIU N Z, et al. A lightweight multi-scale context network for salient object detection in optical remote sensing images[C]//Proceedings of the 26th International Conference on Pattern Recognition. Washington D.C., USA: IEEE Press, 2022: 238-244. URL
32	GUO C L, SZEMENYEI M, YI Y G, et al. SA-UNet: spatial attention U-Net for retinal vessel segmentation[C]//Proceedings of the 25th International Conference on Pattern Recognition. Washington D.C., USA: IEEE Press, 2021: 1236-1242.
33	QIN X B , ZHANG Z C , HUANG C Y , et al. U²Net: going deeper with nested U-structure for salient object detection. Pattern Recognition, 2020, 106, 107404. doi: 10.1016/j.patcog.2020.107404
34	LI G Y , BAI Z , LIU Z , et al. Salient object detection in optical remote sensing images driven by transformer. IEEE Transactions on Image Processing, 2023, 32, 5257- 5269. doi: 10.1109/TIP.2023.3314285
35	CHEN J N, LU Y Y, YU Q H, et al. TransUNet: transformers make strong encoders for medical image segmentation[EB/OL]. [2023-10-05]. http://arxiv.org/abs/2102.04306v1. URL
36	XU G A , LI J C , GAO G W , et al. Lightweight real-time semantic segmentation network with efficient transformer and CNN. IEEE Transactions on Intelligent Transportation Systems, 2023, 24 (12): 15897- 15906. doi: 10.1109/TITS.2023.3248089

选择文件类型/文献管理软件名称

选择包含的内容