Research Progress of Multi-Robot Collaborative SLAM Technology

doi:10.19678/j.issn.1000-3428.0062504

Abstract

Abstract: Because of the limitations of single-robot Simultaneous Localization and Mapping(SLAM) technology in practical applications, multi-robot collaborative SLAM technology has received extensive attention from researchers with its strong flexibility and robustness, and has great application prospects in agricultural production, environmental monitoring, maritime search and rescue, and other fields.Multi-robot collaborative SLAM is the core of multi-robot collaborative work, and it is the key to obtaining timely situational awareness information in a large-scale complex environment, which enables each robot to co-locate and build a workspace map when working together.Multi-robot collaborative SLAM is mainly implemented based on single-robot SLAM algorithm, multi-robot system architecture, map fusion and other technologies.Combined with the development history of multi-robot collaborative SLAM, this study compares and analyzes the current mainstream multi-robot collaborative SLAM algorithms.From the sensor, the multi-robot collaborative SLAM is divided into three categories:laser collaborative SLAM, vision collaborative SLAM and laser vision fusion collaborative SLAM, and the architecture selection, multi-machine communication, relative pose, map fusion and post-processing of multi-robot collaborative SLAM are discussed.Simultaneously, it is pointed out that the collaborative SLAM of heterogeneous robots and semantic SLAM based on deep learning is the future development trend of multi-robot collaborative SLAM.

Key words: multi-robot system, collaborative Simultaneous Localization and Mapping(SLAM), relative pose, map fusion, back-end optimization

摘要： 由于单机器人同步定位与建图（SLAM）技术在实际应用中的局限性，多机器人协同SLAM技术以较强的灵活性和鲁棒性受到研究人员的广泛关注，并且在农业生产、环境监测、海上搜救等领域具有巨大应用前景。多机器人协同SLAM是多机器人协同工作的核心及大范围复杂环境内及时获得场景感知信息的关键，能使多个机器人在协同工作时共同定位并构建任务空间地图，主要基于单机器人SLAM算法、多机器人系统架构、地图融合等技术实现。结合多机器人协同SLAM的发展历程，对比分析当前主流的多机器人协同SLAM算法。从传感器的角度，将多机器人协同SLAM分为激光协同SLAM、视觉协同SLAM以及激光视觉融合协同SLAM三类，并对多机器人协同SLAM的架构选择、多机通信、相对位姿、地图融合和后端优化问题进行讨论，同时指出异构机器人协同、基于深度学习的语义SLAM是多机器人协同SLAM的未来发展趋势。

关键词: 多机器人系统, 协同同步定位与建图, 相对位姿, 地图融合, 后端优化

CLC Number:

TP242

LIU Xin, WANG Zhong, QIN Mingxing. Research Progress of Multi-Robot Collaborative SLAM Technology[J]. Computer Engineering, 2022, 48(5): 1-10.

刘鑫, 王忠, 秦明星. 多机器人协同SLAM技术研究进展[J]. 计算机工程, 2022, 48(5): 1-10.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0062504

http://www.ecice06.com/EN/Y2022/V48/I5/1

Figures/Tables 5

References

[1] SMITH R C, CHEESEMAN P.On the representation and estimation of spatial uncertainty[J].The International Journal of Robotics Research, 1986, 5(4):56-68.
[2] SAEEDI S, TRENTINI M, SETO M, et al.Multiple-robot simultaneous localization and mapping:a review[J].Journal of Field Robotics, 2016, 33(1):3-46.
[3] RIZK Y, AWAD M, TUNSTEL E W.Cooperative heterogeneous multi-robot systems:a survey[J].ACM Computing Surveys, 2020, 52(2):29-31.
[4] GRISETTI G, STACHNISS C, BURGARD W.Improved techniques for grid mapping with Rao-Blackwellized particle filters[J].IEEE Transactions on Robotics, 2007, 23(1):34-46.
[5] KOHLBRECHER S, VON STRYK O, MEYER J, et al.A flexible and scalable SLAM system with full 3D motion estimation[C]//Proceedings of IEEE International Symposium on Safety, Security, and Rescue Robotics.Washington D.C., USA:IEEE Press, 2011:155-160.
[6] HESS W, KOHLER D, RAPP H, et al.Real-time loop closure in 2D LIDAR SLAM[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2016:1271-1278.
[7] FORSTER C, PIZZOLI M, SCARAMUZZA D.SVO:fast semi-direct monocular visual odometry[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2014:15-22.
[8] MUR-ARTAL R, MONTIEL J M M, TARDÓS J D.ORB-SLAM:a versatile and accurate monocular SLAM system[J].IEEE Transactions on Robotics, 2015, 31(5):1147-1163.
[9] VALENTINI G, FERRANTE E, HAMANN H, et al.Collective decision with 100 Kilobots:speed versus accuracy in binary discrimination problems[J].Autonomous Agents and Multi-Agent Systems, 2016, 30(3):553-580.
[10] SCHMIDT A.Multi-robot, EKF-based visual SLAM system[M].Berlin, Germany:Springer, 2014.
[11] PIASCO N, MARZAT J, SANFOURCHE M.Collaborative localization and formation flying using distributed stereo-vision[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2016:1202-1207.
[12] ZHOU Z, WANG D Q, XU B Y.A multi-innovation with forgetting factor based EKF-SLAM method for mobile robots[J].Assembly Automation, 2021, 41(1):71-78.
[13] MONTEMERLO M, STENTZ A.FastSLAM:a factored solution to the simultaneous localization and mapping problem with unknown data association[C]//Proceedings of AAAI National Conference on Artificial Intelligence Edmonton Alberta.New York, USA:ACM Press, 2002:240-248.
[14] TANG X L, LI L M, JIANG B J.Mobile robot SLAM method based on multi-agent particle swarm optimized particle filter[J].The Journal of China Universities of Posts and Telecommunications, 2014, 21(6):78-86.
[15] LIU W L.SLAM algorithm for multi-robot communication in unknown environment based on particle filter[J/OL].Journal of Ambient Intelligence and Humanized Compting:1-9[2021-07-18].https://doi.org/10.1007/s12652-021-03020-3.
[16] WEN W S, HSU L T, ZHANG G H.Performance analysis of NDT-based graph SLAM for autonomous vehicle in diverse typical driving scenarios of Hong Kong[J].Sensors, 2018, 18(11):3928.
[17] KIM B, KAESS M, FLETCHER L, et al.Multiple relative pose graphs for robust cooperative mapping[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2010:3185-3192.
[18] 张金凤, 石朝侠, 王燕清.动态场景下基于视觉特征的SLAM方法[J].计算机工程, 2020, 46(10):95-102. ZHANG J F, SHI C X, WANG Y Q.SLAM method based on visual features in dynamic scene[J].Computer Engineering, 2020, 46(10):95-102.(in Chinese)
[19] 余东应, 刘桂华, 曾维林, 等.自适应窗隔匹配与深度学习相结合的RGB-D SLAM算法[J].计算机工程, 2021, 47(8):224-233. YU D Y, LIU G H, ZENG W L, et al.RGB-D SLAM algorithm combining adaptive window interval matching and deep learning[J].Computer Engineering, 2021, 47(8):224-233.(in Chinese)
[20] COSTANTE G, MANCINI M, VALIGI P, et al.Exploring representation learning with CNNs for frame-to-frame ego-motion estimation[J].IEEE Robotics and Automation Letters, 2016, 1(1):18-25.
[21] GAO X, ZHANG T.Unsupervised learning to detect loops using deep neural networks for visual SLAM system[J].Autonomous Robots, 2017, 41(1):1-18.
[22] MA L N, STÜCKLER J, KERL C, et al.Multi-view deep learning for consistent semantic mapping with RGB-D cameras[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems.Washington D.C., USA:IEEE Press, 2017:598-605.
[23] 田野, 陈宏巍, 王法胜, 等.室内移动机器人的SLAM算法综述[J].计算机科学, 2021, 48(9):223-234. TIAN Y, CHEN H W, WANG F S, et al.Overview of SLAM algorithms for mobile robots[J].Computer Science, 2021, 48(9):223-234.(in Chinese)
[24] CHO H, KIM E K, KIM S.Indoor SLAM application using geometric and ICP matching methods based on line features[J].Robotics and Autonomous Systems, 2018, 100:206-224.
[25] REN R K, FU H, WU M P.Large-scale outdoor SLAM based on 2D lidar[J].Electronics, 2019, 8(6):613.
[26] SRINARA S, LEE C M, TSAI S, et al.Performance analysis of 3D NDT scan matching for autonomous vehicles using INS/GNSS/3D LiDAR-SLAM integration scheme[C]//Proceedings of IEEE International Symposium on Inertial Sensors and Systems.Washington D.C., USA:IEEE Press, 2021:1-4.
[27] SMITH R, SELF M, CHEESEMAN P.Estimating uncertain spatial relationships in robotics[C]//Proceedings of 1987 IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 1987:850.
[28] 仇昌成.基于三维激光点云的室内多机器人SLAM研究[D].苏州:苏州大学, 2020. QIU C C.Research on indoor multi-robot SLAM based on 3D lidar point cloud[D].Suzhou:Soochow University, 2020.(in Chinese)
[29] ZHANG Y C, CHEN L, XUANYUAN Z, et al.Three-dimensional cooperative mapping for connected and automated vehicles[J].IEEE Transactions on Industrial Electronics, 2020, 67(8):6649-6658.
[30] ZHANG J, SINGH S.LOAM:lidar odometry and mapping in real-time[J].Robotics:Science and Systems, 2014, 2:9.
[31] 权美香, 朴松昊, 李国.视觉SLAM综述[J].智能系统学报, 2016, 11(6):768-776. QUAN M X, PIAO S H, LI G.An overview of visual SLAM[J].CAAI Transactions on Intelligent Systems, 2016, 11(6):768-776.(in Chinese)
[32] 潘林豪, 田福庆, 应文健, 等.单目相机-IMU外参自动标定与在线估计的视觉-惯导SLAM[J].仪器仪表学报, 2019, 40(6):56-67. PAN L H, TIAN F Q, YING W J, et al.VI-SLAM algorithm with camera-IMU extrinsic automatic calibration and online estimation[J].Chinese Journal of Scientific Instrument, 2019, 40(6):56-67.(in Chinese)
[33] 樊建彪, 孙剑, 樊欢欢, 等.基于磁力计、IMU和单目视觉的自主定位方法[J].宇航总体技术, 2019, 3(6):39-45. FAN J B, SUN J, FAN H H, et al.A method of autonomous localization based on magnetometer, IMU, and monocular vision[J].Astronautical Systems Engineering Technology, 2019, 3(6):39-45.(in Chinese)
[34] CAO L K, LING J, XIAO X H.Study on the influence of image noise on monocular feature-based visual SLAM based on FFDNet[J].Sensors, 2020, 20(17):4922.
[35] PUDCHUEN N, JITVIRIYA W.3-D mapping and localization using RGB-D camera[C]//Proceedings of the 1st International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics.Washington D.C., USA:IEEE Press, 2019:139-142.
[36] DENG C G, LUO X N, ZHONG Y R.Improved closed-loop detection and Octomap algorithm based on RGB-D SLAM[C]//Proceedings of IEEE International Conference on Artificial Intelligence and Computer Applications.Washington D.C., USA:IEEE Press, 2020:73-76.
[37] HU Z F, QI B L, LUO Y, et al.Mobile robot V-SLAM based on improved closed-loop detection algorithm[C]//Proceedings of the 8th Joint International Information Technology and Artificial Intelligence Conference.Washington D.C., USA:IEEE Press, 2019:1150-1154.
[38] ZHANG Q S, XU G H, LI N.Improved SLAM closed-loop detection algorithm based on DBoW2[J].Journal of Physics:Conference Series, 2019, 1345(4):42094.
[39] DAVISON A J, REID I D, MOLTON N D, et al.MonoSLAM:real-time single camera SLAM[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(6):1052-1067.
[40] SCHMUCK P, CHLI M.CCM-SLAM:robust and efficient centralized collaborative monocular simultaneous localization and mapping for robotic teams[J].Journal of Field Robotics, 2019, 36(4):763-781.
[41] NEWMAN P, COLE D, HO K.Outdoor SLAM using visual appearance and laser ranging[C]//Proceedings 2006 IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2006:1180-1187.
[42] ZHANG J, SINGH S.Visual-lidar odometry and mapping:low-drift, robust, and fast[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2015:2174-2181.
[43] CHEN H Y, HUANG H L, QIN Y, et al.Vision and laser fused SLAM in indoor environments with multi-robot system[J].Assembly Automation, 2019, 39(2):297-307.
[44] SCHMUCK P, CHLI M.Multi-UAV collaborative monocular SLAM[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2017:3863-3870.
[45] MA T Y, ZHANG T, LI S P.Multi-robot collaborative SLAM and scene reconstruction based on RGB-D camera[C]//Proceedings of Chinese Automation Congress.Washington D.C., USA:IEEE Press, 2020:139-144.
[46] SCHMUCK P, ZIEGLER T, KARRER M, et al.COVINS:visual-inertial SLAM for centralized collaboration[C]//Proceedings of 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct.Washington D.C., USA:IEEE Press, 2021:1-12.
[47] LAJOIE P Y, RAMTOULA B, CHANG Y, et al.DOOR-SLAM:distributed, online, and outlier resilient SLAM for robotic teams[J].IEEE Robotics and Automation Letters, 2020, 5(2):1656-1663.
[48] GAO L, BATTISTELLI G, CHISCI L.Random-finite-set-based distributed multirobot SLAM[J].IEEE Transactions on Robotics, 2020, 36(6):1758-1777.
[49] WEN S H, CHEN J, LÜ X H, et al.Cooperative simultaneous localization and mapping algorithm based on distributed particle filter[J/OL].International Journal of Advanced Robotic Systems:1-7[2021-07-18].https://doi.org/10.1177/1729881418819950.
[50] CHEN X, LU H M, XIAO J H, et al.Distributed monocular multi-robot SLAM[C]//Proceedings of the 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems.Washington D.C., USA:IEEE Press, 2018:73-78.
[51] ZHANG H, CHEN X, LU H M, et al.Distributed and collaborative monocular simultaneous localization and mapping for multi-robot systems in large-scale environments[J/OL].International Journal of Advanced Robotic Systems:1-12[2021-07-18].https://doi.org/10.1177/1729881418780178.
[52] RIZK Y, AWAD M, TUNSTEL E W.Cooperative heterogeneous multi-robot systems:a survey[J].ACM Computing Surveys, 2019, 52(2):1-29, 31.
[53] FORSTER C, LYNEN S, KNEIP L, et al.Collaborative monocular SLAM with multiple micro aerial vehicles[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems.Washington D.C., USA:IEEE Press, 2013:3962-3970.
[54] CAPPEL H F.A hierarchical multi-robot mapping architecture subject to communication constraints[D].Austin, USA:University of Texas at Austin, 2021.
[55] GIAMOU M, KHOSOUSSI K, HOW J P.Talk resource-efficiently to me:optimal communication planning for distributed loop closure detection[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2018:3841-3848.
[56] MAHDOUI N, FRÉMONT V, NATALIZIO E.Communicating multi-UAV system for cooperative SLAM-based exploration[J].Journal of Intelligent & Robotic Systems, 2020, 98(2):325-343.
[57] MOHANARAJAH G, USENKO V, SINGH M, et al.Cloud-based collaborative 3D mapping in real-time with low-cost robots[J].IEEE Transactions on Automation Science and Engineering, 2015, 12(2):423-431.
[58] GUPTA L, JAIN R, VASZKUN G.Survey of important issues in UAV communication networks[J].IEEE Communications Surveys & Tutorials, 2016, 18(2):1123-1152.
[59] MARCOTTE R J, WANG X P, MEHTA D, et al.Optimizing multi-robot communication under bandwidth constraints[J].Autonomous Robots, 2020, 44(1):43-55.
[60] NIETO J, GUIVANT J, NEBOT E, et al.Real time data association for FastSLAM[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2003:412-418.
[61] DOHERTY K, FOURIE D, LEONARD J.Multimodal semantic SLAM with probabilistic data association[C]//Proceedings of International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2019:2419-2425.
[62] WANG J K, ENGLOT B.Robust exploration with multiple hypothesis data association[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems.Washington D.C., USA:IEEE Press, 2018:3537-3544.
[63] LEE H.One-way observation-based cooperative robot mapping[C]//Proceedings of the 16th International Conference on Automation Science and Engineering.Washington D.C., USA:IEEE Press, 2020:900-905.
[64] JANG Y, OH C, LEE Y, et al.Multirobot collaborative monocular SLAM utilizing rendezvous[J].IEEE Transactions on Robotics, 2021, 37(5):1469-1486.
[65] TSOUKALAS A, TZES A, KHORRAMI F.Relative pose estimation of unmanned aerial systems[C]//Proceedings of the 26th Mediterranean Conference on Control and Automation.Washington D.C., USA:IEEE Press, 2018:155-160.
[66] INDELMAN V, NELSON E, MICHAEL N, et al.Multi-robot pose graph localization and data association from unknown initial relative poses via expectation maximization[C]//Proceedings of IEEE International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2014:593-600.
[67] CHEN B F, LI S Y, ZHAO H W, et al.Map merging with suppositional box for multi-robot indoor mapping[J].Electronics, 2021, 10(7):815.
[68] SAEEDI S, TRENTINI M, LI H.A hybrid approach for multiple-robot SLAM with particle filtering[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems.Washington D.C., USA:IEEE Press, 2015:3421-3426.
[69] LEE H, LEE S.Extended spectra-based grid map merging with unilateral observations for multi-robot SLAM[J].IEEE Access, 2021, 9:79651-79662.
[70] BIRK A, CARPIN S.Merging occupancy grid maps from multiple robots[J].Proceedings of the IEEE, 2006, 94(7):1384-1397.
[71] FERRÃO V T, VINHAL C D N, DA CRUZ G.An occupancy grid map merging algorithm invariant to scale, rotation and translation[C]//Proceedings of Brazilian Conference on Intelligent Systems.Washington D.C., USA:IEEE Press, 2017:246-251.
[72] ZHOU X S, ROUMELIOTIS S I.Multi-robot SLAM with unknown initial correspondence:the robot rendezvous case[C]//Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems.Washington D.C., USA:IEEE Press, 2006:1785-1792.
[73] THRUN S, LIU Y F.Multi-robot SLAM with sparse extended information filers[M].Berlin, Germany:Springer, 2005.
[74] HOWARD A.Multi-robot simultaneous localization and mapping using particle filters[J].The International Journal of Robotics Research, 2006, 25(12):1243-1256.
[75] DEUTSCH I, LIU M, SIEGWART R.A framework for multi-robot pose graph SLAM[C]//Proceedings of IEEE International Conference on Real-time Computing and Robotics.Washington D.C., USA:IEEE Press, 2016:567-572.
[76] CAMPOS R, GRACIAS N, RIDAO P.Underwater multi-vehicle trajectory alignment and mapping using acoustic and optical constraints[J].Sensors, 2016, 16(3):387.
[77] BONIN-FONT F, BURGUERA A.Towards multi-robot visual graph-slam for autonomous marine vehicles[J].Journal of Marine Science and Engineering, 2020, 8(6):437.

Please choose a citation manager

Content to export