作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2019, Vol. 45 ›› Issue (11): 74-80. doi: 10.19678/j.issn.1000-3428.0052959

• 先进计算与数据处理 • 上一篇    下一篇

分布式存储系统中的纠删码容错方法研究

孙黎1,2, 苏宇2, 张弛2, 张涛2   

  1. 1. 中国科学院大学, 北京 100094;
    2. 中国科学院空间应用工程与技术中心, 北京 100094
  • 收稿日期:2018-10-22 修回日期:2018-12-12 出版日期:2019-11-15 发布日期:2018-12-19
  • 作者简介:孙黎(1988-),女,博士研究生,主研方向为分布式存储系统;苏宇、张弛,工程师;张涛,研究员。
  • 基金资助:
    载人航天重大专项(Y6140511RN)。

Research on Fault-Tolerant Method of Erasure Code for Distributed Storage System

SUN Li1,2, SU Yu2, ZHANG Chi2, ZHANG Tao2   

  1. 1. University of Chinese Academy of Sciences, Beijing 100094, China;
    2. Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China
  • Received:2018-10-22 Revised:2018-12-12 Online:2019-11-15 Published:2018-12-19

摘要: HRC码是一种具有存储效率高、计算复杂度低等优点的纠删码,但其存在编解码计算开销大、实现较为复杂等不足。通过对HRC码的译码算法进行优化,提出一种新型的纠删码HRCSD。采用内外层分层结构,内部的冗余由HRC码的编码结构组成,外层采用偏移复制策略,将原始信息进行旋转存储,能够实现并行读写。实验结果表明,与三副本技术和S2-RAID纠删码相比,HRCSD纠删码具有容错性能高、修复开销低等优势,可满足大规模分布式存储系统的容错需求。

关键词: 分布式存储系统, 纠删码, 数据容错, 数据编码, 数据冗余

Abstract: HRC code is an erasure code with high storage efficiency and low computation complexity,but it has some shortcomings,such as high computational overhead and complex implementation.So,we propose a new erasure coding type,the HRCSD code based on the optimized decoding algorithm of HRC code.The HRCSD code adopts an inner and outer layering structure.The inner redundancy is composed of the coding structure of the HRC code,while the outer layer adopts the offset copy strategy to rotate the original information and store it for parallel reading and writing.Experimental results show that compared with the three-copy technology and the S2-RAID erasure code,the HRCSD has higher fault-tolerant performance and lower repair overhead,which can satisfy the fault-tolerant requirements of large-scale distributed storage systems.

Key words: distributed storage system, erasure code, data fault-tolerant, data encoding, data redundancy

中图分类号: