计算机工程

所属专题: 云计算专题

• 云计算专题 • 上一篇    下一篇

云存储系统中动态负载均衡算法研究

田浪军1,陈卫卫1,陈卫东2,李 涛1   

  1. (1. 中国人民解放军理工大学指挥信息系统学院,南京 210007;2. 国防科学技术大学,长沙 410007)
  • 收稿日期:2013-03-25 出版日期:2013-10-15 发布日期:2013-10-14
  • 作者简介:田浪军(1985-),男,硕士研究生,主研方向:云计算,海量数据存储;陈卫卫,教授;陈卫东,副教授;李 涛,硕士研究生

Research on Dynamic Load Balancing Algorithm in Cloud Storage System

TIAN Lang-jun 1, CHEN Wei-wei 1, CHEN Wei-dong 2, LI Tao 1   

  1. (1. School of Command Information System, PLA University of Science and Technology, Nanjing 210007, China; 2. National University of Defense Technology, Changsha 410007, China)
  • Received:2013-03-25 Online:2013-10-15 Published:2013-10-14

摘要:

针对分布式哈希表(DHT)云存储系统中的存储负载不均问题,提出一种基于节点动态前移(NDF)的负载均衡算法。通过过载节点动态前移,缩小节点存储分区,进而降低节点的存储负载。同时,过载节点向第3个后继节点复制相关数据,保证系统中数据的副本数量稳定。在NDF算法执行过程中,只需过载节点与第3个后继节点进行简单协调,多个过载节点可以并发地进行负载转移,适合在大规模集群中部署。在10个节点的小规模集群中进行功能测试,验证NDF算法具有良好的负载均衡能力。在 5 000个节点的大规模集群中进行性能测试,结果证明在系统总负载不超过60%时,与虚拟节点算法相比,NDF算法负载转移代价可以提升30%以上。

关键词: 分布式哈希表, 云存储, 负载均衡, 节点动态前移算法, 虚拟节点, 负载迁移代价

Abstract:

In order to solve the problem of load imbalance of Distributed Hash Table(DHT) cloud storage system, this paper proposes a load balancing algorithm based on Node Dynamic Forward(NDF). Through overload nodes forward, this algorithm can reduce the node’s partition, and thereby reduce the storage node load. At the same time, copy the corresponding data to the third successor node, to ensure the stable number of copies the data in the system. In the NDF implementation process, it only needs a simple coordination between overload node and the third successor node. Therefore, multiple overloaded nodes can concurrently do load transfer, which is suitable for deployment in a large cluster. The functional test in a minor cluster of 10 nodes verifies that the NDF has good ability of load balancing. The performance test in a massive cluster of 5 000 nodes demonstrates the total system load does not exceed 60%, and compared with the virtual node algorithm, NDF algorithm can improve the load transfer cost by more than 30%.

Key words: Distributed Hash Table(DHT), cloud storage, load balancing, Node Dynamic Forward(NDF) algorithm, virtual node, load transfer cost

中图分类号: