作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2010, Vol. 36 ›› Issue (20): 102-105. doi: 10.3969/j.issn.1000-3428.2010.20.036

• 网络与通信 • 上一篇    下一篇

HPMR系统KV路由算法设计

郑启龙1,2,王向前1,2,王 昊1,2   

  1. (1. 中国科学技术大学计算机科学技术学院,合肥 230027;2. 安徽省高性能计算重点实验室,合肥 230026)
  • 出版日期:2010-10-20 发布日期:2010-10-18
  • 作者简介:郑启龙(1969-),男,副教授,主研方向:并行与分布式计算;王向前、王 昊,硕士研究生
  • 基金资助:
    国家自然科学基金资助重点项目(60533020);安徽省自然科学基金资助项目(090412068)

Design on KV Routing Algorithm for HPMR System

ZHENG Qi-long1,2, WANG Xiang-qian1,2, WANG Hao1,2   

  1. (1. School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China;2. Anhui Provincial Key Laboratory of High Performance Computing, Hefei 230026, China)
  • Online:2010-10-20 Published:2010-10-18

摘要: 提出一种针对HPMR系统的KV路由算法。HPMR系统是MapReduce模型的一个实现,改进了MapReduce模型以适应高性能计算的需求。HPMR的KV路由算法生成KV路由表,所有数据的收发动作将依据该路由表进行。KV路由算法产生的KV路由表直接决定HPMR系统在通信阶段的时间开销。实验结果表明,该KV路由算法产生的KV路由表可以提高HPMR系统的通信性能。

关键词: MapReduce模型, 高性能计算, DSS-KV路由算法

Abstract: This paper presents a KV Routing Algorithm for High-Performance MapReduce(HPMR) system. HPMR system is an implementation of the MapReduce(MR) model, which accommodates the MR model to the requirements of high-performance computing. The KV routing algorithm is used to create KV routing table by which all the send or receive actions on data are done. The performance of the KV routing table generated by KV routing algorithm directly determines the time cost of the communication phase of HPMR system. Experimental results show that KV routing table created by the KV routing algorithm can improve the communication performance of HPMR system.

Key words: MapReduce(MR) model, high-performance computing, DSS-KV routing algorithm

中图分类号: