Abstract: This paper presents a KV Routing Algorithm for High-Performance MapReduce(HPMR) system. HPMR system is an implementation of the MapReduce(MR) model, which accommodates the MR model to the requirements of high-performance computing. The KV routing algorithm is used to create KV routing table by which all the send or receive actions on data are done. The performance of the KV routing table generated by KV routing algorithm directly determines the time cost of the communication phase of HPMR system. Experimental results show that KV routing table created by the KV routing algorithm can improve the communication performance of HPMR system.

Key words: MapReduce(MR) model, high-performance computing, DSS-KV routing algorithm

摘要： 提出一种针对HPMR系统的KV路由算法。HPMR系统是MapReduce模型的一个实现，改进了MapReduce模型以适应高性能计算的需求。HPMR的KV路由算法生成KV路由表，所有数据的收发动作将依据该路由表进行。KV路由算法产生的KV路由表直接决定HPMR系统在通信阶段的时间开销。实验结果表明，该KV路由算法产生的KV路由表可以提高HPMR系统的通信性能。

关键词: MapReduce模型, 高性能计算, DSS-KV路由算法

CLC Number: 

• TP301.6