计算机工程 ›› 2009, Vol. 35 ›› Issue (11): 40-42.doi: 10.3969/j.issn.1000-3428.2009.11.014

• 软件技术与数据库 • 上一篇    下一篇

并行文件系统的框架设计和性能研究

谢桂园1,魏文国2   

  1. (1. 广东技术师范学院培训中心,广州 510665;2. 广东技术师范学院电子与信息学院,广州 510665)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2009-06-05 发布日期:2009-06-05

Frame Design and Performance Research of Parallel File System

XIE Gui-yuan1, WEI Wen-guo2   

  1. (1. Training Center, Guangdong Polytechnic Normal University, Guangzhou 510665; 2. College of Electronics and Information, Guangdong Polytechnic Normal University, Guangzhou 510665)
  • Received:1900-01-01 Revised:1900-01-01 Online:2009-06-05 Published:2009-06-05

摘要: 利用InfiniBand技术特征实现高效的并行文件系统(EPFS),设计一个高性能的透明传输层,对数据流的缓存管理、动态和公平的缓存共享,以及有效的内存注册和注销进行研究。实验表明,当I/O节点足够多时,随着计算节点的增加,基于InfiniBand 技术的EPFS比基于TCP/IP的EPFS的读写性能增长更快。并且,两级别的内存注册和注销方法AFMRD比受约束的缓存技术更好地改进I/O性能。

关键词: 并行文件系统, 缓存管理, InfiniBand技术

Abstract: This paper examines the feasibility of InfiniBand technology to design and implement an Effective Parallel File System(EPFS). It designs a transport layer customized for EPFS by trading transparency and generality for performance, buffer management for flow control, dynamic and fair buffer sharing, and efficient memory registration and deregistration. Compared with an EPFS implementation over TCP/IP on the InfiniBand network, the implementation offers better I/O performance if the number of I/O nodes is not bottleneck. Further, two-level memory registration and deregistration technology(AFMRD) works much better than pin-down cache technology.

Key words: parallel file system, buffer management, InfiniBand technology

中图分类号: