作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2008, Vol. 34 ›› Issue (13): 64-66. doi: 10.3969/j.issn.1000-3428.2008.13.024

• 软件技术与数据库 • 上一篇    下一篇

高性能分布计算的数据管理与优化

魏文国1,谢桂园2   

  1. (1. 广东技术师范学院电子与信息学院,广州 510665;2. 广东技术师范学院培训中心,广州 510665)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2008-07-05 发布日期:2008-07-05

Data Management and Optimization in High Performance Distributed Computing

WEI Wen-guo1, XIE Gui-yuan2   

  1. (1. College of Electronics and Information, Guangdong Polytechnic Normal University, Guangzhou 510665; 2. Training Center, Guangdong Polytechnic Normal University, Guangzhou 510665)
  • Received:1900-01-01 Revised:1900-01-01 Online:2008-07-05 Published:2008-07-05

摘要: 在高性能计算程序对海量分布存储数据的操控中,有效的数据管理很重要。该文提出一个新的高性能分布计算的数据管理与优化系统,它包含一个元数据管理系统和存储系统,提供一个容易使用且能自动进行存储访问优化的平台。该平台采用的多存储资源体系结构能够满足性能和存储容量需求,并能自适应地利用当前的I/O优化方法。

关键词: 高性能计算, 海量存储, 并行文件系统, 元数据管理, 访问优化

Abstract: Effective data management is an important issue with more and more scientific applications manipulating massive distributed secondary-storage, this paper presents a novel application development architecture which includes a Meta Data Management System(MDMS) and Storage Systems(SS) that provide a platform for easy-to-use and automatic storage access optimizations. It adopts a novel multi-storage resource architecture that can satisfy both performance and storage capacity requirements, and employs an adaptive I/O optimization schemes.

Key words: high performance computing, massive storage, parallel file system, meta data management, access optimization

中图分类号: