计算机工程

• 体系结构与软件技术 • 上一篇    下一篇

基于块的分级存储系统多样性机制设计与研究

杜然 1,2,黄秋兰 1,程耀东 1,陈刚 1   

  1. (1.中国科学院高能物理研究所,北京 100049; 2.中国科学院大学,北京 100049)
  • 收稿日期:2015-12-02 出版日期:2016-12-15 发布日期:2016-12-15
  • 作者简介:杜然(1986—),女,博士研究生,主研方向为海量存储系统;黄秋兰,助理研究员;程耀东,副研究员;陈刚,研究员。
  • 基金项目:
    国家自然科学基金(11305192,11575223,11375221,11405195,11205177);中国科学院“十二五”科研信息化项目“高能物理科技领域云”(Y2293C00S5)。

Diversity Mechanisms Design and Research of Block-based Hierarchical Storage System

DU Ran  1,2,HUANG Qiulan  1,CHENG Yaodong  1,CHEN Gang  1   

  1. (1.Institute of High Energy Physics,Chinese Academy of Sciences,Bejing 100049,China;2.University of Chinese Academy of Sciences,Beijing 100049,China)
  • Received:2015-12-02 Online:2016-12-15 Published:2016-12-15

摘要: HazelNut是一种基于块的分级存储系统,为满足HazelNut多种存储设备和追踪迁移方式的管理需求,设计并实现多样性设备管理机制HNDisk和多样性追踪迁移机制HNType。HNDisk将物理存储设备分层管理,不限制设备种类和设备数量。HNType可按照公共接口添加类型模块,便于配置并选择不同追踪度量和迁移算法。在HNDisk和HNType的基础上,测试不同追踪度量对btier平均值迁移算法性能的影响,结果表明,追踪度量访问次数和访问字节数非线性相关,两者对迁移效果的影响不同,并且使用读写请求完成时间作为追踪度量至少可使顺序读写性能提升10%。

关键词: 分级存储系统, 多样性, Linux内核, 可装载内核模块, 虚拟文件系统开关, 追踪度量, 迁移算法

Abstract: HazelNut is a block-based hierarchical storage system,which requires to manage multiple types of storage devices and different ways of I/O trace and block migration.As a result,a diversity equipment management mechanism(HNDisk) and diversity trace migration mechanism(HNType) are designed and implemented to meet these requirements.HNDisk is able to decentralized organize multiple storage devices in tiers with no constraints on device types and device amount.Meanwhile,HNType can add the type module according to the common interface,and it is easy to configure and select different trace metrics and migration algorithm.At the same time,it tests the influence of different trace metrics on the performance of btier average migration algorithm on the base of HNDisk and HNType.Experimental result show that trace metrics of access times and access sectors are not linearly correlated,as a result,these two metrics bring different migration results.Besides,I/O requests completion time used as trace metrics is able to improve sequential I/O by at least 10%.

Key words: hierarchical storage system, diversity, Linux kernel, loadable kernel module, Virtual Filesystem Switch(VFS), trace metrics, migration algorithm

中图分类号: