Design and Implementation of Cross-platform Parallel Programming Framework

doi:10.3969/j.issn.1000-3428.2014.08.009

Abstract

Abstract: The complexity of parallel programming,and the portability problem caused by the diversity of parallel computing platforms,restrict the popularization of parallel computing.To solve these problems,this paper designs and implements a cross-platform hierarchical parallel programming framework,Open Cross-platform Hierarchical(OpenCH).With a design of two-level parallel libraries and hierarchical API,the framework hides the details of parallelization to the upper applications.By providing common interfaces for library functions based on different platforms,changes of platform are invisible to the upper applications.A block-filling programming method,supported with a task-scheduling system,is designed for the development of lower parallel libraries.OpenCH is tested by applying it to a remote-sensing image classification problem.Experimental results show that,parallel programs based on OpenCH can be executed on multiple parallel computing platforms and achieve ideal parallel speedup ratio,time overhead caused by the framework is no more than 15%.

Key words: arallel computing, parallel programming framework, cross-platform, OpenMP programming, MPI programming, CUDA programming 

摘要： 并行程序设计的复杂性及并行计算平台的多样性导致程序可移植性较差。为此,设计并实现一种跨平台、分层次的并行编程框架OpenCH。该框架通过两层并行函数库和层次化的API设计,对上层应用程序隐藏并行化细节,为基于不同计算平台的库函数设计了统一的函数接口,使底层平台的变化对上层应用程序透明。根据底层函数库的开发,给出一种填充式的编程方法和任务调度系统。将OpenCH应用于遥感影像分类,实验结果证明,基于该框架开发的并行程序可运行于多种并行计算平台,并具有较高的并行加速比,编程框架本身造成的时间开销低于15%。

关键词: 并行计算, 并行编程框架, 跨平台, OpenMP编程, MPI编程, CUDA编程

CLC Number:

TP391

LI Ting,XU Yun,NIE Peng-yu,PAN Wei-hua. Design and Implementation of Cross-platform Parallel Programming Framework[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2014.08.009.

李婷,徐云,聂鹏宇,潘玮华. 一种跨平台的并行编程框架设计与实现[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2014.08.009.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2014.08.009

http://www.ecice06.com/EN/Y2014/V40/I8/43

References

      ［1］        陈国良,安虹,陈峻,等.并行算法实践［M］.北京:高等教育出版社,2004.
   ［2］     张舒,褚艳利.GPU高性能运算之CUDA［M］.北京:中国水利水电出版社,2009.
   ［3］     〖JP3〗Owens J D,Houston M,Luebke D,et al.GPU Computing［J］.Proceedings of the IEEE,2008,96(5):879-899.   
   ［4］     Dagum L,Menon R.OpenMP:An Industry Standard API for Shared-memory Programming［J］.IEEE Computational Science and Engineering,1998,5(1):46-55.
   ［5］     Gropp W.MPICH2:A New Start for MPI Implement- ations［C］//Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface.London,UK:Springer-Verlag,2002:215-222.
   ［6］     Mo Zeyao,Zhang Aiqing,Cao Xiaolin.JASMIN:A Parallel Software Infrastructure for Scientific Computing［J］.Frontiers of Computer Science in China,2010,4(4):480-488.
   ［7］     Linderman M D,Collins J D,Wang Hong,et al.Merge:A Programming Model for Heterogeneous Multi-core Systems［C］//Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems.New York,USA:ACM Press,2008:521-531.
   ［8］     NVIDIA Corporation.Cuda C Programming Guide［Z］.2012.
   ［9］     Stone J E,Gohara D,Shi Guochun.OpenCL:A Parallel Programming Standard for Heterogeneous Computing Systems［J］.Computing in Science and Engineering,2010,12(3):66-73.
   ［10］     Eastman P,Pande V S.OpenMM:A Hardware-independent Framework for Molecular Simulations［J］.Computing in Science & Engineering,2010,12(4):34-39.
   ［11］     Dean J,Ghemawat S.MapReduce:Simplified Data Processing on Large Clusters［J］.Communications of the ACM,2008,51(1):107-113.
   ［12］     White T.Hadoop:The Definitive Guide［M］.［S.1］:O'Reilly Media,Inc.,2012.
   ［13］     Devin F,Boulet P,Dekeyser J L,et al.GASPARD:A Visual Parallel Programming Environment［C］//Proceedings of International Conference on Parallel Computing in Electrical Engineering.Warsaw,Poland:IEEE Computer Society,2002:457-467.
   ［14］     Acosta A,Almeida F,Peláez I.High-level Specifications for Automatically Generating Parallel Code［J］.Concurrency and Computation Practice and Experience,2013,25(7):989-1012.
   ［15］     Mariani G,Palermo G,Silvano C,et al.Arte:An Application-specific Run-time Management Framework for Multi-core Systems［C］//Proceedings of the 9th IEEE Symposium on Application Specific Processors.San Diego,USA:IEEE Computer Society,2011:326-334.
   ［16］     〖JP3〗Cole M.Bringing Skeletons Out of the Closet:A Pragmatic Manifesto for Skeletal Parallel Programming［J］.Parallel Computing,2004,30(3):389-406.   
   ［17］     〖JP+2〗USGC.Landsat Enhanced Thematic Mapper Plus［EB/OL］.［2012-01-24］.https://lta.cr.usgs.gov/ LETMP.
   编辑索书志

[1]	WANG Qihan, PANG Jianmin, YUE Feng, ZHU Di, SHEN Li, XIAO Qian. Implementation and Optimization of Parallel KNN Algorithm for Sunway Architecture [J]. Computer Engineering, 2023, 49(5): 286-294.
[2]	XIA Libin, LIU Xiaoyu, JIANG Xiaowei, SUN Gongxing. Memory Optimization Method for Parallel Computing Framework Based on Distributed Dataset [J]. Computer Engineering, 2023, 49(4): 43-51.
[3]	ZHOU Yonghao, XU Jinlong, LI Bin, QIAN Hong, NIE Kai. Parallel Compilation Optimization Method for Sunway High Performance Multi-Core Processors [J]. Computer Engineering, 2022, 48(9): 130-138.
[4]	DU Qinghua, ZHANG Kai. An Efficient Cross-Platform Workflow Optimization Method [J]. Computer Engineering, 2022, 48(7): 13-21,28.
[5]	LI Jinguo, JIAO Xubin. Research on Intrusion Detection Model in Fog Computing Environment [J]. Computer Engineering, 2022, 48(5): 43-52.
[6]	ZHANG Kun, JIA Jinfang, YAN Wenxin, HUANG Jianqiang, WANG Xiaoying. Parallel Solution and Optimization of Large-Scale Sparse Linear System in GRAPES Dynamic Framework [J]. Computer Engineering, 2022, 48(1): 149-154,162.
[7]	HUANG Rui, JIN Guanghao, LI Lei, JIANG Wenchao, SONG Qingzeng. Design and Implementation of Accelerator for Lightweight Neural Network [J]. Computer Engineering, 2021, 47(9): 185-190,196.
[8]	YI Peihuai, LI Weidong, LIN Tao, ZOU Jiaheng, DENG Ziyan, LIU Yan. Application of GPU in Fast Muon Simulation [J]. Computer Engineering, 2021, 47(8): 100-108.
[9]	SHE Xin, HE Zhenying. Spark-based clique Community Search Algorithm Under Complex Attribute Condition [J]. Computer Engineering, 2021, 47(12): 54-61,70.
[10]	GUO Yuluo, BIAN Haodong, DONG Runting, TANG Jiahao, WANG Xiaoying, HUANG Jianqiang. Parallel Fourier Space Image Similarity Calculation Based on SIMD [J]. Computer Engineering, 2021, 47(11): 247-253.
[11]	XIAO Chenglong, NIE Ziyang, WANG Ning, ZHANG Zhongpeng, WANG Shanshan. Research on Maximum Clique Identification Based on Parallel Constraint Programming [J]. Computer Engineering, 2020, 46(4): 53-59,69.
[12]	LI Jie, ZHU Hongliang, CHEN Yuling, XIN Yang. Improved Parallel Apriori Algorithm Based on Hash Storage and Transaction Weighting [J]. Computer Engineering, 2020, 46(11): 109-116.
[13]	XU Guowei, CHEN Jian, CHENG Yi. Research on Radar Clutter Simulation Based on GPU Parallel Computing [J]. Computer Engineering, 2020, 46(11): 306-314.
[14]	SONG Kuangshi, LI Chong, ZHANG Shibo. Design and Implementation of a Lightweight Distributed Machine Learning System [J]. Computer Engineering, 2020, 46(1): 201-207.
[15]	CAI Ruichu, HOU Yongjie, HAO Zhifeng. Cross-platform Gene Expression Data Classification Based on Hierarchical Rule Tree [J]. Computer Engineering, 2019, 45(7): 26-31.

Please choose a citation manager

Content to export