Large-scale Job Management System Based on Partition  and Lease Technologies

doi:10.3969/j.issn.1000-3428.2007.17.034

Computer Engineering ›› 2007, Vol. 33 ›› Issue (17): 99-101. doi: 10.3969/j.issn.1000-3428.2007.17.034

• Software Technology and Database • Previous Articles Next Articles

Large-scale Job Management System Based on Partition and Lease Technologies

ZOU Ming1,2, TU Bi-bo1,2, ZHAN Jian-feng1

(1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100080; 2. Graduate School, Chinese Academy of Sciences, Beijing 100039)

Received:1900-01-01 Revised:1900-01-01 Online:2007-09-05 Published:2007-09-05

基于分区租借的大规模作业管理系统

邹铭1,2，涂碧波1,2，詹剑锋1

(1. 中国科学院计算技术研究所，北京100080；2. 中国科学院研究生院，北京 100039)

Abstract

Abstract: Partitioned workload system (PWS) is one job management system using partition and dynamic resources-lease technology, which enhances the manageability of JMS and improves the utilization of cluster system. With optimized communication system, PWS can support cluster systems with thousands of CPUs or nodes. PWS has been applied in Shuguang 4000A super server and other computation fields requiring high performances. the design and implementation of the PWS is introduced.

Key words: JMS, cluster system, partition, lease, scalability

摘要： PWS(partitioned workload system)是引入分区化技术以及资源租借技术的作业管理系统(JMS)。分区技术加强了机群系统中资源的可管理性，通过资源租借技术提高了系统资源的利用率。优化的通信方式让PWS能够支持上千节点的大规模机群系统。PWS已经在曙光4000A超级计算机以及相关高性能计算领域中得到了应用。该文介绍了PWS的设计与实现。

关键词: JMS, 机群系统, 分区, 租借, 扩展性

CLC Number:

TP393

ZOU Ming; TU Bi-bo; ZHAN Jian-feng. Large-scale Job Management System Based on Partition and Lease Technologies[J]. Computer Engineering, 2007, 33(17): 99-101.

邹铭;涂碧波;詹剑锋. 基于分区租借的大规模作业管理系统[J]. 计算机工程, 2007, 33(17): 99-101.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2007.17.034

http://www.ecice06.com/EN/Y2007/V33/I17/99

[1]	SU Ruiguo, YANG Jian, QIN Jiwei, WU Xiaoxiong, JIA Zhenhong. Research on Lightweight Consensus Algorithm Based on IoT Blockchain [J]. Computer Engineering, 2023, 49(2): 175-180.
[2]	HUANG Huawei, KONG Wei, PENG Xiaowen, ZHENG Zibin. Survey on Blockchain Sharding Technology [J]. Computer Engineering, 2022, 48(6): 1-10.
[3]	WANG Xiaofeng, YU Zhuo, ZHAO Jian, CAO Zexuan. Algorithm Analysis for Solving Maximum Clique Problems of Large-scale Graphs [J]. Computer Engineering, 2022, 48(6): 182-192,199.
[4]	JIN Yuanyuan, NI Zhiwei, ZHU Xuhui, CHEN Hengheng, CHEN Qian. Spatial Data Adaptive Partition Algorithm Based on Local Differential Privacy [J]. Computer Engineering, 2022, 48(5): 136-144.
[5]	YU Jin, YAN Hua. Garbage Collection Algorithm for NAND Flash Memory Based on Data Update Interval [J]. Computer Engineering, 2022, 48(3): 54-59.
[6]	WANG Hailang, ZHANG Linghua. Improvement of Routing Protocol for Wireless Sensor Networks Based on PEGASIS [J]. Computer Engineering, 2022, 48(12): 165-171,179.
[7]	XU Le, AN Hong, CHEN Junshi, ZHANG Pengfei, WU Zheng. Unstructured Grid Computing Acceleration Algorithm Based on Sunway TaihuLight [J]. Computer Engineering, 2022, 48(12): 45-53.
[8]	LIU Xianfeng, LIANG Sai, LI Qiang, ZHANG Jin. Cloud-Edge Collaborative DNN Inference Based on Deep Reinforcement Learning [J]. Computer Engineering, 2022, 48(11): 30-38.
[9]	CAI Ruichu, LIN Fengji, HAO Zhifeng, WANG Li, WEN Wen. Research on Index Construction and Storage Method for Trajectory Stream Data [J]. Computer Engineering, 2021, 47(3): 62-70.
[10]	LIU Xu, ZHANG Xihuang, LIU Zhao, LÜ Xiaojing, ZHU Guanghui. Cosmological Multi-Body Simulation Based on Sunway TaihuLight [J]. Computer Engineering, 2020, 46(9): 35-43.
[11]	HAO Zhanjun, HOU Jiaojiao, DANG Xiaochao, QU Nanjiang. A Node Coverage Optimization Method for Strip Area in WSN [J]. Computer Engineering, 2020, 46(7): 165-172.
[12]	ZHANG Man, YAN Fei, YAN Gaowei, LI Pu. Dynamic Partition of Control Sub-Regions in Road Network Based on Dirichlet Problem [J]. Computer Engineering, 2020, 46(12): 21-26,35.
[13]	ZHANG Shengfeng, XIAO Ao, HUANG Sheng. Fast SCC Inter-Frame Algorithm Based on Rate-distortion Cost [J]. Computer Engineering, 2019, 45(8): 236-240.
[14]	OUYANG Xiangzhen, ZHU Yian, LI Lian, SHI Xianchen. A Safety-Critical Embedded Real Time Operating System Kernel Design [J]. Computer Engineering, 2019, 45(7): 78-85.
[15]	ZHANG Wei,WANG Zhijie. Research on Join Operation of Temporal Big Data in Distributed Environment [J]. Computer Engineering, 2019, 45(3): 20-25,31.

Please choose a citation manager

Content to export

Large-scale Job Management System Based on Partition and Lease Technologies

基于分区租借的大规模作业管理系统

PDF

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

模态框（Modal）标题

Please choose a citation manager

Content to export

Large-scale Job Management System Based on Partition and Lease Technologies

基于分区租借的大规模作业管理系统

PDF

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments