摘要： 由于数据流速率的不稳定特性,将数据流查询部署在固定数量的结点上会导致分布式数据流管理系统(DDSMS)难以高效地利用计算资源。为此,针对目前支持一个结点运行多个实例模式的DDSMS,提出一种基于操作符组的自适应动态调整技术,包含桶机制的路由管理、生成调 整策略和调整执行计划等方法。通过监控当前执行计划的运行状态,DDSMS生成代价较小的调整策略,并对当前执行计划进行调整。在数据流处理的基准测试数据上进行实验,结果表明,该调整技术可以更加细粒度地制定调整策略,灵活应对数据流速率的变化。

关键词: 数据流查询, 分布式, 动态调整, 状态管理, 调整策略

Abstract: As the rate of stream data is various,it is hard to effectively use computing resource when deploying data stream query on a fixed number of nodes.For the multi-instance-per-node execution model adopted by the current Distributed Data Stream Management System(DDSMS),this paper presents an operator group based adaptive dynamic adjustment technology which contains the approaches of bucket based routing management,adjustment strategy making and adjustment execution.Based on executing status of current execution plan,DDSMS makes adjustment strategy and adjusts current execution plan according to the adjustment strategy.Through testing the adjustment technology using benchmark of stream processing,results show the effectiveness of the proposed technology.

Key words: data stream query, distributed, dynamical adjustment, state management, adjustment strategy

中图分类号: 

• TP391