摘要： 在单输入单输出无线数据包传输系统中,普遍采用马尔可夫决策过程(MDP)模型求解最优发送速率控制策略以减小传输丢包率,但在现有模型中,忽略了队列溢出丢包的影响,造成模型求解的结果与实际相比误差较大。为此,提出一种改进的跨层优化MDP模型。在一步转移报酬函数中引入队列溢出丢包的计算因子,基于改进模型求解得到新的最优发送速率控制策略。仿真结果表明,与原来的MDP模型相比,该模型更准确,其偏离仿真值的平均误差由12%降低为3%,能获得较好的最优化目标值。

关键词: 有限状态马尔可夫信道, 自适应调制和编码, 速率控制, 马尔可夫决策过程, 跨层优化

Abstract: In a single-input-single-output wireless data packet transmission system,the Markov Decision Process(MDP)model is generally used to obtain an optimal transmission rate control policy to reduce the packet loss rate.But in the existing model,the queue overflow packet loss is ignored,causing that the result obtained by model calculating is inaccurrate compared with the practical result.To resolve this problem,an improved cross-layer MDP model is proposed.In this model,a factor of queue overflow packets loss is introduced in the one-step transition reward function.A new optimal transmission rate control policy is obtained from the improved MDP model.Simulation results show that the optimal transmission rate control policy obtained from the improved MDP model is more accurate compared with the previous one and it reduces the simulation deviation error from 12% to 3% on average,yielding better optimal target value.

Key words: Finite State Markov Channel(FSMC), Adaptive Modulation and Coding(AMC), rate control, Markov Decision Process(MDP), cross-layer optimization

中图分类号: 

• TN915