作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2018, Vol. 44 ›› Issue (5): 296-302,308. doi: 10.19678/j.issn.1000-3428.0047111

• 开发研究与工程应用 • 上一篇    下一篇

空天异构网络中基于Q学习的切换判决优化算法

张振浩 1,梁俊 1,肖楠 1,刘玉磊 1,丁然 1,姬永清 2   

  1. 1.空军工程大学 信息与导航学院,西安 710077; 2.中国电子科技集团公司第28研究所,南京 210007
  • 收稿日期:2017-05-08 出版日期:2018-05-15 发布日期:2018-05-15
  • 作者简介:张振浩(1994—),男,硕士研究生,主研方向为卫星通信、空中骨干网络;梁俊,教授、博士生导师;肖楠,讲师;刘玉磊,博士研究生;丁然,硕士研究生;姬永清,工程师。

Handoff Decision Optimized Algorithm Based on Q-learning Approach for Heterogeneous Networks in Aerospace

ZHANG Zhenhao  1,LIANG Jun  1,XIAO Nan  1,LIU Yulei  1,DING Ran  1,JI Yongqing  2   

  1. 1.School of Information and Navigation,Air Force Engineering University,Xi’an 710077,China; 2.The 28th Research Institute of China Electronics Technology Group Corporation,Nanjing 210007,China
  • Received:2017-05-08 Online:2018-05-15 Published:2018-05-15

摘要: 小型空中飞行平台在接入空天异构无线网络时,现有切换算法未充分考虑下一时刻网络与用户状态以及用户对不同业务的传输需求。为此,提出一种支持空天异构无线网络的Q学习优化算法。在回报函数中考虑用户体验,将通过综合预测方法获得的当前与下一时刻网络的信干燥比、用户移动速度、网络切换代价、信息传输的时延及网络的拥塞程度作为综合评价参数,同时根据层次分析法确定不同业务类型下的评价参数权值。仿真结果表明,在用户到达率较高、环境干扰强度较强时,相比基于Q学习的切换判决算法,该算法可以有效提高网络切换成功率并降低切换次数,在传输不同类型的业务时,可以提供更优的网络切换策略并降低切换阻塞率。

关键词: 异构无线网络, 信干噪比, 切换判决, Q学习, 用户体验

Abstract: The existing handoff algorithm lacking of considering status about the next time networks and user status and the user′s demand for transmitting different service when the small-scale aircraft is connected to the aerospace heterogeneous wireless networks.In order to solve the problem,a Q-learning optimized algorithm is proposed to support the heterogeneous wireless networks.The algorithm introduces user experience into reward function,and uses the comprehensive prediction method to get the current and next networks Signal to Interference and Noise Ratio(SINR),user mobility speed,networks handoff cost,information transmission delay and networks congestion degree as comprehensive evaluation parameters.Then,it applies the Analytic Hierarchy Process(AHP) method to determine the evaluation parameter weight according to the service type difference in transmission networks.Simulation results show that,the proposed algorithm has better preference in improving the successful handoff ratio and reducing the handoff number than the traditional algorithm based on Q-learning,when there are different types of services in the networks,the proposed algorithm can provide better networks handoff strategy and reduce the blocking ratio of handoff.

Key words: heterogeneous wireless networks, Signal to Interference and Noise Ratio(SINR), handoff decision, Q-leaning, user experience

中图分类号: