计算机工程 ›› 2019, Vol. 45 ›› Issue (10): 234-238.doi: 10.19678/j.issn.1000-3428.0052165

• 人工智能及识别技术 • 上一篇    下一篇

一种神经网络模型剪枝后泛化能力的验证方法

刘崇阳, 刘勤让   

  1. 国家数字交换系统工程技术研究中心, 郑州 450002
  • 收稿日期:2018-07-19 修回日期:2018-08-21 出版日期:2019-10-15 发布日期:2018-08-29
  • 作者简介:刘崇阳(1994-),男,硕士研究生,主研方向为人工智能、深度学习;刘勤让,研究员、博士。
  • 基金项目:
    国家科技重大专项(2016ZX01012101);国家自然科学基金面上项目(61572520);国家自然科学基金创新研究群体项目(61521003)。

A Verification Method on Post-Pruning Generalization Ability of Neural Network Model

LIU Chongyang, LIU Qinrang   

  1. China National Digital Switching System Engineering and Technological R & D Center, Zhengzhou 450002, China
  • Received:2018-07-19 Revised:2018-08-21 Online:2019-10-15 Published:2018-08-29

摘要: 针对神经网络模型在剪枝操作中Dropout率下调造成的过拟合问题,提出一种剪枝模型泛化能力的验证方法。研究人为遮挡数据集模拟图像范围的变化情况,分析不同Dropout值和剪枝比例对模型准确率的影响,进而得到剪枝操作后模型泛化能力变化的原因。在卷积神经网络模型lenet-5上进行实验,结果表明,剪枝模型泛化能力减弱是因为Dropout率下调和剪枝操作时参数量的变化。

关键词: 深度神经网络, 模型剪枝, 深度学习, 泛化能力, 遮挡数据集

Abstract: To address the over-fitting problem caused by the down-regulation of the Dropout rate in the pruning operation of the neural network model,a verification method for the generalization ability of the pruning model is proposed.By artificially occluding the dataset to simulate the change of the image range,the effects of different Dropout values and pruning ratios on the accuracy of the model are analyzed,and the reasons for the change of the generalization ability of the model after pruning operation are obtained.Experiments on the convolutional neural network model lenet-5 show that the generalization ability of the pruning model is weakened because of the drop of the Dropout rate and the change of the parameter amount during the pruning operation.

Key words: Deep Neural Networks(DNN), model pruning, Deep Learning(DL), generalization ability, occlusion datasets

中图分类号: