作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程

• 人工智能及识别技术 • 上一篇    下一篇

基于改进对比散度的GRBM 语音识别

赵彩光,张树群,雷兆宜   

  1. (暨南大学信息科学技术学院,广州510632)
  • 收稿日期:2014-06-16 出版日期:2015-05-15 发布日期:2015-05-15
  • 作者简介:赵彩光(1989 - ),男,硕士研究生,主研方向:神经网络,语音识别;张树群,副教授;雷兆宜,高级实验师。

Speech Recognition of Gaussian-Bernoulli Restricted Boltzmann Machine Based on Improved Contrastive Divergence

ZHAO Caiguang,ZHANG Shuqun,LEI Zhaoyi   

  1. (College of Information Science and Technology,Jinan University,Guangzhou 510632,China)
  • Received:2014-06-16 Online:2015-05-15 Published:2015-05-15

摘要: 对比散度作为训练受限波尔兹曼机模型的主流技术之一,在实验训练中具有较好的测试效果。通过结合 指数平均数指标算法和并行回火的思想,提出一种改进对比散度的训练算法,包括模型参数的更新和样本数据的 采样,并将改进后的训练算法应用于高斯伯努利受限玻尔兹曼机(GRBM)中训练语音识别模型参数。在TI-Digits 数字语音训练和数字测试数据库上的实验结果表明,采用改进的对比散度训练的GRBM 明显优于传统的模型训练 算法,语音识别率能够达到80% 左右,最高提升7% 左右,而且应用改进算法训练的其他GRBM 对比模型的语音识 别率也都有所提高,具有较好的识别性能。

关键词: 对比散度, 高斯伯努利受限玻尔兹曼机, 受限玻尔兹曼机, 指数平均数指标, 并行回火, 语音识别, 深度神经网络

Abstract: Contrastive divergence has a good result for training restricted Boltzmann machine model as one of the mainstream training algorithm in the experiments. An improved contrastive divergence based on Exponential Moving Average ( EMA ) is proposed by combining with the exponential moving average learning algorithm and Parallel Tempering(PT),which includes updating the model parameters and samples. The improved algorithm is applied to train speech recognition model parameters in Gaussian-Bernoulli Restricted Boltzmann Machine (GRBM),and experimental results of digit speech recognition on the core test of TI-Digits show that the proposed algorithm works better than traditional training algorithms in GRBM,the accuracy can be as high as 80. 53% and increase by about 7% . Recognition accuracy of some other GRBM models also increase apparently based on the proposed algorithm. And its performance keeps well.

Key words: Contrastive Divergence (CD), Gaussian-Bernoulli Restricted Boltzmann Machine ( GRBM), Restricted Boltzmann Machine(RBM), Exponential Moving Average(EMA), Parallel Tempering(PT), speech recognition, Deep Neural Network(DNN)

中图分类号: