摘要： 结合卷积神经网络（CNN）和嵌套长短期记忆网络（NLSTM）2种模型，基于注意力机制提出一个用于文本表示和分类的CNLSTM模型。采用CNN提取短语序列的特征表示，利用NLSTM学习文本的特征表示，引入注意力机制突出关键短语以优化特征提取的过程。在3个公开新闻数据集中进行性能测试，结果表明，该模型的分类准确率分别为96.87%、95.43%和97.58%，其性能比baseline方法有显著提高。

关键词: 卷积神经网络, 特征表示, 嵌套长短期记忆网络, 注意力机制, 文本分类

Abstract: Combining Convolutional Neural Network (CNN) and Nested Long Short-Term Memory (NLSTM) models,this paper proposes a CNLSTM model for text representation and classification based on the attention mechanism.The model uses CNN to extract feature of phrase sequences,and then uses NLSTM to learn the representation of text features.By introducing attention mechanisms,the key phrases are highlighted to optimize feature extraction.Experiments on three published news data sets demonstrate that the classification accuracy of the model is 96.87%,95.43%,and 97.58%,respectively,and its performance is significantly improved compared with the baseline methods.

Key words: Convolutional Neural Network (CNN), feature representation, Nested Long Short-Term Memory(NLSTM), attention mechanism, text classification

中图分类号: 

• TP391.1