摘要： 为提高旅游问句文本中关键特征的利用率，提出一种集成词级卷积神经网络（WL-CNN）与句级双向长短期记忆（SL-Bi-LSTM）网络的旅游问句文本分类算法。利用WL-CNN和SL-Bi-LSTM分别学习词序列子空间向量和句序列深层语义信息，通过多头注意力机制将两种深度学习模型进行集成以实现旅游问句文本的语法和语义信息互补，并通过SoftMax分类器得到最终的旅游问句文本分类结果。实验结果表明，与基于传统深度学习模型的旅游问句文本分类算法相比，该算法在准确率和损失率上分别取得了0.986 6和0.127 7的最优结果，具有更好的分类效果。

关键词: 子空间结构信息, 深层语义信息, 多头注意力机制, 卷积神经网络, 双向长短期记忆网络

Abstract: To improve the utilization of key features of tourist question texts, this paper proposes a classification algorithm for tourist question texts integrated with the Word Level Convolutional Neural Network(WL-CNN) and the Sentence Level Bi-directional Long Short-Term Memory(SL-Bi-LSTM) network.The algorithm uses WL-CNN and SL-Bi-LSTM to learn the subspace vector of the word sequence and the deep semantic information of the sentence sequence.Then the two deep learning models are integrated by using the Multi-Head Attention Mechanism(MH-AM) to realize the syntactic and semantic information complementary of tourist question texts.Finally,the SoftMax classifier is used to obtain the classification results of tourist question texts.Experimental results show that the proposed algorithm has better classification performance than the tourist question text classification algorithms based on traditional deep learning models,increasing the accuracy to 0.986 6 and loss rate to 0.127 7.

Key words: subspace structure information, deep semantic information, Multi-Head Attention Mechanism(MH-AM), Convolutional Neural Network(CNN), Bi-directional Long Short-Term Memory(Bi-LSTM) network

中图分类号: 

• TP391