基于上下文知识增强型Transformer网络的抑郁检测

doi:10.19678/j.issn.1000-3428.0067936

摘要/Abstract

摘要：

抑郁症作为一种常见的心理健康问题，严重影响人们的日常生活甚至是生命安全。鉴于目前的抑郁症检测存在主观性和人工干预等缺点，基于深度学习的自动检测方式成为热门研究方向。对于最易获取的文本模态而言，主要的挑战在于如何建模抑郁文本中的长距离依赖与序列依赖。为解决该问题，提出一种基于上下文知识的增强型Transformer网络模型RoBERTa-BiLSTM，旨在从抑郁文本序列中充分提取和利用上下文特征。结合序列模型与Transformer模型优点，建模单词间上下文交互，为抑郁类别揭示与信息表征提供参考。首先，利用RoBERTa方法将词汇嵌入到语义向量空间；其次，利用双向长短期记忆网络(BiLSTM)模型有效捕获长距离上下文语义；最后，在DAIC-WOZ和EATD-Corpus 2个大规模数据集上进行实证研究。实验结果显示，RoBERTa-BiLSTM模型的准确率分别达到0.74和0.93以上，召回率分别达到0.66和0.56以上，能够准确地检测抑郁症。

关键词: 抑郁检测, 序列模型, 深度学习, Transformer模型, 双向长短期记忆模型

Abstract:

Depression, as a prevalent mental health problem, substantially impacts individual′s daily lives and well-being. Addressing the limitations of current depression detection, such as subjectivity and manual intervention, automatic detection methods based on deep learning have become a popular research direction. The primary challenge in the most accessible text modality is modelling the long-range and sequence dependencies in depressive texts. To address this problem, this paper proposes a contextual knowledge-based enhanced Transformer network model, named Robustly optimized Bidirectional Encoder Representations from Transformers approach-Bidirectional Long Short-Term Memory(RoBERTa-BiLSTM), to comprehensively extract and utilize contextual features from depressive text sequences. By combining the strengths of sequence models and Transformer architectures, the proposed model captures contextual interactions between words to provide a reference for depression category prediction and information characterization. First, the RoBERTa model is employed to embed vocabulary into a semantic vector space, and then, a BiLSTM network effectively captures long-range contextual semantics. Finally, empirical research is conducted on two large-scale datasets, DAIC-WOZ and EATD-Corpus. Experimental results demonstrate that the model achieves an accuracy exceeding 0.74 and 0.93, and a recall exceeding 0.66 and 0.56, respectively, enabling accurate depression detection.

Key words: depression detection, sequence model, deep learning, Transformer model, Bi-directional Long Short-Term Memory(BiLSTM) model

张亚洲, 和玉, 戎璐, 王祥凯. 基于上下文知识增强型Transformer网络的抑郁检测[J]. 计算机工程, 2024, 50(8): 75-85.

Yazhou ZHANG, Yu HE, Lu RONG, Xiangkai WANG. Depression Detection Based on Contextual Knowledge Enhanced Transformer Network[J]. Computer Engineering, 2024, 50(8): 75-85.

https://www.ecice06.com/CN/Y2024/V50/I8/75

图/表 13

图1 RoBERTa-BiLSTM模型结构

Fig.1 Structure of the RoBERTa-BiLSTM model

图2 Transformer模型结构

Fig.2 Structure of the Transformer model

图3 LSTM网络单元结构

Fig.3 Structure of the LSTM network unit

图4 BiLSTM网络结构

Fig.4 Structure of the BiLSTM network

图5 损失随Epoch变化曲线

Fig.5 Loss changes with Epoch

图6 DAIC-WOZ数据集消融实验结果

Fig.6 Results of ablation experiment on DAIC-WOZ dataset

图7 EATD-Corpus数据集消融实验结果

Fig.7 Results of ablation experiment on EATD-Corpus dataset

参考文献 28

1	WEI P C, PENG K Y, ROITBERG A, et al. Multi-modal depression estimation based on sub-attentional fusion[C]//Proceedings of European Conference on Computer Vision. Berlin, Germany: Springer, 2023: 623-639.
2	FALAGAS M E , VARDAKAS K Z , VERGIDIS P I . Under-diagnosis of common chronic diseases: prevalence and impact on human health. International Journal of Clinical Practice, 2007, 61 (9): 1569- 1579. doi: 10.1111/j.1742-1241.2007.01423.x
3	ZHOU X Z , JIN K , SHANG Y Y , et al. Visually interpretable representation learning for depression recognition from facial images. IEEE Transactions on Affective Computing, 2020, 11 (3): 542- 552. doi: 10.1109/TAFFC.2018.2828819
4	TSAKALIDIS A, LIAKATA M, DAMOULAS T, et al. Can we assess mental health through social media and smart devices? Addressing bias in methodology and evaluation[C]//Proceedings of Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Berlin, Germany: Springer, 2019: 407-423.
5	王款, 宣士斌, 何雪东, 等. 基于交叉注意力Transformer的人体姿态估计方法. 计算机工程, 2023, 49 (7): 223- 231. URL
	WANG K , XUAN S B , HE X D , et al. Human pose estimation method based on cross attention Transformer. Computer Engineering, 2023, 49 (7): 223- 231. URL
6	LIU Z, LIN W, SHI Y, et al. A robustly optimized BERT pre-training approach with post-training[C]//Proceedings of China National Conference on Chinese Computational Linguistics. Berlin, Germany: Springer, 2021: 471-484.
7	张应成, 杨洋, 蒋瑞, 等. 基于BiLSTM-CRF的商情实体识别模型. 计算机工程, 2019, 45 (5): 308- 314. URL
	ZHANG Y C , YANG Y , JIANG R , et al. Commercial intelligence entity recognition model based on BiLSTM-CRF. Computer Engineering, 2019, 45 (5): 308- 314. URL
8	LOSADA D E , GAMALLO P . Evaluating and improving lexical resources for detecting signs of depression in text. Language Resources and Evaluation, 2020, 54 (1): 1- 24. doi: 10.1007/s10579-018-9423-1
9	WOLOHAN J T, HIRAGA M, MUKHERJEE A, et al. Detecting linguistic traces of depression in topic-restricted text: attending to self-stigmatized depression with NLP[C]//Proceedings of the 1st International Workshop on Language Cognition and Computational Models. Stroudsburg, USA: ACL Press, 2018: 11-21.
10	WILLIAMSON J R, GODOY E, CHA M, et al. Detecting depression using vocal, facial and semantic communication cues[C]//Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge. New York, USA: ACM Press, 2016: 11-18.
11	YANG L, JIANG D M, HE L, et al. Decision tree based depression classification from audio video and language information[C]//Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge. New York, USA: ACM Press, 2016: 89-96.
12	LAM G, HUANG D Y, LIN W S. Context-aware deep learning for multi-modal depression detection[C]// Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing. Washington D. C., USA: IEEE Press, 2019: 3946-3950.
13	韩虎, 赵启涛, 孙天岳, 等. 面向社交媒体评论的上下文语境讽刺检测模型. 计算机工程, 2021, 47 (1): 66- 71. URL
	HAN H , ZHAO Q T , SUN T Y , et al. Contextual sarcasm detection model for social media comments. Computer Engineering, 2021, 47 (1): 66- 71. URL
14	VASHA Z N , SHARMA B , ESHA I J , et al. Depression detection in social media comments data using machine learning algorithms. Bulletin of Electrical Engineering and Informatics, 2023, 12 (2): 987- 996. doi: 10.11591/eei.v12i2.4182
15	TROTZEK M , KOITKA S , FRIEDRICH C M . Utilizing neural networks and linguistic metadata for early detection of depression indications in text sequences. IEEE Transactions on Knowledge and Data Engineering, 2018, 32 (3): 588- 601.
16	AMANAT A , RIZWAN M , JAVED A R , et al. Deep learning for depression detection from textual data. Electronics, 2022, 11 (5): 2079- 9292.
17	YU L X , JIANG W Y , REN Z H , et al. Detecting changes in attitudes toward depression on Chinese social media: a text analysis. Journal of Affective Disorders, 2021, 280 (Pt A): 354- 363.
18	LI Z P , AN Z Y , CHENG W C , et al. MHA: a multimodal hierarchical attention model for depression detection in social media. Health Information Science and Systems, 2023, 11 (1): 6.
19	YADAV U , SHARMA A K . A novel automated depression detection technique using text transcript. International Journal of Imaging Systems and Technology, 2023, 33 (1): 108- 122.
20	SENN S, TLACHAC M L, FLORES R, et al. Ensembles of BERT for depression classification[C]// Proceedings of the 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society. Washington D. C., USA: IEEE Press, 2022: 4691-4694.
21	PENNINGTON J, SOCHER R, MANNING C D. GloVe: global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL Press, 2014: 1532-1543.
22	PETERS M E, NEUMANN M, IYYER M, et al. Deep contextualized word representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: ACL Press, 2018: 2227-2237.
23	DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional Transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: ACL Press, 2019: 4171-4186.
24	贺小伟, 徐靖杰, 王宾, 等. 基于GRU-LSTM组合模型的云计算资源负载预测研究. 计算机工程, 2022, 48 (5): 11-17, 34. URL
	HE X W , XU J J , WANG B , et al. Research on cloud computing resource load forecasting based on GRU-LSTM combination model. Computer Engineering, 2022, 48 (5): 11-17, 34. URL
25	GRATCH J, ARTSTEIN R, LUCAS G, et al. The distress analysis interview corpus of human and computer interviews[C]//Proceedings of the 9th International Conference on Language Resources and Evaluation. Paris, France: ELRA Press, 2014: 3123-3128.
26	SHEN Y, YANG H Y, LIN L. Automatic depression detection: an emotional audio-textual corpus and a GRU/BiLSTM-based model[C]//Proceedings of the 2022 IEEE International Conference on Acoustics, Speech and Signal Processing. Washington D. C., USA: IEEE Press, 2022: 6247-6251.
27	LIU X Y , WU J X , ZHOU Z H . Exploratory undersampling for class-imbalance learning. IEEE Transactions on Systems, Man, and Cybernetics Part B, Cybernetics, 2009, 39 (2): 539- 550.
28	ALHANAI T, GHASSEMI M, GLASS J. Detecting depression with audio/text sequence modeling of interviews[C]//Proceedings of the Annual Conference of the International Speech Communication Association. Baixas, France: ISCA Press, 2018: 1716-1720.

[1]	魏嵬, 丁香香, 郭梦星, 杨钊, 刘辉. 文本相似度计算方法综述[J]. 计算机工程, 2024, 50(9): 18-32.
[2]	朱凯, 李理, 张彤, 江晟, 别一鸣. 基于Transformer的多阶段运动模糊图像修复网络[J]. 计算机工程, 2024, 50(9): 276-285.
[3]	张天鹏, 韩晶, 吕学强. 基于多任务学习的超分辨率辅助小目标检测[J]. 计算机工程, 2024, 50(9): 304-312.
[4]	高煜宝, 文志诚. 基于注意力机制的双路解码器图像去噪方法[J]. 计算机工程, 2024, 50(9): 324-332.
[5]	王言国, 吕鹏远, 兰金江, 刘明哲, 秦冠军, 张硕桦, 周宇. 基于对抗训练与Transformer的风力发电机故障分类方法[J]. 计算机工程, 2024, 50(9): 377-384.
[6]	张华青, 夏张涛, 陆晓庆, 童基均. 基于字形特征的血管外科命名实体识别[J]. 计算机工程, 2024, 50(8): 13-21.
[7]	白雪冰, 车进, 吴金蔓, 陈玉敏. 基于Transformer视觉特征融合的图像描述方法[J]. 计算机工程, 2024, 50(8): 229-238.
[8]	赵宏, 王枭. 基于Swin-Transformer的黑色素瘤图像病灶分割研究[J]. 计算机工程, 2024, 50(8): 249-258.
[9]	高伟, 李帅龙, 茆琳, 王磊, 李颖颖, 韩林. 一种基于TVM的算子生成加速策略[J]. 计算机工程, 2024, 50(8): 353-362.
[10]	王宇, 祁琦, 王纯, 许才. 储能变流器信号高精度故障诊断方法[J]. 计算机工程, 2024, 50(8): 389-396.
[11]	牛瑞婷, 严天峰, 高锐, 王映植. 低信噪比下基于深度学习TCNN-MobileNet的调制识别[J]. 计算机工程, 2024, 50(7): 204-215.
[12]	肖慈, 徐杨, 张永丹, 冯明文, 黄易仟. 结合注意力和低光增强的夜间语义分割[J]. 计算机工程, 2024, 50(7): 271-281.
[13]	张诗婧, 莫绪涛, 赵行, 董杨林. 基于球面折反射成像和YOLOv7的内螺纹缺陷检测[J]. 计算机工程, 2024, 50(7): 282-292.
[14]	徐明亮, 李芳媛, 马浩然, 何飞. 大规模神经记录的峰电位聚类算法(特邀)[J]. 计算机工程, 2024, 50(6): 1-34.
[15]	魏琢艺, 罗迈, 李文兵, 曾远松, 余伟江, 杨跃东. 基于多源域适应的单细胞智能分类[J]. 计算机工程, 2024, 50(6): 48-55.

选择文件类型/文献管理软件名称

选择包含的内容