Topic Thread Detection Algorithm in Dynamic Text Flow

doi:10.3969/j.issn.1000-3428.2011.24.015

Abstract

Abstract: For the topic clue inspection of dynamic text flow, this paper proposes an inspection algorithm based on semantic relevance model. It calculates the semantic relevance of message text and topic clue, allots message to related topic clue, and adopts the improved algorithm of semantic relevance model to inspect different data sets and topics of different lengths. Experimental results show that this algorithm gives higher F1 value than current algorithms.

Key words: dynamic text flow, topic thread detection, semantic relevance degree, message division, Instant Messaging(IM) tool

摘要： 针对动态文本流中的话题线索检测问题，提出一种基于语义相关度模型的话题线索检测算法。利用改进的语义相关度模型计算消息文本与话题线索之间的语义相关度，将消息划分至相应的话题线索。在真实数据集上的实验结果表明，与现有算法相比，该算法的F1测度值较高。

关键词: 动态文本流, 话题线索检测, 语义相关度, 消息划分, 即时通信工具

CLC Number:

TP311

CAO Ru-Qin. Topic Thread Detection Algorithm in Dynamic Text Flow[J]. Computer Engineering, 2011, 37(24): 45-49.

曹月芹. 动态文本流中的话题线索检测算法[J]. 计算机工程, 2011, 37(24): 45-49.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2011.24.015

http://www.ecice06.com/EN/Y2011/V37/I24/45

References

[1] Wang Lidian, Oard D. Context-based Message Expansion for Disentanglement of Interleaved Text Conversations[C]//Proc. of NAACL’09. Colorado, USA: [s. n.], 2009.
[2] Shen Dou, Yang Qiang, Sun Jiantao, et al. Thread Detection in Dynamic Text Message Streams[C]//Proc. of SIGIR’06. Seattle, USA: ACM Press, 2006: 35-42.
[3] Yang Yiming. Learning Approaches for Detecting and Tracking News Events[J]. IEEE Intelligent Systems, 1999, 14(4): 32-43.
[4] 洪宇, 张宇, 刘挺, 等. 话题检测与跟踪的评测及研究综述[J]. 中文信息学报, 2007, 21(6): 71-87.
[5] Wang Le, Jia Yan, Chen Yingwen. Conversation Extraction in Dynamic Text Message Stream[J]. Journal of Computers, 2008, 3(10): 86-93.
[6] Georgiou T, Karvounis M, Ioannidis Y. Extracting Topics of Debate Between Users on Web Discussion Boards[C]//Proc. of SIGMOD’10. Indianapolis, Indiana, USA: [s. n.], 2010.
[7] Hassan A, Qazvinian V, Radev D. What’s with the Attitude? Identifying Sentences with Attitude in Online Discussions[C]// Proc. of EMNLP’10. Cambridge, Massachusetts, USA: [s. n.], 2010.
[8] 王君泽. 基于大规模问答语料的问题检索系统[D]. 武汉: 华中科技大学, 2010.
[9] Elsner M, Charniak E. Disentangling Chat[J]. Computational Lin- guistics, 2010, 36(3): 390-409.
[10] Manning C D, Schutze H. Foundations of Statistical Natural Language Processing[M]. Cambridge, Massachusetts, USA: The MIT Press, 1999.
[11] 刘群, 李素建. 基于《知网》的词汇语义相似度的计算[C]//第三届汉语词汇语义学研讨会议论文集. 中国台北: [出版者不详], 2002.
[12] Wang Hongning, Wang Chi, Zhai Chengxiang, et al. Learning Online Discussion Structures by Conditional Random Fields[C]// Proc. of SIGIR’11. Beijing, China: ACM Press, 2011.
[13] Wang Yi-chia, Joshi M, Cohen W, et al. Recovering Implicit Thread Structure in Newsgroup Style Conversations[C]//Proc. of ICWSM’08. Seattle, Washington, USA: [s. n.], 2008.
[14] Lin Chen, Yang Jiang-ming, Cai Rui, et al. Simultaneously Modeling Semantics and Structure of Threaded Discussions: A Sparse Coding Approach and Its Applications[C]//Proc. of SIGIR’09. Boston, Massachusetts, USA: [s. n.], 2009.
[15] Elsner M, Charniak E. You Talking to Me? A Corpus and Algorithm for Conversation Disentanglement[C]//Proc. of the 46th Annual Meeting on Association for Computational Linguistics. Columbus, USA: [s. n.], 2008.
[16] Moerchen F, Brinker K, Neubauer C, et al. Any-time Clus- tering of High Frequency News Streams[C]//Proc. of KDD’07. San Jose, California, USA: [s. n.], 2007.
[17] Liu Yubao, Cai Jiarong, Yin Jian, et al. Clustering Text Data Streams[J]. Journal of Computer Science and Technology, 2008, 23(1): 112-128.
[18] Berger A, Lafferty J. Information Retrieval as Statistical Translation[C]//Proc. of SIGIR’99. Berkeley, USA: ACM Press, 1999.
[19] 郑继明, 张萍. 改进的 BIC 说话人分割算法[J]. 计算机工程, 2010, 36(17): 240-242.
[20] Jeon J, Croft W B, Lee J H. Finding Similar Questions in Large Question and Answer Archives[C]//Proc. of the 14th ACM International Conference on Information and Knowledge Management. Bremen, Germany: [s. n.], 2005: 84-90.

Please choose a citation manager

Content to export