The Maximum Probability Algorithm of Automatic Chinese Word Segmentation Based on Context

Abstract

Abstract: This article presents a new algorithm of automatic Chinese word segmentation. Its main idea is to settle the problem of different meanings under the separating words process by scanning the article two times. And puts forward a new efficient string segmentation algorithm, which can exclude possibilities of redundant single words in other algorithms.

摘要： 提出了一种新的汉语自动分词算法,其主要思想是通过前后两次对文章的扫描来解决分词过程中出现的交叉歧义问题,介绍了一种新的有效的字段切分算法,它能够排除类似穷举算法中冗余的单字词的切分可能。

关键词: 上下文相关, 汉语自动分词, 分词统计模型

CLC Number:

TP391.1

JIN Yu, LU Qiming, GAO Feng. The Maximum Probability Algorithm of Automatic Chinese Word Segmentation Based on Context[J]. , 2004, 30(16): 156-158.

金瑜,陆启明,高峰. 基于上下文相关的最大概率汉语自动分词算法[J]. , 2004, 30(16): 156-158.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/Y2004/V30/I16/156

[1]	WU Haipeng, QIAN Yurong, LENG Hongyong. Multimodal Relation Extraction Based on Bidirectional Attention Mechanism [J]. Computer Engineering, 2024, 50(4): 160-167.
[2]	MO Shaocong, CHEN Qingfeng, XIE Ze, LIU Chunyu, QIU Junlai. Entity Alignment Based on Dynamic Graph Attention and Label Propagation [J]. Computer Engineering, 2024, 50(4): 150-159.
[3]	YANG Piao, DONG Wenyong. Chinese Named Entity Recognition Method Based on BERT Embedding [J]. Computer Engineering, 2020, 46(4): 40-45,52.
[4]	LIU Yue, ZHAI Donghai, REN Qingning. News Text Classification Based on CNLSTM Model with Attention Mechanism [J]. Computer Engineering, 2019, 45(7): 303-308,314.
[5]	YAO Li,ZHANG Xihuang. An Improved Topics over Time Model Based on Label [J]. Computer Engineering, 2019, 45(4): 205-210,216.
[6]	ZHANG Kaihang,XU Kefu,ZHANG Chuang. Web News Extraction Method Based on Topic Weight of Wildcard Node [J]. Computer Engineering, 2019, 45(4): 275-280.
[7]	TAN Mengjie,L Xin,TAO Feifei. Study of Financial News Topic Detection Based on Multi-feature Fusion [J]. Computer Engineering, 2019, 45(3): 293-299,308.
[8]	CHEN Siyuan,PENG Chao,CAI Linsen,GUO Lanying. A Deep Network Model for Specific Target Sentiment Analysis [J]. Computer Engineering, 2019, 45(3): 286-292.
[9]	CHEN Bin,ZHOU Yong,LIU Bing. Event Trigger Word Extraction Based on Convolutional Bidirectional Long Short Term Memory Network [J]. Computer Engineering, 2019, 45(1): 153-158.
[10]	HE Hongye,ZHENG Jin,ZHANG Zuping. Text Sentiment Analysis Combined with Part of Speech Features and Convolutional Neural Network [J]. Computer Engineering, 2018, 44(11): 209-214,221.
[11]	XING Yuying,XIA Hongbin,WANG Han.. Improved ALS Online Recommendation Algorithm with Missing Data Modeling [J]. Computer Engineering, 2018, 44(8): 212-217,223.
[12]	LU Jiale,LI Weixiang,MAO Xiangyu. Recommendation Algorithm Based on Fuzzy Time Series Classification and Weighted Similarity [J]. Computer Engineering, 2018, 44(6): 156-161.
[13]	ZHANG Zhen,FAN Xingyue,GUO Yutian,WU Guohua. Dynamic Summarization Update Method Based on Topic Signature [J]. Computer Engineering, 2018, 44(6): 169-175.
[14]	JING Qi,DUAN Liguo,LI Aiping,ZHAO Qian. Short Text Correlation Calculation Based on Wikipedia [J]. Computer Engineering, 2018, 44(2): 197-202.
[15]	WU Xukang,YANG Xuguang,CHEN Yuanyuan,WANG Yingguan,ZHANG Yuechuan. Topic Combined Word Vector Model [J]. Computer Engineering, 2018, 44(2): 233-237,270.

Please choose a citation manager

Content to export