摘要: 提出了一种新的汉语自动分词算法,其主要思想是通过前后两次对文章的扫描来解决分词过程中出现的交叉歧义问题,介绍了一种新的有效的字段切分算法,它能够排除类似穷举算法中冗余的单字词的切分可能。
关键词:
上下文相关,
汉语自动分词,
分词统计模型
Abstract: This article presents a new algorithm of automatic Chinese word segmentation. Its main idea is to settle the problem of different meanings under the separating words process by scanning the article two times. And puts forward a new efficient string segmentation algorithm, which can exclude possibilities of redundant single words in other algorithms.
中图分类号:
金瑜,陆启明,高峰. 基于上下文相关的最大概率汉语自动分词算法[J]. , 2004, 30(16): 156-158.
JIN Yu, LU Qiming, GAO Feng. The Maximum Probability Algorithm of Automatic Chinese Word Segmentation Based on Context[J]. , 2004, 30(16): 156-158.