Research on a Feature of Chinese New Word Identification

Abstract

Abstract: One of the problems of Chinese word segmentation is the identification of OOV (out of vocabulary) words. Chinese new words are often time-sensitive or domain specific, which take large percentage of OOV words. As to new words identification (NWI) problem, this paper summarizes the previous work on NWI, and then introduces a novel feature. Final result shows that the performance of NWl can be improved by the feature.

摘要： 未登录词识别是汉语自动分词的难题之一。中文新词多为时间敏感词或者领域相关词汇,占据未登录词很大比例。针对新词识别问题,首先总结了已有新词识别特征,然后引入了一个语言学特征。实验结果表明该特征可以提高新词识别率。

关键词: 中文分词, 新词识别, 支持向量机, 语素生产率

CLC Number:

TP391.4

QIN Haowei,BU Fenglin. Research on a Feature of Chinese New Word Identification[J]. , 2004, 30(S1): 381-.

秦浩伟,步丰林. 一个中文新词识别特征的研究[J]. , 2004, 30(S1): 381-.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/Y2004/V30/IS1/381

[1]	DONG Liangzhen, TIAN Jianyan, YANG Shengqiang, CHEN Haibin. Image Enhancement of Parts Surface Based on Illumination Correction and Image Fusion [J]. Computer Engineering, 2024, 50(6): 245-254.
[2]	JIAO Shichao, GUAN Ripeng, KUANG Liqun, XIONG Fengguan, HAN Xie. Image-Based Cross-Domain Visual-Data Retrieval with Deep Semantic Correlation Learning [J]. Computer Engineering, 2024, 50(5): 190-199.
[3]	LI Jing, LI Jian, CHEN Haifeng, ZHANG Qian, WANG Liyan, PEI Ercheng. Facial Expression Recognition Based on Key Region Masking and Reconstruction [J]. Computer Engineering, 2024, 50(5): 241-249.
[4]	HU Aoran, CHEN Xiaohong. One-step Multi-view Clustering Based on Diversity and Consistency [J]. Computer Engineering, 2024, 50(5): 51-61.
[5]	HU Shuai, LI Hualing, HAO Dechen. Improved Multistage Edge-Enhanced Medical Image Segmentation Network of U-Net [J]. Computer Engineering, 2024, 50(4): 286-293.
[6]	LONG Chenzhi, CHEN Ping, LI Chuankun. Fusing Global-Local Contextual Information for Small Object Multi-Person Pose Estimation [J]. Computer Engineering, 2024, 50(4): 342-349.
[7]	LIU Yanhong, YANG Qiuxiang, HU Shuai. Research on Multi-Scale Feature Fusion Dehazing Network Based on Feature Differences [J]. Computer Engineering, 2024, 50(4): 247-257.
[8]	LI Chen, HOU Jin, LI Jinbiao, CHEN Zirui. Infrared and Visible Image Fusion Method Based on Attention and Residual Concatenation [J]. Computer Engineering, 2022, 48(7): 234-240.
[9]	WEI Ziwei, QU Dan, LIU Cong. Method for Person Re-identification Feature Extraction Based on Connected Attention [J]. Computer Engineering, 2022, 48(7): 220-226.
[10]	ZHANG Yexing, CHEN Min, PAN Qiuyu. Object Detection Method Based on Feature Channel Modeling [J]. Computer Engineering, 2022, 48(7): 264-269,299.
[11]	HAO Axiang, JIA Guojun. Person Re-identification Model Combining Attention and Batch Feature Erasure [J]. Computer Engineering, 2022, 48(7): 270-276,306.
[12]	CUI Yunxuan, LIU Guihua, YU Dongying, GUO Zhongyuan, ZHANG Wenkai. Lidar-Mono-Inertial SLAM System with Fusion of Point-Line Features [J]. Computer Engineering, 2022, 48(7): 254-263.
[13]	LI Kequan, CHEN Yan, LIU Jiachen, MU Xiangwei. Survey of Deep Learning-Based Object Detection Algorithms [J]. Computer Engineering, 2022, 48(7): 1-12.
[14]	HU Xinrong, GONG Chuang, ZHANG Zili, ZHU Qiang, PENG Tao, HE Ruhan. Clothing Image Segmentation Network Based on Improved Deeplab v3+ [J]. Computer Engineering, 2022, 48(7): 284-291.
[15]	WANG Anzhi, REN Chunhong, HE Linyan, YANG Yuanying, QU Weihua. Light Field Salient Object Detection Based on Multi-modal Multi-level Feature Aggregation Network [J]. Computer Engineering, 2022, 48(7): 227-233,240.

Please choose a citation manager

Content to export