| 基于双向最大匹配和HMM的分词消歧模型* |
| |
| 引用本文： | 麦范金,王挺.基于双向最大匹配和HMM的分词消歧模型*[J].现代图书情报技术,2008,24(8):37-41. |
| |
| 作者姓名： | 麦范金 王挺 |
| |
| 作者单位： | 1. 桂林工学院现代教育技术中心,桂林,541004
2. 桂林工学院电子与计算机系,桂林,541004 |
| |
| 摘 要： | 提出一种消减分词切分歧义的模型。利用正向和逆向最大匹配方法对中文文本信息进行分词，基于隐马尔科夫模型对两次最大匹配的分词结果进行对比消歧，得到较为精确的结果。整个过程分为歧义发现、歧义抽取、歧义消除3个过程。测试结果显示，该模型能有效地降低分词歧义引起的错误切分率。
|
| 关 键 词： | 分词 最大匹配 隐马尔科夫模型 歧义消减 |
| 收稿时间： | 2008-04-25 |
| 修稿时间： | 2008-06-12 |
Sense Disambiguation of Chinese Segmentation Based on Bi-direction Matching Method and HMM |
| |
| Mai Fanjin,Wang Ting.Sense Disambiguation of Chinese Segmentation Based on Bi-direction Matching Method and HMM[J].New Technology of Library and Information Service,2008,24(8):37-41. |
| |
| Authors: | Mai Fanjin Wang Ting |
| |
| Institution: | (Modern Education Technology Center, Guilin University of Technology, Guilin 541004, China)
(Department of Electronic and Computer Science, Guilin University of Technology, Guilin 541004, China) |
| |
| Abstract: | This paper puts forward a model which can eliminate sense ambiguity of Chinese segmentation.This model segments word based on MM and RMM at first.Then it compares the segmentation results with each other,and output a more accurate result for the segmentation.The process can be divided into three parts:discovery,extraction and disambiguation.The test result shows that this model is able to reduce the error rate of segmentation,which is caused by the ambiguity of word segmentation. |
| |
| Keywords: | Word segmentation Maximum matching method HMM Sense disambiguation |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
| 点击此处可从《现代图书情报技术》浏览原始摘要信息 |
| 点击此处可从《现代图书情报技术》下载免费的PDF全文 |
|
