| 基于nGram2vec与词义演化的词相似度计算方法 |
| |
| 引用本文： | 汪玉珠,王永滨.基于nGram2vec与词义演化的词相似度计算方法[J].教育技术导刊,2020,19(2):96-99. |
| |
| 作者姓名： | 汪玉珠 王永滨 |
| |
| 作者单位： | 1. 中国传媒大学 计算机与网络空间安全学院；2. 中国传媒大学 智能融媒体教育部重点实验室，北京 100024 |
| |
| 摘 要： | 词相似度计算在文本分类等自然语言处理众多任务中有广泛应用，为了提高准确率并将其应用于文本分类任务中，提出基于知网与同义词林以及基于nGram训练大规模语料相结合的方法，通过词义演化技术检测词义变化确定两种方法的权重，利用皮尔逊相关系数对比人工定义词语相似度。通过实验将该方法与基于知网和同义词林的方法进行对比，根据随时间改变而词义有无变化选取15对词语进行测试，结果表明后者比前者提高了28%。由此可以看出，基于语料与语义词典的方法明显比单纯基于语义词典的方法好，但仍有较大改进空间。
|
| 关 键 词： | 词相似度 nGram2vec 同义词林 知网 词义演化 |
| 收稿时间： | 2019-10-24 |
Word Similarity Calculation Method Based on nGram2vec and Word Meaning Evolution |
| |
| WANG Yu-zhu,WANG Yong-bin.Word Similarity Calculation Method Based on nGram2vec and Word Meaning Evolution[J].Introduction of Educational Technology,2020,19(2):96-99. |
| |
| Authors: | WANG Yu-zhu WANG Yong-bin |
| |
| Institution: | 1. School of Computer and Cyberspace Securit， Communication University of China；2. Key Laboratory of Smart Fusion Media of Ministry of Education，Communication University of China，Beijing 100024，China |
| |
| Abstract: | Word similarity calculation is widely used in many tasks such as text classification and natural language processing. In order to improve the accuracy and apply it in text classification tasks， this paper proposes a method which combines of HowNet and synonym forest and nGram training based on large-scale corpus. The word meaning evolution technique is used to detect the change of word meaning to determine the weight of the two methods. The Pearson correlation coefficient is used to compare the similarity of the word. The experiment compares the method based on HowNet and the same word forest and the method proposed in this paper. The experiment tests 15 pairs of words according to the change of meaning with time. The result shows that the latter is increased by 0.28 than the former. It can be seen that the method based on corpus and semantic dictionary is obviously better than the method solely based on semantic dictionary， but there is still much room for improvement. |
| |
| Keywords: | word similarity nGram2vec synonym forest HowNet word meaning evolution |
|
| 点击此处可从《教育技术导刊》浏览原始摘要信息 |
| 点击此处可从《教育技术导刊》下载免费的PDF全文 |
