首页 | 本学科首页   官方微博 | 高级检索  
     检索      

基于词向量的汉日通用汉字词语义计量研究方法探索
引用本文:施建军,刘,磊,周,瓴.基于词向量的汉日通用汉字词语义计量研究方法探索[J].外语教学理论与实践,2023,181(1):18.
作者姓名:施建军        
作者单位:上海外国语大学语言研究院 上海外国语大学语言研究院 上海外国语大学日本文化经济学院/常熟理工学院
摘    要:中日现代语言通用汉字词各义项在两种语言中的使用情况一直是学界关注的难题。基于高频中日同形词的研究结果表明,利用BERT词向量技术对日语目标词义项统计的平均准确率达到了90%,最高达到97%;对汉语目标词义项统计的平均准确率达到了88.3%,最高也达到97%,利用词向量技术对中日汉字词汇语义开展计量研究具备可行性。同时研究还发现,传统词典义项设立的科学性、例句规范性和句长等因素都会对基于词向量的语义分析产生影响。

关 键 词:词向量  中日同形词  语义  计量研究  

A quantitative semantic study on Chinese-Japanese homographs based on word embedding
SHI Jianjun,LIU Lei & ZHOU Ling.A quantitative semantic study on Chinese-Japanese homographs based on word embedding[J].外语教学理论与实践,2023,181(1):18.
Authors:SHI Jianjun  LIU Lei & ZHOU Ling
Abstract:The sense frequency and distribution of Chinese characters commonly used in modern languages of China and Japan have always been a concern of the academic community, as well as a problem in the comparative study of the two languages. Using neural-network-based word embedding as a tool, this paper selects 10 high-frequency homographs with rich meanings as target words to conduct exploratory research on this issue. Research result shows that the sense classification accuracy of Japanese target words based on BERT word embedding reaches 90% on average and 97% at the highest; The average accuracy of Chinese target words has reached 88.3% with the highest also at 97%. It is feasible to use word embedding to carry out quantitative research on the semantics of Chinese and Japanese words. The research also reveals that, among other factors, the scientificity and rationality of word sense induction in traditional dictionaries, the length of dictionary sample sentences, the standardization of corpus sample sentences, the accuracy of sample sentence extraction, and the length of corpus sample sentences have an impact on the semantic analysis based on word embedding.
Keywords:word embedding  word vector  Chinese-Japanese homographs  semantic  quantitative study  
点击此处可从《外语教学理论与实践》浏览原始摘要信息
点击此处可从《外语教学理论与实践》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号