基于语境信息的中文分词交叉歧义处理方法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

基金项目:


Contextbased Approach to Overlapping Ambiguity Resolution  in Chinese Word Segmentation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    模拟人浏览句子按照语境寻找消歧证据的经验,计算歧义字段与其所在句子的语义相似度和相关度,据此作为语境计算模型,利用歧义字段与其所在句子的语境信息进行中文分词交叉歧义处理;与经典的基于统计方法相比,切分准确率有很大提高。

    Abstract:

    This method simulates the experience of people when searching for evidence to eliminate overlapping ambiguity using context information in Chinese word segmentation. The semantic similarity and correlation of overlapping ambiguity and its sentence are calculated. A context calculation model is set up, which resolves overlapping ambiguity in Chinese word segmentation using contextual information. Our experimental results show that compared with the traditional statisticsbased approach, our algorithm has a good segmentation accuracy.

    参考文献
    相似文献
    引证文献
引用本文

尹倩.基于语境信息的中文分词交叉歧义处理方法[J].重庆工商大学学报(自然科学版),2016,33(5):20-24
YIN Qian. Contextbased Approach to Overlapping Ambiguity Resolution  in Chinese Word Segmentation[J]. Journal of Chongqing Technology and Business University(Natural Science Edition),2016,33(5):20-24

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2016-10-13
×
2024年《重庆工商大学学报(自然科学版)》影响因子显著提升