location: Current position: Home >> Scientific Research >> Paper Publications

A Hybrid Model Based on CRFs for Chinese Named Entity Recognition

Hits:

Indexed by:会议论文

Date of Publication:2008-07-23

Included Journals:EI、CPCI-S、Scopus

Page Number:127-132

Abstract:This paper presents a hybrid model and the corresponding algorithm combining Conditional Random Fields (CRFs) with statistical methods to improve the performance of CRFs for the task of Chinese Named Entity Recognition (NER). CRFs has a good performance in the task of sequence labeling. In the experiment Of recognizing Chinese Named Entity with CRFs, it can be found that the wrong tags labeled by CRFs are mostly the ones which have lower marginal probabilities. A statistical model is introduced to compliment it. In the hybrid model, marginal probability of every label in CRFs is used to separate CRFs method and statistical method. If the probability is greater than the given threshold, the test sample is recognized by CRFs; otherwise, the statistical model is used. By integrating the advantages of two methods, the hybrid model achieves 93.61% F-measure for Chinese person names and 91.75% F-measure for Chinese location names on MSRA dataset.

Pre One:基于CRFs的汉语功能块分析

Next One:A Dependency Analysis Method for Japanese Sentences with Complex Conjunctive Relations