location: Current position: Home >> Scientific Research >> Paper Publications

An end-to-end entity and relation extraction network with multi-head attention

Hits:

Indexed by:会议论文

Date of Publication:2018-10-19

Volume:11221 LNAI

Page Number:136-146

Abstract:Relation extraction is an important semantic processing task in natural language processing. The state-of-the-art systems usually rely on elaborately designed features, which are usually time-consuming and may lead to poor generalization. Besides, most existing systems adopt pipeline methods, which treat the task as two separated tasks, i.e., named entity recognition and relation extraction. However, the pipeline methods suffer two problems: (1) Pipeline model over-simplifies the task to two independent parts. (2) The errors will be accumulated from named entity recognition to relation extraction. Therefore, we present a novel joint model for entities and relations extraction based on multi-head attention, which avoids the problems in the pipeline methods and reduces the dependence on features engineering. The experimental results show that our model achieves good performance without extra features. Our model reaches an F-score of 85.7% on SemEval-2010 relation extraction task 8, which has competitive performance without extra feature compared with previous joint models. On publication, codes will be made publicly available. © Springer Nature Switzerland AG 2018.

Pre One:Multi-Level Attention Based BLSTM Neural Network for Biomedical Event Extraction

Next One:Extracting chemical-protein interactions from biomedical literature via granular attention based recurrent neural networks