Repository logo
 

Enhancing biomedical word embeddings by retrofitting to verb clusters

Published version
Peer-reviewed

Loading...
Thumbnail Image

Type

Conference Object

Change log

Authors

Chiu, B 
Palmer, M 
Korhonen, A 

Abstract

Verbs play a fundamental role in many biomedical tasks and applications such as relation and event extraction. We hypothesize that performance on many downstream tasks can be improved by aligning the input pretrained embeddings according to semantic verb classes. In this work, we show that by using semantic clusters for verbs, a large lexicon of verb classes derived from biomedical literature, we are able to improve the performance of common pretrained embeddings in downstream tasks by retrofitting them to verb classes. We present a simple and computationally efficient approach using a widely available “off-theshelf” retrofitting algorithm to align pretrained embeddings according to semantic verb clusters. We achieve state-of-the-art results on text classification and relation extraction tasks.

Description

Keywords

Journal Title

BioNLP 2019 - SIGBioMed Workshop on Biomedical Natural Language Processing, Proceedings of the 18th BioNLP Workshop and Shared Task

Conference Name

BioNLP 2019

Journal ISSN

Volume Title

Publisher

Association for Computational Linguistics
Sponsorship
European Research Council (648909)