Repository logo
 

Cross-lingual syntactically informed distributed word representations

Accepted version
Peer-reviewed

Type

Conference Object

Change log

Authors

Vulic, I 

Abstract

We develop a novel cross-lingual word representation model which injects syntactic information through dependency-based contexts into a shared cross-lingual word vector space. The model, termed CL-DepEmb, is based on the following assumptions: (1) dependency relations are largely language-independent, at least for related languages and prominent dependency links such as direct objects, as evidenced by the Universal Dependencies project; (2) word translation equivalents take similar grammatical roles in a sentence and are therefore substitutable within their syntactic contexts. Experiments with several language pairs on word similarity and bilingual lexicon induction, two fundamental semantic tasks emphasising semantic similarity, suggest the usefulness of the proposed syntactically informed cross-lingual word vector spaces. Improvements are observed in both tasks over standard cross-lingual "offline mapping" baselines trained using the same setup and an equal level of bilingual supervision.

Description

Keywords

Cross-lingual word embeddings, Representation learning, Cross-lingual NLP, Semantic representation, Dependency-based contexts

Journal Title

15th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2017 - Proceedings of Conference

Conference Name

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers

Journal ISSN

Volume Title

2

Publisher

Association for Computational Linguistics
Sponsorship
European Research Council (648909)