A survey of cross-lingual word embedding models
cam.issuedOnline | 2019-08-12 | |
dc.contributor.author | Ruder, S | |
dc.contributor.author | Vulić, I | |
dc.contributor.author | Søgaard, A | |
dc.date.accessioned | 2018-10-03T04:45:38Z | |
dc.date.available | 2018-10-03T04:45:38Z | |
dc.date.issued | 2019 | |
dc.description.abstract | <jats:p>Cross-lingual representations of words enable us to reason about word meaning in multilingual contexts and are a key facilitator of cross-lingual transfer when developing natural language processing models for low-resource languages. In this survey, we provide a comprehensive typology of cross-lingual word embedding models. We compare their data requirements and objective functions. The recurring theme of the survey is that many of the models presented in the literature optimize for the same objectives, and that seemingly different models are often equivalent, modulo optimization strategies, hyper-parameters, and such. We also discuss the different ways cross-lingual word embeddings are evaluated, as well as future challenges and research horizons.</jats:p> | |
dc.identifier.doi | 10.17863/CAM.30462 | |
dc.identifier.eissn | 1943-5037 | |
dc.identifier.issn | 1076-9757 | |
dc.identifier.uri | https://www.repository.cam.ac.uk/handle/1810/283100 | |
dc.language.iso | eng | |
dc.publisher | AI Access Foundation | |
dc.publisher.url | http://dx.doi.org/10.1613/jair.1.11640 | |
dc.subject | 4603 Computer Vision and Multimedia Computation | |
dc.subject | 46 Information and Computing Sciences | |
dc.subject | 4602 Artificial Intelligence | |
dc.subject | 4611 Machine Learning | |
dc.title | A survey of cross-lingual word embedding models | |
dc.type | Article | |
dcterms.dateAccepted | 2018-05-02 | |
prism.endingPage | 631 | |
prism.publicationDate | 2019 | |
prism.publicationName | Journal of Artificial Intelligence Research | |
prism.startingPage | 569 | |
prism.volume | 65 | |
pubs.funder-project-id | European Research Council (648909) | |
rioxxterms.licenseref.startdate | 2019-01-01 | |
rioxxterms.licenseref.uri | http://www.rioxx.net/licenses/all-rights-reserved | |
rioxxterms.type | Journal Article/Review | |
rioxxterms.version | AM | |
rioxxterms.versionofrecord | 10.1613/JAIR.1.11640 |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- survey-cross-lingual.pdf
- Size:
- 1.42 MB
- Format:
- Adobe Portable Document Format
- Description:
- Accepted version
- Licence
- http://www.rioxx.net/licenses/all-rights-reserved
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- DepositLicenceAgreementv2.1.pdf
- Size:
- 150.9 KB
- Format:
- Adobe Portable Document Format