Repository logo
 

Comparing Data Sources and Architectures for Deep Visual Representation Learning in Semantics

Published version
Peer-reviewed

Type

Conference Object

Change log

Authors

Kiela, D 
Vero, AL 
Clark, S 

Abstract

Multi-modal distributional models learn grounded representations for improved performance in semantics. Deep visual representations, learned using convolutional neural networks, have been shown to achieve particularly high performance. In this study, we systematically compare deep visual representation learning techniques, experimenting with three well-known network architectures. In addition, we explore the various data sources that can be used for retrieving relevant images, showing that images from search engines perform as well as, or better than, those from manually crafted resources such as ImageNet. Furthermore, we explore the optimal number of images and the multi-lingual applicability of multi-modal semantics. We hope that these findings can serve as a guide for future research in the field.

Description

Keywords

Journal Title

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing

Conference Name

Empirical Methods in Natural Language Processing Conference (EMNLP 2016)

Journal ISSN

Volume Title

D16

Publisher

Association for Computational Linguistics
Sponsorship
Anita Verõ is supported by the Nuance Foundation Grant: Learning Type-Driven Distributed Representations of Language. Stephen Clark is supported by the ERC Starting Grant: DisCoTex (306920).