View Project


Obtaining referential word meanings from visual and distributional information: Experiments on object naming


We investigate object naming, which is an important sub-task of referring expression generation on real-world images. As opposed to mutually exclusive labels used in object recognition, object names are more flexible, subject to communicative preferences and semantically related to each other. Therefore, we investigate models of referential word meaning that link visual to lexical information which we assume to be given through distributional word embeddings. We present a model that learns individual predictors for object names that link visual and distributional aspects of word meaning during training. We show that this is particularly beneficial for zero-shot learning, as compared to projecting visual objects directly into the distributional space. In a standard object naming task, we find that different ways of combining lexical and visual information achieve very similar performance, though experiments on model combination suggest that they capture complementary aspects of referential meaning.


Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 Natural Language Processing Jacob Eisenstein 711 survey 188.57
2 Natural Language Processing Jacob Eisenstein 711 survey 187.81
3 Topics, Trends, and Resources in NLP Mohit Bansal 133 tutorial 187.37
4 Vector Space Models of Lexical Meaning Stephen Clark 721 survey 185.53
5 Integrating Generative Lexicon and Lexical Semantic Resources James Pustejovsky, Elisabetta Jezek 353 survey 184.06
6 Natural Language Processing Jacob Eisenstein 711 survey 181.10
7 A Technical Introduction to Statistical Natural Language Processing Jacob Eisenstein 133 survey 179.44
8 Learning Semantic Relations from Text Preslav Nakov, Diarmuid O' Seaghdha, Vivi Nastase, Stan Szpakowicz 353 tutorial 177.78
9 Deep Learning for Natural Language Processing: Introductioin Richard Socher 11 lecture 176.75
10 Natural Language Processing with Python Steven Bird, Ewan Klein, Edward Loper 132 survey 172.62
11 Speech and Language Processing Daniel Jurafsky, James H. Martin 133 survey 172.25
12 Semantic Parsing with Combinatory Categorial Grammars Yoav Artzi, Nicholas FitzGerald and Luke Zettlemoyer 365 tutorial 171.96
13 Neural Network Methods for Natural Language Processing Yoav Goldberg 713 survey 171.75
14 A Survey of Paraphrasing and Textual Entailment Methods Ion Androutsopoulos, Prodromos Malakasiotis 351 survey 171.03
15 Automatic Summarization Ani Nenkova and Kathleen McKeown 421 survey 169.89
16 Semantic Similarity Frontiers: From Concepts to Documents David Jurgens, Mohammad Taher Pilehvar 314 tutorial 169.72
17 From Frequency to Meaning: Vector Space Models of Semantics Peter D. Turney, Patrick Pantel 322 paper 169.14
18 An Introduction to Neural Information Retrieval Bhaskar Mitra, Nick Craswell 232 survey 169.13
19 Learning language through pictures Grzegorz Chrupa?a, Ákos Kádár, Afra Alishahi 999 paper 168.57
20 Most "babies" are "little" and most "problems" are "huge": Compositional Entailment in Adjective-Nouns Ellie Pavlick, Chris Callison-Burch 999 paper 168.20
21 Embeddings for Word Sense Disambiguation: An Evaluation Study Ignacio Iacobacci, Mohammad Taher Pilehvar, Roberto Navigli 999 paper 167.96
22 Opinion mining and sentiment analysis Bo Pang and Lillian Lee 381 survey 165.07
23 Grounded Language Learning from Video Described with Sentences Haonan Yu, Jeffrey Mark Siskind 999 paper 163.95
24 Graph Representation Learning Jure Leskovec 967 tutorial 163.92
25 Deep Learning for NLP: An Overview of Recent Trends Elvis 711 resource 163.90
26 Deep Learning Yoshua Bengio 711 tutorial 163.40
27 Adaptive Joint Learning of Compositional and Non-Compositional Phrase Embeddings Kazuma Hashimoto, Yoshimasa Tsuruoka 999 paper 162.93
28 Natural Language Data Management and Interfaces Yunyao Li, Davood Rafiei 974 tutorial 162.78
29 Cross-Lingual Word Representations: Induction and Evaluation Ivan Vulic, Anders Sogaard, Manaal Faruqui 999 survey 162.63
30 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 713 resource 161.16
31 Generalized Linear Models Roger Levy tutorial 160.57
32 Syntax-Aware Multi-Sense Word Embeddings for Deep Compositional Models of Meaning Jianpeng Cheng, Dimitri Kartsaklis 999 paper 160.19
33 Word Sense Disambiguation: A Survey Roberto Navigli 391 survey 160.17
34 Combinatory Categorial Grammars for Robust Natural Language Processing Mark Steedman 264 tutorial 159.86
35 Learning to Compose Neural Networks for Question Answering Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 999 paper 159.33
36 Search Engines Information Retrieval in Practice W. Bruce Croft, Donald Metzler, Trevor Strohman 612 survey 159.16
37 Learning Deep Architectures for AI Yoshua Bengio 712 survey 158.96
38 Spoken Content Retrieval: A Survey of Techniques and Technologies Martha Larson and Gareth J. F. Jones 962 survey 158.19
39 Deep Learning in NLP Vered Shwartz 711 resource 157.03
40 Recent Developments of Content-Based Recommendation systems Giovanni Semeraro 999 tutorial 156.14
41 Categorial Grammar Mark Steedman 264 survey 156.10
42 Information Extraction Katharina Kaiser and Silvia Miksch 232 survey 155.93
43 Authorship Attribution Patrick Juola 965 survey 155.82
44 Transfer Learning - Machine Learnings Next Frontier Sebastian Ruder 978 tutorial 155.73
45 Advances in Word Sense Disambiguation Ted Pedersen, Rada Mihalcea 391 tutorial 155.50
46 A Survey of Automatic Query Expansion in Information Retrieval Claudio Carpineto And Giovanni Romano 232 survey 155.40
47 Scholarly Data Mining: Making Sense of Scientific Literature Horacio Saggion, Francesco Ronzano 974 tutorial 155.39
48 Scholarly Data Mining: Making Sense of Scientific Literature Horacio Saggion & Francesco Ronzano 974 tutorial 155.39
49 SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity Daniela Gerz, Ivan Vuli?, Felix Hill, Roi Reichart, Anna Korhonen 999 paper 155.31
50 Open-Domain Question Answering John Prager 411 survey 155.13