View Project

Title:

Obtaining referential word meanings from visual and distributional information: Experiments on object naming

Abstract:

We investigate object naming, which is an important sub-task of referring expression generation on real-world images. As opposed to mutually exclusive labels used in object recognition, object names are more flexible, subject to communicative preferences and semantically related to each other. Therefore, we investigate models of referential word meaning that link visual to lexical information which we assume to be given through distributional word embeddings. We present a model that learns individual predictors for object names that link visual and distributional aspects of word meaning during training. We show that this is particularly beneficial for zero-shot learning, as compared to projecting visual objects directly into the distributional space. In a standard object naming task, we find that different ways of combining lexical and visual information achieve very similar performance, though experiments on model combination suggest that they capture complementary aspects of referential meaning.

Comments:

Actions

Suggested Topics

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 Similarity-driven Semantic Role Induction via Graph Partitioning Joel Lang, Mirella Lapata 999 paper 201.48
2 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizur Rahman, Pinar Karagoz, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek K 713 resource 199.10
3 Codra: A Novel Discriminative Framework for Rhetorical Analysis Shafiq Joty, Giuseppe Carenini, Raymond T. Ng 999 paper 191.71
4 Highlights of EMNLP 2017: Exciting Datasets, Return of the Clusters, and More! Sebastian Ruder 641 resource 183.73
5 NLP's ImageNet moment has arrived Sebastian Ruder 862 resource 179.51
6 Discriminative Syntax-based Word Ordering for Text Generation Yue Zhang, Stephen Clark 999 paper 174.04
7 NLP’s generalization problem, and how researchers are tackling it Ana Marasovic 711 resource 172.25
8 Deep Learning in NLP Vered Shwartz 711 resource 171.81
9 Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience Ismael Rafols, Martin Meyer 999 paper 171.00
10 Transfer Learning - Machine Learnings Next Frontier Sebastian Ruder 978 tutorial 169.48
11 Deep Learning for NLP: An Overview of Recent Trends Elvis 711 resource 168.57
12 DEEP LEARNING FOR CHATBOTS, PART 2 - IMPLEMENTING A RETRIEVAL-BASED MODEL IN TENSORFLOW Denny Britz 445 tutorial 167.40
13 A survey of transfer learning Karl Weiss, Taghi M. Khoshgoftaar and DingDing Wang 978 resource 164.76
14 An end to end implementation of a Machine Learning pipeline Spandan Madan 107 tutorial 163.50
15 The Building Blocks of Interpretability Chris Olah 614 resource 162.72
16 The data that transformed AI research—and possibly the world Dave Gershgorn 107 resource 160.29
17 Analyzing the Meaning of Sentences Steven Bird, Ewan Klein, Edward Loper 721 course 159.06
18 Visualizing Representations: Deep Learning and Human Beings Christopher Olah 713 tutorial 158.83
19 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 421 survey 157.45
20 Ideas on interpreting machine learning Patrick Hall, Wen Phan, SriSatish Ambati 134 tutorial 156.24
21 How do we capture structure in relational data? Matthew Das Sarma 711 resource 152.72
22 Machine Learning for Humans Vishal Maini, Samer Sabri 134 tutorial 151.72
23 An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship J. E. Hirsch 999 paper 151.30
24 Explain yourself, machine. Producing simple text descriptions for AI interpretability. Luke Oakden-Rayner 811 resource 150.76
25 Introduction to Neural Machine Translation with GPUs (part 3) Kyunghyun Cho 753 tutorial 149.40
26 Lexicalization and Generative Power in Ccg Marco Kuhlmann, Alexander Koller, Giorgio Satta 999 paper 148.94
27 Clustering cliques for graph-based summarization of the biomedical research literature Han Zhang, Marcelo Fiszman, Dongwook Shin, Bartomiej Wilkowski, Thomas Rindflesch 999 paper 144.93
28 A survey of cross-lingual embedding models Sebastian Ruder 721 tutorial 143.95
29 Vector Representations of Words Author Unknown 731 resource 143.60
30 An Intuitive Guide to Linear Algebra Kalid Azad 121 tutorial 143.27
31 Show, attend and tell: Fine details of how state-of-the-art deep learning systems generate image captions Koustubh 958 resource 143.10
32 Vector Calculus: Understanding the Dot Product Kalid Azad 101 tutorial 142.62
33 Deep Learning Achievements Over the Past Year Eduard Tyantov 711 resource 142.47
34 Tombones Computer Vision Blog Tomasz Malisiewicz 958 resource 142.45
35 A miscellany of fun deep learning papers Adrian Colyer 711 resource 141.70
36 Must Know Tips/Tricks in Deep Neural Networks Xiu-Shen Wei 713 tutorial 141.20
37 Wordnet, getting your hands dirty bogdani 315 resource 141.04
38 Neural Text Embeddings for IR Bhaskar Mitra, Nick Craswell 721 tutorial 140.97
39 Recurrent Neural Network Tutorial, Part 4 – Implementing a GRU/LSTM RNN with Python and Theano Denny Britz 742 tutorial 140.92
40 Four deep learning trends from ACL 2017: Part 1 Abigail See 713 resource 140.42
41 Rohan & Lenny #2: Convolutional Neural Networks Lenny Khazan 744 tutorial 138.97
42 Gimli: open source and high-performance biomedical name recognition David Campos, Sergio Matos, Jose Oliveira 999 paper 138.90
43 Using Artificial Intelligence to Augment Human Intelligence Shan Carter, Michael Nielsen 811 resource 138.67
44 A Practitioner's Guide to Natural Language Processing (Part I)?—?Processing & Understanding Text Dipanjan (DJ) Sarker 112 resource 138.48
45 Vector Representations of Words - TensorFlow Tutorials TensorFlow Team 721 tutorial 138.39
46 Rohan & Lenny #3: Recurrent Neural Networks & LSTMs Rohan Kapur 741 tutorial 138.18
47 Vector Representation of Words TensorFlow 321 tutorial 138.00
48 Negated bio-events: analysis and identification Raheel Nawaz, Paul Thompson, Sophia Ananiadou 999 paper 137.76
49 Understanding Feature Engineering (Part 4)?—?Deep Learning Methods for Text Data Dipajan Sarkar 711 resource 137.62
50 The 10 Deep Learning Methods AI Practitioners Need to Apply James Le 811 tutorial 137.40
51 State-of-the-art neural coreference resolution for chatbots Thomas Wolf 756 tutorial 137.03
52 spaCy 101: Everything you need to know Author Unknown 731 resource 136.22
53 Face recognition with OpenCV, Python, and deep learning Adrian Rosebrock 862 resource 135.20
54 Written Memories: Understanding, Deriving and Extending the LSTM R2RT 742 resource 134.85
55 Caption this, with TensorFlow Raul Puri, Daniel Riccardelli 731 tutorial 134.66
56 Recurrent Neural Networks Stephen Grossberg 741 paper 134.49
57 Recurrent Neural Networks Tutorial, Part 1 - Introduction to RNNs Denny Britz 741 tutorial 134.34
58 Convolutional neural networks, Part 1 Adrian Colyer 744 resource 133.97
59 Python for Data Science Joe McCarthy 131 tutorial 133.88
60 Quora Duplicate Questions Corpus Quora 151 corpus 133.88
61 Deep Learning 2: Part 2 Lesson 11 Hiromi Suenaga 711 resource 133.81
62 Natural Language Processing in Artificial Intelligence is almost human-level accurate. Worse yet, it gets smart! Rafal 133 tutorial 133.46
63 Word embeddings in 2017: Trends and future directions Sebastian Ruder 721 resource 132.94
64 Do Altmetrics Work? Twitter and Ten Other Social Web Services Mike Thelwall, Stefanie Haustein, Vincent Larivière, Cassidy R. Sugimoto 999 paper 132.68
65 Introducing Gluon - An Easy-to-Use Programming Interface for Flexible Deep Learning Vikram Madan 731 resource 132.63
66 Rohan #2: Artificial intelligence, ?Progress/?Time Rohan Kapur 811 tutorial 132.39
67 New approaches to Deep Networks:Capsules (Hinton), HTM (Numenta), Sparsey (Neurithmic Systems) and RCN (Vicarious) Gideon Kowadlo 731 resource 132.31
68 A social network's changing statistical properties and the quality of human innovation Brian Uzzi 999 paper 132.16
69 Deep Learning 2: Part 2 Lesson 10 Hiromi Suenaga 711 resource 132.16
70 DEEP LEARNING FOR CHATBOTS, PART 1 - INTRODUCTION Denny Britz 445 tutorial 131.29
71 A large-scale community structure analysis in Facebook Emilio Ferrara 999 paper 131.26
72 The 8 Neural Network Architectures Machine Learning Researchers Need to Learn Nand Kishor 711 resource 130.72
73 The 7 NLP Techniques That Will Change How You Communicate in the Future (Part II) James Le 133 resource 130.62
74 Word Vectors and Semantic Similarity Author Unknown 314 resource 130.51
75 Understanding Convolutional Neural Networks for NLP Denny Britz 744 tutorial 129.93
76 SippyCup Unit 2: Travel queries Bill MacCartney 365 tutorial 129.88
77 Ultimate Guide to Understand & Implement Natural Language Processing (with codes in Python) Shivam Bansal 131 tutorial 129.79
78 Recurrent neural networks and LSTM tutorial in Python and TensorFlow Author Unknown 742 tutorial 129.54
79 Deep Learning 2: Part 2 Lesson 8 Hiromi Suenaga 711 resource 129.22
80 Demystifying Word2Vec Jan Bussieck 721 tutorial 128.70
81 AI’s Language Problem Will Knight 133 tutorial 128.40
82 ICML+ACL’18: Structure Back in Play, Translation Wants More Context Andre Martins 956 resource 128.34
83 Interpreting machine learning models Lars Hulstaert 711 resource 128.23
84 A First Taste of Machine Learning Terence Parr, Jeremy Howard 112 resource 128.06
85 Machine Learning Glossary Author Unknown 107 resource 127.84
86 A Beginners Guide to Deep Learning Kumar Shridhar 711 tutorial 127.63
87 Deconstruction with Discrete Embeddings R2RT 711 resource 127.47
88 Web Scraping in Python using Scrapy (with multiple examples) Mohd Sanad Zaki Rizvi 999 resource 127.24
89 The Unreasonable Effectiveness of Recurrent Neural Networks Andrej Karpathy 741 survey 126.53