View Project

Title:

Obtaining referential word meanings from visual and distributional information: Experiments on object naming

Abstract:

We investigate object naming, which is an important sub-task of referring expression generation on real-world images. As opposed to mutually exclusive labels used in object recognition, object names are more flexible, subject to communicative preferences and semantically related to each other. Therefore, we investigate models of referential word meaning that link visual to lexical information which we assume to be given through distributional word embeddings. We present a model that learns individual predictors for object names that link visual and distributional aspects of word meaning during training. We show that this is particularly beneficial for zero-shot learning, as compared to projecting visual objects directly into the distributional space. In a standard object naming task, we find that different ways of combining lexical and visual information achieve very similar performance, though experiments on model combination suggest that they capture complementary aspects of referential meaning.

Comments:

Actions

Suggested Topics

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 Similarity-driven Semantic Role Induction via Graph Partitioning Joel Lang, Mirella Lapata 999 paper 202.53
2 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizur Rahman, Pinar Karagoz, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek K 713 resource 200.62
3 Codra: A Novel Discriminative Framework for Rhetorical Analysis Shafiq Joty, Giuseppe Carenini, Raymond T. Ng 999 paper 192.84
4 Highlights of EMNLP 2017: Exciting Datasets, Return of the Clusters, and More! Sebastian Ruder 641 resource 184.67
5 Discriminative Syntax-based Word Ordering for Text Generation Yue Zhang, Stephen Clark 999 paper 175.03
6 Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience Ismael Rafols, Martin Meyer 999 paper 171.95
7 Transfer Learning - Machine Learnings Next Frontier Sebastian Ruder 978 tutorial 171.13
8 DEEP LEARNING FOR CHATBOTS, PART 2 - IMPLEMENTING A RETRIEVAL-BASED MODEL IN TENSORFLOW Denny Britz 445 tutorial 168.36
9 A survey of transfer learning Karl Weiss, Taghi M. Khoshgoftaar and DingDing Wang 978 resource 166.18
10 An end to end implementation of a Machine Learning pipeline Spandan Madan 107 tutorial 164.84
11 The Building Blocks of Interpretability Chris Olah 614 resource 164.18
12 The data that transformed AI research—and possibly the world Dave Gershgorn 107 resource 161.16
13 Analyzing the Meaning of Sentences Steven Bird, Ewan Klein, Edward Loper 721 course 160.35
14 Visualizing Representations: Deep Learning and Human Beings Christopher Olah 713 tutorial 160.24
15 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 421 survey 158.75
16 Ideas on interpreting machine learning Patrick Hall, Wen Phan, SriSatish Ambati 134 tutorial 157.59
17 Machine Learning for Humans Vishal Maini, Samer Sabri 134 tutorial 153.20
18 Explain yourself, machine. Producing simple text descriptions for AI interpretability. Luke Oakden-Rayner 811 resource 152.18
19 An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship J. E. Hirsch 999 paper 151.99
20 Introduction to Neural Machine Translation with GPUs (part 3) Kyunghyun Cho 753 tutorial 150.60
21 Lexicalization and Generative Power in Ccg Marco Kuhlmann, Alexander Koller, Giorgio Satta 999 paper 149.71
22 Clustering cliques for graph-based summarization of the biomedical research literature Han Zhang, Marcelo Fiszman, Dongwook Shin, Bartomiej Wilkowski, Thomas Rindflesch 999 paper 145.91
23 A survey of cross-lingual embedding models Sebastian Ruder 721 tutorial 145.17
24 Show, attend and tell: Fine details of how state-of-the-art deep learning systems generate image captions Koustubh 958 resource 144.42
25 An Intuitive Guide to Linear Algebra Kalid Azad 121 tutorial 143.91
26 Tombones Computer Vision Blog Tomasz Malisiewicz 958 resource 143.80
27 Deep Learning Achievements Over the Past Year Eduard Tyantov 711 resource 143.73
28 Vector Calculus: Understanding the Dot Product Kalid Azad 101 tutorial 143.43
29 A miscellany of fun deep learning papers Adrian Colyer 711 resource 143.04
30 Must Know Tips/Tricks in Deep Neural Networks Xiu-Shen Wei 713 tutorial 142.53
31 Neural Text Embeddings for IR Bhaskar Mitra, Nick Craswell 721 tutorial 142.05
32 Recurrent Neural Network Tutorial, Part 4 – Implementing a GRU/LSTM RNN with Python and Theano Denny Britz 742 tutorial 141.69
33 Four deep learning trends from ACL 2017: Part 1 Abigail See 713 resource 141.61
34 Wordnet, getting your hands dirty bogdani 315 resource 141.54
35 Rohan & Lenny #2: Convolutional Neural Networks Lenny Khazan 744 tutorial 140.28
36 Gimli: open source and high-performance biomedical name recognition David Campos, Sergio Matos, Jose Oliveira 999 paper 139.97
37 Using Artificial Intelligence to Augment Human Intelligence Shan Carter, Michael Nielsen 811 resource 139.97
38 Vector Representations of Words - TensorFlow Tutorials TensorFlow Team 721 tutorial 139.54
39 A Practitioner's Guide to Natural Language Processing (Part I)?—?Processing & Understanding Text Dipanjan (DJ) Sarker 112 resource 139.54
40 Rohan & Lenny #3: Recurrent Neural Networks & LSTMs Rohan Kapur 741 tutorial 139.38
41 Vector Representation of Words TensorFlow 321 tutorial 139.16
42 Negated bio-events: analysis and identification Raheel Nawaz, Paul Thompson, Sophia Ananiadou 999 paper 138.83
43 Understanding Feature Engineering (Part 4)?—?Deep Learning Methods for Text Data Dipajan Sarkar 711 resource 138.82
44 The 10 Deep Learning Methods AI Practitioners Need to Apply James Le 811 tutorial 138.65
45 State-of-the-art neural coreference resolution for chatbots Thomas Wolf 756 tutorial 137.70
46 spaCy 101: Everything you need to know Author Unknown 731 resource 137.27
47 Written Memories: Understanding, Deriving and Extending the LSTM R2RT 742 resource 136.02
48 Caption this, with TensorFlow Raul Puri, Daniel Riccardelli 731 tutorial 135.88
49 Recurrent Neural Networks Stephen Grossberg 741 paper 135.75
50 Convolutional neural networks, Part 1 Adrian Colyer 744 resource 135.31
51 Recurrent Neural Networks Tutorial, Part 1 - Introduction to RNNs Denny Britz 741 tutorial 135.02
52 Deep Learning 2: Part 2 Lesson 11 Hiromi Suenaga 711 resource 135.00
53 Quora Duplicate Questions Corpus Quora 151 corpus 134.99
54 Python for Data Science Joe McCarthy 131 tutorial 134.98
55 Natural Language Processing in Artificial Intelligence is almost human-level accurate. Worse yet, it gets smart! Rafal 133 tutorial 134.24
56 Word embeddings in 2017: Trends and future directions Sebastian Ruder 721 resource 134.04
57 New approaches to Deep Networks:Capsules (Hinton), HTM (Numenta), Sparsey (Neurithmic Systems) and RCN (Vicarious) Gideon Kowadlo 731 resource 133.64
58 Rohan #2: Artificial intelligence, ?Progress/?Time Rohan Kapur 811 tutorial 133.48
59 Deep Learning 2: Part 2 Lesson 10 Hiromi Suenaga 711 resource 133.35
60 Introducing Gluon - An Easy-to-Use Programming Interface for Flexible Deep Learning Vikram Madan 731 resource 133.34
61 Do Altmetrics Work? Twitter and Ten Other Social Web Services Mike Thelwall, Stefanie Haustein, Vincent Larivière, Cassidy R. Sugimoto 999 paper 133.21
62 A social network's changing statistical properties and the quality of human innovation Brian Uzzi 999 paper 132.86
63 A large-scale community structure analysis in Facebook Emilio Ferrara 999 paper 132.42
64 The 8 Neural Network Architectures Machine Learning Researchers Need to Learn Nand Kishor 711 resource 132.00
65 DEEP LEARNING FOR CHATBOTS, PART 1 - INTRODUCTION Denny Britz 445 tutorial 131.83
66 Word Vectors and Semantic Similarity Author Unknown 314 resource 131.52
67 Understanding Convolutional Neural Networks for NLP Denny Britz 744 tutorial 131.12
68 SippyCup Unit 2: Travel queries Bill MacCartney 365 tutorial 130.94
69 Ultimate Guide to Understand & Implement Natural Language Processing (with codes in Python) Shivam Bansal 131 tutorial 130.81
70 Recurrent neural networks and LSTM tutorial in Python and TensorFlow Author Unknown 742 tutorial 130.71
71 Deep Learning 2: Part 2 Lesson 8 Hiromi Suenaga 711 resource 130.44
72 Demystifying Word2Vec Jan Bussieck 721 tutorial 129.90
73 AI’s Language Problem Will Knight 133 tutorial 129.70
74 Interpreting machine learning models Lars Hulstaert 711 resource 129.41
75 Machine Learning Glossary Author Unknown 107 resource 128.88
76 A Beginners Guide to Deep Learning Kumar Shridhar 711 tutorial 128.83
77 Deconstruction with Discrete Embeddings R2RT 711 resource 128.69
78 Web Scraping in Python using Scrapy (with multiple examples) Mohd Sanad Zaki Rizvi 999 resource 128.06
79 The Unreasonable Effectiveness of Recurrent Neural Networks Andrej Karpathy 741 survey 127.56
80 Captioning Novel Objects in Images Subhashini Venugopalan, Lisa Anne Hendricks 958 tutorial 127.47
81 Deep Learning for NLP, advancements and trends in 2017 Javier 711 resource 127.18
82 A general framework for analysing diversity in science, technology and society Andy Stirling 999 paper 127.11
83 The 9 Deep Learning Papers You Need To Know About (Understanding CNNs Part 3) Adit Deshpande 744 tutorial 127.05
84 The NeuroEvolution of Augmenting Topologies (NEAT) Users Page Author Unknown 999 resource 126.94
85 25 Open Datasets for Deep Learning Every Data Scientist Must Work With Pranav Dar 731 resource 126.82
86 Show, attend and tell: Neural image caption generation with visual attention Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard S Zemel, Yoshua Bengio 999 paper 126.76
87 PyTorch-GAN Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A. Efros, Oliver Wang, Eli Shechtman 731 library 126.65
88 Capsule Networks and the Limitations of CNNs Soham Chatterjee 744 resource 126.61
89 The 8 Neural Network Architectures Machine Learning Researchers Need to Learn James Le' 731 resource 126.41