View Project


Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access


This paper proposes KB-InfoBot — a multi-turn dialogue agent w hich helps users search Knowledge Bases (KBs) without composing complicated queries. Such goal-oriented dialogue agents typically need to interact with an external database to a ccess real-world knowledge. Previous systems achieved this by issuing a symbolic query to the KB to retrieve entries based on their attributes. However, such symbolic operations break the differ entiability of the system and prevent end-to-end training of neural dialogue agents. In this paper, we address this limitation by replacing symbolic queries with an induced “soft” posterior dist ribution over the KB that indicates which entities the user is interested in. Integrating the soft retrieval process with a reinforcement learner leads to higher task success rate and reward in both s imulations and against real users. We also present a fully neural end-to-end agent, trained entirely from user feedback, and discuss its application towards personalized dialogue agents.


Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 An Introduction to Deep Learning for Natural Language Processing Jianfeng Gao 711 tutorial 270.99
2 Deep Reinforcement Learning: An Overview Yuxi Li 857 resource 261.20
3 Deep Learning for Dialogue Systems Yun-Nung (Vivian) Chen, Asli Celikyilmaz, Dilek Hakkani-Tur 756 tutorial 236.60
4 Deep Learning for Dialogue Systems Yun-Nung (Vivian) Chen, Asli Celikyilmaz, Dilek Hakkani-Tur 445 tutorial 229.65
5 Conditional Generation and Snapshot Learning in Neural Dialogue Systems Tsung-Hsien Wen, Milica Gasic, Nikola Mrkši?, Lina M. Rojas Barahon... 999 paper 213.17
6 Deep Learning for Conversational AI Pei-Hao Su, Nikola MrköiÊ, Iñigo Casanueva, Ivan VuliÊ 811 tutorial 212.21
7 Artificial Intelligence and Games Georgios N. Yannakakis and Julian Togelius 825 survey 210.58
8 Deep Reinforcement Learning for Dialogue Generation Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, Ji... 999 paper 207.38
9 Neural Networks for Information Retrieval: Generating Responses Mostafa Deghani, Tom Kenter 713 tutorial 204.91
10 Speech and Language Processsing Dan Jurafsky and James Martin 863 tutorial 194.41
11 Web Crawling Christopher Olston and Marc Najork 625 survey 193.63
12 Question Answering Techniques for the World Wide Web Jimmy Lin, Boris Katz 411 tutorial 191.42
13 Natural language question answering: the view from here L. Hirschman, R. Gaizauskas 411 survey 189.71
14 Speech and Language Processing Daniel Jurafsky, James H. Martin 133 survey 189.67
15 Neural Networks for Information Retrieval Tom Kenter, Alexey Borisov, Christophe Van Gysel, Mostafa Dehghani,... tutorial 188.75
16 Natural Language Data Management and Interfaces Yunyao Li, Davood Rafiei 974 tutorial 188.74
17 Information Extraction Sunita Sarawagi 232 survey 187.62
18 Advanced Dialog Systems Daniel Jurafsky, James H. Martin 445 survey 187.48
19 Information Extraction Katharina Kaiser and Silvia Miksch 232 survey 185.70
20 Spoken Content Retrieval: A Survey of Techniques and Technologies Martha Larson and Gareth J. F. Jones 962 survey 181.97
21 Reinforcement Learning: An Introduction (2nd ed) Richard S. Sutton and Andrew G. Barto 857 survey 181.66
22 Reinforcement Learning: An Introduction Richard S. Sutton, Andrew G. Barto 857 survey 181.55
23 An Introduction to Neural Information Retrieval Bhaskar Mitra, Nick Craswell 232 survey 180.46
24 Generalized Low Rank Models Madeleine Udell, Corinne Horn, Reza Zadeh, Stephen Boyd 341 survey 179.93
25 ICML 2018 Notes David Abel 999 survey 178.75
26 Rohan #2: Artificial intelligence, ?Progress/?Time Rohan Kapur 811 tutorial 177.49
27 Key-Value Memory Networks for Directly Reading Documents Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Ant... 999 paper 175.71
28 A Persona-Based Neural Conversation Model Jiwei Li, Michel Galley, Chris Brockett, Georgios Spithourakis, Jia... 999 paper 174.80
29 DEEP LEARNING FOR CHATBOTS, PART 1 - INTRODUCTION Denny Britz 445 tutorial 174.16
30 Open-Domain Question Answering Mark Andrew Greenwood 411 survey 171.81
31 Word Vector Space Specialisation Nikola Mrksic, Mohammad Taher Pilehvar, Ivan Vulic 72 tutorial 171.27
32 Opinion mining and sentiment analysis Bo Pang and Lillian Lee 381 survey 170.43
33 Open-Domain Question Answering John Prager 411 survey 170.31
34 Memory Networks ?for Language Understanding Antoine Bordes 745 tutorial 170.28
35 A Beginner’s Guide to Deep Reinforcement Learning Adam Gibson, Chris Nicholson, Josh Patterson 857 library 168.84
36 Deep Learning for NLP: An Overview of Recent Trends Elvis 711 resource 168.72
37 The problem with Neural Chatbots Ryan Lowe 756 tutorial 167.74
38 Search Engines Information Retrieval in Practice W. Bruce Croft, Donald Metzler, Trevor Strohman 612 survey 167.43
39 Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus Iulian Vlad Serban, Alberto Garc?ia-Durán, Caglar Gulcehre, Sungjin... 999 paper 167.41
40 Natural Language Processing with Python Steven Bird, Ewan Klein, Edward Loper 132 survey 166.02
41 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 713 resource 165.65
42 Natural Language Processing Jacob Eisenstein 711 survey 165.51
43 Natural Language Processing Jacob Eisenstein 711 survey 165.16
44 Building Cross-Lingual End-to-End Product Search with Tensorflow Han Xiao 731 resource 165.02
45 NLP’s generalization problem, and how researchers are tackling it Ana Marasovic 711 resource 164.87
46 Automated Question Answering: Review of the Main Approaches Andrea Andrenucci, Eriks Sneiders 411 survey 164.63
47 Deep Learning for Natural Language Processing Hang Li 711 tutorial 164.44
48 Automatic Summarization Ani Nenkova and Kathleen McKeown 421 survey 163.61
49 Question Answering Karl Moritz Hermann 755 tutorial 162.70
50 Summaries and notes on Deep Learning research papers Denny Britz 713 resource 162.61