View Project

Title:

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Abstract:

This paper proposes KB-InfoBot — a multi-turn dialogue agent w hich helps users search Knowledge Bases (KBs) without composing complicated queries. Such goal-oriented dialogue agents typically need to interact with an external database to a ccess real-world knowledge. Previous systems achieved this by issuing a symbolic query to the KB to retrieve entries based on their attributes. However, such symbolic operations break the differ entiability of the system and prevent end-to-end training of neural dialogue agents. In this paper, we address this limitation by replacing symbolic queries with an induced “soft” posterior dist ribution over the KB that indicates which entities the user is interested in. Integrating the soft retrieval process with a reinforcement learner leads to higher task success rate and reward in both s imulations and against real users. We also present a fully neural end-to-end agent, trained entirely from user feedback, and discuss its application towards personalized dialogue agents.

Actions

Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic
1 End-to-End Reinforcement Learning of Dialogue Agents for Information Access Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, ... 9999
2 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
3 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
4 Neural Approaches to Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
5 A Survey on Dialogue Systems: Recent Advances and New Frontiers Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang 1142
6 Deep Learning for Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
7 A Roadmap towards Machine Intelligence Tomas Mikolov, Armand Joulin, Marco Baroni 9999
8 Evaluating Goal-oriented End-to-End Dialog Systems Antoine Bordes, Jason Weston, Y-Lan Boureau, Jesse Dodge, Andre Gan... 1200
9 Learning End-to-End Goal-Oriented Dialog Antoine Bordes, Jason Weston 9999
10 Deep Reinforcement Learning: An Overview Yuxi Li 1336
11 Challenges in Building Intelligent Open-domain Dialog Systems "MINLIE HUANG and XIAOYAN ZHU," 1200
12 TOP RESEARCH PAPERS IN CONVERSATIONAL AI FOR CHATBOTS AND INTELLIGENT AGENTS Mariya Yao 1302
13 StalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer Conversation Xiang Li, Lili Mou, Rui Yan, Ming Zhang 9999
14 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183
15 Recent Trends in Deep Learning Based Natural Language Processing Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria 1181
16 Survey on Evaluation Methods for Dialogue Systems Jan Deiru 1126
17 Deep Learning for Dialogue Systems Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tür 1142
18 Learning Through Dialogue Interactions Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, ... 9999
19 Deep Learning for Dialogue Systems Yun-Nung (Vivian) Chen, Asli Celikyilmaz, Dilek Hakkani-Tur 1142
20 end-to-end goal-oriented question answering systems "Deepak Argawal, Bee-Chung Chen, Qi He, Jaewon Yang, Liang Zhang" 1125
21 A survey of available corpora for building data-driven dialogue systems Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau 9999
22 Deep Learning Based Chatbot Models Richard Csaky 1183
23 Evaluating prerequisite qualities for learning end-to-end dialog systems Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopr... 9999
24 Natural Language Processing for Information Extraction Sonit Singh 1089
25 A Network-based End-to-End Trainable Task-oriented Dialogue System Tsung-Hsien Wen, Milica Gasic, Nikola Mrksic, Lina M Rojas-Barahona... 9999
26 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
27 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
28 On-line active reward learning for policy optimisation in spoken dialogue systems Pei-Hao Su, Milica Gasic, Nikola Mrksic, Lina Rojas-Barahona, Stefa... 9999
29 End-to-end task-completion neural dialogue systems Xuijun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao 9999
30 The Handbook of Computational Linguistics and Natural Language Processing "Alexander Clark, Chris Fox, and Shalom Lappin" 1557
31 Neural Information Retrieval: A Literature Review Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu... 1169
32 Conditional Generation and Snapshot Learning in Neural Dialogue Systems Tsung-Hsien Wen, Milica Gasic, Nikola Mrksic, Lina M Rojas-Barahona... 9999
33 Deep Learning for conversational AI "Pei-Hao Su, Nikola Mrköi, Iñigo Casanueva, Ivan Vuli" 1200
34 Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation Albert Gatt, Emiel Krahmer 1136
35 Conditional Generation and Snapshot Learning in Neural Dialogue Systems Tsung-Hsien Wen, Milica Gasic, Nikola Mrkši?, Lina M. Rojas Barahon... 9999
36 Towards end-to-end learning for dialog state tracking and management using deep reinforcement learning Tiancheng Zhao, Maxine Eskenazi 9999
37 A Survey on Semantic Parsing Aishwarya Kamath and Rajarshi Das 1218
38 Query Expansion Techniques for Information Retrieval: a Survey Hiteshwar Kumar Azad, Akshay Deepak 1174
39 Natural Language Interfaces to Databases \ An Introduction "I. Androutsopoulos, G.D. Ritchie, P. Thanisch" 1151
40 Spoken Dialogue Systems Kristiina Jokinen, Michael McTear 1142
41 Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks Rajarshi Das, Arvind Neelakantan, David Belanger, Andrew McCallum 9999
42 Coupling Distributed and Symbolic Execution for Natural Language Queries Lili Mou, Zhengdong Lu, Hang Li, Zhi Jin 9999
43 57 Summaries of Machine Learning and NLP Research Marek Rei 1201
44 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
45 A Review of 40 Years of Cognitive Architecture Research: Focus on Perception, Attention, Learning and Applications Iuliia Kotseruba, Oscar J Avella Gonzalez, John K Tsotsos 9999
46 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 1183
47 Neural Belief Tracker: Data-Driven Dialogue State Tracking Nikola Mrkšic?, Diarmuid Ó Séaghdha, Tsung-Hsien Wen, Blaise Thomso... 9999
48 Answering Complicated Question Intents Expressed in Decomposed Question Sequences Mohit Iyyer, Wen-tau Yih, Ming-Wei Chang 9999
49 Machine Translation 3 (Neural), Dialogue Models Mohit Bansal 1142
50 Information Extraction Katharina Kaiser and Silvia Miksch 1089