View Project

Title:

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Abstract:

This paper proposes KB-InfoBot — a multi-turn dialogue agent w hich helps users search Knowledge Bases (KBs) without composing complicated queries. Such goal-oriented dialogue agents typically need to interact with an external database to a ccess real-world knowledge. Previous systems achieved this by issuing a symbolic query to the KB to retrieve entries based on their attributes. However, such symbolic operations break the differ entiability of the system and prevent end-to-end training of neural dialogue agents. In this paper, we address this limitation by replacing symbolic queries with an induced “soft” posterior dist ribution over the KB that indicates which entities the user is interested in. Integrating the soft retrieval process with a reinforcement learner leads to higher task success rate and reward in both s imulations and against real users. We also present a fully neural end-to-end agent, trained entirely from user feedback, and discuss its application towards personalized dialogue agents.

Actions

Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 End-to-End Reinforcement Learning of Dialogue Agents for Information Access Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, ... 9999
2 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
3 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
4 Neural Approaches to Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
5 A Survey on Dialogue Systems: Recent Advances and New Frontiers Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang 1142
6 An Introduction to Deep Learning for Natural Language Processing Jianfeng Gao 1181
7 Deep Learning for Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
8 A Roadmap towards Machine Intelligence Tomas Mikolov, Armand Joulin, Marco Baroni 9999
9 Evaluating Goal-oriented End-to-End Dialog Systems Antoine Bordes, Jason Weston, Y-Lan Boureau, Jesse Dodge, Andre Gan... 1200
10 Learning End-to-End Goal-Oriented Dialog Antoine Bordes, Jason Weston 9999
11 Deep Reinforcement Learning: An Overview Yuxi Li 1336
12 Challenges in Building Intelligent Open-domain Dialog Systems "MINLIE HUANG and XIAOYAN ZHU," 1200
13 StalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer Conversation Xiang Li, Lili Mou, Rui Yan, Ming Zhang 9999
14 TOP RESEARCH PAPERS IN CONVERSATIONAL AI FOR CHATBOTS AND INTELLIGENT AGENTS Mariya Yao 1302
15 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183
16 Recent Trends in Deep Learning Based Natural Language Processing Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria 1181
17 Group Recommender Systems Judith Masthoff 9999
18 Survey on Evaluation Methods for Dialogue Systems Jan Deiru 1126
19 Deep Learning for Dialogue Systems Yun-Nung (Vivian) Chen, Asli Celikyilmaz, Dilek Hakkani-Tur 1200
20 Deep Learning for Dialogue Systems Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tür 1142
21 Learning Through Dialogue Interactions Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, ... 9999
22 end-to-end goal-oriented question answering systems "Deepak Argawal, Bee-Chung Chen, Qi He, Jaewon Yang, Liang Zhang" 1125
23 Deep Learning for Dialogue Systems Yun-Nung (Vivian) Chen, Asli Celikyilmaz, Dilek Hakkani-Tur 1142
24 Deep Learning Based Chatbot Models Richard Csaky 1183
25 Successful Data Mining Methods for NLP Jiawei Han, Heng Ji, Yizhou Sun 1271
26 A survey of available corpora for building data-driven dialogue systems Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau 9999
27 Evaluating prerequisite qualities for learning end-to-end dialog systems Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopr... 9999
28 Natural Language Processing for Information Extraction Sonit Singh 1089
29 A Network-based End-to-End Trainable Task-oriented Dialogue System Tsung-Hsien Wen, Milica Gasic, Nikola Mrksic, Lina M Rojas-Barahona... 9999
30 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
31 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
32 End-to-end task-completion neural dialogue systems Xuijun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao 9999
33 On-line active reward learning for policy optimisation in spoken dialogue systems Pei-Hao Su, Milica Gasic, Nikola Mrksic, Lina Rojas-Barahona, Stefa... 9999
34 Neural Information Retrieval: A Literature Review Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu... 1169
35 Conditional Generation and Snapshot Learning in Neural Dialogue Systems Tsung-Hsien Wen, Milica Gasic, Nikola Mrksic, Lina M Rojas-Barahona... 9999
36 Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation Albert Gatt, Emiel Krahmer 1136
37 Conditional Generation and Snapshot Learning in Neural Dialogue Systems Tsung-Hsien Wen, Milica Gasic, Nikola Mrkši?, Lina M. Rojas Barahon... 9999
38 Towards end-to-end learning for dialog state tracking and management using deep reinforcement learning Tiancheng Zhao, Maxine Eskenazi 9999
39 A Survey on Semantic Parsing Aishwarya Kamath and Rajarshi Das 1218
40 Natural Language Interfaces to Databases \ An Introduction "I. Androutsopoulos, G.D. Ritchie, P. Thanisch" 1151
41 Query Expansion Techniques for Information Retrieval: a Survey Hiteshwar Kumar Azad, Akshay Deepak 1174
42 Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks Rajarshi Das, Arvind Neelakantan, David Belanger, Andrew McCallum 9999
43 Spoken Dialogue Systems Kristiina Jokinen, Michael McTear 1142
44 Coupling Distributed and Symbolic Execution for Natural Language Queries Lili Mou, Zhengdong Lu, Hang Li, Zhi Jin 9999
45 57 Summaries of Machine Learning and NLP Research Marek Rei 1201
46 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
47 A Review of 40 Years of Cognitive Architecture Research: Focus on Perception, Attention, Learning and Applications Iuliia Kotseruba, Oscar J Avella Gonzalez, John K Tsotsos 9999
48 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 1183
49 Machine Translation 3 (Neural), Dialogue Models Mohit Bansal 1142
50 Neural Belief Tracker: Data-Driven Dialogue State Tracking Nikola Mrkšic?, Diarmuid Ó Séaghdha, Tsung-Hsien Wen, Blaise Thomso... 9999