View Project


Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders


While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at word-level to alleviate this problem, we present a novel framework based on conditional variational autoencoders that captures the discourse-level diversity in the encoder. Our model uses latent variables to learn a distribution over potential conversational intents and generates diverse responses using only greedy decoders. We have further developed a novel variant that is integrated with linguistic prior knowledge for better performance. Finally, the training procedure is improved by introducing a bag-of-word loss. Our proposed models have been validated to generate significantly more diverse responses than baseline approaches and exhibit competence in discourse-level decision-making.


Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 A Survey on Dialogue Systems: Recent Advances and New Frontiers Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang 1142
2 Challenges in Building Intelligent Open-domain Dialog Systems "MINLIE HUANG and XIAOYAN ZHU," 1200
3 A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin,... 9999
4 Neural Approaches to Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
5 Controllable Text Generation Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, Eric ... 9999
6 Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation Iulian Vlad Serban, Tim Klinger, Gerald Tesauro, Kartik Talamadupul... 9999
7 A survey of available corpora for building data-driven dialogue systems Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau 9999
8 Deep Reinforcement Learning for Dialogue Generation Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Da... 9999
9 Deep Reinforcement Learning for Dialogue Generation Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, Ji... 9999
10 Survey on Evaluation Methods for Dialogue Systems Jan Deiru 1126
11 Recent Trends in Deep Learning Based Natural Language Processing Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria 1181
12 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
13 Machine Translation 3 (Neural), Dialogue Models Mohit Bansal 1142
14 A Latent Variable Recurrent Neural Network for Discourse Relation Language Models Yangfeng Ji, Gholamreza Haffari, Jacob Eisenstein 9999
15 A Neural Network Approach to Context-Sensitive Generation of Conversational Responses Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Ya... 9999
16 Weakly Supervised Memory Networks Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus 9999
17 Deep Learning Based Chatbot Models Richard Csaky 1183
18 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183
19 Encode, Review, and Decode: Reviewer Module for Caption Generation Zhilin Yang, Ye Yuan, Yuexin Wu, Ruslan Salakhutdinov, William W Cohen 9999
20 A Diversity-Promoting Objective Function for Neural Conversation Models Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan 9999
21 Hierarchical Neural Network Generative Models for Movie Dialogues Iulian V. Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courv... 9999
22 How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation Chia-Wei Liu, Ryan Lowe, Iulian V Serban, Michael Noseworthy, Laure... 9999
23 A Survey on Deep Learning for Named Entity Recognition Li, Jing and Sun, Aixin and Han, Jianglei and Li, Chenliang 1089
24 Representation Learning: A Review and New Perspectives Yoshua Bengio, Aaron Courville, Pascal Vincent 1186
25 Generating Sentences from a Continuous Space Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal ... 9999
26 A Latent Variable Recurrent Neural Network for Discourse-Driven Language Models Yangfeng Ji, Gholamreza Haffari, Jacob Eisenstein 9999
27 Data Distillation for Controlling Specificity in Dialogue Generation Jiwei Li, Will Monroe, Dan Jurafsky 9999
28 Coherent Dialogue with Attention-based Language Models Hongyuan Mei, Mohit Bansal, Matthew R Walter 9999
29 PyTorch-GAN Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A... 1189
30 How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation Chia-Wei Liu, Ryan Lowe, Iulian Serban, Mike Noseworthy, Laurent Ch... 9999
31 Neural Net Models for Open-Domain Discourse Coherence Jiwei Li, Dan Jurafsky 9999
32 Papers With Code : Dialogue Generation None
34 An Attentional Neural Conversation Model with Improved Specificity Kaisheng Yao, Baolin Peng, Geoffrey Zweig, Kam-Fai Wong 9999
35 Neural Information Retrieval: A Literature Review Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu... 1169
36 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
37 LSTM based Conversation Models Yi Luan, Yangfeng Ji, Mari Ostendorf 9999
38 Language+Vision Mohit Bansal 1338
39 Encoder-Decoder Neural Networks Nal Kalchbrenner 1155
40 Towards end-to-end learning for dialog state tracking and management using deep reinforcement learning Tiancheng Zhao, Maxine Eskenazi 9999
41 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
42 Neural Belief Tracker: Data-Driven Dialogue State Tracking Nikola Mrkšic?, Diarmuid Ó Séaghdha, Tsung-Hsien Wen, Blaise Thomso... 9999
43 A Survey of the Usages of Deep Learning in Natural Language Processing Daniel W. Otter, Julian R. Medina, Jugal K. Kalita 1181
44 Summaries and notes on Deep Learning research papers Denny Britz 1183
45 A Survey on Semantic Parsing Aishwarya Kamath and Rajarshi Das 1218
46 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 1183
47 Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation Albert Gatt, Emiel Krahmer 1136
48 Deep Learning for Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
49 A Survey of Text Summarization Techniques Ani Nenkova, Kathleen McKeown 1129
50 Novel Methods for Text Generation using Adverserial Learning and Autoencoders Mariya Yao 1155