View Project


Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders


While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at word-level to alleviate this problem, we present a novel framework based on conditional variational autoencoders that captures the discourse-level diversity in the encoder. Our model uses latent variables to learn a distribution over potential conversational intents and generates diverse responses using only greedy decoders. We have further developed a novel variant that is integrated with linguistic prior knowledge for better performance. Finally, the training procedure is improved by introducing a bag-of-word loss. Our proposed models have been validated to generate significantly more diverse responses than baseline approaches and exhibit competence in discourse-level decision-making.


Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic
1 A Survey on Dialogue Systems: Recent Advances and New Frontiers Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang 1142
2 Challenges in Building Intelligent Open-domain Dialog Systems "MINLIE HUANG and XIAOYAN ZHU," 1200
3 A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin,... 9999
4 Neural Approaches to Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
5 Controllable Text Generation Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, Eric ... 9999
6 Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation Iulian Vlad Serban, Tim Klinger, Gerald Tesauro, Kartik Talamadupul... 9999
7 A survey of available corpora for building data-driven dialogue systems Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau 9999
8 Deep Reinforcement Learning for Dialogue Generation Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Da... 9999
9 Deep Reinforcement Learning for Dialogue Generation Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, Ji... 9999
10 Recent Trends in Deep Learning Based Natural Language Processing Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria 1181
11 Survey on Evaluation Methods for Dialogue Systems Jan Deiru 1126
12 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
13 Machine Translation 3 (Neural), Dialogue Models Mohit Bansal 1142
14 A Latent Variable Recurrent Neural Network for Discourse Relation Language Models Yangfeng Ji, Gholamreza Haffari, Jacob Eisenstein 9999
15 A Neural Network Approach to Context-Sensitive Generation of Conversational Responses Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Ya... 9999
16 Weakly Supervised Memory Networks Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus 9999
17 Deep Learning Based Chatbot Models Richard Csaky 1183
18 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183
19 Encode, Review, and Decode: Reviewer Module for Caption Generation Zhilin Yang, Ye Yuan, Yuexin Wu, Ruslan Salakhutdinov, William W Cohen 9999
20 A Diversity-Promoting Objective Function for Neural Conversation Models Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan 9999
21 Hierarchical Neural Network Generative Models for Movie Dialogues Iulian V. Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courv... 9999
22 A Survey on Deep Learning for Named Entity Recognition Li, Jing and Sun, Aixin and Han, Jianglei and Li, Chenliang 1089
23 How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation Chia-Wei Liu, Ryan Lowe, Iulian V Serban, Michael Noseworthy, Laure... 9999
24 Representation Learning: A Review and New Perspectives Yoshua Bengio, Aaron Courville, Pascal Vincent 1186
25 Generating Sentences from a Continuous Space Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal ... 9999
26 A Latent Variable Recurrent Neural Network for Discourse-Driven Language Models Yangfeng Ji, Gholamreza Haffari, Jacob Eisenstein 9999
27 Data Distillation for Controlling Specificity in Dialogue Generation Jiwei Li, Will Monroe, Dan Jurafsky 9999
28 Coherent Dialogue with Attention-based Language Models Hongyuan Mei, Mohit Bansal, Matthew R Walter 9999
29 PyTorch-GAN Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A... 1189
30 How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation Chia-Wei Liu, Ryan Lowe, Iulian Serban, Mike Noseworthy, Laurent Ch... 9999
31 Neural Net Models for Open-Domain Discourse Coherence Jiwei Li, Dan Jurafsky 9999
32 Neural Information Retrieval: A Literature Review Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu... 1169
33 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
35 GANs for Simulation, Representation and Inference Ari Heljakka 713
36 An Attentional Neural Conversation Model with Improved Specificity Kaisheng Yao, Baolin Peng, Geoffrey Zweig, Kam-Fai Wong 9999
37 Papers With Code : Dialogue Generation None
38 Language+Vision Mohit Bansal 1338
39 Encoder-Decoder Neural Networks Nal Kalchbrenner 1155
40 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
41 A Survey of the Usages of Deep Learning in Natural Language Processing Daniel W. Otter, Julian R. Medina, Jugal K. Kalita 1181
42 LSTM based Conversation Models Yi Luan, Yangfeng Ji, Mari Ostendorf 9999
43 The Handbook of Computational Linguistics and Natural Language Processing "Alexander Clark, Chris Fox, and Shalom Lappin" 1557
44 Towards end-to-end learning for dialog state tracking and management using deep reinforcement learning Tiancheng Zhao, Maxine Eskenazi 9999
45 Neural Belief Tracker: Data-Driven Dialogue State Tracking Nikola Mrkšic?, Diarmuid Ó Séaghdha, Tsung-Hsien Wen, Blaise Thomso... 9999
46 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 1183
47 A Survey on Semantic Parsing Aishwarya Kamath and Rajarshi Das 1218
48 Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation Albert Gatt, Emiel Krahmer 1136
49 Summaries and notes on Deep Learning research papers Denny Britz 1183
50 A Survey of Text Summarization Techniques Ani Nenkova, Kathleen McKeown 1129