View Project

Title:

TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension

Abstract:

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence documents, six per question on average, that provide high quality distant supervision for answering the questions. We show that, in comparison to other recently introduced large-scale datasets, TriviaQA (1) has relatively complex, compositional questions, (2) has considerable syntactic and lexical variability between questions and corresponding answer-evidence sentences, and (3) requires more cross sentence reasoning to find answers. We also present two baseline algorithms: a feature-based classifier and a state-of-the-art neural network, that performs well on SQuAD reading comprehension. Neither approach comes close to human performance (23% and 40% vs. 80%), suggesting that TriviaQA is a challenging test bed that is worth significant future study.

Actions

Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 awesome-qa seriousmac 1125
2 Question answering Sebastian Ruder 1031
3 Standardized Tests as benchmarks for Artificial Intelligence? Mrinmaya Sachan, Minjoon Seo, Hannaneh Hajishirzi, Eric P. Xing 1300
4 Question answering | NLP-progress None
5 TriviaQA: A Large Scale Dataset for Reading Comprehension and Question Answering Mandar Joshi, Eunsol Choi, Daniel Weld, Luke Zettlemoyer 1126
6 403 Forbidden None
7 SQuAD: 100, 000+ Questions for Machine Comprehension of Text Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang 9999
8 Neural Approaches to Conversational AI Jianfeng Gao, Michel Galley, Lihong Li 1200
9 Semantic Parsing 2, Question Answering Mohit Bansal 1125
10 SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang 9999
11 Recent Evolution of QA Datasets and Going Forward Jiwoong Im 1126
12 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
13 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
14 Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks Jason Weston, Antoine Bordes, Sumit Chopra, Tomas Mikolov 9999
15 Successful Data Mining Methods for NLP Jiawei Han, Heng Ji, Yizhou Sun 1271
16 CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases Zihang Dai, Lei Li, Wei Xu 9999
17 Topics, Trends, and Resources in NLP Mohit Bansal 1065
18 Recent Trends in Deep Learning Based Natural Language Processing Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria 1181
19 Multilingual Relation Extraction using Compositional Universal Schema Patrick Verga, David Belanger, Emma Strubell, Benjamin Roth, Andrew... 9999
20 NLP’s generalization problem, and how researchers are tackling it Ana Marasovic 1181
21 Extreme Extraction: Only One Hour per Relation Raphael Hoffmann, Luke S. Zettlemoyer, Daniel S. Weld 9999
22 The Stanford Question Answering Dataset Pranav Rajpurkar 1125
23 Distributional semantics beyond words: Supervised learning of analogy and paraphrase Peter D. Turney 9999
24 WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia Daniel Hewlett, Alexandre Lacoste, Llion Jones, Illia Polosukhin, A... 9999
25 Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures Raffaella Bernardi, Ruket Cakici, Desmond Elliott, Aykut Erdem, Erk... 9999
26 A thorough examination of the cnn/daily mail reading comprehension task Danqi Chen, Jason Bolton, Christopher D Manning 9999
27 Learning to Compose Neural Networks for Question Answering Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 9999
28 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
29 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
30 Knowledge Base Population using Semantic Label Propagation Lucas Sterckx, Thomas Demeester, Johannes Deleu, Chris Develder 9999
31 A Survey of the Usages of Deep Learning in Natural Language Processing Daniel W. Otter, Julian R. Medina, Jugal K. Kalita 1181
32 Encode, Review, and Decode: Reviewer Module for Caption Generation Zhilin Yang, Ye Yuan, Yuexin Wu, Ruslan Salakhutdinov, William W Cohen 9999
33 Neural Information Retrieval: A Literature Review Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu... 1169
34 Construction and Querying of Large-scale Knowledge Bases Xiang Ren, Yu Su, Xifeng Yan 1151
35 Key-Value Memory Networks for Directly Reading Documents Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Ant... 9999
36 Multilingual Relation Extraction using Compositional Universal Schema Patrick Verga, David Belanger, Emma Strubell, Benjamin Roth, Andrew... 9999
37 Paraphrase-Driven Learning for Open Question Answering Anthony Fader, Luke Zettlemoyer, Oren Etzioni 9999
38 Comparing Convolutional Neural Networks to Traditional Models for Slot Filling Heike Adel, Benjamin Roth, Hinrich Schütze 9999
39 SRL, Semantic Parsing, Compositional Semantics 1 Mohit Bansal 1220
40 WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia Daniel Hewlett, Alexandre Lacoste, Llion Jones, Illia Polosukhin, A... 9999
41 Speech and Language Processing "Daniel Jurafsky, James H. Martin" 1252
42 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
43 Language+Vision Mohit Bansal 1338
44 Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation Albert Gatt, Emiel Krahmer 1136
45 Key-Value Memory Networks for Directly Reading Documents Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Ant... 9999
46 Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks Rajarshi Das, Arvind Neelakantan, David Belanger, Andrew McCallum 9999
47 Attributes as Semantic Units between Natural Language and Visual Recognition Marcus Rohrbach 9999
48 Dynamic Memory Networks for Visual and Textual Question Answering Caiming Xiong, Stephen Merity, Richard Socher 9999
49 Learning to Compose Neural Networks for Question Answering Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 9999
50 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183