View Project

Title:

TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension

Abstract:

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence documents, six per question on average, that provide high quality distant supervision for answering the questions. We show that, in comparison to other recently introduced large-scale datasets, TriviaQA (1) has relatively complex, compositional questions, (2) has considerable syntactic and lexical variability between questions and corresponding answer-evidence sentences, and (3) requires more cross sentence reasoning to find answers. We also present two baseline algorithms: a feature-based classifier and a state-of-the-art neural network, that performs well on SQuAD reading comprehension. Neither approach comes close to human performance (23% and 40% vs. 80%), suggesting that TriviaQA is a challenging test bed that is worth significant future study.

Actions

Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 awesome-qa seriousmac 1125
2 Question answering Sebastian Ruder 1031
3 Question answering | NLP-progress None
4 TriviaQA: A Large Scale Dataset for Reading Comprehension and Question Answering Mandar Joshi, Eunsol Choi, Daniel Weld, Luke Zettlemoyer 1126
5 Standardized Tests as benchmarks for Artificial Intelligence? Mrinmaya Sachan, Minjoon Seo, Hannaneh Hajishirzi, Eric P. Xing 1300
6 SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang 9999
7 Semantic Parsing 2, Question Answering Mohit Bansal 1125
8 Recent Evolution of QA Datasets and Going Forward Jiwoong Im 1126
9 Neural Approaches to Conversational AI: Question Answering, Task-Oriented Dialogue and Chatbots: A Unified View Jianfeng Gao, Michel Galley, Lihong Li 1141
10 Neural Approaches to Conversational {AI} Jianfeng Gao and Michel Galley and Lihong Li 1048
11 The Stanford Question Answering Dataset Pranav Rajpurkar 1125
12 Topics, Trends, and Resources in NLP Mohit Bansal 1065
13 NLP’s generalization problem, and how researchers are tackling it Ana Marasovic 1181
14 Learning to Compose Neural Networks for Question Answering Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 9999
15 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
16 Scalable Construction and Reasoning of Massive Knowledge Bases Xiang Ren, Nanyun Peng, William Yang Wang 1216
17 Encode, Review, and Decode: Reviewer Module for Caption Generation Zhilin Yang, Ye Yuan, Yuexin Wu, Ruslan Salakhutdinov, William W Cohen 9999
18 Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures Raffaella Bernardi, Ruket Cakici, Desmond Elliott, Aykut Erdem, Erk... 9999
19 Knowledge Base Population using Semantic Label Propagation Lucas Sterckx, Thomas Demeester, Johannes Deleu, Chris Develder 9999
20 Construction and Querying of Large-scale Knowledge Bases Xiang Ren, Yu Su, Xifeng Yan 1151
21 WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia Daniel Hewlett, Alexandre Lacoste, Llion Jones, Illia Polosukhin, A... 9999
22 Key-Value Memory Networks for Directly Reading Documents Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Ant... 9999
23 Paraphrase-Driven Learning for Open Question Answering Anthony Fader, Luke Zettlemoyer, Oren Etzioni 9999
24 Language+Vision Mohit Bansal 1338
25 SRL, Semantic Parsing, Compositional Semantics 1 Mohit Bansal 1220
26 Multilingual Relation Extraction using Compositional Universal Schema Patrick Verga, David Belanger, Emma Strubell, Benjamin Roth, Andrew... 9999
27 Learning to Compose Neural Networks for Question Answering Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 9999
28 Attributes as Semantic Units between Natural Language and Visual Recognition Marcus Rohrbach 9999
29 Recent Advances in Document Summarization Jin-ge Yao, Xiaojun Wan, Jianguo Xiao 1129
30 A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task Danqi Chen, Jason Bolton, Christopher D. Manning 9999
31 No time to read AI research? We summarized top 2018 papers for you Mariya Yao 1007
32 Dynamic Coattention Networks For Question Answering Caiming Xiong, Victor Zhong, Richard Socher 9999
33 10 Exciting Ideas of 2018 in NLP Sebastian Ruder 1201
34 Modern Deep Learning Techniques Applied to Natural Language Processing Elvis Saravia, Soujanya Poria 1183
35 MovieQA: Understanding Stories in Movies through Question-Answering Makarand Tapaswi, Yukun Zhu, Rainer Stiefelhagen, Antonio Torralba,... 9999
36 A large annotated corpus for learning natural language inference Samuel R Bowman, Gabor Angeli, Christopher Potts, Christopher D Man... 9999
37 Commonsense for Machine Intelligence: Text to Knowledge and Knowledge to Text Gerard de Melo, Niket Tandon and Aparna S. Varde 1216
38 Large-scale Simple Question Answering with Memory Networks Antoine Bordes, Nicolas Usunier, Sumit Chopra, Jason Weston 9999
39 Natural Language Inference, Reading Comprehension and Deep Learning Christopher Manning 1181
40 The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations Felix Hill, Antoine Bordes, Sumit Chopra, Jason Weston 9999
41 HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment Ivan Vulic?, Daniela Gerz, Douwe Kiela, Felix Hill, Anna Korhonen 9999
42 Don't count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors Marco Baroni, Georgiana Dinu, Germán Kruszewski 9999
43 Deep Compositional Question Answering with Neural Module Networks Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein 9999
44 A Survey on Deep Learning for Named Entity Recognition Li, Jing and Sun, Aixin and Han, Jianglei and Li, Chenliang 1089
45 Deep Unordered Composition Rivals Syntactic Methods for Text Classification Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, Hal Daumé III 9999
46 Deep Unordered Composition Rivals Syntactic Methods for Text Classification Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, Hal Daum’e III 9999
47 Constructing and Mining Web-scale Knowledge Graphs Evgeniy Gabrilovich, Nicolas Usunier 1257
48 Dialogue Learning With Human-In-The-Loop Jiwei Li, Alexander H Miller, Sumit Chopra, Marc'Aurelio Ranzato, J... 9999
49 Learning Executable Semantic Parsers for Natural Language Understanding Percy Liang 9999
50 Sentence Pair Scoring: Towards Unified Framework for Text Comprehension Petr Baudiš, Jan Šedivy? 9999