View Project


A Teacher-Student Framework for Zero-Resource Neural Machine Translation


While end-to-end neural machine translation (NMT) has made remarkable progress recently, it still suffers from the data scarcity problem for low-resource language pairs and domains. In this paper, we propose a method for zero-resource NMT by assuming that parallel sentence shave close probabilities of generating a sentence in a third language. Based on this assumption, our method is able to train a source-to-target NMT model (“student”) without parallel corpora available, guided by an existing pivot-to-target NMT model (“teacher”) on a source-pivot parallel corpus. Experimental results show that the proposed method significantly improves over a baseline pivot-based model by +3.0 BLEU points across various language pairs.


Login to edit or delete this resource.

Suggested Topics (up to Top 50)

Full Matches (full topic name in abstract)

Partial Matches (at least half of words topic name appear in abstract)

Suggested Resources

Uses abstract to search the content of resources available in Topics. Sorted by relevance.

# Title Author Topic Medium Score
1 Semi-Supervised Learning for Neural Machine Translation Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu 999 paper 201.20
2 Advances in Neural Machine Translation Rico Sennrich, Alexandra Birch, Marcin Junczys-Dowmunt 753 tutorial 173.71
3 Cross Lingual Information Retrieval Jian-Yun Nie 611 survey 156.48
4 Practical Neural Machine Translation Haddow Sennrich 753 tutorial 152.89
5 Tree-to-Sequence Attentional Neural Machine Translation Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka 999 paper 148.84
6 Tips on Building Neural Machine Translation Systems Graham Neubig 753 tutorial 142.66
7 Word Sense Disambiguation: A Survey Roberto Navigli 391 survey 137.63
8 A Technical Introduction to Statistical Natural Language Processing Jacob Eisenstein 133 survey 137.21
9 Natural Language Processing Jacob Eisenstein 711 survey 136.82
10 Neural Machine Translation and Sequence-to-sequence Models: A Tutorial Graham Neubig 999 paper 134.62
11 Natural Language Processing Jacob Eisenstein 711 survey 133.67
12 Natural Language Processing Jacob Eisenstein 711 survey 131.14
13 Neural Machine Translation Graham Neubig 753 tutorial 130.73
14 Computing with Word Senses Daniel Jurafsky, James H. Martin 513 survey 124.83
15 Search Engines Information Retrieval in Practice W. Bruce Croft, Donald Metzler, Trevor Strohman 612 survey 122.07
16 A survey of transfer learning Karl Weiss, Taghi M. Khoshgoftaar and DingDing Wang 978 resource 120.20
17 Machine Learning for NLP Charu C. Aggarwal 711 survey 119.81
18 Deep Learning Yoshua Bengio 711 tutorial 119.49
19 Speech and Language Processing Daniel Jurafsky, James H. Martin 133 survey 119.43
20 Large-scale Paraphrasing for Natural Language Generation Chris Callison-Burch 452 lecture 118.40
21 Natural Language Processing with Python Steven Bird, Ewan Klein, Edward Loper 132 survey 117.91
22 Neural Information Retrieval: At the End of the Early Years Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md Mustafizu... 713 resource 117.39
23 Reinforcement Learning: An Introduction (2nd ed) Richard S. Sutton and Andrew G. Barto 857 survey 115.28
24 Representations for Language: From Word Embeddings to Sentence Meanings Christopher Manning 721 tutorial 115.21
25 Representations for Language: From Word Embeddings to Sentence Meanings Christopher Manning 721 tutorial 115.18
26 Reinforcement Learning: An Introduction Richard S. Sutton, Andrew G. Barto 857 survey 114.87
27 The Elements of Automatic Summarization Daniel Jacob Gillick 421 survey 114.79
28 A tutorial survey of architectures, algorithms, and applications for deep learning Li Deng survey 113.05
29 Endangered Languages Richard Littauer survey 110.88
30 High-Performance Hardware for Machine Learning William Dally 134 tutorial 110.10
31 Data Mining Ian Witten, Eibe Frank 107 survey 108.14
32 Prototype Synthesis for Model Laws Matthew Burgess, Eugenia Giraudy, Eytan Adar 999 paper 108.05
33 Natural Language Data Management and Interfaces Yunyao Li, Davood Rafiei 974 tutorial 107.77
34 Embeddings for Word Sense Disambiguation: An Evaluation Study Ignacio Iacobacci, Mohammad Taher Pilehvar, Roberto Navigli 999 paper 106.00
35 Auto-sklearn: Efficient and Robust Automated Machine Learning Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Tobias S... 107 survey 105.80
36 Gimli: open source and high-performance biomedical name recognition David Campos, Sergio Matos, Jose Oliveira 999 paper 104.23
37 Align, Disambiguate and Walk: A Unified Approach for Measuring Semantic Similarity Mohammad Taher Pilehvar, David Jurgens, Roberto Navigli 999 paper 104.20
38 Artificial Intelligence and Games Georgios N. Yannakakis and Julian Togelius 825 survey 103.82
39 Machine Learning, Neural and Statistical Classification D. Michie, D.J. Spiegelhalter, C.C. Taylor 54 survey 102.55
40 Statistical Language Models for Text Data Retrieval and Analysis Zhongyu Wei, ChengXiang Zhai 211 tutorial 100.60
41 Information Theory, Inference, and Learning Algorithm David J. C. MacKay 711 survey 97.65
42 MixKMeans: Clustering Question-Answer Archives Deepak P 999 paper 97.58
43 Lecture 4: Lexical Semantics Kevin Gimpel 28 lecture 97.38
44 Computer Age Statistical Inference Bradley Efron, Trevor Hastie 364 survey 97.32
45 KnowNet: Building a Large Net of Knowledge from the Web Montse Cuadros, German Rigau 999 paper 96.49
46 Lexicons for Sentiment and Affect Extraction Daniel Jurafsky, James H. Martin 382 survey 95.89
47 Advanced Data Analysis from an Elementary Point of View Cosma Rohilla Shalizi 123 survey 95.66
48 Open-Domain Question Answering Mark Andrew Greenwood 411 survey 95.32
49 Sentiment Analysis in Practice Yongzheng (Tiger) Zhang, Dan Shen, Catherine Baudin 381 tutorial 94.79
50 Recurrent Memory Networks for Language Modeling Ke Tran, Arianna Bisazza, Christof Monz 999 paper 94.51