Sequence to Sequence Learning with Neural Networks

E260048

"Sequence to Sequence Learning with Neural Networks" is a seminal 2014 paper that introduced the sequence-to-sequence (seq2seq) neural network framework for tasks like machine translation, laying the groundwork for many modern NLP models.

All labels observed (1)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf machine learning paper
neural networks paper
scientific paper
affiliationOfAuthors Google
approach encoder-decoder architecture
recurrent neural networks
author Ilya Sutskever
Oriol Vinyals
Quoc V. Le
citationStatus highly cited
conference NeurIPS
surface form: Neural Information Processing Systems 2014
demonstratedOn English-to-French machine translation
WMT English-French dataset
field deep learning
machine learning
natural language processing
firstAuthor Ilya Sutskever
impact foundational work for modern neural sequence modeling
influenceOn Transformer-based models
attention-based sequence models
encoder-decoder architectures in deep learning
neural machine translation
sequence-to-sequence models in NLP
speech recognition sequence models
text summarization models
keyIdea map variable-length input sequences to variable-length output sequences
train encoder and decoder jointly to maximize conditional probability of target sequence
use a fixed-length vector representation of the input sequence
mainContribution application of encoder-decoder RNNs to sequence transduction tasks
demonstration of neural machine translation with RNN encoder-decoder
introduction of the sequence-to-sequence neural network framework
organization Google
publicationYear 2014
publishedIn NeurIPS
surface form: Advances in Neural Information Processing Systems

NeurIPS
surface form: NeurIPS 2014
publisher NeurIPS
surface form: Neural Information Processing Systems Foundation
relatedConcept encoder-decoder RNN
neural machine translation
sequence modeling
result achieved state-of-the-art performance on English-French translation at time of publication
task machine translation
sequence transduction
sequence-to-sequence learning
technique reversing the order of words in the source sentence
use of beam search for decoding
use of multi-layer LSTMs
title Sequence to Sequence Learning with Neural Networks self-link
usesModel LSTM decoder
LSTM encoder
LSTM networks
surface form: Long Short-Term Memory network

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Quoc V. Le coAuthorOf Sequence to Sequence Learning with Neural Networks
Oriol Vinyals notableWork Sequence to Sequence Learning with Neural Networks
Sequence to Sequence Learning with Neural Networks title Sequence to Sequence Learning with Neural Networks self-link