T5

E435867

T5 is a Transformer-based text-to-text language model developed by Google that treats every NLP task as converting input text to output text.

All labels observed (1)

Label Occurrences
T5 canonical 3

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf Transformer-based model
neural language model
text-to-text model
abbreviationOf Text-to-Text Transfer Transformer NERFINISHED
basedOn Transformer architecture
citationVenue Journal of Machine Learning Research NERFINISHED
developer Google
Google Research NERFINISHED
frameworkImplementation JAX NERFINISHED
TensorFlow NERFINISHED
hasVariant T5-11B NERFINISHED
T5-3B NERFINISHED
T5-Base NERFINISHED
T5-Large NERFINISHED
T5-Small NERFINISHED
inputFormat text
inspired unified text-to-text framework for NLP
introducedBy Adam Roberts NERFINISHED
Colin Raffel NERFINISHED
Katherine Lee NERFINISHED
Michael Matena NERFINISHED
Noam Shazeer NERFINISHED
Peter J. Liu NERFINISHED
Sharan Narang NERFINISHED
Wei Li NERFINISHED
Yanqi Zhou NERFINISHED
language English
license Apache License 2.0
modelType encoder-decoder
openSource true
optimizationGoal transfer learning across NLP tasks
pretrainingObjective denoising autoencoding
span corruption
publicationTitle Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer NERFINISHED
publicationYear 2019
releasedYear 2019
supportsFineTuning true
supportsTask machine translation
natural language inference
question answering
summarization
text classification
text generation
trainingData Colossal Clean Crawled Corpus NERFINISHED
treatsEveryNLPTasAs text-to-text problem
usesDecoder Transformer decoder NERFINISHED
usesEncoder Transformer encoder NERFINISHED

How these facts were elicited

Referenced by (3)

Full triples — surface form annotated when it differs from this entity's canonical label.