mBART

E435877

mBART is a multilingual sequence-to-sequence Transformer model designed for tasks like machine translation and text generation across many languages.

All labels observed (1)

Label Occurrences
mBART canonical 1

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf Transformer model
denoising autoencoder
multilingual sequence-to-sequence model
neural machine translation model
architectureType encoder-decoder
basedOn Transformer architecture
category large language model
multilingual language model
designedFor cross-lingual transfer
low-resource machine translation
developer Facebook AI NERFINISHED
Meta AI NERFINISHED
hasComponent Transformer decoder NERFINISHED
Transformer encoder
hasVariant mBART-25 NERFINISHED
mBART-50 NERFINISHED
implementedIn Hugging Face Transformers NERFINISHED
fairseq NERFINISHED
inputRepresentation language-specific tokens
shared subword vocabulary
inputType text
introducedIn research paper
languageCoverage multilingual
learningParadigm encoder-decoder pretraining
license Apache-2.0 (via common implementations)
notableProperty single model for many translation directions
strong performance on low-resource languages
optimizationAlgorithm Adam NERFINISHED
outputType text
paperTitle Multilingual Denoising Pre-training for Neural Machine Translation NERFINISHED
pretrainedOn large multilingual corpora
pretrainingType self-supervised learning
releaseYear 2020
supports many languages
supportsTask denoising
machine translation
sequence-to-sequence learning
summarization
text generation
trainingObjective denoising autoencoding
reconstructing original text from noisy input
typicalUse fine-tuning for specific translation directions
zero-shot translation
uses Transformer attention mechanisms
subword tokenization

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.