OPT

E435873

OPT is a family of open-source large language models developed by Meta AI, designed as efficient, GPT-style transformer models for natural language processing tasks.

All labels observed (1)

Label Occurrences
OPT canonical 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf autoregressive language model
large language model family
basedOn GPT-style architecture
codeRepositoryHost GitHub NERFINISHED
codeRepositoryOrganization facebookresearch NERFINISHED
comparisonTarget OpenAI GPT-3 NERFINISHED
designGoal efficient GPT-style model
open-source alternative to GPT-3
developer Meta AI NERFINISHED
Meta Platforms NERFINISHED
hasPaper OPT: Open Pre-trained Transformer Language Models NERFINISHED
includesVariant OPT-1.3B
OPT-125M
OPT-13B
OPT-175B NERFINISHED
OPT-2.7B
OPT-30B NERFINISHED
OPT-350M NERFINISHED
OPT-6.7B
OPT-66B
intendedUse benchmarking against GPT-3
downstream NLP applications
research
language English
largestModel OPT-175B NERFINISHED
license custom Meta license
modelArchitecture transformer
modelType decoder-only transformer
openSource true
organization Meta AI NERFINISHED
paperArchive arXiv NERFINISHED
paperArxivId 2205.01068
parameterRange 125M–175B parameters
releaseDate 2022-05
supportsFineTuning true
supportsInferencePrecision BF16
FP16
supportsPrompting true
supportsTask classification via prompting
dialogue modeling
language modeling
question answering
summarization
text completion
text generation
trainingComputeOptimization efficiency-focused implementation
trainingDataSource licensed text data
publicly available text data
trainingObjective causal language modeling

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.