Elmo

E214835

Elmo is a deep contextualized word representation model for natural language processing that captures complex characteristics of word use and syntax across different linguistic contexts.

All labels observed (1)

Label Occurrences
Elmo canonical 2

How this entity was disambiguated

Statements (43)

Predicate Object
instanceOf deep contextualized word representation model
language model
natural language processing model
neural network model
appliedTo named entity recognition
question answering
sentiment analysis
textual entailment
basedOn bidirectional LSTM
captures complex characteristics of word use
context-dependent word meaning
semantic information
syntactic information
category contextual word embedding
combines internal states of a deep bidirectional language model
contrastsWith static word embeddings
developedBy Allen Institute for Artificial Intelligence
University of Washington
hasFullName Embeddings from Language Models
improves performance on downstream NLP tasks
influenced BERT
GPT
contextual word embedding research
introducedBy Christopher Clark
Kenton Lee
Luke Zettlemoyer
Mark Neumann
Matt Gardner
Matthew E. Peters
Mohit Iyyer
introducedInPaper Deep contextualized word representations
introducedYear 2018
language English
optimizedFor sentence-level classification tasks
sequence labeling tasks
produces contextualized word embeddings
provides deep contextualized word representations
publishedAtConference NAACL 2018
releasedAs pretrained model
represents words in context
trainedOn large text corpora
uses character-level CNN inputs
usesArchitecture bidirectional language model

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.