Noam Shazeer

E457852

Noam Shazeer is an AI researcher and engineer best known as a co-creator of the Transformer architecture and a key contributor to large-scale neural language models.

All labels observed (1)

Label Occurrences
Noam Shazeer canonical 3

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf artificial intelligence researcher
computer scientist
person
software engineer
coAuthorOf Attention Is All You Need NERFINISHED
Exploring the Limits of Language Modeling NERFINISHED
On Layer Normalization in the Transformer Architecture NERFINISHED
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer NERFINISHED
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity NERFINISHED
coAuthorWith Aidan N. Gomez NERFINISHED
Ashish Vaswani NERFINISHED
Illia Polosukhin NERFINISHED
Jakob Uszkoreit NERFINISHED
Llion Jones NERFINISHED
Niki Parmar NERFINISHED
Łukasz Kaiser NERFINISHED
contributedTo Google’s large-scale language models
Transformer architecture
developed Sparsely-Gated Mixture-of-Experts layer NERFINISHED
Switch Transformer architecture NERFINISHED
educatedAt Brown University
employer Google
Google Brain NERFINISHED
Google Research NERFINISHED
fieldOfWork artificial intelligence
large language models
machine learning
natural language processing
gender male
knownFor Mixture-of-Experts models NERFINISHED
Sparsely-Gated Mixture-of-Experts layer NERFINISHED
Switch Transformer NERFINISHED
Tensor Processing Unit software contributions
co-creating the Transformer architecture
contributions to large-scale neural language models
work on attention mechanisms in neural networks
nationality American
notableWork Sparsely-Gated Mixture-of-Experts layer NERFINISHED
Switch Transformer model NERFINISHED
Transformer architecture NERFINISHED
positionHeld research scientist at Google
researchInterest efficient training of large models
neural network architectures
scaling laws for neural networks
sequence modeling

How these facts were elicited

Referenced by (3)

Full triples — surface form annotated when it differs from this entity's canonical label.

Transformer introducedBy Noam Shazeer
Lukasz Kaiser notableStudent Noam Shazeer
subject surface form: Łukasz Kaiser
Lukasz Kaiser collaboratedWith Noam Shazeer
subject surface form: Łukasz Kaiser