Wav2Vec2

E435883

Wav2Vec2 is a self-supervised deep learning model for automatic speech recognition that learns powerful audio representations directly from raw waveforms.

All labels observed (1)

Label Occurrences
Wav2Vec2 canonical 1

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf automatic speech recognition model
deep learning model
self-supervised learning model
speech representation learning model
achievesStateOfTheArtOn LibriSpeech 100h setting (at time of publication)
availableVia Hugging Face Transformers NERFINISHED
basedOn convolutional neural networks
transformer architecture
developedBy Facebook AI Research NERFINISHED
Meta AI NERFINISHED
domain audio representation learning
speech processing
fineTuningDataType labeled speech with transcripts
hasComponent convolutional feature encoder
quantization module
transformer context network
hasVariant XLSR-53 NERFINISHED
wav2vec 2.0 Base NERFINISHED
wav2vec 2.0 Large NERFINISHED
wav2vec 2.0 XLSR NERFINISHED
implementedIn Fairseq NERFINISHED
PyTorch NERFINISHED
inputType 16 kHz mono audio
inspired HuBERT NERFINISHED
WavLM NERFINISHED
introducedIn 2020
introducedInPaper wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations NERFINISHED
languageCoverage English
multilingual (via XLSR variants)
learningParadigm contrastive learning
self-supervised learning
operatesOn raw audio waveforms
outperforms previous self-supervised speech models on LibriSpeech
paperAuthors Abdelrahman Mohamed NERFINISHED
Alexei Baevski NERFINISHED
Henry Zhou NERFINISHED
Michael Auli NERFINISHED
pretrainingDataType unlabeled speech audio
publishedAtConference NeurIPS 2020 NERFINISHED
releasedAs open-source model
supportsTask keyword spotting
speech classification
speech recognition fine-tuning
task automatic speech recognition
trainingStrategy pretrain-then-finetune
usesMasking time-step masking on latent speech representations
usesObjective contrastive loss
masked prediction

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.