HuBERT

E435884

HuBERT is a self-supervised speech representation learning model that learns powerful audio features from unlabeled speech for tasks like automatic speech recognition and audio classification.

All labels observed (1)

Label Occurrences
HuBERT canonical 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf deep learning model
self-supervised speech representation learning model
speech foundation model
basedOn Transformer architecture
designedFor audio classification
automatic speech recognition
downstream speech tasks
self-supervised learning from speech
speech representation learning
spoken language understanding
developedBy Facebook AI Research NERFINISHED
Meta AI NERFINISHED
evaluationBenchmark Libri-light NERFINISHED
LibriSpeech NERFINISHED
TIMIT NERFINISHED
hasAuthor Benjamin Bolte NERFINISHED
James Glass NERFINISHED
Kyunghyun Cho NERFINISHED
Wei-Ning Hsu NERFINISHED
Yao-Hung Hubert Tsai NERFINISHED
hasVariant HuBERT Base NERFINISHED
HuBERT Large NERFINISHED
HuBERT X-Large NERFINISHED
improvesOver wav2vec 2.0 on several speech benchmarks
inputType acoustic features such as log-mel filterbanks
raw audio waveforms
introducedIn 2021
introducedInPaper HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units NERFINISHED
language primarily English in original experiments
learningSignalSource discrete units obtained by clustering MFCC or filterbank features
maskingStrategy masking of contiguous time spans in the input sequence
openSourceImplementation Hugging Face Transformers NERFINISHED
fairseq NERFINISHED
outputType contextualized speech representations
frame-level audio embeddings
pretrainingStage masked region prediction of cluster assignments
offline clustering of acoustic features
publishedAt Interspeech 2021 NERFINISHED
relatedTo Data2Vec NERFINISHED
WavLM NERFINISHED
wav2vec 2.0 NERFINISHED
supportsTask audio event classification
automatic speech recognition fine-tuning
emotion recognition from speech
keyword spotting
phoneme recognition
speaker recognition
trainingDataType unlabeled speech audio
trainingParadigm self-supervised learning
usesObjective cluster-based prediction task
masked prediction of latent speech units

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.