Helmholtz machine

E260031

The Helmholtz machine is a pioneering generative neural network model that learns internal representations by using separate recognition and generative pathways to perform unsupervised learning.

All labels observed (2)

Label Occurrences
Helmholtz machine canonical 1
wake-sleep algorithm 1

How this entity was disambiguated

Statements (44)

Predicate Object
instanceOf generative neural network model
latent variable model
probabilistic generative model
unsupervised learning model
comparedTo Boltzmann machines
surface form: Boltzmann machine

autoencoder
field artificial neural networks
computational neuroscience
machine learning
goal learn generative model of data
model sensory data distribution
perform approximate Bayesian inference
hasAdvantage biologically plausible learning scheme
separate pathways for inference and generation
hasArchitecture layered stochastic neural network
top-down generative model with bottom-up recognition model
hasComponent generative network
recognition network
hasConcept sleep phase updates recognition weights
wake phase updates generative weights
hasLearningType unsupervised learning
hasLimitation approximate inference quality depends on recognition network
training can be difficult
hasProperty approximate inference
bottom-up recognition connections
energy-based interpretation
hierarchical structure
learns internal representations
separate recognition and generative pathways
stochastic latent variables
top-down generative connections
hasTrainingObjective maximize data likelihood approximately
minimize divergence between recognition and generative distributions
inspired modern deep generative models
variational autoencoders
surface form: variational autoencoder
namedAfter Hermann von Helmholtz
trainedBy sleep phase
wake phase
usedFor density estimation
representation learning
unsupervised feature extraction
uses local learning rules
stochastic units
usesLearningRule Helmholtz machine self-linksurface differs
surface form: wake-sleep algorithm

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Terrence Sejnowski knownFor Helmholtz machine
Helmholtz machine usesLearningRule Helmholtz machine self-linksurface differs
this entity surface form: wake-sleep algorithm