SAC

E426679

SAC (Soft Actor-Critic) is a popular off-policy deep reinforcement learning algorithm that optimizes both expected return and policy entropy to achieve stable and efficient learning in continuous control tasks.

All labels observed (1)

Label Occurrences
SAC canonical 2

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf deep reinforcement learning algorithm
deep reinforcement learning algorithm
off-policy reinforcement learning algorithm
off-policy reinforcement learning algorithm
abbreviation SAC NERFINISHED
advantageOverDeterministicMethods better exploration via entropy maximization
aimsFor sample-efficient learning
stable learning
canBe model-free
category actor-critic methods
commonlyEvaluatedOn MuJoCo benchmarks NERFINISHED
OpenAI Gym continuous control tasks
comparedWith DDPG NERFINISHED
TD3 NERFINISHED
criticUpdateBasedOn soft Bellman backup
firstPublishedIn "Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor" NERFINISHED
fullName Soft Actor-Critic NERFINISHED
hasVariant automatic entropy tuning SAC
discrete SAC
implementedIn PyTorch NERFINISHED
TensorFlow NERFINISHED
introducedIn 2018
is maximum entropy reinforcement learning method
laterExtendedIn "Soft Actor-Critic Algorithms and Applications" NERFINISHED
learningSignal temporal-difference error
objectiveIncludes temperature parameter
optimizationObjective expected return
policy entropy
policyOutput distribution over continuous actions
policyType stochastic policy
policyUpdateBasedOn reparameterization trick
proposedBy Aurick Zhou NERFINISHED
Pieter Abbeel NERFINISHED
Sergey Levine NERFINISHED
Tuomas Haarnoja NERFINISHED
sampleEfficiency high
supports continuous action spaces
temperatureParameterControls entropy-returns trade-off
trainingStability high
typicalDomain continuous control tasks
updateStyle off-policy updates
usedIn autonomous driving research
manipulation tasks
robotics control
uses actor-critic architecture
entropy regularization
replay buffer
target networks
valueFunctionType soft Q-function

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.