IMPALA

E428323

IMPALA is a scalable deep reinforcement learning architecture designed for efficient distributed training of agents across many tasks and environments.

All labels observed (1)

Label Occurrences
IMPALA canonical 1

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf deep reinforcement learning architecture
distributed reinforcement learning system
scalable RL architecture
affiliation DeepMind Technologies NERFINISHED
architectureType actor-critic
citationVenue ICML 2018 NERFINISHED
comparedWith A2C NERFINISHED
A3C NERFINISHED
contribution demonstrated scalable distributed deep RL with stable learning
designedFor distributed training of agents
multi-task reinforcement learning
scalable deep reinforcement learning
developedBy DeepMind NERFINISHED
enables training with thousands of actors
evaluationDomain Atari NERFINISHED
DeepMind Lab NERFINISHED
multi-task environments
field artificial intelligence
deep learning
reinforcement learning
fullName Importance Weighted Actor-Learner Architectures NERFINISHED
handles large-scale distributed training
off-policy data
policy lag between actors and learner
hasAlgorithm V-trace NERFINISHED
improves data efficiency
scalability
throughput
keyIdea decouple acting from learning via distributed actors and a central learner
use importance weighting to correct for policy lag
language implemented primarily in TensorFlow in the original work
notableComponent V-trace off-policy correction algorithm NERFINISHED
optimizationMethod policy gradient
value-based learning
outperforms A2C on large-scale multi-task benchmarks
A3C on large-scale multi-task benchmarks NERFINISHED
paperTitle IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures NERFINISHED
publishedIn International Conference on Machine Learning NERFINISHED
supports large-scale experiments
many tasks and environments
multi-task learning
uses V-trace NERFINISHED
actor-learner architecture
centralized learner
distributed actors
off-policy correction
yearIntroduced 2018

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.

A3C inspiredAlgorithms IMPALA