IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures

This is more of: how to implement DeepRL with workers in a distributed system?

I took a skim of this after reading the kickstarting DeepRL paper, which used this agent. Might take another look at this again later.