Commits

Branch selector

 master

User selector

summer-yue

Datepicker

All time

Commit History

Commits on Sep 20, 2021

• Add testing for Reverb observers using the real reverb client and writer.

  Show description for cc8036f
  

  summer-yue

  authored and

  copybara-github

  committed
  cc8036f

  Copy full SHA for cc8036f

Commits on Sep 17, 2021

• Convert history to trajectory column when writing in episodic replay buffer.

  Show description for 3cd7a16
  

  summer-yue

  authored and

  copybara-github

  committed
  3cd7a16

  Copy full SHA for 3cd7a16

Commits on Sep 1, 2021

• Fix bug in PPO advantage normalization.

  Show description for c957dea
  

  summer-yue

  authored and

  copybara-github

  committed
  c957dea

  Copy full SHA for c957dea

Commits on Aug 27, 2021

• Make env_name a FLAG for distributed examples instead of gin configured.

  Show description for a11854c
  

  summer-yue

  authored and

  copybara-github

  committed
  a11854c

  Copy full SHA for a11854c

Commits on Aug 25, 2021

• Add metric aggregator to TFA example for combining distribution evaluation metrics.

  Show description for c979f7b
  

  summer-yue

  authored and

  copybara-github

  committed
  c979f7b

  Copy full SHA for c979f7b

Commits on Aug 10, 2021

• Update README for using the new checkpoint based evaluator (as opposed to Reverb VC based).

  Show description for 65fe999
  

  summer-yue

  authored and

  copybara-github

  committed
  65fe999

  Copy full SHA for 65fe999

• Set up checkpoint based eval job (instead of relying on VC)

  Show description for 4648fcd
  

  summer-yue

  authored and

  copybara-github

  committed
  4648fcd

  Copy full SHA for 4648fcd

Commits on Aug 2, 2021

• Skip interleaving dataset optimizations when cycle_length==1 in reverb RB.

  Show description for 80e0eab
  

  summer-yue

  authored and

  copybara-github

  committed
  80e0eab

  Copy full SHA for 80e0eab

Commits on Jul 16, 2021

• Add note on caveat of episodic observer.

  Show description for 3787bad
  

  summer-yue

  authored and

  copybara-github

  committed
  3787bad

  Copy full SHA for 3787bad

Commits on Jun 3, 2021

• Explain how the number of training steps is calculated in PPO README.

  Show description for 12f0bb7
  

  summer-yue

  authored and

  copybara-github

  committed
  12f0bb7

  Copy full SHA for 12f0bb7

Commits on May 25, 2021

• Better error handling in PPOLearner.

  Show description for 717c10b
  

  summer-yue

  authored and

  copybara-github

  committed
  717c10b

  Copy full SHA for 717c10b

Commits on May 24, 2021

• Rename PPOLearner.num_batches to num_samples to de-confuse with the number of mini batches use with training.

  Show description for 35137a4
  

  summer-yue

  authored and

  copybara-github

  committed
  35137a4

  Copy full SHA for 35137a4

Commits on May 21, 2021

• Adjust reverb signature in SAC example to be compatible with new Reverb writer.

  Show description for 28341f9
  

  summer-yue

  authored and

  copybara-github

  committed
  28341f9

  Copy full SHA for 28341f9

Commits on May 18, 2021

• [TF-Agents] Avoid setting tf.config.set_device_placement if it's already set.

  Show description for c1394c3
  

  summer-yue

  authored and

  copybara-github

  committed
  c1394c3

  Copy full SHA for c1394c3

• Add option to flush the writer from the observers.

  Show description for 3653d55
  

  summer-yue

  authored and

  copybara-github

  committed
  3653d55

  Copy full SHA for 3653d55

Commits on May 13, 2021

• Only write items in Reverb when there's data appended in the writer.

  Show description for 71085f3
  

  summer-yue

  authored and

  copybara-github

  committed
  71085f3

  Copy full SHA for 71085f3

• Adjust reverb signature in SAC example to be compatible with new Reverb writer.

  Show description for 3acfd0f
  

  summer-yue

  authored and

  copybara-github

  committed
  3acfd0f

  Copy full SHA for 3acfd0f

Commits on Apr 28, 2021

• Fully align PPO sequential network setup with the legacy actor distribution setup.

  Show description for 58ca29e
  

  summer-yue

  authored and

  copybara-github

  committed
  58ca29e

  Copy full SHA for 58ca29e

Commits on Apr 22, 2021

• Use the current user as the group owner for reverb checkpointing.

  Show description for 79a17f4
  

  summer-yue

  authored and

  copybara-github

  committed
  79a17f4

  Copy full SHA for 79a17f4

Commits on Apr 21, 2021

• Always use batch-wise advantage normalization for PPO.

  Show description for c082b1a
  

  summer-yue

  authored and

  copybara-github

  committed
  c082b1a

  Copy full SHA for c082b1a

Commits on Apr 20, 2021

• Use the current user as the group owner for reverb checkpointing.

  Show description for beaec4a
  

  summer-yue

  authored and

  copybara-github

  committed
  beaec4a

  Copy full SHA for beaec4a

Commits on Apr 1, 2021

• Add ReverbCheckpointTrigger and enable checkpointing the replay buffer periodically in the SAC example.

  Show description for e436726
  

  summer-yue

  authored and

  copybara-github

  committed
  e436726

  Copy full SHA for e436726

Commits on Feb 10, 2021

• Use sequential network in PPO examples and the learner unit test.

  Show description for 5a49b32
  

  summer-yue

  authored and

  copybara-github

  committed
  5a49b32

  Copy full SHA for 5a49b32

Commits on Jan 26, 2021

• Add an optional callback in the distributed eval job to enable optional reporting.

  Show description for a20ba47
  

  summer-yue

  authored and

  copybara-github

  committed
  a20ba47

  Copy full SHA for a20ba47

Commits on Jan 14, 2021

• Use trajectory observer with padding for DQN RNN example.

  Show description for 07ceb30
  

  summer-yue

  authored and

  copybara-github

  committed
  07ceb30

  Copy full SHA for 07ceb30

• Support padding for ReverbAddTrajectoryObserver and better align observer interface.

  Show description for 1ac788d
  

  summer-yue

  authored and

  copybara-github

  committed
  1ac788d

  Copy full SHA for 1ac788d

Commits on Jan 13, 2021

• Internal change.

  Show description for 25df53c
  

  summer-yue

  authored and

  copybara-github

  committed
  25df53c

  Copy full SHA for 25df53c

• Reinforce agent bug fix on conversion from dict to ReinforceAgentLossInfo.

  Show description for 69eaf37
  

  summer-yue

  authored and

  copybara-github

  committed
  69eaf37

  Copy full SHA for 69eaf37

Commits on Dec 29, 2020

• API changes for ReverbAddEpisodeObserver to better align observer interface.

  Show description for b2ed02d
  

  summer-yue

  authored and

  copybara-github

  committed
  b2ed02d

  Copy full SHA for b2ed02d

Commits on Dec 27, 2020

• Move Schulman specific libraries to Schulman 17 folder.

  Show description for fb0410d
  

  summer-yue

  authored and

  copybara-github

  committed
  fb0410d

  Copy full SHA for fb0410d

Commits on Dec 8, 2020

• Add Atari DQN gin configs for Pong and Breakout with terminating on life loss (aligning with paper).

  Show description for d9bbb85
  

  summer-yue

  authored and

  copybara-github

  committed
  d9bbb85

  Copy full SHA for d9bbb85

Commits on Dec 4, 2020

• Move checkpoint creation to under the strategy scope. This bug was crashing TPU examples in the case of preemption.

  Show description for d18c2ff
  

  summer-yue

  authored and

  copybara-github

  committed
  d18c2ff

  Copy full SHA for d18c2ff

Commits on Nov 25, 2020

• Opensource DQN actor/learner examples (including CartPole, Mnih15 and RNN).

  Show description for 635af30
  

  summer-yue

  authored and

  copybara-github

  committed
  635af30

  Copy full SHA for 635af30

Commits on Nov 24, 2020

• Documentation to discourage manually disabling checkpointing from the learners.

  Show description for 31726cb
  

  summer-yue

  authored and

  copybara-github

  committed
  31726cb

  Copy full SHA for 31726cb

• Do not write initial policies from PolicySavedModelTrigger if they exist already.

  Show description for b456ce8
  

  summer-yue

  authored and

  copybara-github

  committed
  b456ce8

  Copy full SHA for b456ce8

Pagination

Previous

Next