Commits

Branch selector

 master

User selector

summer-yue

Datepicker

All time

Commit History

Commits on Jul 31, 2020

• Remove confusing arg allow_multiple_sequences from public actor/learner API

  Show description for 3e892d3
  

  summer-yue

  authored and

  copybara-github

  committed
  3e892d3

  Copy full SHA for 3e892d3

Commits on Jul 21, 2020

• Use dtype.min instead of neg inf for masked logits.

  Show description for 7742d80
  

  summer-yue

  authored and

  copybara-github

  committed
  7742d80

  Copy full SHA for 7742d80

Commits on Jul 16, 2020

• Get rid of NaNs in kl penalty losses in the presence of masked networks.

  Show description for c4cdcb3
  

  summer-yue

  authored and

  copybara-github

  committed
  c4cdcb3

  Copy full SHA for c4cdcb3

Commits on Jul 8, 2020

• Simplify TD3Agent by removing DDPG specific DQDA logic for actor loss.

  Show description for 18f12c7
  

  summer-yue

  authored and

  copybara-github

  committed
  18f12c7

  Copy full SHA for 18f12c7

Commits on Jul 1, 2020

• Better documentation on caveats with normalize_observation for PPO.

  Show description for 0c1be8b
  

  summer-yue

  authored and

  copybara-github

  committed
  0c1be8b

  Copy full SHA for 0c1be8b

Commits on Jun 30, 2020

• Make DDPG actor_network's kernel initializer configurable.

  Show description for 3247402
  

  summer-yue

  authored and

  copybara-github

  committed
  3247402

  Copy full SHA for 3247402

Commits on Jun 29, 2020

• Support sampled_weights as a python scalar float.

  Show description for 42799f7
  

  summer-yue

  authored and

  copybara-github

  committed
  42799f7

  Copy full SHA for 42799f7

• Support broadasting sampled_weights in common.aggregate_losses.

  Show description for 07d25df
  

  summer-yue

  authored and

  copybara-github

  committed
  07d25df

  Copy full SHA for 07d25df

Commits on Jun 26, 2020

• Let common.aggregate_losses support [B,T] inputs in addition to [B].

  Show description for 1c6a8f1
  

  summer-yue

  authored and

  copybara-github

  committed
  1c6a8f1

  Copy full SHA for 1c6a8f1

• Remove dimension augmentation in SAC agent to scale alpha loss properly.

  Show description for 6f3a917
  

  summer-yue

  authored and

  copybara-github

  committed
  6f3a917

  Copy full SHA for 6f3a917

• Remove outdated TODO in td3_agent.

  Show description for ea63eb1
  

  summer-yue

  authored and

  copybara-github

  committed
  ea63eb1

  Copy full SHA for ea63eb1

Commits on Jun 24, 2020

• Add clarifying note to doc string for drivers.

  Show description for 029bb3f
  

  summer-yue

  authored and

  copybara-github

  committed
  029bb3f

  Copy full SHA for 029bb3f

Commits on Jun 23, 2020

• Align PPO gradient clipping with Schulman 17.

  Show description for c59fcfb
  

  summer-yue

  authored and

  copybara-github

  committed
  c59fcfb

  Copy full SHA for c59fcfb

Commits on Jun 19, 2020

• Add option to update the normalizers outside of PPO agent.

  Show description for d1810dc
  

  summer-yue

  authored and

  copybara-github

  committed
  d1810dc

  Copy full SHA for d1810dc

Commits on Jun 17, 2020

• Learning rate annealing and orthogonal initialization in PPO.

  Show description for 6d3a469
  

  summer-yue

  authored and

  copybara-github

  committed
  6d3a469

  Copy full SHA for 6d3a469

Commits on Jun 13, 2020

• Fix PPO reward normalization NaN bug.

  Show description for 701a099
  

  summer-yue

  authored and

  copybara-github

  committed
  701a099

  Copy full SHA for 701a099

Commits on May 26, 2020

• Update PPO Agent to support training experiences with sequence length 1.

  Show description for ab412d7
  

  summer-yue

  authored and

  copybara-github

  committed
  ab412d7

  Copy full SHA for ab412d7

Commits on May 8, 2020

• Add get_metadata method in py tf eager policy.

  Show description for 3e1c4d2
  

  summer-yue

  authored and

  copybara-github

  committed
  3e1c4d2

  Copy full SHA for 3e1c4d2

Commits on May 7, 2020

• Add the option to save metadata in PolicySaver.

  Show description for adee9f5
  

  summer-yue

  authored and

  copybara-github

  committed
  adee9f5

  Copy full SHA for adee9f5

Commits on Apr 29, 2020

• Remove outdated copy() function from Policies colab.

  Show description for dc4224f
  

  summer-yue

  authored and

  copybara-github

  committed
  dc4224f

  Copy full SHA for dc4224f

• Bug fix in PPO value clipping to use the saved value prediction.

  Show description for 1a89d94
  

  summer-yue

  authored and

  copybara-github

  committed
  1a89d94

  Copy full SHA for 1a89d94

Commits on Apr 24, 2020

• Add optional preprocessing to tf_agent and PPO Agents.

  Show description for 4b4a089
  

  summer-yue

  authored and

  copybara-github

  committed
  4b4a089

  Copy full SHA for 4b4a089

Commits on Apr 22, 2020

• Bug fix in ppo_policy for stateless value net + stateful policy net edge case.

  Show description for f958f01
  

  summer-yue

  authored and

  copybara-github

  committed
  f958f01

  Copy full SHA for f958f01

Commits on Apr 21, 2020

• Add the option for value clipping in PPO agents.

  Show description for 5846587
  

  summer-yue

  authored and

  copybara-github

  committed
  5846587

  Copy full SHA for 5846587

Commits on Apr 15, 2020

• Add an option to perform PPO value calculation at collection time.

  Show description for c195b6a
  

  summer-yue

  authored and

  copybara-github

  committed
  c195b6a

  Copy full SHA for c195b6a

Commits on Apr 7, 2020

• Modify distribution seed stream salt in tf_policy.

  Show description for e329a6d
  

  summer-yue

  authored and

  copybara-github

  committed
  e329a6d

  Copy full SHA for e329a6d

Commits on Mar 28, 2020

• Modify policy info in ppo_policy to a nested dict.

  Show description for 92b7cf4
  

  summer-yue

  authored and

  copybara-github

  committed
  92b7cf4

  Copy full SHA for 92b7cf4

Commits on Mar 14, 2020

• Update policy_info documentation in trajectory.py.

  Show description for e3557bb
  

  summer-yue

  authored and

  copybara-github

  committed
  e3557bb

  Copy full SHA for e3557bb

Commits on Feb 28, 2020

• Modify PPO examples that are clipping specific to using the new PPOClipAgent.

  Show description for 1e82d5e
  

  summer-yue

  authored and

  copybara-github

  committed
  1e82d5e

  Copy full SHA for 1e82d5e

Commits on Feb 26, 2020

• Rename `PPOKLPenalty` to `PPOKLPenaltyAgent`.

  Show description for 77ce67e
  

  summer-yue

  authored and

  copybara-github

  committed
  77ce67e

  Copy full SHA for 77ce67e

• PPOAgent docstring update.

  Show description for 199e0ee
  

  summer-yue

  authored and

  copybara-github

  committed
  199e0ee

  Copy full SHA for 199e0ee

• Create PPOKLPenaltyAgent by wrapping the existing PPOAgent.

  Show description for a66ec72
  

  summer-yue

  authored and

  copybara-github

  committed
  a66ec72

  Copy full SHA for a66ec72

Commits on Feb 20, 2020

• Create PPOClipAgent by wrapping the existing PPOAgent.

  Show description for af5f115
  

  summer-yue

  authored and

  copybara-github

  committed
  af5f115

  Copy full SHA for af5f115

Commits on Feb 7, 2020

• More effective unit tests for behavioral cloning agent by replacing random trajectories.

  Show description for 71ec57f
  

  summer-yue

  authored and

  copybara-github

  committed
  71ec57f

  Copy full SHA for 71ec57f

• Fix small bug in actor_distribution_network unit test.

  Show description for 2bb8da4
  

  summer-yue

  authored and

  copybara-github

  committed
  2bb8da4

  Copy full SHA for 2bb8da4