Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 18, 2020

• Add Reformer2 decoding timing test and adjust gin config batch sizes and LSH attention (not used by default).

  Show description for 9990f26
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  9990f26

  Copy full SHA for 9990f26

• Merge pull request #962 from NathanHowell:spelling-fixes

  Show description for 81848d8
  copybara-github

  committed
  81848d8

  Copy full SHA for 81848d8

• Allow to use ReversibleSerialTrainer in Loop, save eval_model state in checkpoints.

  Show description for d3fe5bb
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  d3fe5bb

  Copy full SHA for d3fe5bb

• [TRAX/Reformer2] Reformer2 fast-inference with SelfAttention.

  Show description for 20770df
  

  afrozenator

  authored and

  copybara-github

  committed
  20770df

  Copy full SHA for 20770df

Commits on Sep 17, 2020

• Turn off donation in Trainer to make RL tests run for now (pending more investigation).

  Show description for 716b552
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  716b552

  Copy full SHA for 716b552

• Change reformer2_copy.gin to use simple `tl.PositionalEncoding` and add a decoding test for the same.

  Show description for 8d553c6
  

  afrozenator

  authored and

  copybara-github

  committed
  8d553c6

  Copy full SHA for 8d553c6

• Use jax.api.device_put_sharded() in place of private JAX APIs.

  Show description for e83ee7d
  

  Jake VanderPlas

  authored and

  copybara-github

  committed
  e83ee7d

  Copy full SHA for e83ee7d

Commits on Sep 16, 2020

• Make Reformer2 compatible with ReversibleSerialTrainer, debugging improvements.

  Show description for c44c517
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  c44c517

  Copy full SHA for c44c517

• Add settings to experiment with multiplicative value injection.

  Show description for cbc18ea
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  cbc18ea

  Copy full SHA for cbc18ea

• Implement value tasks and test their integration with policy tasks.

  Show description for 25a0656
  

  koz4k

  authored and

  copybara-github

  committed
  25a0656

  Copy full SHA for 25a0656

• Allow multiple non-reversible layers in ReversibleSerialTrainer.

  Show description for 5dd0f69
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  5dd0f69

  Copy full SHA for 5dd0f69

Commits on Sep 15, 2020

• Remove unused argument from _outputs_onto_stack for better readability).

  Show description for 1aab7a5
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  1aab7a5

  Copy full SHA for 1aab7a5

• Adds index_add, index_min and index_max to tf_numpy.extensions

  Show description for da8bd5b
  

  wangpengmit

  authored and

  copybara-github

  committed
  da8bd5b

  Copy full SHA for da8bd5b

• DQN training in Trax.

  Show description for 66f88d9
  

  henrykmichalewski

  authored and

  copybara-github

  committed
  66f88d9

  Copy full SHA for 66f88d9

• Implementing additional features of precision.

  Show description for 86f7c20
  

  henrykmichalewski

  authored and

  copybara-github

  committed
  86f7c20

  Copy full SHA for 86f7c20

Commits on Sep 12, 2020

• [TRAX/Reformer] Ensure at least two buckets in `hash_vectors`.

  Show description for 86b48a0
  

  afrozenator

  authored and

  copybara-github

  committed
  86b48a0

  Copy full SHA for 86b48a0

Commits on Sep 11, 2020

• Refactor ReversibleSerialTrainer for easier generalization (no changes, just moving code).

  Show description for c4faecf
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  c4faecf

  Copy full SHA for c4faecf

Commits on Sep 10, 2020

• Allow forgetting every n_layers in Reformer2, more general reversible Select.

  Show description for 4033132
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  4033132

  Copy full SHA for 4033132

• [TRAX/Reformer2] Move all the helper functions to `research/transformer_no_enc_dec_attention.py`, get rid of `_MaskOfRightShiftedArray` and simplify `ConcatWithPadding` by getting rid of decoder mask.

  Show description for 60f6d2e
  

  afrozenator

  authored and

  copybara-github

  committed
  60f6d2e

  Copy full SHA for 60f6d2e

Commits on Sep 9, 2020

• In LSH attention set n_buckets automatically using a heuristic from input length.

  Show description for 5587a36
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  5587a36

  Copy full SHA for 5587a36

• Refactor the advantage calulation.

  Show description for 64fee7a
  

  koz4k

  authored and

  copybara-github

  committed
  64fee7a

  Copy full SHA for 64fee7a

Commits on Sep 8, 2020

• LayerDrop modifications: Every other and similar strategies.

  Show description for 4abaca4
  

  sebastianjaszczur

  authored and

  copybara-github

  committed
  4abaca4

  Copy full SHA for 4abaca4

• [TRAX] Write out checkpoint if chief only.

  Show description for 24cb4bc
  

  afrozenator

  authored and

  copybara-github

  committed
  24cb4bc

  Copy full SHA for 24cb4bc

• Rewrite PolicyGradient to use Tasks and Loop.

  Show description for 2d3ec07
  

  koz4k

  authored and

  copybara-github

  committed
  2d3ec07

  Copy full SHA for 2d3ec07

• base Layer adding metrics to TensorBoard

  Show description for 0234a4f
  

  sebastianjaszczur

  authored and

  copybara-github

  committed
  0234a4f

  Copy full SHA for 0234a4f

Commits on Sep 4, 2020

• Open the Agent summary writer in the run() loop.

  Show description for ebb9aa0
  

  koz4k

  authored and

  copybara-github

  committed
  ebb9aa0

  Copy full SHA for ebb9aa0

• Merge remote-tracking branch 'upstream/master' into spelling-fixes

  Show description for 07746d7
  NathanHowell

  committed
  07746d7

  Copy full SHA for 07746d7

• Add tests of serialization with training.

  Show description for 4330576
  

  henrykmichalewski

  authored and

  copybara-github

  committed
  4330576

  Copy full SHA for 4330576

• Memory-efficient ReversibleSerialTrainer for models using reversible layers.

  Show description for 67a4edf
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  67a4edf

  Copy full SHA for 67a4edf

• Share vocab embeddings in Reformer2 + gin config adjustments.

  Show description for 023b5f4
  

  Lukasz Kaiser

  authored and

  copybara-github

  committed
  023b5f4

  Copy full SHA for 023b5f4

Commits on Sep 3, 2020

• Fix small typos in example trax.data.Inputs usage

  Show description for d3f6203
  

  kkanska

  authored and

  copybara-github

  committed
  d3f6203

  Copy full SHA for d3f6203

• Revert name change: "momentum" --> "inertia" --> "momentum".

  Show description for 67dda3b
  

  j2i2

  authored and

  copybara-github

  committed
  67dda3b

  Copy full SHA for 67dda3b

• Some concept and naming clean-up in normalization code:

  Show description for 6a5d0cb
  

  j2i2

  authored and

  copybara-github

  committed
  6a5d0cb

  Copy full SHA for 6a5d0cb

Commits on Sep 2, 2020

• Add a config for Reformer2 copy task.

  Show description for 0ba8bae
  

  afrozenator

  authored and

  copybara-github

  committed
  0ba8bae

  Copy full SHA for 0ba8bae

Commits on Sep 1, 2020

• Remove a leftover reference to RLTrainer.

  Show description for b03f631
  

  koz4k

  authored and

  copybara-github

  committed
  b03f631

  Copy full SHA for b03f631

Pagination

Previous

Next