Commits

Branch selector

 master

User selector

aaroey

Datepicker

All time

Commit History

Commits on Apr 12, 2022

• Remove the init_op parameter from Checkpointer constructor. Based on existing

  Show description for 7189b95
  

  aaroey

  authored and

  copybara-github

  committed
  7189b95

  Copy full SHA for 7189b95

Commits on Apr 1, 2022

• Let Saver able to wait for (async) saving to finish before exiting the

  Show description for a765db1
  

  aaroey

  authored and

  copybara-github

  committed
  a765db1

  Copy full SHA for a765db1

Commits on Mar 30, 2022

• Don't restore inside the loop, it's not needed.

  Show description for fc89cb4
  

  aaroey

  authored and

  copybara-github

  committed
  fc89cb4

  Copy full SHA for fc89cb4

• When TPU embedding retrieve ops are used:

  Show description for d9af94a
  

  aaroey

  authored and

  copybara-github

  committed
  d9af94a

  Copy full SHA for d9af94a

• Let Saver able to wait for (async) saving to finish before exiting the

  Show description for 9ffcbdf
  

  aaroey

  authored and

  copybara-github

  committed
  9ffcbdf

  Copy full SHA for 9ffcbdf

Commits on Mar 28, 2022

• Remove name check for variables that have non-static shape (CuDNN support was

  Show description for deabbf2
  

  aaroey

  authored and

  copybara-github

  committed
  deabbf2

  Copy full SHA for deabbf2

• Avoid setting self.enqueue_op when TPU embedding layer is used, so we can run

  Show description for 86041ff
  

  aaroey

  authored and

  copybara-github

  committed
  86041ff

  Copy full SHA for 86041ff

Commits on Mar 22, 2022

• Enable custom saver by default.

  Show description for 52221fa
  

  aaroey

  authored and

  copybara-github

  committed
  52221fa

  Copy full SHA for 52221fa

Commits on Mar 14, 2022

• Fix example_rate metric computation.

  Show description for bc61273
  

  aaroey

  authored and

  copybara-github

  committed
  bc61273

  Copy full SHA for bc61273

• Use tf.function in eager evaler/decoder.

  Show description for db92e97
  

  aaroey

  authored and

  copybara-github

  committed
  db92e97

  Copy full SHA for db92e97

• Check that the batch size of TPU embedding input ids matches the configuration.

  Show description for 4358b14
  

  aaroey

  authored and

  copybara-github

  committed
  4358b14

  Copy full SHA for 4358b14

Commits on Feb 24, 2022

• Add test utils to get tf summary values from event files.

  Show description for 339c549
  

  aaroey

  authored and

  copybara-github

  committed
  339c549

  Copy full SHA for 339c549

Commits on Feb 11, 2022

• BUILD file cleanup.

  Show description for dcd9dc1
  

  aaroey

  authored and

  copybara-github

  committed
  dcd9dc1

  Copy full SHA for dcd9dc1

Commits on Feb 5, 2022

• Use 8-digit checkpoint number for the checkpoint file names.

  Show description for 3079288
  

  aaroey

  authored and

  copybara-github

  committed
  3079288

  Copy full SHA for 3079288

Commits on Feb 1, 2022

• Custom saver sanity check:

  Show description for a77fcda
  

  aaroey

  authored and

  copybara-github

  committed
  a77fcda

  Copy full SHA for a77fcda

Commits on Jan 21, 2022

• Custom saver async checkpointing: collocate the copied variables with the corresponding source variables to avoid unnecessary send/recv across different worker devices.

  Show description for 922a6aa
  

  aaroey

  authored and

  copybara-github

  committed
  922a6aa

  Copy full SHA for 922a6aa

Commits on Jan 18, 2022

• Custom saver: collocate the save/restore ops with the corresponding variables to avoid unnecessary send/recv across different worker devices.

  Show description for 69f0853
  

  aaroey

  authored and

  copybara-github

  committed
  69f0853

  Copy full SHA for 69f0853

Commits on Jan 12, 2022

• Check that the shape of TPU embedding input ids is [-1, max_sequence_length].

  Show description for d9a76ed
  

  aaroey

  authored and

  copybara-github

  committed
  d9a76ed

  Copy full SHA for d9a76ed

• Apply EMA for ConstructFPropGraph/ConstructDecodeGraph only in

  Show description for 4bdf57e
  

  aaroey

  authored and

  copybara-github

  committed
  4bdf57e

  Copy full SHA for 4bdf57e

Commits on Jan 11, 2022

• Add _GetSelfVariablesDict for TPU embedding table and optimizer classes, and let it return the TPU embedding variables that are removed from self._private_vars, so that checkpointer can restore the…

  Show description for 1002956
  

  aaroey

  authored and

  copybara-github

  committed
  1002956

  Copy full SHA for 1002956

Commits on Jan 9, 2022

• Pass executor EMA explicitly to BaseModel.__init__ to avoid using a global

  Show description for 4802c8d
  

  aaroey

  authored and

  copybara-github

  committed
  4802c8d

  Copy full SHA for 4802c8d

Commits on Jan 6, 2022

• Support running eval/decode only programs with executor tpu + EMA.

  Show description for e2006c8
  

  aaroey

  authored and

  copybara-github

  committed
  e2006c8

  Copy full SHA for e2006c8

Commits on Jan 5, 2022

• Encapsulate the EMA creation logic in py_utils.CreateEMAForModel.

  Show description for 47ff25b
  

  aaroey

  authored and

  copybara-github

  committed
  47ff25b

  Copy full SHA for 47ff25b

Commits on Jan 4, 2022

• Remove global step creation. It should happen in self._graph, not the default graph, but it turns out removing it doesn't cause any problem.

  Show description for 997a8e0
  

  aaroey

  authored and

  copybara-github

  committed
  997a8e0

  Copy full SHA for 997a8e0

• Set do_eval to True in eager Evaler/Decoder.

  Show description for 62b1898
  

  aaroey

  authored and

  copybara-github

  committed
  62b1898

  Copy full SHA for 62b1898

Commits on Dec 14, 2021

• Propagate the EMA settings when constructing the SingleTaskModel Params to simplify the logic (task_params is always set during training).

  Show description for af50612
  

  aaroey

  authored and

  copybara-github

  committed
  af50612

  Copy full SHA for af50612

• Simplify argument passing.

  Show description for 2ce1dc7
  

  aaroey

  authored and

  copybara-github

  committed
  2ce1dc7

  Copy full SHA for 2ce1dc7

Commits on Nov 19, 2021

• Check that the multitask and all sub-tasks use the same EMA setting, to avoid

  Show description for 81c7d7b
  

  aaroey

  authored and

  copybara-github

  committed
  81c7d7b

  Copy full SHA for 81c7d7b

• When per-host infeed is used, apply the ordinal function used by CreateTpuEnqueueOps

  Show description for 2d34c7a
  

  aaroey

  authored and

  copybara-github

  committed
  2d34c7a

  Copy full SHA for 2d34c7a

• Add checks to ensure tpu_infeed_parallelism is not enabled when TPU embedding

  Show description for 9d8228b
  

  aaroey

  authored and

  copybara-github

  committed
  9d8228b

  Copy full SHA for 9d8228b

Commits on Nov 4, 2021

• Support EMA for ExecutorTpu eval.

  Show description for 811ccf5
  

  aaroey

  authored and

  copybara-github

  committed
  811ccf5

  Copy full SHA for 811ccf5

Commits on Oct 27, 2021

• Add an option to load the TPU embedding table variables as bfloat16.

  Show description for 8419284
  

  aaroey

  authored and

  copybara-github

  committed
  8419284

  Copy full SHA for 8419284

• Fix doc string.

  Show description for 8a87e1f
  

  aaroey

  authored and

  copybara-github

  committed
  8a87e1f

  Copy full SHA for 8a87e1f

Commits on Oct 14, 2021

• Fix the vocab size when using merged table variable in inference mode.

  Show description for e9331b4
  

  aaroey

  authored and

  copybara-github

  committed
  e9331b4

  Copy full SHA for e9331b4

Commits on Oct 11, 2021

• Add control dependency to infeed op in the eager infeed step function .

  Show description for cc19fa2
  

  aaroey

  authored and

  copybara-github

  committed
  cc19fa2

  Copy full SHA for cc19fa2

Pagination

Previous

Next