Thanks to visit codestin.com
Credit goes to github.com

Skip to content

fix: minor print typo#234

Merged
mcarilli merged 1 commit into
NVIDIA:no_wrap_optimizersfrom
hukkelas:no_wrap_optimizers
Mar 31, 2019
Merged

fix: minor print typo#234
mcarilli merged 1 commit into
NVIDIA:no_wrap_optimizersfrom
hukkelas:no_wrap_optimizers

Conversation

@hukkelas
Copy link
Copy Markdown

Prints

Gradient overflow.  Skipping step, loss scaler 3 reducing loss scale to 32768.0

instead of

Gradient overflow.  Skipping step, loss scaler {} reducing loss scale to 3

@mcarilli
Copy link
Copy Markdown

Good catch, thanks!

@mcarilli mcarilli merged commit c654351 into NVIDIA:no_wrap_optimizers Mar 31, 2019
mcarilli pushed a commit that referenced this pull request Apr 4, 2019
* Refactor to allow more flexible treatment of multiple optimizers/models/losses

* Adding _process_optimizers.py

* Created L0 tests (now passing).

* fix: minor print typo (#234)

* make L1 results easier to read

* L0 multiple model/optimizer/loss test fleshed out

* Adding test that master params remain synced across distributed processes

* Docstring updates

* Docstring updates
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants