Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

Adadelta optimizer test#13443

Merged
sandeep-krishnamurthy merged 2 commits into
apache:masterfrom
anirudhacharya:pyAdaDelta
Dec 4, 2018
Merged

Adadelta optimizer test#13443
sandeep-krishnamurthy merged 2 commits into
apache:masterfrom
anirudhacharya:pyAdaDelta

Conversation

@anirudhacharya
Copy link
Copy Markdown
Member

@anirudhacharya anirudhacharya commented Nov 28, 2018

Description

Adadelta optimizer test

Checklist

Essentials

Please feel free to remove inapplicable items for your PR.

  • The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
  • Changes are complete (i.e. I finished coding on this PR)
  • All changes have test coverage:
  • Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
  • Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
  • Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
  • Code is well-documented:
  • For user-facing API changes, API doc string has been updated.
  • For new C++ functions in header files, their functionalities and arguments are documented.
  • For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
  • Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
  • To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

  • FTML doc fix
  • test for adadelta

@anirudhacharya anirudhacharya requested a review from szha as a code owner November 28, 2018 21:15
@vandanavk
Copy link
Copy Markdown
Contributor

vandanavk commented Nov 28, 2018

@mxnet-label-bot add [Test, pr-awaiting-review]

@marcoabreu marcoabreu added pr-awaiting-review PR is waiting for code review Test labels Nov 28, 2018
Copy link
Copy Markdown
Contributor

@larroy larroy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice change, just 2 comments.

Comment thread tests/python/unittest/test_optimizer.py
Comment thread tests/python/unittest/test_optimizer.py Outdated
rg_options = [{}, {'rescale_grad': 0.14}, {'rescale_grad': 0.8}]
wd_options = [{}, {'wd': 0.0}]
for dtype in [np.float16, np.float32]:
for params in itertools.product(rho_options, eps_options, cg_options,
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is very clean and nice!
Thanks @larroy and @anirudhacharya

Copy link
Copy Markdown

@sandeep-krishnamurthy sandeep-krishnamurthy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.
Pedro - I see your feedback is addressed here. I am going ahead with merging it.

@sandeep-krishnamurthy sandeep-krishnamurthy merged commit 06245b1 into apache:master Dec 4, 2018
@larroy
Copy link
Copy Markdown
Contributor

larroy commented Dec 4, 2018

yes, good job.

@anirudhacharya anirudhacharya deleted the pyAdaDelta branch January 16, 2019 16:17
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

pr-awaiting-review PR is waiting for code review Test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants