Thanks to visit codestin.com
Credit goes to github.com

Skip to content

error in gradient descent as argmin /7-misc/modern-optimizers.html #6

@jpreiss

Description

@jpreiss

The page states

$u = \text{argmin}_{\Delta\theta} \ \ g^T \Delta\theta + \alpha \Vert\Delta \theta\Vert^2 = \alpha g$,

but the solution to that optimization should be

$u = -\frac{1}{2 \alpha} g$.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions