v0.21.1: 2025/08/16 Added Zero-dim tensors support and other small improvements. #203

janpfeifer · 2025-08-16T09:07:39Z

janpfeifer
Aug 16, 2025
Maintainer

Package tensors and graph:
- Added support for zero-dim tensors.
Package backends:
- Method New() will return an error (as opposed to panic).
  The temporarily NewOrErr was marked as deprecated, use New instead.
Package optimizers:
- New AdamConfig.WithBackoffSteps() (or the hyperparameter adam_backoff) that prevents gradient steps
  from being taken until the given number of steps has executed. This allows a better estimate (moving average) of
  the gradients ("momentum") and their variances to be calculated before applying them.
- New optimizers.ParamAdamBeta1 and optimizers.ParamAdamBeta2 hyperparameters to control Adam beta1 and beta2
  hyperparameters.
Package context:
- Added Variable.DType().
- Variable #rngstate marked as non-trainable during creation.
gomlx_checkpoints:
- Added -perturb.
- Now it has its own go.mod, so it separated the dependencies.
Docker:
- Included openssh-client (ssh) and dlv (Go debugger) by default.
SimpleGo ("go") backend:
- Fixed mishandling of multi-output operations and race condition on parallel execution (RandomNormal: Graph failed to execute: Execute: input #0 of node #14 is not calculated yet #197)
- Refactoring and clean up of execution loops.
- Separated TestDotGeneral_PerformanceTable behind the build tag perf.

This discussion was created from the release v0.21.1: 2025/08/16 Added Zero-dim tensors support and other small improvements..