What's Changed
New features
- Expose adamax and adamaxw by @nasyxx in #433
- Support feeding in extra dictionary data in optax/experimental in #373
- Add NovoGrad optimizer by @DT6A in #385
- added optimistic gradient descent in #387
- Add types to utils.py by @atgctg in #367
- Add hyperparam_dtype override to hyperparam injection in #414
- added typing to linear_algebra.py by @shivance in #413
- Add amsgrad optimizer by @merajhashemi in #382
- Add Hinge Loss by @heytanay in #409
Bug fixes
- [optax] Increase chex version requirement to fix issue #456. in #457
- Start inject_hyperparams step count at 0. in #416
- Add noise before multiplying by the learning rate (
noisy_sgd) by @atgctg in #369
Miscellaneous
- Remove flags from lookahead_mnist example. in #395
- Bring alias docstrings more in line with style guide. in #406
- Bugfix in alias_test: Adamax named but not tested. in #419
- Test that all optimizers can be wrapped in inject_hyperparams. in #420
- Add an example for gradient accumulation. in #425
- [docs] Start adding numerical definitions to key parts of optax. in #430
- [optax] Add basic mnist example based on the lookahead_mnist example. in #436
- Install dependencies for dp-accounting manually. in #375
- Update documentation for AdamW in #376
- [Docs] softmax_cross_entropy_with_integer_label by @lkhphuc in #351
- Update Returns section in gradient transformations' docstrings. in #388
- Update logo and theme for the documentation in #391
- Set the test version of flax used in the equivalence test. in #398
- Add holounic to contributors list. by in #400
- Bring transform docstrings more in line with style guide. by in #405
- Update citation. in #407
- Refine the doc of sigmoid_binary_cross_entropy to not assume the meaning of last dimension. in #418
- fix
integer_powrecompilation in_bias_correctionby @epignatelli in #329 - Use auto instead of
/proc/cpuinfo. in #454
New Contributors
- @atgctg made their first contribution in #367
- @nasyxx made their first contribution in #433
- @shivance made their first contribution in #413
- @epignatelli made their first contribution in #329
- @merajhashemi made their first contribution in #382
- @heytanay made their first contribution in #409
Full Changelog: v0.1.3...v0.1.4