PRs Merged
- #1720 thanks @przemb
- #1698 #1699 test/util file fixes thanks to @Vooblin
- Fix serving response from Cloud ML Engine (#1688) thanks to @evalphobia
- Refine automatic mixed precision support via hyper param (#1681) thanks @vinhngx
- correct return shape of rel_pos2abs_pos() (#1686) thanks to @Separius
- save attention weights for relative attention v2 (#1682) thanks to @Ghostvv
- Update generator_utils.py (#1674) thanks to @TanguyUrvoy
Docs
- Transformer tutorial (#1675) many thanks to @Styleoshin
Problems
- 4 new dialog problems by @ricsinaruto in #1642
Models
- Extend NeuralStack to support Dequeu by reading/writing in both directions, thanks @narphorium
TRAX
- Lots of work on SimPLe tuning hyperparameters by @koz4k , @lukaszkaiser and @afrozenator
- async data collection for RL in TRAX
- New memory efficient Transformer using Reversible layers, thanks to Nikita Kitaev, @lukaszkaiser and Anselm Levskaya
- Losses and metrics are layers now in trax, thanks to @lukaszkaiser
- Activations in TRAX thanks to @joaogui1 in #1684 and #1666