** Modalities refactor: Thanks to Dustin, all modalities are now an enum and just functions, making it easier to understand what's happening in the model. Thanks Dustin!
Model-Based Reinforcement Learning for Atari using T2T, please find a nice writeup in at https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/rl/README.md -- thanks a lot to all the authors! @lukaszkaiser @mbz @piotrmilos @blazejosinski Roy Campbell @konradczechowski @doomie Chelsea Finn @koz4k Sergey Levine @rsepassi George Tucker and @henrykmichalewski !
TRAX = T2T + [JAX](https://github.com/google/jax) - please try out and give us feedback at #1478
New Models:
- Evolved Transformer, thanks @stefan-it for adding the paper in #1426
- textCNN model by @ybbaigo in #1421
Documentation and Logging:
Thanks again @cwbeitel and @lgeiger -- good docs and logging goes a long way for understandability.
Bugs fixed:
- t2t_decoder checkpoint fix in #1471 by @wanqizhu
- xrange fix for py3 by in #1468 @lgeiger
- Fixing COCO dataset in #1466 by @hbrylkowski
- Fix math problems by @artitw
- Decoding rev problems enzh by @googlehjx on #1389
- And honourable mentions to @qixiuai , #1440
Many many thanks @wanqizhu @lgeiger @hbrylkowski @artitw @googlehjx and @qixiuai for finding and fixing these and sorry for missing anyone else -- this is really really helpful.
Code Cleanups:
- Registry refactor and optimizer registry by @jackd in #1410 and #1401
- Numerous very nice cleanup PRs ex: #1454 #1451 #1446 #1444 #1424 #1411 #1350 by @lgeiger
Many thanks for the cleanups @jackd and @lgeiger -- and sorry if I missed anyone else.