NOTE:
- MTF code in Tensor2Tensor has been moved to github.com/tensorflow/mesh - thanks @dustinvtran
New Problems:
- English-Setswana translation problem, thanks @jaderabbit
New layers, models, etc:
- Add Bayesian feedforward layer, thanks @dustinvtran
- Lots of changes to the RL pipeline, thanks @koz4k , @blazejosinski , @piotrmilos , @lukaszkaiser , @konradczechowski
- Lots of work on video mdoels, thanks @mbz , @MechCoder
- Image transformer with local1d and local 2d spatial partitioning, thanks @nikiparmar @vaswani
Usability:
- Support DistributionStrategy in Tensor2Tensor for multi-GPU, thanks @smit-hinsu !
- Pass data_dir to feature_encoders, thanks @stefan-falk
- variable_scope wrapper for avg_checkpoints, thanks @Mehrad0711
- Modalities cleanup, thanks @dustinvtran
- Avoid NaN while adding sinusoidal timing signals, thanks @peakji
- Avoid a ascii codec error in CNN/DailyMail, thanks @shahzeb1
- Allow exporting T2T models as tfhub modules, thanks @cyfra