tensorflow/tensor2tensor v1.7.0

on GitHub

Added a MultiProblem class for Multitask Learning. Thanks @urvashik !

Added decoding option to pass through the features dictionary to predictions. Thanks @rsepassi !

Enabled MLEngine path to use Cloud TPUs. Thanks @rsepassi !

Added a simple One-Hot Symbol modality. Thanks @mbz !

Added Cleverhans integration. Thanks @aidangomez !

Problem definitions added for:

• Allen Brain Atlas problems. Thanks @cwbeitel !
• LSUN Bedrooms dataset.
• Added various NLP datasets. Thanks @urvashik !
  • MSR Paraphrase Corpus,
  • Quora Question Pairs,
  • Stanford Sentiment Treebank,
  • Question Answering NLI classification problems,
  • Recognizing Textual Entailment,
  • Corpus of Linguistic Acceptability,
  • Winograd NLI.
• Added a data generator for WSJ parsing.

Model additions:

• Implemented Targeted Dropout for Posthoc Pruning. Thanks @aidangomez !
• Added self attention to VQA attention model.
• Added fast block parallel transformer model
• Implemented auxiliary losses from Stochastic Activation Pruning for Robust Adversarial Defense. Thanks @alexyku !
• Added probability based scheduled sampling for SV2P problem. Thanks @mbz !
• Reimplementated Autoencoder and Eval. Thanks @piotrmilos !
• Relative memory efficient unmasked self-attention.

Notable bug fixes:

• bug with data_gen in style transfer problem Thanks @tlatkowski !
• wmt_enfr dataset should not use vocabulary based on "small" dataset. Thanks @nshazeer !

Many more fixes, tests and work on Model based RL, Transfomer, Video and other models and problems.