• Distillation codepath added
• Improved support for serving language models
• New TransformerScorer model which return log prob of targets on infer
• Support for bfloat16 weights and activations on TPU
• SRU gate added to common_layers
• --checkpoint_path supported in interactive decoding
• Improved support for multiple outputs
• VideoProblem base class
• Various fixes, additions, etc.