• Various bug fixes, improvements, and additions
• Checkpoint Breaking Note: We'd like to have good defaults as well as have immutable hparams sets and so we have an updating naming scheme we're trying, starting with Transformer hparams. transformer_base is now an alias name that points to a versioned hparams set, i.e. transformer_base now calls transformer_base_v2. The previous version of transformer_base is now transformer_base_v1 (so if you have an old checkpoint, use hparams set transfomer_base_v1). This way if you're just trying something out, you can use transformer_base and know that you have a set of up-to-date good defaults. If you want to maintain reproducibility across T2T versions, use one of the versioned names, e.g. transformer_base_v2.