pytorch/text v0.8.0-rc2

Torchtext 0.8.0 release notes

on GitHub

This is a relatively light release while we are working on revamping the library. According to PyTorch feature classification changes, the new building blocks and datasets in the experimental folder are defined as Prototype and available in the nightly release only. Once the prototype building blocks are matured enough, we will release them together with all the relevant commits in a beta release. At the same time, users are encouraged to take a look at those building blocks and give us feedback. An easy way to send your feedback is to open an issue in pytorch/text repo or comment in Issue #664. For details regarding the revamp execution, see Issue #985.

The nightly packages are accessible via Pip and Conda for Windows, Mac, and Linux. For example, Linux users can install the nightly wheels with the following command.

pip install --pre torch torchtext -f https://download.pytorch.org/whl/nightly/cpu/torch_nightly.html

For more detail instructions, please refer to Install PyTorch. It should be noted that the new building blocks are still under development, and the APIs have not been solidified.

The stable release branch here includes a few feature improvements and documentation updates. Compiled against the PyTorch 1.7.0 release, the stable release packages are available via Pip and Conda for Windows, Linux, and Mac.

Improvements

• Updated the BERT pipeline to improve question-answer task score #950
• Fixed the order of the datasets used in the BERT example #1040
• Skipped requests.get in download_from_url function if path exists #922
• Used Ninja to build extensions and disable C++11 ABI when necessary for libtorch compatibility. #931
• Removed SentencePiece from setup.py file. SentencePiece source code is now being used as the third-party library in torchtext #1055
• Improved CircleCI setting for better engineering
  • Switched PyTorch binary location for CI unittests #1044
  • Parameterized UPLOAD_CHANNEL #1037
  • Installed binaries for the CI test directly from the CPU channel #1025, #981
  • Added dataclasses to dependencies for environment.yml #964
  • Bumped Xcode workers to 9.4.1 #951
  • Disabled glove tests due to URL breakage #920
  • Used the specific channel for the CI tests #907

Docs

• Added test and updated error message for load_sp_model function in torch.data.functional #984
• Updated the README file in BERT example #899
• Updated the legacy retirement message #1047
• Updated index page to include links to PyTorch libraries and describe feature classification #1048
• Cleaned up the doc strings #1049
• Fixed clang-format version to what PyTorch uses #1052
• Added OSX environment variables to the README file #1054
• Updated README file for the prototype in the nightly release #1050

Bug Fixes

• Fixed the order of the datasets used in the BERT example #1040