fasttext 0.9.1

v0.9.1

on Python PyPI

We are happy to announce the release of version 0.9.1.

New release of python module

The main goal of this release is to merge two existing python modules: the official fastText module which was available on our github repository and the unofficial fasttext module which was available on pypi.org.

You can find an overview of the new API here, and more insight in our blog post.

Refactoring

This version includes a massive rewrite of internal classes. The training and test are now split into three different classes : Model that takes care of the computational aspect, Loss that handles loss and applies gradients to the output matrix, and State that is responsible of holding the model's state inside each thread.

That makes the code more straighforward to read but also gives a smaller memory footprint, because the data needed for loss computation is now hold only once unlike before where there was one for each thread.

Misc

• Compilation issues fix for recent versions of Mac OS X.
• Better unicode handling :
  • on_unicode_error argument that helps to handle unicode issues one can face with some datasets
  • bug fix related to different behaviour of pybind11's py::str class between python2 and python3
• script for unsupervised alignment
• public file hosting changed from aws to fbaipublicfiles
• we added a Code of Conduct file.

Thank you !

As always, we want to thank you for your help and your precious feedback which helps making this project better.