github pemistahl/lingua-py v1.1.0
Lingua 1.1.0

latest releases: v1.3.5, v2.0.2, v2.0.1...
2 years ago

Features

  • The new method LanguageDetectorBuilder.with_low_accuracy_mode() has been introduced. By activating it, detection accuracy for short text is reduced in favor of a smaller memory footprint and faster detection performance.

Improvements

  • The memory footprint has been reduced significantly by storing the language models in structured NumPy arrays instead of dictionaries. This reduces memory consumption from 2600 MB to 800 MB, approximately.
  • Several language model files have become obsolete and could be deleted without decreasing detection accuracy. This results in a smaller memory footprint.

Compatibility

  • The lowest supported Python version is 3.8 now. Python 3.7 is no longer compatible with this library.

Don't miss a new lingua-py release

NewReleases is sending notifications on new releases.