sentencepiece 0.1.99

v0.1.99

on Python PyPI

Major changes

N/A

New features

N/A

Bug fixes & minor changes

• [ALL] Fixes the NaN issues in unigram model training: #851
• [ALL] Fixes the bug in unigram loss computation: #628
• [ALL] Fixes the minor bug in BPE token extraction algorithm: #318
• [ALL] Increase the number of maximum threads from 128 to 1024. #857