valeriansaliou/sonic core-v0.2.0

Sonic core v0.2.0

on GitHub

Changes

Improvements to search results:

• Implement BM25 lite (idf only) (in 0ac3e7b)
• Minimum term idf, to avoid low-quality results at the end of the results list (in 58cd0e4)

New Features

• Add support for Unicode normalization (in 678d5e1)
• Add support for custom stopwords (in 764536e)
• Add more RocksDB configuration keys (in 8eb3045)

Bug Fixes

• Make QUERY insensitive to Unicode normal form (in 0fd1050)
• Make stopwords insensitive to Unicode Normal Form (in 3f9782b)
• Remove numbers from stopwords (in 4e11f75)