What's Changed
- Added token batching during llm inference to reduce rerenders and improve performance
- Improved threadpool configuration on iOS significantly increasing inference speed and reducing power consumption
- Fix SQLite bug crashing app builds when SQLite is included from other libraries
Full Changelog: v0.5.6...v0.5.7