What's Changed
- Improve and update docs by @EricLBuehler in #477
- Progress bar and logging when loading repeating layers by @EricLBuehler in #479
- Update deps by @EricLBuehler in #483
- Optimize decoding by removing redundant qkv transpose by @EricLBuehler in #487
- Fixes and tweak docs, logging for local loading by @EricLBuehler in #489
- Add the Gemma 2 model by @EricLBuehler in #490
- Update demo video by @EricLBuehler in #491
- Utilize new quantize_onto qtensor api by @EricLBuehler in #492
- Update deps by @EricLBuehler in #493
- Bump version to 0.1.23 by @EricLBuehler in #495
Full Changelog: v0.1.22...v0.1.23