EricLBuehler/mistral.rs v0.1.26

on GitHub

What's Changed

• Reference cargo dist in readme by @EricLBuehler in #536
• Fix xlora table in readme by @EricLBuehler in #537
• Warning about device mapping for anymoe by @EricLBuehler in #538
• Add updater and installer programs to cargo dist functionality by @EricLBuehler in #540
• Device mapping for AnyMoE by @EricLBuehler in #539
• Add tracking of memory usage by @EricLBuehler in #392
• Fix memory avail for cuda by @EricLBuehler in #543
• Add LLaVA Support by @chenwanqq in #484
• Device mapping fix for normal llama by @EricLBuehler in #549
• Add benchmark for a6000 by @EricLBuehler in #550
• Bump version to 0.1.26 by @EricLBuehler in #551

Full Changelog: v0.1.25...v0.1.26

Install mistralrs-server 0.1.26

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.1.26/mistralrs-server-installer.sh | sh

Download mistralrs-server 0.1.26