EricLBuehler/mistral.rs v0.2.1

on GitHub

What's Changed

• Fix path normalize for mistralrs-paged-attn by @EricLBuehler in #592
• ISQ python example by @EricLBuehler in #593
• Add support for mistral nemo by @EricLBuehler in #595
• Fix dtype with QLinear by @EricLBuehler in #600
• Update paged-attn build.rs with NVCC flags by @joshpopelka20 in #604
• Bump openssl from 0.10.64 to 0.10.66 by @dependabot in #605
• Update GitHub issue templates by @EricLBuehler in #607
• Add server throughput logging by @EricLBuehler in #608
• Make the plotly feature optional by @EricLBuehler in #597
• Use OnceLock for Python bindings device by @EricLBuehler in #602
• Topk for X-LoRA scalings by @EricLBuehler in #609
• Fix server cross-origin errors by @openmynet in #610
• Refactor sampler by @EricLBuehler in #611
• Bump version to 0.2.1 by @EricLBuehler in #613

New Contributors

• @dependabot made their first contribution in #605
• @openmynet made their first contribution in #610

Full Changelog: v0.2.0...v0.2.1

Install mistralrs-server 0.2.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.1/mistralrs-server-installer.sh | sh

Download mistralrs-server 0.2.1