EricLBuehler/mistral.rs v0.2.2
on GitHub

latest releases: v0.3.2, v0.3.1, v0.3.0...

3 months ago

What's Changed

Fix ctrlc handling for scheduler v2 by @EricLBuehler in #614
Make sliding_window optional for mixtral by @csicar in #616
Support Llama 3.1 scaled rope by @EricLBuehler in #618

New Contributors

@csicar made their first contribution in #616

Full Changelog: v0.2.1...v0.2.2

MSRV

MSRV is 1.75.

Install mistralrs-server 0.2.2

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-installer.sh | sh

Download mistralrs-server 0.2.2

File	Platform	Checksum
mistralrs-server-aarch64-apple-darwin.tar.xz	Apple Silicon macOS	checksum
mistralrs-server-x86_64-apple-darwin.tar.xz	Intel macOS	checksum
mistralrs-server-x86_64-unknown-linux-gnu.tar.xz	x64 Linux	checksum

Check out latest releases or
releases around EricLBuehler/mistral.rs v0.2.2

Don't miss a new mistral.rs release

NewReleases is sending notifications on new releases.

Get notifications