github turboderp-org/exllamav3 v0.0.23
0.0.23

latest releases: v1.5.3, v1.5.2, v1.5.1...
6 months ago
  • Support Qwen 3.5 (Qwen3_5ForConditionalGeneration, Qwen3_5MoeForConditionalGeneration)
  • Support Step 3.5 (Step3p5ForCausalLM)
  • Enable tensor-P support for Minimax-M2
  • Switch quantizer to use out_scales by default
  • Include Torch 2.10 wheels
  • Various bugfixes, optimizations and QoL improvements

Full Changelog: v0.0.22...v0.0.23

Don't miss a new exllamav3 release

NewReleases is sending notifications on new releases.