github turboderp-org/exllamav3 v0.0.29
0.0.29

latest releases: v1.5.0, v1.4.9, v1.4.8...
5 months ago
  • Support Gemma4ForConditionalGeneration
  • Fix bug causing quantizer to allocate too much system RAM on resume
  • Fix bug causing potential segfaults when saving large tensors
  • Add loop detection option
  • More benchmarks
  • QoL improvements
  • Other bugfixes
  • Add Torch 2.11 wheels
  • Add Python 3.14 wheels (Torch 2.9+ only)

Full Changelog: v0.0.28...v0.0.29

Don't miss a new exllamav3 release

NewReleases is sending notifications on new releases.