github turboderp-org/exllamav3 v1.6.6
1.6.6

4 hours ago
  • Support DeepseekV41ForCausalLM
  • Support Lfm3ForCausalLM and Lfm3VlForConditionalGeneration
  • Improved loop detection
  • Greatly reduced VRAM usage during quantization
  • Faster quantization capture pass
  • Fixed disk cache eviction policy (prevent possible churn when switching between many models)
  • More optimizations, bugfixes and QoL improments

Full Changelog: v1.6.5...v1.6.6

Don't miss a new exllamav3 release

NewReleases is sending notifications on new releases.