github turboderp-org/exllamav3 v1.2.0
1.2.0

latest releases: v1.6.5, v1.6.4, v1.6.3...
3 months ago
  • Support LagunaForCausalLM (and DFlashLagunaForCausalLM)
  • Experimental CPU offloading support for expert layers
  • Experimental dynamic draft window feature
  • Improved safetensors loader (faster)
  • More graph paths
  • Performance tuning
  • Removed compare_q.py, superseded by qbench.py
  • Various bugfixes

Full Changelog: v1.1.0...v1.2.0

Don't miss a new exllamav3 release

NewReleases is sending notifications on new releases.