github huggingface/text-generation-inference v1.0.1

latest releases: v3.3.6, v3.3.5, v3.3.4...
2 years ago

Notable changes:

  • More GPTQ support
  • Rope scaling (linear + dynamic)
  • Bitsandbytes 4bits (both modes)
  • Added more documentation

What's Changed

New Contributors

Full Changelog: v1.0.0...v1.0.1

Don't miss a new text-generation-inference release

NewReleases is sending notifications on new releases.