huggingface/text-generation-inference v1.4.5
v.1.4.5

on GitHub

latest releases: v3.3.7, v3.3.6, v3.3.5...

20 months ago

Highlights

DBRX support #1685. See #1679 on how to prompt the model.

What's Changed

fix: adjust logprob response logic by @drbh in #1682
fix: handle batches with and without grammars by @drbh in #1676
feat: Add dbrx support by @OlivierDehaene in #1685

Full Changelog: v1.4.4...v1.4.5

Check out latest releases or
releases around huggingface/text-generation-inference v1.4.5

Don't miss a new text-generation-inference release

NewReleases is sending notifications on new releases.

Get notifications