huggingface/text-generation-inference v3.2.2

on GitHub

What's Changed

• Minor fixes. by @Narsil in #3125
• configurable termination timeout by @ErikKaum in #3126
• CI: enable server tests for backends by @baptistecolle in #3128
• Torch 2.6 by @Narsil in #3134
• Gaudi: Fix llava-next and mllama crash issue by @yuanwu2017 in #3127
• nix-v3.2.1 -> v3.2.1-nix by @co42 in #3129
• Gaudi: Use exponential growth to replace BATCH_BUCKET_SIZE by @yuanwu2017 in #3131
• Add llama4 by @mht-sharma in #3145
• Preparing for release. by @Narsil in #3147

New Contributors

• @co42 made their first contribution in #3129

Full Changelog: v3.2.1...v3.2.2