huggingface/text-generation-inference v1.2.0

v.1.2.0

on GitHub

What's Changed

• fix: do not leak inputs on error by @OlivierDehaene in #1228
• Fix missing trust_remote_code flag for AutoTokenizer in utils.peft by @creatorrr in #1270
• Load PEFT weights from local directory by @tleyden in #1260
• chore: update to torch 2.1.0 by @OlivierDehaene in #1182
• Fix IDEFICS dtype by @vakker in #1214
• Exllama v2 by @Narsil in #1211
• Add RoCm support by @fxmarty in #1243
• Let each model resolve their own default dtype. by @Narsil in #1287
• Make GPTQ test less flaky by @Narsil in #1295

New Contributors

• @creatorrr made their first contribution in #1270
• @tleyden made their first contribution in #1260
• @vakker made their first contribution in #1214

Full Changelog: v1.1.1...v1.2.0