deepspeedai/DeepSpeed v0.14.0

DeepSpeed v0.14.0

on GitHub

New Features

• DeepSpeed-FP6: The Power of FP6-Centric Serving for Large Language Models.

What's Changed

• Update version.txt after 0.13.5 release by @mrwyattii in #5229
• MOE gate fixes and enhancements by @mosheisland in #5156
• FP6 quantization end-to-end. by @loadams in #5234
• FP6 blog by @loadams in #5235

Full Changelog: v0.13.5...v0.14.0