hpcaitech/ColossalAI v0.4.2

Version v0.4.2 Release Today!

on GitHub

What's Changed

Release

• [release] update version (#5952) by Hongxin Liu

Zero

• [zero] hotfix update master params (#5951) by Hongxin Liu

Feat

• [Feat] Distrifusion Acceleration Support for Diffusion Inference (#5895) by Runyu Lu

Shardformer

• [shardformer] hotfix attn mask (#5947) by Hongxin Liu
• [shardformer] hotfix attn mask (#5945) by Hongxin Liu

Chat

• Merge pull request #5922 from hpcaitech/kto by YeAnbang

Feature

• [Feature] Add a switch to control whether the model checkpoint needs to be saved after each epoch ends (#5941) by zhurunhua

Hotfix

• [Hotfix] Fix ZeRO typo #5936 by Edenzzzz

Fix bug

• [FIX BUG] convert env param to int in (#5934) by Gao, Ruiyuan
• [FIX BUG] UnboundLocalError: cannot access local variable 'default_conversation' where it is not associated with a value (#5931) by zhurunhua

Colossalchat

• [ColossalChat] Hotfix for ColossalChat (#5910) by Tong Li

Examples

• [Examples] Add lazy init to OPT and GPT examples (#5924) by Edenzzzz

Plugin

• [plugin] support all-gather overlap for hybrid parallel (#5919) by Hongxin Liu

Full Changelog: v0.4.2...v0.4.1