hpcaitech/ColossalAI v0.4.0

Version v0.4.0 Release Today!

on GitHub

What's Changed

Release

• [release] update version (#5864) by Hongxin Liu

Inference

• [Inference]Lazy Init Support (#5785) by Runyu Lu

Shardformer

• [shardformer] Support the T5ForTokenClassification model (#5816) by Guangyao Zhang

Zero

• [zero] use bucket during allgather (#5860) by Hongxin Liu

Gemini

• [gemini] fixes for benchmarking (#5847) by botbw
• [gemini] fix missing return (#5845) by botbw

Feature

• [Feature] optimize PP overlap (#5735) by Edenzzzz

Doc

• [doc] add GPU cloud playground (#5851) by binmakeswell
• [doc] fix open sora model weight link (#5848) by binmakeswell
• [doc] opensora v1.2 news (#5846) by binmakeswell

Full Changelog: v0.4.0...v0.3.9