What's Changed
Release
- [release] update version (#6174) by Hongxin Liu
Pre-commit.ci
- [pre-commit.ci] pre-commit autoupdate (#6113) by pre-commit-ci[bot]
Sharderformer
- [Sharderformer] Support zbv in Sharderformer Policy (#6150) by duanjunwen
Checkpointio
- [checkpointio] support non blocking pin load (#6172) by Hongxin Liu
- [checkpointio]support asyncio for 3d (#6152) by flybird11111
- [checkpointio] fix async io (#6155) by flybird11111
- [checkpointio] support debug log (#6153) by Hongxin Liu
- [checkpointio] fix zero optimizer async save memory (#6151) by Hongxin Liu
- Merge pull request #6149 from ver217/hotfix/ckpt by Wang Binluo
- [checkpointio] disable buffering by ver217
- [checkpointio] fix pinned state dict by ver217
- [checkpointio] fix size compute by ver217
- [checkpointio] fix performance issue (#6139) by Hongxin Liu
- [checkpointio] support async model save (#6131) by Hongxin Liu
News
- [news] release colossalai for sora (#6166) by binmakeswell
Hotfix
- [hotfix] improve compatibility (#6165) by Hongxin Liu
- [Hotfix] hotfix normalization (#6163) by duanjunwen
- [hotfix] fix zero comm buffer init (#6154) by Hongxin Liu
- [hotfix] fix flash attn window_size err (#6132) by duanjunwen
Doc
- [doc] add bonus event (#6164) by binmakeswell
- [doc] update cloud link (#6148) by Sze-qq
- [doc] add hpc cloud intro (#6147) by Sze-qq
Device
- [Device]Support npu (#6159) by flybird11111
Fix
- [fix] fix bug caused by perf version (#6156) by duanjunwen
- [fix] multi-node backward slowdown (#6134) by Hanks
Optim
- [optim] hotfix adam load (#6146) by Hongxin Liu
Zerobubble
- [Zerobubble] merge main. (#6142) by duanjunwen
Async io
- [async io]supoort async io (#6137) by flybird11111
Ckpt
- [ckpt] Add async ckpt api (#6136) by Wang Binluo
Cli
- [cli] support run as module option (#6135) by Hongxin Liu
Zero
- [zero] support extra dp (#6123) by Hongxin Liu
Coati
Plugin
- [plugin] support get_grad_norm (#6115) by Hongxin Liu
Full Changelog: v0.4.7...v0.4.6