hpcaitech/ColossalAI v0.1.13

Version v0.1.13 Release Today!

on GitHub

What's Changed

Version

• [version] 0.1.13 (#2152) by Jiarui Fang
• Revert "[version] version to v0.1.13 (#2139)" (#2153) by Jiarui Fang
• [version] version to v0.1.13 (#2139) by Jiarui Fang

Gemini

• [Gemini] GeminiDPP convert to PyTorch Module. (#2151) by Jiarui Fang
• [Gemini] Update coloinit_ctx to support meta_tensor (#2147) by BlueRum
• [Gemini] revert ZeROInitCtx related tracer (#2138) by Jiarui Fang
• [Gemini] update API of the chunkmemstatscollector. (#2129) by Jiarui Fang
• [Gemini] update the non model data record method in runtime memory tracer (#2128) by Jiarui Fang
• [Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127) by Jiarui Fang
• [Gemini] update non model data calculation method (#2126) by Jiarui Fang
• [Gemini] hotfix the unittest bugs (#2125) by Jiarui Fang
• [Gemini] mapping of preop timestep and param (#2124) by Jiarui Fang
• [Gemini] chunk init using runtime visited param order (#2115) by Jiarui Fang
• [Gemini] chunk init use OrderedParamGenerator (#2110) by Jiarui Fang

Nfc

• [NFC] remove useless graph node code (#2150) by Jiarui Fang
• [NFC] update chunk manager API (#2119) by Jiarui Fang
• [NFC] polish comments for Chunk class (#2116) by Jiarui Fang

Autoparallel

• [autoparallel] process size nodes in runtime pass (#2130) by YuliangLiu0306
• [autoparallel] implement softmax handler (#2132) by YuliangLiu0306
• [autoparallel] gpt2lp runtimee test (#2113) by YuliangLiu0306

Example

• Merge pull request #2120 from Fazziekey/example/stablediffusion-v2 by Fazzie-Maqianli

Optimizer

• [optimizer] add div_scale for optimizers (#2117) by HELSON

Pp middleware

• [PP Middleware] Add bwd and step for PP middleware (#2111) by Ziyue Jiang

Full Changelog: v0.1.13...v0.1.12