hpcaitech/ColossalAI v0.1.11rc5

Version v0.1.11rc5 Release Today!

on GitHub

What's Changed

Release

• [release] update to 0.1.11rc5 (#2053) by Frank Lee

Cli

• [cli] updated installation cheheck with more inforamtion (#2050) by Frank Lee

Gemini

• [gemini] fix init bugs for modules (#2047) by HELSON
• [gemini] add arguments (#2046) by HELSON
• [Gemini] free and allocate cuda memory by tensor.storage, add grad hook (#2040) by Zihao
• [Gemini] more tests for Gemini (#2038) by Jiarui Fang
• [Gemini] more rigorous unit tests for run_fwd_bwd (#2034) by Jiarui Fang
• [Gemini] paramWrapper paramTracerHook unitest (#2030) by Zihao
• [Gemini] patch for supporting orch.add_ function for ColoTensor (#2003) by Jiarui Fang
• [gemini] param_trace_hook (#2020) by Zihao
• [Gemini] add unitests to check gemini correctness (#2015) by Jiarui Fang
• [Gemini] ParamMemHook (#2008) by Zihao
• [Gemini] param_tracer_wrapper and test case (#2009) by Zihao

Setup

• [setup] supported conda-installed torch (#2048) by Frank Lee

Test

• [test] align model name with the file name. (#2045) by Jiarui Fang

Hotfix

• [hotfix] hotfix Gemini for no leaf modules bug (#2043) by Jiarui Fang
• [hotfix] add bert test for gemini fwd bwd (#2035) by Jiarui Fang
• [hotfix] revert bug PRs (#2016) by Jiarui Fang

Zero

• [zero] fix testing parameters (#2042) by HELSON
• [zero] fix unit-tests (#2039) by HELSON
• [zero] test gradient accumulation (#1964) by HELSON

Testing

• [testing] fix testing models (#2036) by HELSON

Rpc

• [rpc] split with dag (#2028) by Ziyue Jiang

Autoparallel

• [autoparallel] add split handler (#2032) by YuliangLiu0306
• [autoparallel] add experimental permute handler (#2029) by YuliangLiu0306
• [autoparallel] add runtime pass and numerical test for view handler (#2018) by YuliangLiu0306
• [autoparallel] add experimental view handler (#2011) by YuliangLiu0306
• [autoparallel] mix gather (#1977) by Genghan Zhang

Fx

• [fx]Split partition with DAG information (#2025) by Ziyue Jiang

Github

• [GitHub] update issue template (#2023) by binmakeswell

Workflow

• [workflow] removed unused pypi release workflow (#2022) by Frank Lee

Full Changelog: v0.1.11rc5...v0.1.11rc4