hpcaitech/ColossalAI v0.1.11rc3

Version v0.1.11rc3 Release Today!

on GitHub

What's Changed

Release

• [release] update version (#1931) by ver217

Tutorial

• [tutorial] polish README and OPT files (#1930) by binmakeswell
• [tutorial] add synthetic dataset for opt (#1924) by ver217
• [tutorial] updated hybrid parallel readme (#1928) by Frank Lee
• [tutorial] added synthetic data for sequence parallel (#1927) by Frank Lee
• [tutorial] removed huggingface model warning (#1925) by Frank Lee
• Hotfix/tutorial readme index (#1922) by Frank Lee
• [tutorial] modify hands-on of auto activation checkpoint (#1920) by Boyuan Yao
• [tutorial] added synthetic data for hybrid parallel (#1921) by Frank Lee
• [tutorial] added synthetic data for hybrid parallel (#1919) by Frank Lee
• [tutorial] added synthetic dataset for auto parallel demo (#1918) by Frank Lee
• [tutorial] updated auto parallel demo with latest data path (#1917) by Frank Lee
• [tutorial] added data script and updated readme (#1916) by Frank Lee
• [tutorial] add cifar10 for diffusion (#1907) by binmakeswell
• [tutorial] removed duplicated tutorials (#1904) by Frank Lee
• [tutorial] edited hands-on practices (#1899) by BoxiangW

Example

• [example] update auto_parallel img path (#1910) by binmakeswell
• [example] add cifar10 dadaset for diffusion (#1902) by Fazzie-Maqianli
• [example] migrate diffusion and auto_parallel hands-on (#1871) by binmakeswell
• [example] initialize tutorial (#1865) by binmakeswell
• Merge pull request #1842 from feifeibear/jiarui/polish by Fazzie-Maqianli
• [example] polish diffusion readme by jiaruifang

Sc

• [SC] add GPT example for auto checkpoint (#1889) by Boyuan Yao
• [sc] add examples for auto checkpoint. (#1880) by Super Daniel

Nfc

• [NFC] polish colossalai/amp/naive_amp/init.py code style (#1905) by Junming Wu
• [NFC] remove redundant dependency (#1869) by binmakeswell
• [NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1856) by yuxuan-lou
• [NFC] polish .github/workflows/scripts/generate_release_draft.py code style (#1855) by Ofey Chan
• [NFC] polish workflows code style (#1854) by Kai Wang (Victor Kai)
• [NFC] polish colossalai/amp/apex_amp/init.py code style (#1853) by LuGY
• [NFC] polish .readthedocs.yaml code style (#1852) by nuszzh
• [NFC] polish <.github/workflows/release_nightly.yml> code style (#1851) by RichardoLuo
• [NFC] polish amp.naive_amp.grad_scaler code style by zbian
• [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style (#1845) by HELSON
• [NFC] polish ./colossalai/amp/torch_amp/init.py code style (#1836) by Genghan Zhang
• [NFC] polish .github/workflows/build.yml code style (#1837) by xyupeng
• [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py code style (#1829) by Sze-qq
• [NFC] polish colossalai/amp/torch_amp/_grad_scaler.py code style (#1823) by Ziyue Jiang
• [NFC] polish .github/workflows/release_docker.yml code style by Maruyama_Aya
• [NFC] polish .github/workflows/submodule.yml code style (#1822) by shenggan
• [NFC] polish .github/workflows/draft_github_release_post.yml code style (#1820) by Arsmart1
• [NFC] polish colossalai/amp/naive_amp/_fp16_optimizer.py code style (#1819) by Fazzie-Maqianli
• [NFC] polish colossalai/amp/naive_amp/_utils.py code style (#1816) by CsRic
• [NFC] polish .github/workflows/build_gpu_8.yml code style (#1813) by Zangwei Zheng
• [NFC] polish MANIFEST.in code style (#1814) by Zirui Zhu
• [NFC] polish strategies_constructor.py code style (#1806) by binmakeswell

Doc

• [doc] add news (#1901) by binmakeswell

Zero

• [zero] migrate zero1&2 (#1878) by HELSON

Autoparallel

• [autoparallel] user-friendly API for CheckpointSolver. (#1879) by Super Daniel
• [autoparallel] fix linear logical convert issue (#1857) by YuliangLiu0306

Fx

• [fx] metainfo_trace as an API. (#1873) by Super Daniel

Hotfix

• [hotfix] pass test_complete_workflow (#1877) by Jiarui Fang

Inference

• [inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876) by Jiarui Fang
• [inference] streaming Linear 1D Row inference (#1874) by Jiarui Fang

Amp

• [amp] add torch amp test (#1860) by xcnick

Diffusion

• [diffusion] fix package conflicts (#1875) by HELSON

Utils

• [utils] fixed lazy init context (#1867) by Frank Lee
• [utils] remove lazy_memory_allocate from ColoInitContext (#1844) by Jiarui Fang

Full Changelog: v0.1.11rc3...v0.1.11rc2