hpcaitech/ColossalAI v0.3.6

Version v0.3.6 Release Today!

on GitHub

What's Changed

Release

• [release] update version (#5411) by Hongxin Liu

Colossal-llama2

• [colossal-llama2] add stream chat examlple for chat version model (#5428) by Camille Zhong

Hotfix

• [hotfix] fix stable diffusion inference bug. (#5289) by Youngon
• [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) by digger yu
• [hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317) by digger yu
• [hotfix] fix typo change _descrption to _description (#5331) by digger yu
• [hotfix] fix typo of openmoe model source (#5403) by Luo Yihang
• [hotfix] fix sd vit import error (#5420) by MickeyCHAN
• [hotfix] Fix wrong import in meta_registry (#5392) by Stephan Kölker
• [hotfix] fix variable type for top_p (#5313) by CZYCW

Doc

• [doc] Fix typo s/infered/inferred/ (#5288) by hugo-syn
• [doc] update some translations with README-zh-Hans.md (#5382) by digger yu
• [doc] sora release (#5425) by binmakeswell
• [doc] fix blog link by binmakeswell
• [doc] fix blog link by binmakeswell
• [doc] updated installation command (#5389) by Frank Lee
• [doc] Fix typo (#5361) by yixiaoer

Eval-hotfix

• [eval-hotfix] set few_shot_data to None when few shot is disabled (#5422) by Dongruixuan Li

Devops

• [devops] fix extention building (#5427) by Hongxin Liu

Example

• [example]add gpt2 benchmark example script. (#5295) by flybird11111
• [example] reuse flash attn patch (#5400) by Hongxin Liu

Workflow

• [workflow] added pypi channel (#5412) by Frank Lee

Shardformer

• [shardformer]gather llama logits (#5398) by flybird11111

Setup

• [setup] fixed nightly release (#5388) by Frank Lee

Fsdp

• [fsdp] impl save/load shard model/optimizer (#5357) by QinLuo

Extension

• [extension] hotfix jit extension setup (#5402) by Hongxin Liu

Llama

• [llama] fix training and inference scripts (#5384) by Hongxin Liu

Full Changelog: v0.3.6...v0.3.5