MakazhanAlpamys/Soup v0.3.0

v0.3.0 — Phase 3: Serve, Generate, Sweep, Diff, DeepSpeed

on GitHub

What's New

🚀 New Commands

• soup serve — FastAPI inference server with OpenAI-compatible API (/v1/chat/completions), SSE streaming support
• soup data generate — Synthetic data generation via OpenAI API or local models (alpaca/sharegpt/chatml formats)
• soup sweep — Hyperparameter search with grid/random strategies, integrated with experiment tracker
• soup diff — Side-by-side model comparison with overlap metrics

⚡ Multi-GPU / DeepSpeed

• --deepspeed flag in soup train (presets: zero2, zero3, zero2_offload, or custom JSON)
• Auto GPU detection for multi-GPU setups

📦 Install extras

pip install soup-cli[serve]     # FastAPI + uvicorn
pip install soup-cli[generate]  # httpx for OpenAI API
pip install soup-cli[deepspeed] # DeepSpeed

🧪 Testing

• 95 new tests (281 total), all passing
• 5 new test files: test_serve, test_generate, test_sweep, test_diff, test_deepspeed

Full Changelog: v0.2.2...v0.3.0