What's New
π Phase 6.1: Community & Examples
New Files
- CONTRIBUTING.md β Full contributor guide: fork, run tests, lint, code style, submit PRs
- CODE_OF_CONDUCT.md β Contributor Covenant v2.1 for a welcoming community
- SECURITY.md β Responsible disclosure policy with 48h response SLA
- .github/FUNDING.yml β GitHub Sponsors + Buy Me a Coffee sponsorship links
- examples/ β Real-world configuration examples and sample datasets
Example Configurations
- sft_basic.yaml β TinyLlama SFT (quick test, 2-3 min on consumer GPU)
- dpo_chat.yaml β Llama 2 7B with DPO (Direct Preference Optimization)
- grpo_reasoning.yaml β Reasoning model with GRPO
- οΏ½ision_llama.yaml β LLaMA-Vision on image-caption pairs
lhf_step1_sft.yaml,
lhf_step2_reward.yaml,
lhf_step3_ppo.yaml β Full RLHF pipeline
Sample Datasets
- οΏ½lpaca_tiny.jsonl β 10 instruction-following examples
- chat_preferences.jsonl β 5 preference-ranked chat responses (for DPO, reward modeling)
easoning_math.jsonl β 5 math/logic problems with step-by-step solutions
Community
- 611 tests passing (ruff lint clean, CI green)
- Ready for contributors π²
Install / Upgrade
\\οΏ½ash
pip install --upgrade soup-cli
\\
Documentation
- CONTRIBUTING.md β How to contribute
- examples/ β Try the examples
- SECURITY.md β Report security issues
- CODE_OF_CONDUCT.md β Community guidelines