github MakazhanAlpamys/Soup v0.18.0
v0.18.0 — Ollama Integration

latest releases: v0.75.2, v0.75.1, v0.75.0...
6 months ago

What's New

Ollama Integration — Deploy Models in One Command

Seamless pipeline: train → export → deploy to Ollama.

New commands:

  • soup deploy ollama --model <gguf> --name <name> — deploy GGUF to local Ollama
  • soup deploy ollama --list — list Soup-deployed models
  • soup deploy ollama --remove <name> — remove a model
  • soup export --deploy ollama — export GGUF + auto-deploy in one step

Features:

  • Auto-detect chat template from soup.yaml (chatml, llama, mistral, vicuna, zephyr)
  • Custom system prompts via --system
  • Configurable Ollama parameters via --parameter key=value (repeatable)
  • Rich terminal UI with deploy plan panel and progress indicators

Security hardening:

  • GGUF path traversal protection + .gguf extension validation
  • Model name validation (no path separators, null bytes)
  • Modelfile parameter key allowlist prevents directive injection
  • Parameter value newline/null sanitization
  • Subprocess calls use list args (no shell injection)
  • Warning panel before overwriting existing Ollama models

Stats: 1449 tests, 57 test files, all passing

Install / Upgrade

pip install --upgrade soup-cli

Don't miss a new Soup release

NewReleases is sending notifications on new releases.