av/harbor v0.5.0

v0.5.0 - DMR, MLX, oMLX, Daytona

on GitHub

TL;DR

Four new backends - DMR (Docker Model Runner), MLX, oMLX, and Daytona sandbox - with cross-service integrations rolled out to 26 services each. llamacpp replaces Ollama as the default backend (harbor defaults add ollama to restore the old behavior). The Tauri app now handles the entire install workflow in-app. New CLI features: tab completion, port conflict detection, smart pull routing, custom volume mounts, fuzzy service suggestions, and harbor skills for AI agent discovery.

llamacpp default backend (breaking change)

llamacpp is now the default backend, replacing Ollama. Running harbor up with no arguments starts llamacpp instead of Ollama. Existing users who rely on harbor up launching Ollama should explicitly run harbor up ollama or set their default via harbor defaults add ollama. Cross-service integrations for llamacpp have been rolled out to 38 services.

Agent Skills

New harbor skills command exposes agent-facing CLI documentation, letting AI coding agents discover and use Harbor commands without manual prompting.

harbor skills             # list available skills
harbor skills get <name>  # show a skill's content

In-App Install

The Tauri app now ships a full guided setup flow — Docker detection, dependency installation, platform-specific package management, and CLI bootstrapping all happen inside the app. Covers macOS, WSL, Fedora, openSUSE, and minimal environments with cancel-between-steps, error recovery, and disk space checks.

DMR (Docker Model Runner)

Run models through Docker Desktop's built-in Model Runner with OpenAI-compatible API, auto-bootstrapped on harbor up.

harbor up dmr

MLX

Apple Silicon native inference via mlx-lm, with auto-bootstrap and host component setup on first run.

harbor up mlx

oMLX

OpenAI-compatible MLX inference server for Apple Silicon.

harbor up omlx

Daytona

Self-hosted sandbox environment service for AI agent workloads.

harbor up daytona

Misc

• Tab completion for bash, zsh, and fish shells.
• Port conflict pre-detection warns before harbor up fails.
• Smart pull routing automatically directs model downloads to the right backend.
• Custom volume mounts via harbor volumes CLI.
• Fuzzy service name suggestions when you mistype a service handle.
• MiniMax default model upgraded to M3.
• Comprehensive integration test suites added for CLI, config, and service lifecycle.

Full Changelog: v0.4.19...v0.5.0