av/harbor v0.3.8

v0.3.8 - LocalAI, Local Deep Research

on GitHub

LocalAI

All-in-one service to download and run LLMs, TTS/STT/Image generation models

harbor up localai

Local Deep Research

Deep Research functionality with local LLMs

harbor up ldr searxng

Harbor Boost - new workflows

• dot - Draft of Thoughts
• grug - Grug make plan with simple word-think. Grug find new path in head-picture that smart-talk no find.
• polyglot - Model generates answers in multiple langugages then synthesises a final solution
• tri - Generates three aspects, then three pitfalls and then three alternative answers before synthesising a final solution

Misc

• boost
  • Switching to av/tools, use uv
  • llm - stream_completion allows skipping emit to the client
  • querying downstream models is cached for 1 minute
• ollama - disabling automatic restarts to align with other Harbor services
• searxng
  • aligning configuration with other services - configurable image/version
  • fixed healthcheck
  • harbor config set searxng.internal_url to point all harbor searxng use to an external SearXNG instance
• librechat - connect to boost
• ollama - modelfile for Gemma 3 QAT w/ tool use in the template

Full Changelog: v0.3.7...v0.3.8