av/harbor v0.2.16

v0.2.16 - 4 new services, bugfixes, Discord

on GitHub

Overview

This release comes a few new services, as well as some additional helper features.

Open WebUI Pipelines

Integration authored by @ic4l4s9c 🎉

pipelines bring modular, customizable workflows to any UI client supporting OpenAI API specs.

harbor up pipelines

• Official documentation
• Examples on GitHub

Qdrant

Also authored by @ic4l4s9c 🎉

First shared vector store for Harbor - will be used by supported satellites in the future.

harbor up qdrant

REST API: http://localhost:34221
Web UI: http://localhost:34221/dashboard
GRPC API: http://localhost:34222

Chat Nio

New promising WebUI for LLMs. Harbor pre-configures it for ollama and searxng out of the box.

# Start the service
harbor up chatnio
# [Optional] Open the UI
harbor open chatnio

K6

Load testing toolkit. Harbor's version comes with a lot of things pre-configured testing of OpenAI-compatible LLM APIs, including a custom grafana dashboard (with token stats), api client helpers and sample scripts.

Discord

We have a Discord now. Come say "Hi 👋🏻" if you want to chat to someone about Harbor.

Misc

• webui - fixing missing override.env after v0.2.15
• harbor open - now supports overrides via <service>.open_url config

New Contributors

• @ic4l4s9c made their first contribution in #75

Full Changelog: v0.2.15...v0.2.16