av/harbor v0.4.15

v0.4.15 - Lemonade, Tokscale

on GitHub

Lemonade

AMD Lemonade inference server for ROCm GPUs.

harbor up lemonade

Tokscale

Token-level autoscaling proxy for LLM backends.

harbor up tokscale

Misc

• TabbyAPI switched to official image with updated default model and hfdownloader fix

• fix(profile): validate remotely downloaded profiles to prevent command injection (CWE-78) by @sebastiondev in #236

• Lint exclusions for vendored third-party caches

Full Changelog: v0.4.14...v0.4.15