🍺 Homebrew support (Apple M1/M2)
brew install tabbyml/tabby/tabby
# Start with StarCoder-1B
tabby serve --device metal --model TabbyML/StarCoder-1B📦 Artifacts
- Binary for Mac OSX M1/M2, with Metal support: tabby_aarch64-apple-darwin.
- Binary for Linux x86/64, CPU only: tabby_x86_64-unknown-linux-gnu.
- Docker image with NVIDIA CUDA Support: tabbyml/tabby:0.1.1.
🚀 Features
- Metal inference backend for Apple M1/M2: #391
- StarCoder model series support: ggml-org/llama.cpp#3187
- Experimental support of http api backend: in #410 #419
🧰 Improvements
- Improve default suffix handling in FIM inference. #400
💫 New Contributors
- @sunny0826 made their first contribution in #399
- @leiwen83 made their first contribution in #421
Full Changelog: v0.0.1...v0.1.1