FastFlowLM v0.9.13 delivers performance improvements, OpenAI Harmony support, and greater compatibility with Ollama-style endpoints.
🚀 Highlights
🔹 1. GPT-OSS:20b Prefill Speed Boost
- Up to 20% faster prefill for
gpt-oss:20b - Reduces latency for long prompts and improves responsiveness
- v0.9.13 auto-downloads the updated model from HuggingFace.
🔹 2. OpenAI Harmony Integration
- Added support for OpenAI’s Harmony Chat Template
- Enables richer multi-turn dialogue and structured generation capabilities
🔹 3. /api/show Endpoint (Ollama Compatibility)
- FastFlowLM now supports
/api/show - Compatible with tools that rely on Ollama API conventions
🔹 4. /v1/completions (legacy OpenAI API) is now supported
- OpenAI do not recommend to use it for new app
⚙️ Optional Performance Tip
🆕 New NPU Driver Available
Upgrading to the latest AMD Ryzen AI NPU driver (v32.0.203.304) may boost prefill and decoding performance by an additional 5–10%.
📄 Download Link
Note: You will need an AMD account to access the driver.
This release makes FastFlowLM faster, more OpenAI-compatible, and ready for broader integration into multimodal workflows and edge deployments.