ROCm/FastFlowLM v0.9.18

🚀 FastFlowLM v0.9.18 — Major Prefill Boost for GPT-OSS & Full LFM2 Integration

on GitHub

✨ What’s New

🔥 1. Significant Prefill Acceleration for GPT-OSS Models

FastFlowLM’s execution pipeline has undergone deep optimization, resulting in significant improvements to prefill performance — including faster time to first token (TTFT) and more efficient long-context ingestion.

Currently, these enhancements apply to:

• gpt-oss:20b
• gpt-oss-safeguard:20b

⬇️ A model redownload is required.

💧 2. Full Support for LFM2-1.2B (Liquid Foundation Model)

FastFlowLM now supports the LFM2-1.2B model (LiquidAI): first hybrid LLM architecture on AMD AMD Ryzen AI NPU, powered by very efficient FLM's linear attention engine.

Try it:

1. CLI mode

flm run lfm2:1.2b

1. Serve mode

flm serve lfm2:1.2b

This release delivers a major prefill speed boost for GPT-OSS models and introduces full support for the LFM2-1.2B Liquid Foundation Model.