github ROCm/FastFlowLM v0.9.16
πŸš€ FastFlowLM v0.9.16 β€” Qwen3-VL arrives!

latest releases: v1.0.4, v1.0.3, v1.0.2...
10 months ago

✨ What’s included

πŸ–ΌοΈ New vision model: Qwen3-VL-4B-Instruct

  • Fully offline on AMD Ryzenβ„’ AI NPU
  • Optimized for lightweight, fast, vision-capable edge inference

Try it in two ways πŸ‘‡

πŸ’» CLI

Run model

flm run qwen3vl-it:4b

Then type

/input <image_path> <prompt>

🌐 In serve mode

Start flm server first:

flm serve qwen3vl-it:4b

and then interact with Open WebUI or any openai compatible client!


🌟 Summary

FastFlowLM v0.9.16 adds Qwen3-VL-4B-Instruct with full offline vision on AMD Ryzen AI β€” faster, smaller, and ready for edge.

Don't miss a new FastFlowLM release

NewReleases is sending notifications on new releases.