ROCm/FastFlowLM v1.0.4

🚀 FastFlowLM v1.0.4 — Gemma4-12B-IT

on GitHub

This release adds a new model and fixes an image-max-tokens bug affecting the Gemma4 family.

📦 New Model Support

🌎 Gemma4-12B-IT

FastFlowLM now supports gemma4-it:12b for language, vision, audio workloads, including concurrent multimodal input for omni-model use cases.

• Tag: gemma4-it:12b

Run in CLI mode:

flm run gemma4-it:12b

Run in server mode:

flm serve gemma4-it:12b

For more details, see the model card and benchmark results.

🐛 Bug Fix: Gemma4 Family image-max-tokens

Fixed a bug where the image-max-tokens custom parameter was not workable in previous versions for the Gemma4 family. Image token limits are now correctly applied.

See Add FLM Custom Parameters for how to set it via Open WebUI.

🌟 Summary

Thanks for your support — see you in the next one! 🚀