ROCm/FastFlowLM v0.9.12

🚀 FastFlowLM v0.9.12 — GPT-OSS 20B, CORS Defaults, Cleaner Lists

on GitHub

✨ What’s New

🧠 1. New Model: gpt-oss:20b

Introducing the first-ever MoE (Mixture of Experts) model to run natively on AMD Ryzen™ AI NPUs, and also the first MoE model released by FastFlowLM (FLM).

gpt-oss:20b is a fast, open-source MoE model by OpenAI — powered by FLM’s NPU-native MoE engine with MXFP4 support, delivering high throughput and power efficiency optimized for AMD NPUs.

• Runs fully offline on AMD Ryzen™ AI NPU
• Supports reasoning effort controls in both CLI and Server mode

Try it:

# CLI
flm run gpt-oss:20b
# Server
flm serve gpt-oss:20b

Set reasoning effort (CLI):

# CLI
flm run gpt-oss:20b
/set r-eff medium

📝 NOTE

• Memory Requirements
  ⚠️ Note: Running gpt-oss:20b may need a system with > 32 GB RAM. The model itself uses ~15.1 GB of memory in FLM, and there is an internal cap (~15.6 GB) from on NPU memory allocation enforced by AMD/Microsoft, which makes only about half of the total system RAM available to the NPU. On 32 GB machines, it sometimes works sometimes not, so we recommend more RAM for a smooth experience.

🌐 2. Cross-Origin Resource Sharing (CORS)

CORS lets browser apps hosted on a different origin call your FLM server safely.

• Enable CORS

flm serve --cors 1

• Disable CORS

flm serve --cors 0

⚠️ Default: CORS is enabled.
🔒 Security tip: Disable CORS (or restrict at your proxy) if your server is exposed beyond localhost.

🔌 3. Default Server Port Change

The default port has moved from 11434 → 52625 to reduce conflicts.

Check or override anytime:

# Show current effective port
flm port

# Use a custom port for this session only
flm serve llama3.2:1b --port 8000
flm serve llama3.2:1b -p 8000

💡 --port (or -p) affects this run only and does not change your system defaults.

📃 4 Improved flm list

Cleaner output, filters, and a quiet mode.

Common uses:

# Default view (pretty, with icons)
flm list

# Quiet view (no emoji / minimal)
flm list --quiet

# Show everything
flm list --filter all --quiet

# Only models already installed
flm list --filter installed --quiet

# Only models not yet installed
flm list --filter not-installed --quiet

🌟 Summary

This release supports gpt-oss:20b which is a state-of-the-art MoE model, enables CORS by default (toggleable), changes the default server port to 52625, and improves flm list with quieter, filterable output.