ROCm/FastFlowLM v0.1.1

🛠️ FastFlowLM v0.1.1 — Enhanced Model Support & UX Improvements

on GitHub

We’re excited to release v0.1.1 of FastFlowLM, bringing expanded model compatibility and improved usability for Windows users and REST API workflows.

✨ What's New

1. New Model Support

   • Added support for:
     Deepseek-R1-distill-Llama3.1-8B (think)
     This extends FastFlowLM to support the "think" variant of the Deepseek-R1 distilled model.

2. Improved Model Download Path

   • The default model directory has been updated to:

     C:\Users\<USER>\Documents\flm\models\
     

3. Simplified REST API Usage

   • The serve command now defaults to llama3.2:1B.
     You can start the server without specifying a model:

     flm serve

✅ Reminder: Supported Models

• Llama3.1:8B
• Llama3.2:1B
• Llama3.2:3B
• Deepseek-R1-distill-Llama3.1-8B