Public preview update for the Foundry Local CLI.
Important
Preview. This is an early CLI build. Expect rough edges, missing polish, and changes between releases. Please file issues with [cli] in the title and include foundry report output when possible.
What's New
Updated Foundry Local SDK
This build updates the Foundry Local SDK and Runtime packages to 2.2.1, ONNX Runtime to 1.31.0 and ONNX Runtime GenAI 0.18.0.
⚡ Improvements
- CUDA execution-provider download and registration on Linux ARM64.
- Lower CLI overhead for model operations, large image requests, download progress, and log inspection.
- Clearer presentation of typed errors
- Support BYOM models
- Add verbose inference stats
- Improve Responses lifecycle to optimize memory usage
🐛 Fixed
- Fix loading CUDA EP on Windows
Note
CUDA and cuDNN runtimes must be installed separately; Foundry Local does not download them.
- Windows/Linux x64: CUDA 12 and compatible cuDNN 9 runtimes.
- Windows/Linux ARM64: CUDA 13 and compatible cuDNN 9 runtimes.
On Windows, add the runtime DLL directories to PATH. On Linux, configure the system library search path or LD_LIBRARY_PATH.
After changing these settings, open a new terminal and run foundry server restart.
Install
Pick the asset for your platform from the downloads list below.
| Platform | Asset |
|---|---|
| Windows x64 | foundry-0.12.1-win-x64.msix
|
| Windows ARM64 | foundry-0.12.1-win-arm64.msix
|
| macOS Apple Silicon | foundry-0.12.1-osx-arm64.pkg or foundry-0.12.1-osx-arm64.zip
|
| Linux x64 | foundry-0.12.1-linux-x64.tar.gz
|
| Linux ARM64 | foundry-0.12.1-linux-arm64.tar.gz
|
# Windows
Add-AppxPackage .\foundry-0.12.1-win-x64-winml.msix
foundry --version# macOS
sudo installer -pkg foundry-0.12.1-osx-arm64.pkg -target /
foundry --version# Linux
tar xzf foundry-0.12.1-linux-x64.tar.gz
cd foundry-0.12.1-linux-x64
./lib/foundry --versionAll binaries are signed by Microsoft Corporation. SHA-256 digests are shown on the asset list above.
Quick Start
foundry status
foundry model list
foundry model load qwen3-0.6b
foundry chat qwen3-0.6b
foundry transcribe -m whisper-tiny -f audio.wav
foundry server stop
Most commands accept --output json for scripting. Run foundry --help for the full command surface.
Coming from the older Foundry Local CLI?
The earlier service-based CLI has been replaced. Common commands map roughly as follows:
| Old service-based CLI | New CLI |
|---|---|
foundry service start / stop / restart / ps / diag
| foundry server start / stop / restart / logs
|
foundry model run <alias>
| foundry run <alias>
|
Run foundry --help for the full surface.
Links
- Docs: https://aka.ms/foundry-local-docs
- SDK: https://github.com/microsoft/Foundry-Local/tree/main/sdk
- Discord: https://aka.ms/foundry-local-discord
- Issues: https://github.com/microsoft/Foundry-Local/issues
Feedback
File issues at https://github.com/microsoft/Foundry-Local/issues with [cli] in the title and include the output of foundry report.