🚀 Foundry Local v2.2.1

We're excited to announce Foundry Local v2.2.1. This release makes it easier to bring your own models to local applications, expands tool calling for agentic workflows, and delivers important security, reliability, and inference improvements across the SDKs.

🆕 What's New

🔄 CUDA changes

Reduced binary size by no longer bundling CUDA toolkit and CUDA runtime on Windows
Enable CUDA EP download/registration for Linux ARM64
Support independent PATH and AddDllDirectory CUDA loading on Windows

Note

CUDA and cuDNN runtimes must be installed separately; Foundry Local does not download them.

Windows/Linux x64: CUDA 12 and compatible cuDNN 9 runtimes.
Windows/Linux ARM64: CUDA 13 and compatible cuDNN 9 runtimes.

On Windows, add the runtime DLL directories to PATH. On Linux, configure the system library search path or LD_LIBRARY_PATH.
Configure library search paths before starting your application.
Windows x64 applications must additionally call AddDllDirectory for the CUDA runtime directory before CUDA execution-provider registration; PATH alone is insufficient for the GenAI CUDA bridge. This additional step is not required for the shipped Windows ARM64 bridge.

📦Models

Migrated to catalog v2, which should support increased speeds and stability
Check minimum Foundry Local version needed for model so that we always fetch the latest version of a model that can run with the given version of Foundry Local SDK
Support coding models
Improve BYOM metadata

🛠️ More Capable Tool Calling

Improve tool calling for Qwen and coding agents
Reject generic tool calls; fail-closed if schema is invalid
Allow disabling of parallel tool calls

🔒 Security, Reliability, and Bug Fixes

Enable CFG for Foundry Local DLL
Enable CPP SDK signing and versioning
Allow removal of incomplete/corrupted model caches
Fix telemetry teardown hang/crash
Cancel non-streaming chat inference when clients disconnect
Add NuGet proxy fallback for environments where we cannot pull packages from nuget.org

📥 Source Code

GitHub automatically includes source archives with the v2.2.1 release:

📚 Resources


📖 Documentation	https://aka.ms/foundry-local-docs
🐙 GitHub	https://github.com/microsoft/Foundry-Local
🧪 Samples	https://github.com/microsoft/Foundry-Local/tree/main/samples
💬 Discord	https://aka.ms/foundry-local-discord

💙 Feedback

File issues at https://github.com/microsoft/Foundry-Local/issues and include the SDK version, platform, and relevant diagnostics.

microsoft/Foundry-Local v2.2.1 Foundry Local v2.2.1 on GitHub