0.119.14 (2025-12-01)
Features
- Add web search assertion type (#5111) (11c01cc)
- examples: add Strands Agents SDK example (#6384) (28c3d58)
- providers: add AWS Bedrock Converse API provider (#6348) (8ab3f96)
- providers: add Claude Agent SDK plugin support (#6377) (d3e67f5)
- providers: add comprehensive Azure model support (#6375) (2e53c08)
- providers: add Google Cloud Model Armor support to Vertex AI (#6365) (0d1641b)
- providers: add Groq reasoning models, Responses API, and built-in tools support (#6231) (7cbddd0)
- providers: add missing Claude Agent SDK options (#6389) (d0d227c)
- providers: add OpenAI ChatKit provider (#6406) (433ac65)
- providers: add OpenAI Codex SDK provider (#6321) (cc45c0f)
- providers: add verbosity and isReasoningModel config to azure:responses (#6382) (e99b8a8)
- providers: add xAI Responses API with Agent Tools support (#6386) (fad0fc8)
- redteam: update VLGuard to use original MIT-licensed dataset (#5809) (dbabbaf)
- Share trace data to promptfoo cloud (ce251ae)
- vs code red team extension (#6396) (406dc61)
Bug Fixes
- ci: restore original tag format for GitHub releases (#6402) (e49e5b8)
- cli: resolve eval command hanging by adding missing await calls (#6422) (137231a)
- deps: replace xlsx with read-excel-file to fix high severity vulnerability (#6357) (e6e2b98)
- deps: update node-forge to 1.3.2 to fix security vulnerability (#6395) (2b96ee2)
- evals: do not truncate image responses in eval (#6391) (d6fb07c)
- mcp: pass timeout configuration to MCP SDK calls (#6394) (d05da44)
- modelaudit: track scanner version and re-scan on version changes (#6361) (f0e8065)
- preserve all file:// references in vars context for runtime loading (#6393) (55c553c)
- prevent Node.js from hanging when importing promptfoo as a library (#6351) (af857a3)
- providers: fix ChatKit echo behavior and concurrency issues (#6420) (04df4a8)
- site: add truncation marker to blog post (#6392) (900fac2)
- webui: resolve Vitest timing issues causing test timeouts (#6356) (353ab11)