What's Changed
Features
- feat: FERPA red team plugin by @typpo in #6130
- feat(redteam): show granular subcategory metrics for harmful plugins by @MrFlounder in #6134
- feat: hydra the new advanced multi-turn red team strategy by @MrFlounder in #6151
- feat(providers): add variable templating support for initialMessages in simulated-user provider by @mldangelo in #6143
- feat: executable prompt scripts by @typpo in #5329
- feat(webui): display rendered assertion values in Evaluation tab by @mldangelo in #6145
- feat(webui): improve delete eval UX with confirmation and smart navigation by @mldangelo in #6113
- feat(eval): add 'not_equals' operator for plugin filters by @will-holley in #6155
Bug Fixes
- fix: table width now respects column visibility changes by @mldangelo in #5884
- fix(webui): custom policy name consistency by @will-holley in #6123
- fix(docker): resolve @swc/core SIGSEGV on Alpine Linux by @pokutuna in #6127
- fix(deps): add @vitest/coverage-v8 to match vitest version by @mldangelo in #6122
- fix(openai): extend automatic 10-minute timeout to gpt-5-pro models by @mldangelo in #6147
- fix: support runtime variables in custom rubricPrompt for factuality and model-graded-closedqa by @typpo in #5340
- fix(cli): honor commandLineOptions from config file for all runtime options by @mldangelo in #6142
- fix: update risk scoring thresholds to align with CVSS v3.x/v4.0 by @addelong in #6132
Documentation
- docs(site): homepage and other updates by @typpo in #6135
- docs(site): mobile fixes by @typpo in #6137
- docs(site): fix buttons unclickable when animations disabled by @typpo in #6138
- docs(site): minor update to github star display by @typpo in #6140
- docs(site): homepage accessibility and styling fixes by @typpo in #6141
- docs(providers): comprehensive Alibaba Cloud provider update with 100+ models by @mldangelo in #6144
- docs: add portkey post to guides section by @ladyofcode in #5730
- docs(site): re-add adaptive guardrail documentation by @mldangelo in #5955
- docs(site): add threat intelligence blog on PROMPTFLUX, PROMPTSTEAL, and AI-orchestrated attacks by @ladyofcode in #5583
- docs: document promptfoo view --no flag in command-line docs by @iitslamaa in #6067
- docs: Update installation instructions with troubleshooting info by @iitslamaa in #6014
- docs(site): demo cta and minor copy changes by @typpo in #6160
- docs(site): add October 2025 release highlights by @mldangelo in #6158
- chore: add doc for grading guidance by @MrFlounder in #6128
Chores
- chore: bump @aws-sdk/client-bedrock-runtime from 3.925.0 to 3.926.0 by @dependabot[bot] in #6129
- chore(examples): update openai-agents-basic example by @mldangelo in #6114
- chore(deps): update dependencies to latest minor and patch versions by @mldangelo in #6139
- chore(server): change traces fetch log to debug level by @mldangelo in #6152
- chore(ci): make staging redteam test non-blocking by @mldangelo in #6159
- chore(changelog): clean up Unreleased section with PR references and user-focused descriptions by @mldangelo in #6157
- chore: bump version 0.119.5 by @MrFlounder in #6163
- refactor(webui): centralize hidden metadata keys constant by @mldangelo in #6146
- refactor: add type safety for database query results by @mldangelo in #6150
- perf: remove unnecessary await from synchronous database operations by @mldangelo in #6149
Tests
- test: CoverBot: Added tests for RedTeam report suggestions dialog (
src/app) by @Use-Tusk[bot] in #6161
Full Changelog: 0.119.4...0.119.5