What's Changed
Features
- feat(providers): Add xAI image provider by @mldangelo in #4130
- feat(cli): add validate command by @mldangelo in #4134
- feat(redteam): add camelCase strategy by @mldangelo in #4146
- feat: add typed row interfaces for eval queries by @mldangelo in #4186
- feat: add goal/intent extraction by @MrFlounder in #4178
Fixes
- fix(prompts): splitting when PROMPTFOO_PROMPT_SEPARATOR is contained within a string with text files by @mldangelo in #4142
- fix: isolate proxy vars in bedrock tests by @mldangelo in #4181
- fix(docs): Fix issue with docs links not scrolling to the top by @faizanminhas in #4195
- fix: when there’s too many intents result won’t render error by @MrFlounder in #4175
- fix: need to send auth request to api path by @sklein12 in #4199
- fix: Gemini MCP integration - can not parse $schema field by @adelmuursepp in #4200
Chores
- chore(redteam): add harmful plugin preset to redteam setup ui by @mldangelo in #4132
- chore(redteam): add label strategy-less plugins in redteam setup ui by @mldangelo in #4131
- chore(redteam): improve style of redteam purpose field in webui by @mldangelo in #4124
- chore(providers): add xai live search support by @mldangelo in #4123
- chore(providers): add Claude 4 support to anthropic, bedrock, and vertex providers by @mldangelo in #4129
- chore: bump @aws-sdk/client-bedrock-runtime from 3.816.0 to 3.817.0 by @dependabot in #4164
- chore(providers): update fal provider by @mldangelo in #4182
- chore: remove redundant test comments by @mldangelo in #4183
- chore: add typed interface for MCP tool schemas by @mldangelo in #4187
- chore(redteam): add ToxicChat dataset as redteam plugin by @mldangelo in #4121
- chore(webui): add max concurrency as an option for run in browser by @faizanminhas in #4147
- chore(app/evals): Adds Agent Discovered Information to Redteam Report by @will-holley in #4198
- chore: bump version 0.114.0 by @sklein12 in #4201
Docs
- docs(site): minimal copy page button + sanitize text by @mldangelo in #4156
- docs(site): scroll to top when using by @mldangelo in #4162
- docs: fix DOM nesting warning and sort plugins array by @mldangelo in #4174
- docs(site): document missing redteam plugins by @mldangelo in #4169
- docs(site): restore scroll-to-top behavior on page navigation by @mldangelo in #4176
- docs: iterative jailbreak diagram by @typpo in #4191
Full Changelog: 0.113.4...0.114.0