github promptfoo/promptfoo 0.114.0

latest releases: 0.118.3, 0.118.2, 0.118.1...
3 months ago

What's Changed

Features

Fixes

  • fix(prompts): splitting when PROMPTFOO_PROMPT_SEPARATOR is contained within a string with text files by @mldangelo in #4142
  • fix: isolate proxy vars in bedrock tests by @mldangelo in #4181
  • fix(docs): Fix issue with docs links not scrolling to the top by @faizanminhas in #4195
  • fix: when there’s too many intents result won’t render error by @MrFlounder in #4175
  • fix: need to send auth request to api path by @sklein12 in #4199
  • fix: Gemini MCP integration - can not parse $schema field by @adelmuursepp in #4200

Chores

  • chore(redteam): add harmful plugin preset to redteam setup ui by @mldangelo in #4132
  • chore(redteam): add label strategy-less plugins in redteam setup ui by @mldangelo in #4131
  • chore(redteam): improve style of redteam purpose field in webui by @mldangelo in #4124
  • chore(providers): add xai live search support by @mldangelo in #4123
  • chore(providers): add Claude 4 support to anthropic, bedrock, and vertex providers by @mldangelo in #4129
  • chore: bump @aws-sdk/client-bedrock-runtime from 3.816.0 to 3.817.0 by @dependabot in #4164
  • chore(providers): update fal provider by @mldangelo in #4182
  • chore: remove redundant test comments by @mldangelo in #4183
  • chore: add typed interface for MCP tool schemas by @mldangelo in #4187
  • chore(redteam): add ToxicChat dataset as redteam plugin by @mldangelo in #4121
  • chore(webui): add max concurrency as an option for run in browser by @faizanminhas in #4147
  • chore(app/evals): Adds Agent Discovered Information to Redteam Report by @will-holley in #4198
  • chore: bump version 0.114.0 by @sklein12 in #4201

Docs

Full Changelog: 0.113.4...0.114.0

Don't miss a new promptfoo release

NewReleases is sending notifications on new releases.