github promptfoo/promptfoo 0.107.5

latest releases: 0.107.7, 0.107.6
7 days ago

What's Changed

Features

Bug Fixes

  • fix(togetherai): ensure max_tokens is respected in configuration by @mldangelo in #3468
  • fix(providers): handle malformed response in a21 by @typpo in #3465
  • fix(csv): newlines in CSVs by @typpo in #3459
  • fix(providers): simulated user bugs by @typpo in #3463
  • fix(assertions): replace logical OR with nullish coalescing for thresholds by @mldangelo in #3486
  • fix(redteam): filter out template variables in entity extraction by @mldangelo in #3476
  • fix(redteam): type of ALL_STRATEGIES to be as const by @faizanminhas in #3494

Chores

  • chore: add filepaths to debug output by @typpo in #3464
  • chore: remove generate test cases button from UI by @faizanminhas in #3475
  • chore(content): update user statistics by @mldangelo in #3460
  • chore(deps): update dependencies to latest versions by @mldangelo in #3453
  • chore(providers): add support and docs for gemini 2.5 pro to Google Chat Provider by @faizanminhas in #3485
  • chore(providers): support refusal and JSON schemas in openai responses api by @mldangelo in #3456
  • chore(providers): update openai model costs and add missing models by @mldangelo in #3454
  • chore(redteam): add a PlinyGrader to more accurately grade Pliny results by @faizanminhas in #3478
  • chore: bump @aws-sdk/client-bedrock-runtime from 3.758.0 to 3.772.0 by @dependabot in #3452
  • chore: bump @aws-sdk/client-bedrock-runtime from 3.772.0 to 3.774.0 by @dependabot in #3482
  • chore: bump @aws-sdk/client-bedrock-runtime from 3.774.0 to 3.775.0 by @dependabot in #3498
  • chore: bump openai from 4.88.0 to 4.89.0 by @dependabot in #3451
  • chore: bump version 0.107.5 by @mldangelo in #3505
  • chore: bump vite from 5.4.14 to 5.4.15 in the npm_and_yarn group by @dependabot in #3483

Docs

Tests

  • test: add unit test for src/app/src/pages/redteam/setup/components/strategies/utils.ts by @gru-agent in #3495
  • test: add unit test for src/providers/openai/util.ts by @gru-agent in #3455

Full Changelog: 0.107.4...0.107.5

Don't miss a new promptfoo release

NewReleases is sending notifications on new releases.