promptfoo/promptfoo 0.114.3

on GitHub

What's Changed

Features

• feat: Display audio file variables in result table
  #3864 by @faizanminhas
• feat(redteam): Update application definition flow to collect better info
  #4244 by @faizanminhas

Fixes

• fix: Resolve model-graded assertion providers from providerMap
  #4273 by @mldangelo
• fix: File content not being loaded when referenced with file:// prefix in vars
  #3793 by @adityabharadwaj198
• fix: Use array as type for vars
  #4281 by @sklein12

Tests

• test: Add unit test for src/globalConfig/accounts.ts
  #4259 by @gru-agent
• test: Add unit test for src/util/config/manage.ts
  #4258 by @gru-agent
• test: Add vitest coverage for frontend pages
  #4274 by @mldangelo
• test: Add unit test for renderVarsInObject formatting
  #4254 by @mldangelo
• test: Add unit test for src/redteam/plugins/base.ts
  #4233 by @gru-agent
• test: Add unit test for src/redteam/providers/crescendo/index.ts
  #4211
  #4214 by @gru-agent
• test: Add unit test for src/redteam/providers/crescendo/prompts.ts
  #4213 by @gru-agent

Documentation

• docs: Add job board
  #4264 by @typpo
• docs: Add custom policy to sidebar
  #4272 by @typpo
• docs: Add native build guidance to troubleshooting section
  #4253 by @mldangelo
• docs: Add anchor links to press page section headings
  #4265 by @mldangelo
• docs: Add JSON schema to example
  #4276 by @ladyofcode
• docs: Add schema header to example configs
  #4277 by @mldangelo
• docs: Unify formatting across site
  #4270 by @mldangelo

Chores

• chore: Fix open handles in readline tests preventing graceful Jest exit
  #4242 by @mldangelo
• chore: Add external file loading support for response_format in OpenAI API
  #4240 by @mldangelo
• chore: Always have unique redteam file when running live
  #4237 by @sklein12
• chore: Add metadata to generated redteam.yaml
  #4257 by @typpo
• chore: Bump openai from 4.103.0 to 5.0.1
  #4250 by @dependabot
• chore: Redteam → red team
  #4268 by @typpo
• chore: Improve dark mode highlight styling for eval cell views
  #4269 by @mldangelo
• chore: Update dependencies to latest minor/patch versions
  #4271 by @mldangelo
• chore: Clarify wording
  #4278 by @typpo
• chore: Format estimated probes
  #4279 by @typpo
• chore: Update grader for malicious code
  #4286 by @MrFlounder
• chore: Add back example config to red team create flow
  #4282 by @faizanminhas
• chore: Bump version 0.114.3
  #4287 by @sklein12
• chore(webui): Hide diff filter option on /eval when single column
  #4246 by @mldangelo
• chore(webui): Allow toggling highlight on eval outputs
  #4252 by @mldangelo

New Contributors

• @ladyofcode made their first contribution in #4276

Full Changelog: 0.114.2...0.114.3