github promptfoo/promptfoo 0.103.12

latest release: 0.103.13
18 hours ago

What's Changed

Bug Fixes

  • fix(providers): Add support for tool_resources in OpenAI assistants by @dsappet in #2772
  • fix(providers): Do not set top_p, presence_penalty, or frequency_penalty by default in OpenAI providers by @typpo in #2753
  • fix(providers): Handle serialization bug in defaultTest for provider overrides with self references (Groq) by @mldangelo in #2760
  • fix(webui): Add error boundary to React Markdown component by @mldangelo in #2756
  • fix(redteam): Add missing strategy tags by @typpo in #2769
  • fix(redteam): Empty response is not a failure for red team by @typpo in #2754
  • fix(redteam): Self-harm, graphic, sexual content, competitors false positives by @typpo in #2759

Chores

  • chore(providers): Add DeepSeek provider alias by @mldangelo in #2768
  • chore(types): Remove unused 'getSessionId' field from ApiProvider by @mldangelo in #2765
  • chore(redteam): Add copyright violations grader by @typpo in #2770
  • chore(redteam): Show plugin in strategy stats prompt/response examples by @typpo in #2758
  • chore(redteam): Improve competitors grader by @mldangelo in #2761
  • chore(lint): Resolve trailing whitespace issues in YAML file by @mldangelo in #2767
  • chore(deps): Bump @aws-sdk/client-bedrock-runtime from 3.730.0 to 3.731.1 by @dependabot in #2750
  • chore(deps): Bump openai from 4.78.1 to 4.79.1 by @dependabot in #2751

Tests

  • test: Add unit test for src/providers/bam.ts by @gru-agent in #2748
  • test: Add unit test for src/redteam/graders.ts by @gru-agent in #2762
  • test: Add unit test for src/redteam/plugins/harmful/graders.ts by @gru-agent in #2763
  • test: Add unit test for src/redteam/plugins/harmful/graders.ts by @gru-agent in #2771
  • test: Add unit test for src/redteam/providers/crescendo/index.ts by @gru-agent in #2749
  • test: Add mocks to reduce CI flakes and logs by @mldangelo in #2774

New Contributors

Full Changelog: 0.103.11...0.103.12

Don't miss a new promptfoo release

NewReleases is sending notifications on new releases.