What's Changed
Features
- feat(providers): add MCP provider by @faizanminhas in #4768
- feat(providers): add new AIMLAPI provider by @D1m7asis in #4721
- feat(assertions): add contextTransform support for RAG evaluation by @mldangelo in #4467
- feat(assertions): add finish reason as assertion option by @christophersutton in #3879
- feat(assertions): trace assertions by @typpo in #4750
- feat(tracing): add traces to JavaScript, Python asserts by @typpo in #4745
Fixes
- fix(telemetry): prevent PostHog initialization when telemetry is disabled by @mldangelo in #4772
- fix(redteam): fix modifiers application order in PII plugins by @faizanminhas in #4779
Chores
- chore(schema): remove duplicate 'bias' entry in config-schema.json by @mldangelo in #4773
- chore(telemetry): add PostHog client to app by @faizanminhas in #4726
- chore(redteam): add reason field to give clear/customized guardrails triggering reason by @MrFlounder in #4764
- chore(providers): expose MCP plugin in UI by @sklein12 in #4762
- chore(providers): AWS SageMaker AI provider cleanup by @will-holley in #4667
- chore(providers): update AIML integration by @mldangelo in #4751
- chore(redteam): improve organization of redteam strategies in setup UI by @mldangelo in #4738
- chore(telemetry): identify to PostHog whether user is also cloud user by @will-holley in #4782
- chore(deps): bump @anthropic-ai/sdk from 0.55.1 to 0.56.0 by @dependabot in #4756
- chore(deps): bump @aws-sdk/client-bedrock-runtime from 3.840.0 to 3.842.0 by @dependabot in #4747
- chore(deps): bump @azure/identity from 4.10.1 to 4.10.2 by @dependabot in #4748
- chore(deps): bump version 0.116.3 by @faizanminhas in #4792
- chore(deps): update pbkdf2 to 3.1.3 by @mldangelo in #4777
- chore(deps): upgrade glob from v10 to v11 by @mldangelo in #4776
- chore: expose doRedteamRun in package exports by @mldangelo in #4758
Docs
- docs: add Gemini Live API audio by @adelmuursepp in #4729
- docs: ModelAudit vs ModelScan by @typpo in #4769
- docs: multiple MCP server connections by @typpo in #4755
- docs: update ModelAudit documentation with new features and fixes by @mldangelo in #4699
Tests
- test: add integrity check for generated-constants.ts by @mldangelo in #4753
- test: fix flaky Google Live test and improve test speed by @mldangelo in #4774
- test: fix mock pollution in testCaseReader by @mldangelo in #4775
- test: isolate mocks so tests can run in any order with --randomize by @mldangelo in #4744
New Contributors
- @christophersutton made their first contribution in #3879
- @D1m7asis made their first contribution in #4721
Full Changelog: 0.116.2...0.116.3