github confident-ai/deepeval v3.0.8
🎉 New Conversational Evaluation, LiteLLM Integration

latest releases: v2.4.8, v3.3.5, v3.2.6...
3 months ago

In DeepEval's latest release, we are introducing a slight change in how a conversation is evaluated.

Previously we assumed a conversation as as a list of LLMTestCases, which might necessarily be the case. Now a conversational test case is made up of a list of Turns instead, which follows OpenAI's standard messages format:

from deepeval.test_case import Turn

turns = [Turn(role="user", content="...")]

Docs here: https://deepeval.com/docs/evaluation-test-cases#conversational-test-case

Don't miss a new deepeval release

NewReleases is sending notifications on new releases.