pypi mlflow 3.6.0
v3.6.0
on Python PyPI

2 days ago

MLflow 3.6.0 includes several major features and improvements for AI Observability, Experiment UI, Agent Evaluation and Deployment.

  • 🔗 Full OpenTelemetry Support in OSS Server: MLflow now offers comprehensive OpenTelemetry integration, allowing you to ingest OpenTelemetry traces into MLflow and use both SDK seamlessly together. (#18540, #18532, #18357, @B-Step62, @serena-ruan)
  • 💬 Session-level View in Trace UI: New chat sessions tab provides a dedicated view for organizing and analyzing related traces at the session level, making it easier to track conversational workflows. (#18594, @daniellok-db)
  • 🧭 New experiment tab bar: The experiment tab navigation bar has been moved from the top of the page to the left side. As MLflow continues to grow, this layout provides more room to add new tabs while keeping everything easy to find. (#18594, @daniellok-db)
  • 🚀 New Supported Frameworks in TypeScript Tracing SDK: Auto-tracing support for Vercel AI SDK, Gemini, Anthropic, Mastra in TypeScript, expanding MLflow's observability capabilities across popular JavaScript/TypeScript frameworks. (#18402, @B-Step62)
  • 💰 Tracking Judge Cost and Traces: Comprehensive tracking of LLM judge evaluation costs and traces, providing visibility into evaluation expenses and performance with automatic cost calculation and rendering. (#18481, #18484, @B-Step62)
  • ⚙️ Agent Server: New agent server infrastructure for managing and deploying scoring agents with enhanced orchestration capabilities. (#18596, @bbqiu)

Breaking changes:

Features:

Bug fixes:

  • [Evaluation] Fix plugin incompatibility with circular import (#18599, @BenWilson2)
  • [Tracing] Paginate delete_traces calls to Databricks MLflow server (#18563, @dbrx-euirim)
  • [Artifacts] Fix handling of pathlib.Path in validation.py (#16660, @benglewis)
  • [Tracking] Enhance SqlAlchemyStore to include model outputs in run search results (#18568, @TomeHirata)
  • [Prompts] Fix typo in gepa version (#18423, @TomeHirata)
  • [Tracking] Add validation checks for search runs (#18487, @BenWilson2)
  • [Tracking] Fix: Update run to use the new run name when resuming an existing run (#18511, @WeichenXu123)
  • [UI] Fix search filter for metrics/params with spaces in names (#18503, @serena-ruan)
  • [Evaluation] Remove the ability to register or load custom scorers (#18493, @BenWilson2)
  • [UI] Fix assessment editing UI resetting field values when selecting name (#18474, @serena-ruan)
  • [Evaluation] Add specificity to the system prompt for metrics (#18460, @BenWilson2)
  • [Evaluation] [Eval #2] Support evaluating traces and linking to run in OSS (#18415, @B-Step62)
  • [Tracking] Disable autologging for pytorch forecasting model predict method (#18444, @WeichenXu123)
  • [Evaluation / Tracing] Reuse traces in genai.evaluate when endpoint uses dual-write mode (#18403, @harupy)
  • [UI] Remove X-Frame-Options for notebook trace renderer (#18446, @TomeHirata)
  • [Evaluation] Adjust util for remote tracking server declaration (#18411, @BenWilson2)
  • [Evaluation / UI] Fix evaluation runs table link to point to traces tab instead of overview (#18332, @ritoban23)
  • [Models] fix-streaming (#18337, @BenWilson2)
  • [Evaluation / Tracing / Tracking] Job backend: Fix job store sql engine race condition (#18233, @WeichenXu123)
  • [Evaluation] Add atomicity to job_start API (#18226, @BenWilson2)
  • [Evaluation / Tracking] Job backend: Eager launch huey consumer to prevent Huey race condition (#18220, @WeichenXu123)

Documentation updates:

Small bug fixes and documentation updates:

#18735, #18429, #18530, #18416, #18401, #18400, #18465, #18453, #18414, #18421, @B-Step62; #18641, #18631, #18629, #18605, #18426, #18603, #18526, #18587, #18583, #18564, #18536, #18544, #18567, #18565, #18533, #18535, #18501, #18498, #18368, #18357, #18471, #18476, #18356, #18214, #17975, @serena-ruan; #18600, #18604, #18602, #18566, #18549, #18538, #18517, #15849, #18492, #18468, #18475, #18469, #18467, #18452, #18449, #18450, #18447, #18442, #18327, #18395, #18418, #18350, #18278, #18242, #18234, #18203, #18175, #18210, @harupy; #18625, #18424, #18028, @daniellok-db; #18616, #18615, #18607, #18598, #18588, #18586, #18584, #18572, #18580, #18571, #18554, #18553, #18552, #18551, #18548, #18546, #18528, #18527, #18525, #18521, #18520, #18515, #18519, #18518, #18506, #18507, #18505, #18502, #18495, #18494, #18472, #18463, #18464, #18462, #18443, #18440, #18399, #18394, #18393, #18392, #18390, #18389, #18380, #18376, #18378, #18377, #18366, #18362, #18361, #18343, #18340, #18318, #18311, #18307, #18269, #18268, #18261, #18260, #18259, #18258, #18257, #18256, #18253, #18254, #18252, #18250, #18243, #18238, #18213, #18206, #18198, #18184, #18179, @copilot-swe-agent; #18578, #18569, @TomeHirata; #18575, @dbrx-euirim; #18570, #18116, #18360, #18351, @WeichenXu123; #18513, #18461, #18430, #18336, @BenWilson2; #18459, @smoorjani; #18488, @raymondzhou-db; #18334, @NJAHNAVI2907

Check out latest releases or
releases around mlflow 3.6.0

Don't miss a new mlflow release

NewReleases is sending notifications on new releases.

Get notifications