MLflow 3.17: Jev models as judges in genai.evaluate()
MLflow 3.17.0 adds Jev Decisions, letting Jev models act as judges for yes/no and finite-category checks in mlflow.genai.evaluate(), with tracing and AI Gateway support included.
MLflow 3.17.0 is now available! 🎉 Major new features include: ✅ Jev Decisions: Use TypeSafe’s Jev models as judges in mlflow.genai.evaluate() for yes/no and finite-category checks. Tracing and AI Gateway support are included, so those calls can be inspected and governed in one place. 🔐 Fine-Grained Permissions: Control access to runs, traces, assessments, logged models, review queues, and model, prompt, scorer, and MCP-server versions. Grant an experiment without exposing everything inside it, including with an explicit DENY. 📈 Faster Trace Analytics: SQL-backed dashboards spend less time on trace counts, latency, token usage, costs, and assessments. Optional daily rollups reuse precomputed summaries as datasets grow. Release notes 👉 https://mlflow.org/releases/3.17.0/ #MLflow #GenAI #LLMOps