MLflow
banner
mlflow.org
MLflow
@mlflow.org
The open source developer platform to build AI applications and models with confidence.
๐—”๐—œ ๐—ข๐—ฏ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ฎ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐˜† ๐—ณ๐—ผ๐—ฟ ๐—˜๐˜ƒ๐—ฒ๐—ฟ๐˜† ๐—ง๐˜†๐—ฝ๐—ฒ๐—ฆ๐—ฐ๐—ฟ๐—ถ๐—ฝ๐˜ ๐—Ÿ๐—Ÿ๐—  ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ ๐Ÿš€

MLflow 3.6 brings automatic tracing to JS/TS! Get traces from Vercel AI SDK, LangChain, Mastra, Anthropic, & Gemini in the same UI as your Python services.

๐Ÿ”— Read more: mlflow.org/blog/typescr...

#mlflow #opensource #oss #typescript #llm #ai
January 6, 2026 at 7:38 PM
The last 6 months of 2025 were a defining era for MLflow! ๐Ÿš€

โœ… ๐Ÿญ๐Ÿฐ ๐—ฅ๐—ฒ๐—น๐—ฒ๐—ฎ๐˜€๐—ฒ๐˜€: Focused on LLM Agentic observability, evaluation, & scalability
โœ… ๐—ก๐—ฒ๐˜„ ๐—™๐—ฒ๐—ฎ๐˜๐˜‚๐—ฟ๐—ฒ๐˜€: GenAI evaluation, unified tracing & more
โœ… ๐—–๐—ผ๐—บ๐—บ๐˜‚๐—ป๐—ถ๐˜๐˜† ๐—š๐—ฟ๐—ผ๐˜„๐˜๐—ต: 23 Ambassadors across 17 countries

Dive in โžก๏ธ www.linkedin.com/pulse/celebr...
Celebration of Innovation: A Retrospective on the MLflow Community's Last Six Months of 2025
Authors: Carly Akerly, Daniel Liden & Jules Damji MLflow 3.x and the GenAI Revolution The past six months have marked a transformative era for MLflow, with a total of 14 releases.
www.linkedin.com
January 5, 2026 at 10:03 PM
Weโ€™re excited to announce the release of ๐— ๐—Ÿ๐—ณ๐—น๐—ผ๐˜„ ๐Ÿฏ.๐Ÿด! ๐Ÿš€

Whatโ€™s New?
โš™๏ธ ๐—ฃ๐—ฟ๐—ผ๐—บ๐—ฝ๐˜ ๐— ๐—ผ๐—ฑ๐—ฒ๐—น ๐—–๐—ผ๐—ป๐—ณ๐—ถ๐—ด๐˜‚๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป
โณ ๐—œ๐—ป-๐—ฃ๐—ฟ๐—ผ๐—ด๐—ฟ๐—ฒ๐˜€๐˜€ ๐—ง๐—ฟ๐—ฎ๐—ฐ๐—ฒ ๐——๐—ถ๐˜€๐—ฝ๐—น๐—ฎ๐˜†
โš–๏ธ ๐——๐—ฒ๐—ฒ๐—ฝ๐—˜๐˜ƒ๐—ฎ๐—น ๐—ฎ๐—ป๐—ฑ ๐—ฅ๐—”๐—š๐—”๐—ฆ ๐—๐˜‚๐—ฑ๐—ด๐—ฒ๐˜€ ๐—œ๐—ป๐˜๐—ฒ๐—ด๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป
๐Ÿ›ก๏ธ ๐—–๐—ผ๐—ป๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐—ฎ๐—น ๐—ฆ๐—ฎ๐—ณ๐—ฒ๐˜๐˜† ๐—ฆ๐—ฐ๐—ผ๐—ฟ๐—ฒ๐—ฟ
โšก ๐—–๐—ผ๐—ป๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐—ฎ๐—น ๐—ง๐—ผ๐—ผ๐—น ๐—–๐—ฎ๐—น๐—น ๐—˜๐—ณ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฒ๐—ป๐—ฐ๐˜† ๐—ฆ๐—ฐ๐—ผ๐—ฟ๐—ฒ๐—ฟ

Dive into the release notes: github.com/mlflow/mlflo...
December 22, 2025 at 4:16 PM
In this video, #MLflow Contributor and Staff Developer Advocate Jules Damji walks through the powerful new features in MLflow 3.7, showcasing how to gain full observability over your GenAI application traces. ๐Ÿš€

๐Ÿ”— Watch the full video: youtube.com/watch?v=29W0...

#GenAI #LLMOps #OpenSource
MLflow 3.7 Release: Key Features & Multi-turn Conversation Evaluation Demo
YouTube video by MLflow
youtube.com
December 16, 2025 at 8:38 PM
MLflow Ambassador Joana Ferreira just dropped the next chapter in her GenAI series! ๐Ÿš€

๐Ÿ“– "๐—˜๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ถ๐—ป๐—ด ๐—š๐—ฒ๐—ป๐—”๐—œ ๐˜„๐—ถ๐˜๐—ต ๐— ๐—Ÿ๐—ณ๐—น๐—ผ๐˜„: ๐— ๐—ผ๐—ป๐—ถ๐˜๐—ผ๐—ฟ๐—ถ๐—ป๐—ด ๐—ถ๐—ป ๐—ฃ๐—ฟ๐—ผ๐—ฑ๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป"

Learn to use MLflowโ€™s unified evaluation framework for continuous production monitoring.

Dive in: medium.com/@joana.c.mes...

#MLflow #GenAI #OpenSource
December 15, 2025 at 5:13 PM
Stop the AI Agent "vibe checks" & manual labeling! ๐Ÿ›‘๐Ÿ› ๏ธ

Samraj Moorjani (Databricks) shows how #MLflow accelerates high-quality, production-ready agent development. Learn the techniques leading companies use to skip the iteration loop. ๐Ÿš€

๐ŸŽฅ Watch the full session: www.youtube.com/watch?v=qOFK...
December 9, 2025 at 4:06 PM
MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! ๐Ÿ™Œ๐Ÿฅณ

๐Ÿ”— View the release notes: github.com/mlflow/mlflo...

Thanks to all the contributions from the community! ๐Ÿ™

๐Ÿš€ Try it out: pip install mlflow==3.7.0

#opensource #mlflow
December 8, 2025 at 5:18 PM
Why log GenAI models as code? It's essential for ensuring versioning & reproducibility of API-based models, providing clear traceability for the model's logic & dependencies.

Learn how to log GenAI models as code directly from Python into MLflow Tracking. โคต๏ธ

๐ŸŽฅ ๐—ช๐—ฎ๐˜๐—ฐ๐—ต: www.youtube.com/watch?v=jXzH...
Getting Started with Mlflow: Logging GenAI Models as Code
YouTube video by MLflow
www.youtube.com
December 3, 2025 at 5:30 PM
Is your GenAI agent production-ready, or just passing "vibe checks"? ๐Ÿค”

Building is easy. Quality is hard.

Samraj Moorjani (Databricks) breaks down the full MLflow Quality stack:
๐Ÿ” Tracing (@opentelemetry.io)
๐Ÿค– AI-based Debugging (AI Insights)
โš–๏ธ LLM as a Judge

๐ŸŽฅDive in: youtube.com/watch?v=J92r...
How to Test GenAI Agents in Production: MLflow Tracing & Evaluation Deep Dive
YouTube video by VectorLab
youtube.com
December 2, 2025 at 3:49 PM
๐Ÿ”น ๐—ช๐—ต๐—ผ ๐˜€๐—ต๐—ผ๐˜‚๐—น๐—ฑ ๐—ฎ๐—ฝ๐—ฝ๐—น๐˜†: open source contributors, speakers, and organizers with a track record in MLOps/AI.
๐Ÿ”น ๐—ช๐—ต๐˜† ๐—ท๐—ผ๐—ถ๐—ป: amplify your impact and shape #GenAI practice in your community with MLflowโ€™s evolving toolkitโ€”spanning evaluation, #LLM/agent tracing, and prompt lifecycle management.โ€‹

#opensource
November 28, 2025 at 9:27 PM
Only a few days left to apply for the next #MLflow Ambassador cohort! ๐Ÿš€

Join a global group of leaders advancing open source MLflow and helping teams ship high-quality #GenAI with evaluation, tracing, and prompt management. Submit your application by ๐——๐—ฒ๐—ฐ ๐Ÿญ.

๐Ÿ”— Apply today: forms.gle/eBEf6fTfKWNm...
November 28, 2025 at 9:24 PM
Two weeks from today โ€” donโ€™t miss it! ๐Ÿ™Œ

๐Ÿ“ฃ Join the next ๐— ๐—Ÿ๐—ณ๐—น๐—ผ๐˜„ ๐—–๐—ผ๐—บ๐—บ๐˜‚๐—ป๐—ถ๐˜๐˜† ๐— ๐—ฒ๐—ฒ๐˜๐˜‚๐—ฝ on November 12 to explore the latest in AI observability and agent tracing.

Featuring two exciting talks:
๐Ÿ”น ๐—–๐—น๐—ฎ๐˜‚๐—ฑ๐—ฒ ๐—–๐—ผ๐—ฑ๐—ฒ & ๐—”๐—ด๐—ฒ๐—ป๐˜ ๐—ฆ๐——๐—ž ๐—ง๐—ฟ๐—ฎ๐—ฐ๐—ถ๐—ป๐—ด
๐Ÿ”น ๐—ข๐—ฝ๐—ฒ๐—ป๐—ง๐—ฒ๐—น๐—ฒ๐—บ๐—ฒ๐˜๐—ฟ๐˜† (๐—ข๐—ง๐—˜๐—Ÿ) ๐—ฆ๐˜‚๐—ฝ๐—ฝ๐—ผ๐—ฟ๐˜

๐Ÿ”— RSVP: luma.com/mlflowmeetup...

#mlflow #oss
MLflow Community Meetup | November 2025 ยท Luma
November MLflow Community Meetup We'll dive into: ๐Ÿ”น Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have toโ€ฆ
luma.com
October 29, 2025 at 3:46 PM
Building agentic applications is complex, but it doesnโ€™t have to be slow.

In this blog, Samraj Moorjani shows how to go from idea to measurable results in hours using the Claude Agent SDK with MLflow for observability and evaluation.

๐Ÿ”— Dive in: mlflow.org/blog/mlflow-...

#MLflow #agentic
Rapidly Prototype and Evaluate Agents with Claude Agent SDK and MLflow | MLflow
How to quickly prototype an agent using the Claude Agent SDK then instrument and evaluate it with MLflow
mlflow.org
October 23, 2025 at 11:04 PM
๐Ÿ“ฃ Join the next ๐— ๐—Ÿ๐—ณ๐—น๐—ผ๐˜„ ๐—–๐—ผ๐—บ๐—บ๐˜‚๐—ป๐—ถ๐˜๐˜† ๐— ๐—ฒ๐—ฒ๐˜๐˜‚๐—ฝ on November 12 to explore the latest in AI observability and agent tracing โ€” featuring two exciting talks:

๐Ÿ”น ๐—–๐—น๐—ฎ๐˜‚๐—ฑ๐—ฒ ๐—–๐—ผ๐—ฑ๐—ฒ & ๐—”๐—ด๐—ฒ๐—ป๐˜ ๐—ฆ๐——๐—ž ๐—ง๐—ฟ๐—ฎ๐—ฐ๐—ถ๐—ป๐—ด
๐Ÿ”น ๐—ข๐—ฝ๐—ฒ๐—ป๐—ง๐—ฒ๐—น๐—ฒ๐—บ๐—ฒ๐˜๐—ฟ๐˜† (๐—ข๐—ง๐—˜๐—Ÿ) ๐—ฆ๐˜‚๐—ฝ๐—ฝ๐—ผ๐—ฟ๐˜

๐Ÿ”— RSVP: luma.com/mlflowmeetup...

#MLflow #opensource #oss #genai
MLflow Community Meetup | November 2025 ยท Luma
November MLflow Community Meetup We'll dive into: ๐Ÿ”น Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have toโ€ฆ
luma.com
October 22, 2025 at 6:37 PM
โฐ Donโ€™t forget โ€” MLflow Office Hours are this Wednesday, October 22 at 8AM PT on Zoom!

Come for:
๐Ÿ”น Real-time MLflow troubleshooting and guidance
๐Ÿ”น Best practices for managing LLM & GenAI experiments
๐Ÿ”น A look ahead at new MLflow features

๐Ÿ”— RSVP: luma.com/officehours1...

#opensource #oss #MLflow
MLflow Office Hours | October 22 ยท Zoom ยท Luma
luma.com
October 20, 2025 at 3:13 PM
With that metadataโ€”and MLflowโ€™s MCP features released recentlyโ€”the judge can make tool calls to MLflow to search spans and query different aspects of the trace.

Office Hours: Wed, Oct 22: luma.com/officehours1...

#mlflow #agenticjudges #llm #genai
MLflow Office Hours | October 22 ยท Zoom ยท Luma
luma.com
October 15, 2025 at 2:15 PM
In this mode, the judge gets the MLflow trace info object: input to the call, output, and basically the root span ID for that trace.
October 15, 2025 at 2:15 PM
Missed last weekโ€™s #MLflow Community Meetup? Check out Ben Wilson on agentic judges: โ€œThe judge no longer works as an LLM as a judgeโ€”it actually works as an agent as a judge.โ€

๐ŸŽฅ Full video: www.youtube.com/live/bkMabn8...

#opensource #oss #agenticjudges
October 15, 2025 at 2:14 PM
Use AI to debug AI! ๐Ÿ‘ With MLflow 3.4โ€™s MCP server, Claude can query MLflow traces to compare runs and identify issues. @danliden.comโ€™s post covers setup and examples in minutes.

Learn more: www.danliden.com/posts/202510...

#opensource #mlflow #oss #MCP #claude
Using MLflow's MCP Server for Conversational Trace Analysis
A hands-on exploration of MLflow's new Model Context Protocol server that enables AI assistants to interact with MLflow traces, with setup tips for virtual environments and examples in both Claude ...
www.danliden.com
October 13, 2025 at 4:15 PM
โšก In this lightning talk at MLOps World, Danny Chiao tackled a top agent challenge: ensuring high quality output.

Rather than labeling and analyzing traces by hand, MLflow makes it easy to log, evaluate, and iterate fasterโ€”using techniques leading companies rely on to deploy agents in production. โœ…
October 9, 2025 at 7:31 PM
๐Ÿšจ Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT!

We'll explore traceโ€‘aware, feedbackโ€‘aligned judges and versioned eval datasets in MLflow. You don't wait to miss it!

๐ŸŽฅ LIVE on LinkedIn, YouTube & X
๐Ÿ”— RSVP: luma.com/mlflow-1001

#opensource #oss #mlflow
October 7, 2025 at 4:42 PM
Building better LLM evals? Ben Wilson highlights how frameworks like #DSPy boost judge promptsโ€”and reliabilityโ€”as models evolve.

Tips for judge reproducibility/reliability: use reproducible pipelines, re-tune logic as endpoints change, & standardize. โœ…

๐ŸŽฅ Watch more: www.youtube.com/live/HTxpmnO...
October 6, 2025 at 5:59 PM
Ready to dive into #MLflow? ๐Ÿš€

Join our text-based LIVE AMA with Danny Chiao & @danliden.com after Danny's MLOps World | GenAI Summit lightning talk!

๐Ÿ—“๏ธ Oct 9 | 1โ€“3pm CT
๐Ÿ“MLflow Slack | #General channel
๐Ÿ”— RSVP: luma.com/liveama-slac...

#opensource #oss #genai #mlops #llmops
[Live AMA] From production tricks, labeling tips, to integrating MLflow for agent qualityโ€”ask anything MLflow! ยท Luma
Join us for a text-based Live AMA (Ask Me Anything) with Danny Chiao, following his lightning talk at MLOps World. This is your chance to dive deeper intoโ€ฆ
luma.com
October 3, 2025 at 6:06 PM
๐Ÿš€ Headed to MLOps World | GenAI Summit 2025 next week? Donโ€™t miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks!

๐ŸŽค ๐—ง๐—ฒ๐—ฐ๐—ต๐—ป๐—ถ๐—พ๐˜‚๐—ฒ๐˜€ ๐˜๐—ผ ๐—ฏ๐˜‚๐—ถ๐—น๐—ฑ ๐—ต๐—ถ๐—ด๐—ต ๐—พ๐˜‚๐—ฎ๐—น๐—ถ๐˜๐˜† ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐˜€ ๐—ณ๐—ฎ๐˜€๐˜๐—ฒ๐—ฟ ๐˜„๐—ถ๐˜๐—ต ๐— ๐—Ÿ๐—ณ๐—น๐—ผ๐˜„

๐Ÿ—“๏ธ October 9
๐Ÿ“ Austin, TX
๐Ÿ”— Learn more: mlopsworld.com#agenda

#MLflow #GenAI #MLOps #LLM
October 1, 2025 at 9:17 PM
๐Ÿšจ RESCHEDULED: Wednesday, October 8

The next MLflow Community Meetup happens NEXT Wednesday, Oct 8 at 4PM PTโ€”and you wonโ€™t want to miss it.

RSVP here: luma.com/mlflow-1001

#opensource #oss #mlflow
October 1, 2025 at 8:23 PM