MLflow Integration

[B-Step62]

Self Checks

• [x] I have read the Contributing Guide and Language Policy.
• [x] I have searched for existing issues search for existing issues, including closed ones.
• [x] I confirm that I am using English to submit this report, otherwise it will be closed.
• [x] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Dify provides tracing integration with many Ops platform such as Langfuse, Opik, and Arize.

This FR proposes adding new integration for MLflow, an widely adapted MLOps platform, that supports tracing, evaluation, and versioning for LLM/agentic workflow.

• https://mlflow.org/docs/latest/genai/

This integration also unlock users on cloud platform such as Databricks, Amazon SageMaker, AzureML, to use Dify with their ops capabilities, since MLflow is offered as managed service in those providers (reference).

2. Additional context or comments

No response

3. Can you help us with this feature?

• [x] I am interested in contributing to this feature.

[B-Step62]

Hi team! Gentle follow-up on the interests in adding this integration. I'm happy to work on this if the proposal makes sense. Thanks!

[crazywoola]

Sure, PRs are welcome. FYI, you might refer this for more details

feat: Improve Observability with Arize & Phoenix Integration (#19840)

[dosubot[bot]]

Hi, @B-Step62. I'm Dosu, and I'm helping the Dify team manage their backlog and am marking this issue as stale.

Issue Summary:

• You proposed adding MLflow integration to Dify for tracing, evaluation, and versioning of LLM/agentic workflows.
• This integration aims to support cloud platforms like Databricks and SageMaker.
• A maintainer expressed support and pointed to a related issue (#19840) for reference.
• There has been no recent activity or progress updates on this feature request.
• The issue remains open and unresolved, with potential for community contribution.

Next Steps:

• Please let me know if this feature is still relevant to your needs and the latest version of Dify by commenting on this issue.
• If I do not hear back within 15 days, the issue will be automatically closed to keep the backlog manageable.

Thank you for your understanding and contribution!

[B-Step62]

@dosubot I finished the implementation and working on doc now. Please keep this issue open.

[dosubot[bot]]

@crazywoola The user @B-Step62 has completed the implementation of the MLflow integration and is currently working on documentation. Could you please assist with the next steps for this feature request?

[B-Step62]

@crazywoola I've opened the PR, would appreciate if you could take a look!

Meanwhile I'm working on the doc, but have a quick question. How do you maintain images in the doc? I saw some images are hosted at https://assets-docs.dify.ai, but other pages like Arize integration use a public image hosting service.

[rcruzin]

Hi! Any update on when will this be integrated on DIFY?

[crazywoola]

@B-Step62 @rcruzin There are some conflicts in this PR and we might need some extra work to finish this.

[B-Step62]

Sure, I will work on resolving them this weekend.

[B-Step62]

@crazywoola Could you review the PR and help merging it? It seems the conflict happens quite frequent so I hope to merge it as soon as possible if the implementation looks fine.

[rcruzin]

Thanks @B-Step62 ! @crazywoola

This is relevant and valuable now,, we are seeing more databricks/mlflow integration (Agent Bricks ) w/ OpenAI and other providers. More adoption soon!

[rcruzin]

Need this feature asap. Thank you!