dify icon indicating copy to clipboard operation
dify copied to clipboard

Multiple Prompts Testing

Open mkeari opened this issue 1 year ago • 1 comments

Self Checks

  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

While developing a new workflow we frequently experiment with the system prompts. Chaning them sometimes improves the results but other times you might want to get back to the previous one. In some cases it is beneficial to have multiple runs with outputs side-by-side for comparison. And keeping track of each of them in a separate notetaking app is frustrating.

Therefore, is it possible to add support for 2 (or more) different versions of system prompt running simultaneously? With side-by-side display of their outputs (similar to ChatGPT's suggested 2 versions). Maybe a special mode or button near the "Preview".

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [X] I am interested in contributing to this feature.

mkeari avatar Oct 23 '24 07:10 mkeari

I just realized that Dify has something similar but for models comparison ("Debug as Multiple Models"). But now it would be great to have the analog for prompts, and preferably not only in basic chatbot but chatflow as well

mkeari avatar Oct 23 '24 07:10 mkeari

I mentioned a similar request in #9055 but about Debug as Multiple Models in Workflow/Chatflow mode. Having multiple prompts testing and multiple models testing would help a great load in early development.

nickjfrench avatar Oct 29 '24 14:10 nickjfrench

Hi, @mkeari. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • You requested a feature to test multiple system prompts simultaneously for side-by-side output comparison.
  • You noted that Dify has a similar feature for model comparison.
  • You expressed interest in contributing to the development of this feature.
  • Another user, nickjfrench, referenced a related request (#9055) for testing multiple models in Workflow/Chatflow mode.

Next Steps

  • Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open.
  • Otherwise, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Nov 29 '24 16:11 dosubot[bot]