[WebUI] Add support for webui
What would you like to be added:
Once we launched a model, we can simply co-launch a webui for interaction, we can support llmpos tools like dify but maybe we can find or create a lightweight one like gradio.
We also have a repo located here which implemented with gradio https://github.com/InftyAI/llmaz-dashboard.
Why is this needed:
For better UX.
Completion requirements:
This enhancement requires the following artifacts:
- [ ] Design doc
- [ ] API change
- [ ] Docs update
The artifacts should be linked in subsequent comments.
/kind feature
/help
/milestone v0.2.0
~see https://github.com/InftyAI/llmchat/issues/30~
This is pending for https://github.com/InftyAI/llmaz/issues/339 to get the model list.