NextChat icon indicating copy to clipboard operation
NextChat copied to clipboard

[Feature Request] 能否支持多个API设置?即在应用中存储多个API及对应的默认模型设置

Open XixianLiang opened this issue 1 year ago • 3 comments

🥰 Feature Description

主要是我有多个API,对应调用不同的模型,能否提供一个自定义接口,类似用户/资源组。可以像选择模型一样进行快捷切换

比方说: 用户/资源1:API key1,服务器地址1,默认模型1 用户/资源2:API key2,服务器地址2,默认模型2

🧐 Proposed Solution

对应用开发不太了解,不知道怎么做

📝 Additional Information

No response

XixianLiang avatar Aug 07 '24 14:08 XixianLiang

Bot detected the issue body's language is not English, translate it automatically.


Title: [Feature Request] Can multiple API settings be supported? That is, multiple APIs and corresponding default model settings are stored in the application.

🥰 Feature Description

The main reason is that I have multiple APIs that call different models. Can I provide a custom interface, similar to user/resource group? You can quickly switch like selecting a model

for example: User/resource 1: API key1, server address 1, default model 1 User/resource1: API key2, server address2, default model2

🧐 Proposed Solution

Don’t know much about application development and don’t know how to do it

📝 Additional Information

No response

Issues-translate-bot avatar Aug 07 '24 14:08 Issues-translate-bot

same issues

xxachangxx avatar Sep 02 '24 06:09 xxachangxx

这个光靠 NextChat 是不够的,得借助别的库实现统一api,譬如:

  • one-api:https://github.com/songquanpeng/one-api
  • litellm:https://github.com/BerriAI/litellm
  • lmdeploy proxy:https://github.com/InternLM/lmdeploy/blob/main/docs/zh_cn/llm/proxy_server.md

QwertyJack avatar Sep 13 '24 06:09 QwertyJack