chatbot-ui-llama.cpp icon indicating copy to clipboard operation
chatbot-ui-llama.cpp copied to clipboard
verified publisher icon yportne13

[feature] tokens/sec

Open 0wwafa opened this issue 1 year ago • 0 comments

On the last line of the chat window, where you wrote "ChatBot UI. Chatbot UI is an advanced chatbot kit for OpenAI's chat models aiming to mimic ChatGPT's interface and functionality." It would be nice to have the tokens/second

0wwafa avatar May 28 '24 20:05 0wwafa