pluto icon indicating copy to clipboard operation
pluto copied to clipboard

Support WebSocket protocol

Open jianzs opened this issue 1 year ago • 0 comments

The text generation process of large language models usually takes some time, so it's common to use streams to send the result back to users. Therefore, we need to support the WebSocket protocol in both the Router and Function.

jianzs avatar Feb 29 '24 13:02 jianzs