lua-openai icon indicating copy to clipboard operation
lua-openai copied to clipboard

Break request / abort streaming

Open johnd0e opened this issue 1 year ago • 0 comments

  1. Document the way to set timeout. AFAIK the default is 60s, but this may not always be sufficient.
  2. Response streaming can be time-consuming and in certain situations a user might want to terminate it prematurely. This could be implemented checking the return value of a callback function.

johnd0e avatar Apr 19 '24 21:04 johnd0e