semantic-kernel icon indicating copy to clipboard operation
semantic-kernel copied to clipboard

Streaming support, implementation of IAsyncEnumberalbe

Open ColinZeb opened this issue 2 years ago • 1 comments

Because I see that Example App Chat Copilot's response is too slow, I would like to ask if Streaming will be implemented in the future.

Additional description: Nuget package Azure.AI.OpenAI supports Streaming Example:

Response<StreamingChatCompletions> response = await client.GetChatCompletionsStreamingAsync(
               deploymentOrModelName: model,
               chatCompletionsOptions);
using StreamingChatCompletions streamingChatCompletions = response.Value;

await foreach (StreamingChatChoice choice in streamingChatCompletions.GetChoicesStreaming())
{
   await foreach (ChatMessage message in choice.GetMessageStreaming())
   {
       Console.Write(message.Content);
   }
   Console.WriteLine("-------------");
}

ColinZeb avatar Apr 08 '23 10:04 ColinZeb

We are working on this.

microsoftShannon avatar Apr 13 '23 20:04 microsoftShannon

did not see this and created other option. link here and follow to close once the issue is solved. https://github.com/microsoft/semantic-kernel/pull/836

I'm using copilot with signalr to connect status change and streaming and the UX changes completely SK_signalr_stream

dedalo avatar May 06 '23 23:05 dedalo