semantic-kernel
semantic-kernel copied to clipboard
Streaming support, implementation of IAsyncEnumberalbe
Because I see that Example App Chat Copilot's response is too slow, I would like to ask if Streaming will be implemented in the future.
Additional description: Nuget package Azure.AI.OpenAI supports Streaming Example:
Response<StreamingChatCompletions> response = await client.GetChatCompletionsStreamingAsync(
deploymentOrModelName: model,
chatCompletionsOptions);
using StreamingChatCompletions streamingChatCompletions = response.Value;
await foreach (StreamingChatChoice choice in streamingChatCompletions.GetChoicesStreaming())
{
await foreach (ChatMessage message in choice.GetMessageStreaming())
{
Console.Write(message.Content);
}
Console.WriteLine("-------------");
}
We are working on this.
did not see this and created other option. link here and follow to close once the issue is solved. https://github.com/microsoft/semantic-kernel/pull/836
I'm using copilot with signalr to connect status change and streaming and the UX changes completely
