Jörg Jooss

Foundry Local 0.8.101 does not emit finish_reason

1

When using streaming APIs in Foundry Local 0.8.101, there is no `finish_reason` field in the `choices` array. ``` data: {"model":"qwen2.5-1.5b-instruct-generic-gpu:3","choices":[{"delta":{"role":"assistant","content":"ence","tool_calls":[]},"message":{"role":"assistant","content":"ence","tool_calls":[]},"index":0}],"created":1762612476,"CreatedAt":"2025-11-08T14:34:36+00:00","id":"chat.id.1","IsDelta":false,"Successful":true,"HttpStatusCode":0,"object":"chat.completion.chunk"} data: {"model":"qwen2.5-1.5b-instruct-generic-gpu:3","choices":[{"delta":{"role":"assistant","content":" holds","tool_calls":[]},"message":{"role":"assistant","content":" holds","tool_calls":[]},"index":0}],"created":1762612476,"CreatedAt":"2025-11-08T14:34:36+00:00","id":"chat.id.1","IsDelta":false,"Successful":true,"HttpStatusCode":0,"object":"chat.completion.chunk"} data: {"model":"qwen2.5-1.5b-instruct-generic-gpu:3","choices":[{"delta":{"role":"assistant","content":" its","tool_calls":[]},"message":{"role":"assistant","content":" its","tool_calls":[]},"index":0}],"created":1762612476,"CreatedAt":"2025-11-08T14:34:36+00:00","id":"chat.id.1","IsDelta":false,"Successful":true,"HttpStatusCode":0,"object":"chat.completion.chunk"} data: {"model":"qwen2.5-1.5b-instruct-generic-gpu:3","choices":[{"delta":{"role":"assistant","content":"...

Remove all implementation specific fields from streaming chunks and "error"

1

I'm using OpenAI's .NET and Go SDKs with Foundry Local 0.7.120. When using Chat Completion streaming, Foundry Local (still) adds a number of non-standard fields to each streaming chunk: ```json...