LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

Output from OpenAI gpt-oss-20b and gpt-oss-120b is not in the correct format

Open vaaale opened this issue 1 week ago • 0 comments

LocalAI version: 3.9.0

Environment, CPU architecture, OS, and Version: Not relevant

Describe the bug The OpenAI gpt-oss-* models is generating output in the "harmony" format. LocalAI does not handle this correctly to be compatible with the OpenAI api. Instead of returning the reasoning in the "reasoning_content" of the response, it's placed in the normal "content" breaking any application trying to use these models.

To Reproduce Run gpt-oss-20b or gpt-oss120b

Expected behavior Localai should return the response according to the OpenAI specification.

Logs N/A

Additional context N/A

vaaale avatar Jan 14 '26 19:01 vaaale