OpenAI icon indicating copy to clipboard operation
OpenAI copied to clipboard

Feat: Get token usage data for streamed chat completion response.

Open sdimka opened this issue 1 year ago • 2 comments

What

Added a feature to retrieve token usage in stream chat mode.

Why

This functionality is available in the original API and could be useful for some users.

Affected Areas

  • Added the streamOptions parameter to ChatQuery to enable feature.
  • Included Usage in ChatStreamResult to fetch data usage results.

sdimka avatar May 19 '24 09:05 sdimka

577DF509-4FAC-49A4-8002-EC563A9346B0 A6B77BEB-9C03-4FC2-AA18-CA2FCFDDC635 It doesn't seem to be working

qaz1991815 avatar Aug 08 '24 06:08 qaz1991815