Flowise icon indicating copy to clipboard operation
Flowise copied to clipboard

[FEATURE] Result includes llm token usage along with the response

Open LuisFX opened this issue 1 year ago • 1 comments

API call result object would include the token utilization For accounting reasons, it would be useful to get the token utilization for each call. Akin to what openai includes along other metadata.

LuisFX avatar Jul 26 '24 00:07 LuisFX

I do agree, It would be great to get in in all models. I would use it in VertexAI model.

severfire avatar Jul 26 '24 09:07 severfire

This is must have feature, it is rly hard to use flowine in production without option to know how much user spend @HenryHengZJ

bendadaniel avatar Oct 18 '24 10:10 bendadaniel

Is this being considered yet or should I seek alternative builders for production

RepairYourTech avatar Nov 25 '24 17:11 RepairYourTech