openplayground icon indicating copy to clipboard operation
openplayground copied to clipboard
verified publisher icon nat

Added time to first token as requested in the README

Open ckgresla opened this issue 2 years ago • 0 comments

I added the functionality to measure when we receive the first chars response from models and then display the time to that moment in either milliseconds (ms) or seconds (s)

ckgresla avatar Oct 07 '23 21:10 ckgresla