model_server icon indicating copy to clipboard operation
model_server copied to clipboard

Align timing routines, fix average inference calculation

Open ngaloppo opened this issue 2 years ago • 2 comments

The callback function records inference time based on the timestamp sent by the client using self.get_timestamp(). The display() function needs to use the same timing routine to get consistent time deltas.

ngaloppo avatar Nov 21 '23 01:11 ngaloppo

@dtrawins FYI

ngaloppo avatar Nov 21 '23 23:11 ngaloppo

@dtrawins can you merge?

ngaloppo avatar Dec 14 '23 19:12 ngaloppo