envoy icon indicating copy to clipboard operation
envoy copied to clipboard

Expose time-series and access log metric to measure queueing latency at Envoy

Open wenjiezen opened this issue 3 years ago • 4 comments

Title: Expose time-series and access log metric to measure queueing latency at Envoy

Description: To better attribute and breakdown e2e latency and correctly tune Envoy, we find it important to understand the queueing latency at Envoy for requests and responses. This will help us find out the proportion of time that a request or response spent locally at Envoy, and how that compares to the e2e latency.

[optional Relevant Links:]

Any extra documentation required to understand the issue.

wenjiezen avatar Aug 18 '22 22:08 wenjiezen

There are several duration access log such as: %DURATION% %REQUEST_DURATION% %RESPONSE_DURATION% ...

zhangbo1882 avatar Aug 19 '22 01:08 zhangbo1882

Hi Zhangbo, thanks for the quick reply!

According to this, %DURATION% measures

Total duration in milliseconds of the request from the start time to the last byte out.

IIUC, start time refers to the time the first byte the request is received from downstream. If that's the case, it seems that I can compute queueing latency for a request with

%DURATION% - %REQUEST_DURATION% - %REQUEST_TX_DURATION%

Is there a time-series equivalent of this?

wenjiezen avatar Aug 19 '22 03:08 wenjiezen

Is there a time-series equivalent of this?

Not to my knowledge. I think this is something we could think about adding.

mattklein123 avatar Aug 29 '22 15:08 mattklein123

/assign @agrawroh

agrawroh avatar Sep 07 '22 17:09 agrawroh