loadtest icon indicating copy to clipboard operation
loadtest copied to clipboard

feature request: single first outlier causes mean to be useless for comparison

Open nolistic opened this issue 6 years ago • 1 comments

as a business user, I want to easily compare metrics across loadtest reports.

However, miliseconds matter in the world of response time.

Outliers cause me to need more robust reporting than is offered by loadtest when comparing platforms.

image

when separated across threads, this first outlier makes sense image

but that doesn't mean I want it in my comparison report.

nolistic avatar Sep 24 '19 20:09 nolistic

It's easy to change the mean response time to median (in fact that is what the chart uses for the horizontal gray line), but should we do something in the first plot to remove that outlier? It makes the rest of the chart useless, but could be important.

jnolis avatar Sep 25 '19 21:09 jnolis