Network speed difference shouldn't affect score

Open rniwa opened this issue 2 years ago • 3 comments

See https://webkit.slack.com/archives/C05QJJZQZRQ/p1698264053662939.

Apparently the network speed difference can affect Speedometer 2.0 score. We should make sure to either verify that this doesn't happen on Speedometer 3.0 or mitigate it some way e.g. prime network cache prior to start measurements.

Oct 25 '23 21:10 rniwa

The consensus here seems to be investigating adding HTTP header for caching so that browsers would consistently cache or not cache.

Nov 15 '23 18:11 rniwa

I'd say this is out of v3 at this point. Perhaps v3.1?

Feb 24 '24 02:02 rniwa

Yeah, sounds good to look into this in a later version. v3.0 is not worse than v2.1 in that respect, so technically not a regression.

Feb 26 '24 18:02 camillobruni