cloud-native-setup icon indicating copy to clipboard operation
cloud-native-setup copied to clipboard

metrics: Start to build a set of tests to track progress/regressions

Open grahamwhaley opened this issue 6 years ago • 4 comments

This is a placeholder/high level view issue. Expect sub-issues to implement/fix/add specific items.

We should start to build up a set of metrics tests that we can run (both in a regular/automated manner via a CI and by hand if necessary) to monitor progress and/or regressions in the stack performance, both due to stack changes and/or underlying OS updates.

We can start with the basic measurements:

  • pod launch times
  • pod footprints
  • pod scaling limits
  • cpu overheads

and then move on to more complex testing:

  • pod response times and availability
  • inter-pod container testing
  • cross-pod testing
  • both storage (volume) and network tests

grahamwhaley avatar Jul 18 '19 13:07 grahamwhaley

/cc @krsna1729 @mcastelino @obedmr @dklyle @kad

The idea is we will make a new subdir for the tree of tests and support tools.

grahamwhaley avatar Jul 18 '19 14:07 grahamwhaley

@grahamwhaley please do. This makes perfect sense.

mcastelino avatar Jul 18 '19 15:07 mcastelino

Closing this, since the PR is merged.

knangia avatar Aug 12 '19 21:08 knangia

Our bad, re-opening.

jascott1 avatar Aug 12 '19 21:08 jascott1