jetstream icon indicating copy to clipboard operation
jetstream copied to clipboard

Make it easy to filter to (or to filter out) default metrics or metrics by name when testing locally

Open ncalexan opened this issue 2 years ago • 2 comments

When testing locally, it would be very helpful to filter the set of computed metrics to not include the default metrics and/or to filter metrics by name. This would allow focusing on the single metric or statistic that is relevant. This gets more and more important as the set of default metrics grows and as the cost of computing default metrics increases.

This is related to https://github.com/mozilla/metric-hub/pull/108#issuecomment-1577120511. Locally I hacked this into an earlier version of the repository but when I revisited, I didn't apply these changes and spent a lot of time running analyses that aren't relevant to my use case.

┆Issue is synchronized with this Jira Task

ncalexan avatar Jun 05 '23 16:06 ncalexan

OpMon allows the use of skip_default_metrics. Back then we decided not to have it for jetstream, but it might be time to revisit. I'll bring it up to the experimentation DS people

scholtzan avatar Jun 05 '23 19:06 scholtzan

I worked up a patch for my local testing that I'll open as a PR sometime soon.

ncalexan avatar Jun 05 '23 20:06 ncalexan