probe-scraper
probe-scraper copied to clipboard
mozilla
Scrape and publish Telemetry probe data from Firefox
This ensures the builds are reproducible and don't suddenly fail from one day to another due to new releases of some dependency down the chain. This might benefit from some...
# feat(bug-1891646): add firefox_bridge app to repositories.yaml Bug link: https://bugzilla.mozilla.org/show_bug.cgi?id=1891646 [ ] Make sure the project repository has [Validate and publish metrics](https://mozilla.github.io/glean/book/user/adding-glean-to-your-project/enable-data-ingestion.html#validate-and-publish-metrics) Github Action set up.
Fixes #697 --- I _think_ we can do this now? A dry-run locally succeeds. ``` python3 -m probe_scraper.runner --dry-run --cache-dir tmp/cache --out-dir tmp/out --glean --glean-repo firefox-klar-android --glean-repo service-nimbus --glean-repo nimbus...
right now we depend on consumers of the "Glean probe-scraper" github action to report unexpected failures, such as in https://github.com/mozilla/probe-scraper/issues/574 We need to add monitoring so that can be aware...
I added a hack to get firefox-desktop to work properly again: https://github.com/mozilla/probe-scraper/blob/5717fce6ddcf5ce103cd7e47414c348547cf8651/probe_scraper/glean_checks.py#L19-L25 We should find a way that this is not necessary. It shouldn't. The metric is moved from the...
mozilla-central is moving from hg to git sometime in the medium term. When that happens, we can expect hgweb to either stop or change, which will interfere with the Telemetry...
probe-scraper deploys a Google Cloud Function, that is used by the CI task. We should document how to access its log, how to test it locally, etc.
When adding new libraries/apps we recommend doing a dry-run to ensure probe-scraper is working as expected and without issues. This however requires deep knowledge about probe-scraper and how it works...
#559 broke compatibility with Python 3.8. Since I'm the only one noticing, this likely means everything it's fine! At the very minimum though, we should remove [this line](https://github.com/mozilla/probe-scraper/blob/f5e7b72ead35c1b16f42451c5aef9e614a6a6413/setup.py#L17) and make...
https://github.com/mozilla/bedrock/actions/runs/4598182706/jobs/8121878736 https://github.com/mozilla/glean/actions/runs/4609412250/jobs/8146505104?pr=2441 gsutil is failing to download objects that fail with 404 exceptions: ``` Error: Command ['gsutil', '-q', '-m', 'rsync', '-r', 'gs://probe-scraper-prod-artifacts/glean/', '/tmp/tmpy4y4leon/output/glean'] returned non-zero exit status 1: NotFoundException: 404...