codecov-action icon indicating copy to clipboard operation
codecov-action copied to clipboard

[BUG] Uploaded coverage reports missing, out of date report "latest" on `main` branch

Open tay1orjones opened this issue 6 months ago • 15 comments

Describe the bug

The action reports that coverage reports are successfully uploaded. Navigating to the url from the logs shows no uploads.

Additionally, the "latest" commit on main is out of date by a full week and we can't figure out why or how to update it.

To Reproduce Steps to reproduce the "missing successful uploads" behavior:

  1. Commit https://github.com/carbon-design-system/carbon/commit/7659f5df1cba1eaea86858b8de022ddd2619003f was merged as part of a merge_group via GitHub's Merge Queue feature.
  2. View the log for this here: https://github.com/carbon-design-system/carbon/actions/runs/16779700173/job/47514731976#step:9:243
    • info - 2025-08-06 14:42:11,650 -- ci service found: github-actions
      warning - 2025-08-06 14:42:11,722 -- xcrun is not installed or can't be found.
      warning - 2025-08-06 14:42:15,244 -- No gcov data found.
      warning - 2025-08-06 14:42:15,244 -- coverage.py is not installed or can't be found.
      info - 2025-08-06 14:42:17,339 -- Found 3 coverage files to report
      info - 2025-08-06 14:42:17,340 -- > /home/runner/work/carbon/carbon/coverage/lcov.info
      info - 2025-08-06 14:42:17,340 -- > /home/runner/work/carbon/carbon/coverage/clover.xml
      info - 2025-08-06 14:42:17,340 -- > /home/runner/work/carbon/carbon/coverage/coverage-final.json
      info - 2025-08-06 14:42:17,938 -- Your upload is now processing. When finished, results will be available at: https://app.codecov.io/github/carbon-design-system/carbon/commit/7659f5df1cba1eaea86858b8de022ddd2619003f
      info - 2025-08-06 14:42:18,122 -- Process Upload complete
      
  3. Click on the "results available" url - it shows no uploads when it should
Image

Steps to reproduce the latest commit on main being out of date

  1. Go to https://app.codecov.io/gh/carbon-design-system/carbon

  2. See latest commit currently shows https://github.com/carbon-design-system/carbon/commit/30b4f874c37a5725bfac3be52b55349a8bbdaaaf

    • Image
  3. The latest commit in the repo shows different - lots has been merged since then. This ss shows just through Aug 5 - it's Aug 11 and there's even more ahead of this with successful uploads in the logs but no uploads shown in the tool.

Image

Expected behavior

  • Uploads should work and be shown in the tool when logs show success upload
  • reports for main should be up to date based on these
  • codecov status checks should report/pass on PRs (they're not right now)

Regression Technically this worked 7 days ago (one time) but before that it also had been happening. I don't know when exactly it started but we've had to made the codecov status check non-required for the past week since none of the checks are passing or reporting.

Screenshots see above

Product Area coverage

Versions

  • OS: mac
  • Git Host: GitHub
  • CI/CD: GitHub Actions
  • Uploader: codecov/codecov-action@18283e04ce6e62d37312384ff67231eb8fd56d24 # v5.4.3

Commit and CI link see above

Additional context n/a

tay1orjones avatar Aug 11 '25 16:08 tay1orjones

I have the same experience. The webhooks and annotations stopped working, too.

vgvassilev avatar Aug 13 '25 07:08 vgvassilev

We are also facing this issue on some runs such as https://github.com/nationalarchives/ds-caselaw-editor-ui/actions/runs/16871296604/job/47786633552?pr=2231 https://app.codecov.io/github/nationalarchives/ds-caselaw-editor-ui/commit/df7bacacc8ccb3bd8071df623c475ec70d319d99

anthonyhashemi avatar Aug 13 '25 13:08 anthonyhashemi

thought it was just me! https://app.codecov.io/github/mlapaglia/MotionMiner/commit/dfa509aa7129667c55c19e5231673fb10768ced3 https://app.codecov.io/github/mlapaglia/ng20-rename/commit/a5df2fbc05207a8ddeb413bfb06b3340fda26996

mlapaglia avatar Aug 17 '25 02:08 mlapaglia

Same here: https://app.codecov.io/github/mhx/dwarfs/commit/8829c5345ab5ecce885db9d237cbd1dd655e1d30

mhx avatar Aug 17 '25 07:08 mhx

Same here: https://github.com/pepijn-devries/blosc/actions/runs/17018435588/job/48244079338 https://app.codecov.io/github/pepijn-devries/blosc/commit/adb1a5d295b5ece69b84ddcc55f6510dd37be7d7

pepijn-devries avatar Aug 17 '25 09:08 pepijn-devries

Same here: https://app.codecov.io/gh/skaengus2012/REMINDER_ANDROID/commit/4e5bd7cd69a1d2d7d17d110ccf553bf7206f5863

skaengus2012 avatar Aug 17 '25 12:08 skaengus2012

Seems like it started working ~3 hours ago

destel avatar Aug 17 '25 22:08 destel

Seems like it started working ~3 hours ago

Still broken for me: https://app.codecov.io/gh/mhx/dwarfs/commit/12d7aae392cf43993ac1642679e31215b68bb914

mhx avatar Aug 17 '25 22:08 mhx

Any update on this? Codecov seems very flaky given that I've had several of these similar issues in the past couple of months

jiaxin-lin avatar Aug 17 '25 22:08 jiaxin-lin

Confirmed, I had the same issue last week, but it seems to be working now.

PR

  • https://github.com/waffiqaziz/BAZZ-Movies/pull/296#issuecomment-3194705339
  • https://app.codecov.io/gh/waffiqaziz/BAZZ-Movies/pull/296?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=WaffiqA

Commit

  • https://app.codecov.io/github/waffiqaziz/BAZZ-Movies/commit/adef6cb3b2d89c81dbe1f281e883015d64bf52bb

waffiqaziz avatar Aug 17 '25 23:08 waffiqaziz

Hey @tay1orjones, Adrian from Codecov here. I think the token that you are using is outdated or perhaps has been changed. Can you double-check that it is matching the one with the Codecov UI?

adrianviquez avatar Aug 18 '25 16:08 adrianviquez

Hey @tay1orjones, Adrian from Codecov here. I think the token that you are using is outdated or perhaps has been changed. Can you double-check that it is matching the one with the Codecov UI?

I regenerated the token and codecov/patch started working again but not codecov/project:

Image

Also webhooks are giving 403. Any ideas what needs to be fixed?

vgvassilev avatar Aug 24 '25 10:08 vgvassilev

Hey @vgvassilev can you provide the commit it's happening in? And if the problem is persisting, could you please create an issue for it? That way other engineers at Codecov can help take a look as well

adrianviquez avatar Aug 26 '25 20:08 adrianviquez

Hey @vgvassilev can you provide the commit it's happening in? And if the problem is persisting, could you please create an issue for it? That way other engineers at Codecov can help take a look as well

@adrianviquez, thanks -- here is the new issue: https://github.com/codecov/codecov-action/issues/1869

vgvassilev avatar Aug 27 '25 08:08 vgvassilev