CodeCov PR comment doesn't respond to layout changes in `codecov.yml`
Describe the bug
Changing the layout setting in codecov.yml doesn't change the actual comment on our open-source repository https://github.com/Expensify/App. This appears to be repo specific, since I've forked the repo and it seems to work fine on the fork.
Problematic Repo Information:
- Repo: https://github.com/Expensify/App
-
Our
codecov.yml -
Example of CodeCov PR comment missing
difflayout even though it is specified in the yaml config
Screenshot of comment:
Forked Repo Information:
- Repo: https://github.com/blimpich/App
-
codecov.yml(exact same as problematic repo) -
Example of CodeCov PR comment that correctly posts a comment that includes
difflayout
Screenshot of comment:
Environment (please complete the following information):
- Both systems use codecov/codecov-action@5a1091511ad55cbe89839c7260b706298ca349f7 aka v5.5.1 to upload the coverage reports to CodeCov.
Expected behavior
I would expect that adding the diff option to the layouts attribute of the yaml config would cause the PR comment to update and show that configuration, and it does on the fork, but not on the repo that I need it to update on.
I've now spent many hours trying to figure out the cause of this and I have two theories:
- there is some sort of caching issue on CodeCov's side that isn't updating our YAML
- We were on a free trial and the trial ended and we got somehow put on a developer plan that restricted our feature set
Theory #2 seems sort of likely because I see that the Configuration page for the forked repo appears to be different from the configuration page from the original repo. The only difference I can think of is that the original repo went on a free trial and the forked one didn't:
Ah okay I'm pretty sure the 2nd theory is right, because our comment seems to be hardcoded to reflect the team plan, even though we are on a free developer plan. I can tell it's the team plan because i found the hardcoded footer here: https://github.com/codecov/umbrella/blob/5d0b07fdc38724f9a245ea57ca6c12ec8dada0d0/apps/worker/services/notification/notifiers/mixins/message/writers.py#L140