github-action-benchmark
github-action-benchmark copied to clipboard
Allow a way to use commit comment on fail in the PR gtate
Currently, the recommendation is to not use this for PRs. The problem is that the commit comment is only added after it is pushed to main.
This is kind of my way to add it as a gate to CI:
- PR is submitted
- BDN is ran
- If the Mean is out of range it fails it puts a commit comment in the PR
- PR fails and it isn't added to the charts
For step #3, it would be cool to verify vs a specific commit ID (or maybe most recent one in Main): https://github.com/benchmark-action/github-action-benchmark/issues/281