BenchmarkCI.jl

BenchmarkCI.jl copied to clipboard

We'll be removing `Base.libm_name` in Julia 1.9, and eventually remove OpenLibm from base. https://github.com/JuliaLang/julia/pull/42299 To continue using OpenLibm, simply use `OpenLibm_jll` explicitly in your Project.toml, and this recipe should allow...

ViralBShah

Comment not being posted even though `Post results` step reports `[ Info: Comment posted.`

2

BenchmarkCI has been added to Plots.jl, and seems to work well. However the comment isn't being posted, even though the `Post results` step is reporting `[ Info: Comment posted.` For...

IanButterworth

Feel free to add more!

fonsp

Inplace comment update

2

**`@aviatesk`** composed a solution to update comment in place: https://github.com/aviatesk/JET.jl/blob/8a458dd8d675c8e26c1149517c8dfbb1d755f01b/.github/workflows/benchmark.yml#L28-L68 Quoting my comment on slack: > I moved to git repository-based output (https://github.com/tkf/BenchmarkCI.jl#store-benchmark-result-in-a-git-branch-optional-very-experimental) so I'm not personally annoyed by the...

tkf

Using BenchmarkCI in Buildkite pipelines

2

I tried using following script for running benchmarks on buildkite pipline ``` using Pkg # Activate `benchmark` Pkg.activate("benchmark") Pkg.develop(path=".") # Add parent Project.toml to development env Pkg.instantiate() Pkg.build() Pkg.precompile() #...

ven-k

Benchmarking fails when target and baseline have different dependency compat versions

1

Thanks for your work on so many great packages! We have a pretty simple setup for BenchmarkCI: https://github.com/ITensor/ITensors.jl/tree/v0.1.41/benchmark https://github.com/ITensor/ITensors.jl/blob/v0.1.41/.github/workflows/benchmark.yml which generally runs fine. However, when we update the compatibility of...

mtfishman

New repositories use `main` instead of `master`

1

Is it possible to optionally to another branch than master? ```julia julia> BenchmarkCI.judge() fatal: couldn't find remote ref refs/heads/master ERROR: failed process: Process(`git fetch origin +refs/heads/master:refs/remotes/origin/master`, ProcessExited(128)) [128] ```

Azzaare

Respond gracefully when benchmarks not set up on baseline

3

Thanks for this useful package! I am currently setting up both PkgBenchmark and BenchmarkCI in the same branch of my repo. As a result, the file `benchmark/benchmarks.jl` does not exist...

epatters

Currently, BenchmarkCI.jl fails in PkgEval with ``` *** Please tell me who you are. Run git config --global user.email "[email protected]" git config --global user.name "Your Name" to set your account's...

tkf

Use GitHub.jl?

3

... though what's done here ATM is simple enough to do with `curl`.

tkf