BaseBenchmarks.jl
BaseBenchmarks.jl copied to clipboard
JuliaCI
A collection of Julia benchmarks available for CI tracking from the JuliaLang/julia repository
This commit adds more real-world, heavy compilation benchmarks, using DataFrames.jl, CSV.jl, Plots.jl and OrdinaryDiffEq.jl as examples. replaces #252 closes #251
This allows to get updates for GitHub actions automatically - it is basically an equivalent of CompatHelper. I have used this for my own packages, the [Trixi.jl framework](https://github.com/trixi-framework), and the...
This is an annoyance because it runs on any benchmark job. Here's an example: https://github.com/JuliaLang/julia/pull/47966#issuecomment-1366201064. It would probably be sufficient to bump up the time tolerance.
It would be amazing if this package could export data to Prometheus so we could use Grafana to query it and have nice insights about performance over a given point...
This is an attempt to aggregate most of the benchmarks I've made for sorting into one place and make them sparse enough for it to be practical to run all...
on master ``` julia> run(BaseBenchmarks.SUITE[["shootout", "binary_trees"]]) BenchmarkTools.Trial: memory estimate: 13.96 MiB allocs estimate: 783717 -------------- minimum time: 13.063 ms (0.00% GC) median time: 14.136 ms (0.00% GC) mean time: 14.747...
The tests take too long, here's why: ```julia $ grep '^[^ ]' 093b2a6ea943f4c70fef4742453e73dd1aba255c_primary.out RUNNING BENCHMARKS... (1/20) benchmarking "shootout"... done (took 70.756991683 seconds) (2/20) benchmarking "string"... done (took 90.13968044 seconds) (3/20)...
Ref. https://github.com/JuliaLang/julia/pull/39035
