ReferenceTests.jl
ReferenceTests.jl copied to clipboard
JuliaTesting
Utility package for comparing data against reference files
- rework `@info` in `@test_reference`: now includes `render(...)` (more structured output for the end user, see below, works well with images), this helps CI in ensuring correct message order (io...
I was wondering if there's an easy way to do the equivalent of `@test_broken` but reference test.
In some rare cases: ```julia @test_reference "refrence.png" img # this fails @test_reference "refrence.png" n0f8.(clamp01!(img)) # this works ```
Posted by @adrhill in https://github.com/JuliaTesting/ReferenceTests.jl/issues/97#issuecomment-952841892, we may want to do a key-wise comparison for dictionary types when the reference doesn't match.
I believe this package has proved its usefulness, and I'd like to push it to its 1.0 stage. Here are what I have in mind that needs to be done...
Followup to https://github.com/JuliaTesting/ReferenceTests.jl/pull/82 we didn't quite manage to workout how to use the GHA artifiacts stuff right so that you can download the files that failed. We should make that...
A significant problem with the current API is that using `@test_reference` means we can't do `@test_broken @test_reference` But we could do that if we made the [`test_reference`](https://github.com/JuliaTesting/ReferenceTests.jl/blob/f26bec0c8ec86cbf3c3d207884cfc90b64033e6b/src/test_reference.jl#L86-L91) function the API,...
`test_reference` is like 50 lines long. https://github.com/JuliaTesting/ReferenceTests.jl/blob/f26bec0c8ec86cbf3c3d207884cfc90b64033e6b/src/test_reference.jl#L93-L150 And it is even longer when i put in the stuff for #79 I think we should have it more like ```julia function...
From the docstring it seems that the threshold `t` has a counter-intuitive definition. It is not the usual tolerance `(a - b) = t`? The higher the threshold the more...
Metadata
Owner
Metadata
Utility package for comparing data against reference files