Nikos Bosse

Thanks a lot for this awesome add-on! Do you think there would be an way to use this to export Anki notes as Markdown? Happy to contribute if you think...

I tried summarising by c("model", "quantile"), and specified metric = "interval_score", but still got all metrics back.

When some lower or upper bounds of a prediction interval (i.e. when some quantiles) are NA, then `score()` should alert the user somehow of this. Maybe the corresponding intervals should...

The function should give you an intuitive error message, when you try to pass the output form "summarise_scores" directly into "plot_correlations". `correlation` should give a warning when it filters out...

I constructed some synthetic data and run into an error that was tricky to spot, caused by the fact that the sample column was automatically ignored: ``` library(dplyr) library(tidyr) library(scoringutils)...

The following issues appear in `plot_pairwise_comparison`, mentioned in #217: > When type = "pval" in plot_pairwise_comparison the smaller_is_good argument did nothing. I have added documentation for this and added an...

Currently there is no way to have coverage displayed on the plot_score_table() plot. The following code will just remove it: ``` example_quantile %>% score() %>% add_coverage(by = c("model")) %>% summarise_scores(by...

Improve calibration plotting

2

- Add Talagrand diagram (verification rank histogram) --> see Gneiting 2007. Somewhat analogous to PIT. - look at sample autocorrelation functions for PIT values - add marginal calibration plot

Add Diebold Mariano test

2

It would be cool to have an implementation of the Diebold-Mariano test to test whether the scores of two models are significantly different.