Quantus icon indicating copy to clipboard operation
Quantus copied to clipboard

Let's make a Metric Comparison Matrix

Open annahedstroem opened this issue 3 years ago • 0 comments

Let's make a Metric Cimparison metric, similar to Captum's: https://captum.ai/docs/algorithms_comparison_matrix)https://captum.ai/docs/algorithms_comparison_matrix.

Tasks:

  • [ ] Create a MetricMatrix.md file
  • [ ] Start adding things like:
    • Short description e.g., a one-liner describing the metric
    • Score range (tuple) e.g., [-1, 1]
    • Bounded (bool) e.g., y/n
    • Time Complexity
    • Category
    • Task/ Data/ Model - Agnostic?
    • Stochastic vs
    • etc etc ....

annahedstroem avatar Jul 13 '22 16:07 annahedstroem