similarity icon indicating copy to clipboard operation
similarity copied to clipboard

Validate the NPV Classification Metric

Open owenvallis opened this issue 3 years ago • 5 comments

Recently observed some noise in the NPV metric as the distance increases. Add tests and verify the metric is consistent as the distance increases. The number of predicted negative decreases as the distance increases and this may make the denominator unstable towards the extremes.

owenvallis avatar Jun 13 '22 19:06 owenvallis

Hi, I would like to take up this issue. Please let me know if it's okay to proceed.

Shivansh-S17 avatar Dec 18 '24 08:12 Shivansh-S17

Yes sure! Thanks for volunteering

ebursztein avatar Dec 22 '24 03:12 ebursztein

@ebursztein Would adding a small epsilon value to stabilize the NPV denominator at extreme distances be the correct approach here, or should we explore other methods?

Shivansh-S17 avatar Dec 22 '24 16:12 Shivansh-S17

I am unsure - Owen was the one looking at it. In general the simplest and closest to the paper the better.

ebursztein avatar Dec 24 '24 22:12 ebursztein

@ebursztein Could you please point me to the specific paper you are talking about

Shivansh-S17 avatar Dec 25 '24 11:12 Shivansh-S17