whitebox icon indicating copy to clipboard operation
whitebox copied to clipboard

The features metrics pipeline running with the cron tasks isn't implemented as intended

Open sinnec opened this issue 3 years ago • 2 comments

The features metrics pipeline running with the cron tasks isn't implemented as intended. It uses inferences while it should be using training datasets and should run when a training dataset is inserted and not in cron tasks.

Note: The current implementation could be used for data quality metrics.

Tasks:

  • [ ] Calculate feature metrics when a training dataset is inserted.
  • [ ] Rename all model integrity functions, properties etc so the use the same name (model integrity metrics, feature metrics or descriptive statistics)

sinnec avatar Feb 08 '23 10:02 sinnec

async def run calculate feature metrics pi For now, let’s use it for processed training data. For inferences let’s keep it for a new feature.

stavrostheocharis avatar Feb 15 '23 14:02 stavrostheocharis

For the name let's use the "descriptive statistics" where we use integrity, etc.: class FeatureMetrics(BaseModel) return Nond

stavrostheocharis avatar Feb 15 '23 14:02 stavrostheocharis