systemds icon indicating copy to clipboard operation
systemds copied to clipboard

[WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions

Open BACtaki opened this issue 3 years ago • 2 comments

This patch proposes a comparison of builtin functions based on a grouping by ML lifecycle phase and ML task. This patch presents only the basic outline- subsequent patches will do the actual comparison.

BACtaki avatar Nov 23 '22 03:11 BACtaki

Thanks Badrul! Although this is a good idea, try to be familiar with the end to end pipelines or a single phase of the cycle with SystemDS. A plenty of working examples are here: https://github.com/damslab/reproducibility

Keep posting any updates here though!

j143 avatar Nov 23 '22 17:11 j143

what i think would be really useful in this direction.

  • run experiments that evaluate performance over time of key algorithms and operations
  • automatically plot these, and provide graphs in GitHub actions.

This can also compare to other systems implementations automatically, to include in the graphs. Optionally it can be an action we run weekly, or monthly?

Baunsgaard avatar Dec 09 '22 11:12 Baunsgaard