Supun Nakandala

Performance benchmark as part of CI/CD

5

I was wondering whether we should have some kind of performance-based tests as part of the CI/CD pipelines. Any thoughts?

The current Sklearn KNeighbors classifier supports only the brute force method. It would be interesting to explore whether we can support kd-tree and ball-tree methods.

FastICA converter with n_components None fails on macos-latest and Python 3.8 due to a sklearn bug.

Cannot Import torch_tvm

2

I have installed the torch nightly build (torch-1.3.0.dev20190819-cp36-cp36m-linux_x86_64.whl) and successfully build torch_tvm. However, when I try to import torch_tvm I get the following error: ``` >>> import torch_tvm Traceback (most...

ASHA is an AutoML procedure that combines random search with early stopping. More details: https://arxiv.org/pdf/1810.05934.pdf

- Cerebro should be integrated with MLFlow for logging and final model storing. - We will support two logging mechanisms. TensorBoard (TB) will be the primary logging mechanism and will...

Cerebro should be able to handle spark task failures. Spark will handle the fault-tolerance of workers. Cerebro should detect the failures and re-execute the models. Faults can also be user...

Currently, data shuffling for each sub-epoch is disabled. We need to add a configurable parameter to enable/disable sub-epoch level partition level data shuffling. Full data shuffling (across partitions) will be...

Currrently, we assume the entire dataset will be used to train the model. But this is not the case. Only some columns may be selected by a particular model, or...