cloud-ml-examples icon indicating copy to clipboard operation
cloud-ml-examples copied to clipboard

[REVIEW] Added AWS EKS Examples using DASK+RAPIDS

Open akaanirban opened this issue 4 years ago • 4 comments

This PR addresses #123 and adds:

  1. Setup guide for EKS cluster.
  2. Necessary pod config templates.
  3. A short notebook for running a XGBoost with Rapids and with smaller dataset.
  4. A longer notebook with performance sweeps on variety of algorithm in cuml and larger dataset.

CAVEAT + WIP:

  1. EKS issue with calling compute on a large dask_cudf.dataframe causing local client to restart

akaanirban avatar Jun 25 '21 14:06 akaanirban

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

Added Note stating the EKS specific issue of the client restarting on calling compute.

akaanirban avatar Jul 08 '21 20:07 akaanirban

Incorporated review comments @Nanthini10 . Should we still keep this as WIP ? @zronaghi

akaanirban avatar Jul 14 '21 18:07 akaanirban

Can you resolve the merge conflicts with README.md?

Nanthini10 avatar Jul 14 '21 20:07 Nanthini10