Joel Stremmel

Results 12 comments of Joel Stremmel

Thanks @sjrl, this is a helpful workaround.

I came across this recently when using AWS EMR and was able to get set up with a Python 3.6.8 driver to match the version of my worker nodes with...

This PR looks really useful! I might dig into it a bit. Wonder if it'll be merged 🐙

Anyone else landing here because they're following instructions from [this link](https://docs.microsoft.com/en-us/azure/machine-learning/how-to-monitor-tensorboard) regarding using Tensorboard in AzureML?

Hey @Yandrak, absolutely you should create a separate data split for a final, unbiased evaluation. The code in this repo uses the same validation data for early stopping and for...

Can you elaborate on the calibration question? I believe the evaluation script is looking at how well-calibrated the predictions from the model are, e.g., if the model assigns a risk...

For sure. Have you looked at [`CalibratedClassifierCV`](https://scikit-learn.org/stable/modules/generated/sklearn.calibration.CalibratedClassifierCV.html#sklearn.calibration.CalibratedClassifierCV)? Unfortunately I don't have any code for calibrating RETAIN, but maybe this sklearn approach could work or be modified to work with RETAIN.

@bliu188, can you share all the output from your training run? Also, what's the prevalence of your target variable?

> Thanks, Joel. What kind of output will be helpful for you? I added keras.metrics.AUC to check your roc-auc in the implementation. These two agree, ~0.5 auc, suggesting nothing is...

@ecchochan would you be wiling to upload this code?