Matthew Bedford
Matthew Bedford
I am also getting this with com.microsoft.ml.spark:mmlspark_2.11:0.18.1. In one step I train the model and save it, and in another step I load it. The load step fails. This is...
 Autoscaling is turned off for this cluster. Also, I notice your cluster uses the ML Databricks runtime. We plan to use Azure Machine Learning to drive this workflow, and...
That did not work either:  This is for mmlspark_2.11:0.17+83-11237da2.
Yes, useBarrierExecutionMode=False and isUnbalance=True solved the problem. Thanks so much for your help.
I also encountered this error. ``` from pyspark.ml.evaluation import RegressionEvaluator from pyspark.ml.tuning import CrossValidator, ParamGridBuilder from mmlspark.lightgbm import LightGBMRegressor regressor = LightGBMRegressor(numIterations=numIterations, labelCol="RegLabel", featuresCol="Features", useBarrierExecutionMode=False) pg = ParamGridBuilder()\ .addGrid(regressor.learningRate, learning_rate)\...