JessicaXYWang

Hi @timpiperseek, thank you for reporting this issue. To help us repro this issue, can you please share the dataset you used? (df) Thanks!

Hi @raxu-wish , thank you for reporting the issue. Can you share the link to the demo code you are using?

Hi raxu and jcui, I cannot repro this on Azure Synapse Analytics or Databricks. I'll try it with EMR on the weekend and get back to you before next Monday.

Hi @raxu-wish , could you try: ``` %%configure -f { "name": "synapseml", "conf": { "spark.jars.packages": "com.microsoft.azure:synapseml_2.12:0.10.2", "spark.jars.repositories": "https://mmlspark.azureedge.net/maven" } } ``` ``` from pyspark.ml.feature import VectorAssembler, StringIndexer from synapse.ml.lightgbm import...

@raxu-wish I cannot get a repro there. Here is my configuration, everything else is default.  and here are my results:  I'd recommend check with AWS for this...

@arshee2403 hi Arshee, can you provide your EMR cluster setup (Release, Applications) and code to repro?

> @JessicaXYWang - I've tracked down the issue and you might need to rebuild LightGBM. As of now Amazon EMR only supports variants of Amazon Linux 2 which have glibc...

Hi @Mike-Soukup , thanks for raising this issue. Can you install other packages on your system in your current way? ---------------------------------------- You are on spark 3.0, and there might be...

@Mike-Soukup It seems the jar is not installed. Can you help to check if you can install any other packages on your system?

@Mike-Soukup Thanks you for the feedback. The compatible versions are not correct on the website. Sorry for the confusion. The documentation will be fixed soon with this [PR](https://github.com/microsoft/SynapseML/pull/1812) I can't...