incubator-gluten icon indicating copy to clipboard operation
incubator-gluten copied to clipboard

libvelox.so issue while running Spark tpcds/tpch workload with Gluten

Open pauldintel opened this issue 1 year ago • 0 comments

Backend

VL (Velox)

Bug description

Running on GCP EMR 80 vcpu with Gluten enable ended up below issue . No issue on N2 - ICX 16 VCPU run .

Same issue on both TPCH and TPCDS run : NO Issue to run same code in Vanilla . Using Spark notebook to execute this :

image

Run parameters below :

image

Spark version

Spark-3.3.x

Spark configurations

Standard Gluten configurations - run file on ICX GCP N2 machine

System information

Ubuntu 20.04 using the Gluten Velox jar

Relevant logs

No response

pauldintel avatar Jun 25 '24 18:06 pauldintel