Pace Francesco

Found more material directly from the RedHat developers Blog: https://developers.redhat.com/blog/2017/03/14/java-inside-docker/

org.apache.spark.SparkException: Task failed while writing rows. at org.apache.spark.sql.sources.InsertIntoHadoopFsRelation.org$apache$spark$sql$sources$InsertIntoHadoopFsRelation$$writeRows$1(commands.scala:161) at org.apache.spark.sql.sources.InsertIntoHadoopFsRelation$$anonfun$insert$1.apply(commands.scala:132) at org.apache.spark.sql.sources.InsertIntoHadoopFsRelation$$anonfun$insert$1.apply(commands.scala:132) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63) at org.apache.spark.scheduler.Task.run(Task.scala:70) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.ArrayIndexOutOfBoundsException: 0 at org.apache.spark.sql.catalyst.expressions.GenericRow.apply(rows.scala:77)...

On the workers I have the following: DBGEN2 Population Generator (Version 1.4.0) Copyright Transaction Processing Performance Council (TPC) 2001 - 2015 15/09/23 12:39:38 ERROR InsertIntoHadoopFsRelation: Aborting task. java.lang.ArrayIndexOutOfBoundsException: 0 at...

@yhuai Hi, first of all thanks for the reply. The dsdgen version is 1.4.0, I downloaded it yesterday. No Exceptions raised if I use the version in the link. This...

Sounds good. Already made the change in the title.

@yhuai I have taken a look at the new dsdgen and compared it with the one from the repo that you linked me. There are a couple of big changes....

Hello @praneetloke, I am also experiencing the same problem in the stack init when using a secret provider. I have tried to use the stack command in the task, but...