databricks
Valid Queries
Which TPC-DS queries are supposed to be working? I'm finding that several queries are not parseable, for a variety of reasons. Specifically, the following queries compile without exception:
Set(q25, q65, q50, q88, q64, q99, q46, q76, q97, q19, q17, q57, q75, q49, q90, q89, q78, q63, qSsMax, q71, q4, q93, q74, q34, q28, q82, q85, q96, q51, q40, q13, q62, q79, q59, q29, q48, q37, q52, q73, q68, q3, q15, q55, q39b, q84, q72, q31, q53, q7, q39a, q43, q61, q42, q11, q26, q21, q47, q91)
The following queries throw exceptions when compiling:
Set(q77, q60, q32, q69, q14b, q86, q98, q6, q35, q83, q66, q87, q94, q23b, q8, q27, q5, q38, q14a, q24b, q67, q56, q16, q45, q23a, q18, q12, q81, q92, q41, q33, q70, q24a, q30, q95, q22, q20, q44, q10, q1, q36, q9, q58, q80, q2, q54)
I've attached detailed output with the various exceptions that are thrown. queries.txt
The code I used to produce this, from the shell, is:
import java.io._
import com.databricks.spark.sql.perf.tpcds.TPCDS
val tpcds = new TPCDS (sqlContext = sqlContext)
val writer = new PrintWriter(new File("queries.txt"))
tpcds.tpcds1_4QueriesMap.keys.foreach(k => try { tpcds.tpcds1_4QueriesMap{k}.tablesInvolved; writer.write(k + ": success\n\n"); } catch { case e: Exception => writer.write(k + ": failed, reason:\n" + e + "\n\n"); })
Is this expected? Since there are several queries split over multiple files (Simple, ImpalaKit, and TPCDS_1_4), are there a set of queries that are considered "supported" right now?
