Tidy up test coverage in preparation of production release

[wgip]

(using testQuick too)

• [ ] should we run some jobs automatically every 8 hours or so so that the state of things is always validated?

• [x] Test / test

• [x] CMake / test

  • [ ] Should we move this off to GitHub shared build rather run on ve clusters to free up resources?
  • [x] On CI, we get this (fixed in #468)

• [ ] VectorEngine / test (vh001 & aurora06 = ok; com.nec.ve.ExchangeOnLocalSpec might fail if running concurrently with another process)

  • [ ] Failing on CI, due to Spark permissions or so:

• [ ] TPC / testOnly *TPC*VE* in https://github.com/XpressAI/SparkCyclone/pull/463 --> https://github.com/XpressAI/SparkCyclone/pull/463#issuecomment-1027337581 --> ( https://www.sparkcyclone.io/tpc-html/20220201081217/ )

  • [ ] Query 16 - unknown reason
  • [x] Query 15/17 /22- https://github.com/XpressAI/SparkCyclone/issues/471
  • [ ] Query 7, 8, 9 --> https://github.com/XpressAI/SparkCyclone/issues/470 --> most likely an issue in the test definition itself
  • [x] Other queries failing due to correctness, exchangeOnVe = false <- seems to fix this
    • [x] Query 4 -- expected --> List((1-URGENT,10594), (3-MEDIUM,10410), (5-LOW,10487)), got --> List((1-URGENT,10594), (2-HIGH,10476), (3-MEDIUM,10410), (4-NOT SPECIFIED,10556), (5-LOW,10487))
    • [x] Query 5 -- [info] List((CHINA,5.372449425659998E7), (INDIA,5.203551200020002E7), (INDONESIA,5.550204116970004E7), (JAPAN,4.5410175695400015E7)) did not equal List((CHINA,5.372449425660001E7), (INDIA,5.2035512000199996E7), (INDONESIA,5.5502041169699915E7), (JAPAN,4.5410175695400015E7), (VIETNAM,5.529508699669991E7)) (TPCHSqlCSpec.scala:580) (on eg_remove_impstring branch and main branch)
    • [x] Query 6
    • [x] Query 10
    • [x] Query 11
    • [x] Query 13
    • [x] Query 21