Dyno Fu

i was trying to split a stacktrace with `'

@alexarchambault i am using ammonite-spark, but still hit the same issue as @schlichtanders, this is on AWS EMR cluster spark-shell works fine. ``` {import org.apache.spark.sql._ val spark = AmmoniteSparkSession.builder .progressBars()...

it's like a hadoop problem. ``` hadoop-amm@ import org.apache.hadoop.util.VersionInfo import org.apache.hadoop.util.VersionInfo hadoop-amm@ var ver = VersionInfo.getVersion() ver: String = "${pom.version}" ```

``` ls.rec! Path("/usr/lib/spark/jars") |? { _.segments.last.endsWith(".jar") } |! { interp.load.cp(_) } import org.apache.hadoop.util.VersionInfo val ver = VersionInfo.getVersion() ver: String = "2.8.3-amzn-1" ``` but there are still other problems...

i actually made it work in our emr cluster. instead of a gist, i just publish my setup and hope it can be a bit help to anybody who are...

i am curious what is this `@`? a script divider? any document about it's usage? thanks.

you can take a look my scripts build on top of Ammonite-spark https://github.com/dyno/ammonite_with_spark_on_emr and the `spark.jars` will use whatever on the emr by ammonite-spark https://github.com/dyno/ammonite_with_spark_on_emr/blob/master/emr.sc#L33.