Share additional variables between Python and Scala

[parente]

If possible:

1. Share a Spark session / context initialized from Python with code running in %%scala cells. As it stands, the first scala cell tries to initialize another Spark context which fails.
2. Share additional variables between Scala and %%python cells. This is already somewhat possible using the interpret and last_result calls but can be made prettier.

[mariusvniekerk]

So for 1 the idea is to use the %%init_spark magic

[ksangeet9ap]

Hi @mariusvniekerk, could you provide details about how I might achieve that i.e using python SparkContext inside scala?