spylon-kernel icon indicating copy to clipboard operation
spylon-kernel copied to clipboard

Integrate or break dependency on spylon package

Open parente opened this issue 8 years ago • 1 comments

maxpoint/spylon is used for configuration purposes in the %%init_spark block and to create the SparkContext from that config. We're uncertain as to whether we're going to keep maintaining the spylon package as a separate entity or not. Either we should break ties with it and go back to using the plain old SparkConfig object with strings, or merge the pieces that support attribute dot-notation and autocomplete into spylon-kernel.

parente avatar Sep 06 '17 15:09 parente

A reasonable amount of the spylon scala utilities aren't that needed anymore due to improvements in py4j as well.

mariusvniekerk avatar Sep 08 '17 14:09 mariusvniekerk