spark-google-spreadsheets
spark-google-spreadsheets copied to clipboard
potix2
Google Spreadsheets datasource for SparkSQL and DataFrames
I am not very familiar with Scala and SBT so my code change might be not optimal. But this version packaged with sbt-assembly as uber-jar works fine on Spark 3.1...
This is on Databricks build 6.1 (includes Apache Spark 2.4.4, Scala 2.11): ``` CREATE TABLE tmp_weekly USING com.github.potix2.spark.google.spreadsheets OPTIONS ( path "sheet_identifier/Weekly", serviceAccountId "[email protected]", credentialPath "/dbfs/FileStore/credentials/blah.p12" ) ``` The `CREATE`...
Like title says, I want to be able to overwrite existing sheet with data. I tried add `SaveMode`, but no effect: ``` scala df .write .mode(SaveMode.Overwrite) .format("com.github.potix2.spark.google.spreadsheets") .option("serviceAccountId", gserviceAccount) .option("credentialPath",...
@potix2 please see: https://github.com/ClintCombs/spark-google-spreadsheets/pull/8 I need a new "case3" tab as shown in the above pull request. Will you add it? Thanks, Clint
When I load it to my zeppelin notebook (spark 2.4.3 based) ``` %spark.dep //Google spread sheets z.load("com.github.potix2:spark-google-spreadsheets_2.11:0.6.2") z.load("org.apache.commons:commons-lang3:3.8.1") ``` ``` import org.apache.spark.sql.SQLContext val sqlContext = new SQLContext(sc) // Creates a...
```scala case class JiraEvent( issue: String, itype: String, created: String, summary: String, assignee: String, reporter: String, status: String, eventDate: Option[Timestamp], eventActor: String, field: String, from: String, to: String ) ```...
