zacayd

## Background [Optional] Hi I have a case of## Background [Optional] Hi I have a case of using delta live tables that runs SQL notebooks I cannot add cell of...

Spline Support of Statment Create table as select

11

I have a statment in a Notebook in Databricks that is ```sql create table lineage_data.lineagedemo.dinner_1 AS SELECT recipe_id, concat(app," + ", main," + ",dessert) AS full_menu FROM lineage_data.lineagedemo.menu ``` the...

Using Spline in Spark Scala project

1

Hi @wajda I have a spark code that I got from someone in the organization that has Scala Code They have a Configuration.conf like this If I add in the...

Hi i creaed a code on the notebook to grab the Notebook data into the execution plan ```scala import scala.util.parsing.json.JSON import za.co.absa.spline.harvester.SparkLineageInitializer._ import za.co.absa.spline.agent.AgentConfig import za.co.absa.spline.harvester.postprocessing.AbstractPostProcessingFilter import za.co.absa.spline.harvester.postprocessing.PostProcessingFilter import org.apache.commons.configuration.Configuration...

Support of setting the arangoDB name on the configuration

7

Hi I am using spline to capture lineage from Databricks notebooks I put on the cluseter - on the advanced settings ``` spark.spline.mode ENABLED spark.spline.lineageDispatcher.http.producer.url http://10.0.19.4:8080/producer spark.spline.lineageDispatcher http ``` since...

Hi I entered into a solution called snowpack https://www.snowflake.com/en/data-cloud/snowpark/ does spline support this? ```[tasklist] ### Tasks ```

use splineAgent as a Jar file

12

Hi i tried to install the Agent Spline without Maven - but Upload of the a Jar FIile i cloned the code from git and build it to a `spline-spark-agent_2.12.jar`...

I have a case of using delta live tables that runs SQL notebooks. I cannot add cell of python `sc._jvm.za.co.absa.spline.harvester.SparkLineageInitializer.enableLineageTracking(spark._jsparkSession)` since DLT doesn't support magic like `%python` So I created...

How to support change of spline to write to a file on HDFS with name as the executionplan

1

How to support change of spline to write to a file on HDFS with name as the executionplan

## Describe the bug I put on the config of spark spark.jars=hdfs:///tmp/spark-2.4-spline-agent-bundle_2.11-2.2.1.jar spark.sql.queryExecutionListeners=za.co.absa.spline.harvester.listener.SplineQueryExecutionListener spark.spline.mode=ENABLED spark.spline.lineageDispatcher=hdfs spark.spline.lineageDispatcher.hdfs.outputDir=hdfs:///tmp/spline/lineage/ spark.spline.lineageDispatcher.hdfs.fileNamePrefix=lineage_ spark.spline.lineageDispatcher.hdfs.fileBufferSize=4096 spark.spline.lineageDispatcher.hdfs.filePermissions=777 spark.driver.memory=4g I run this code from pyspark.sql import SparkSession spark =...