datadevops
datadevops copied to clipboard
How DevOps principles can be applied to Data Pipeline Solution built with Azure Databricks, Data Factory and ADL Gen2. Moved to: https://github.com/Azure-Samples/modern-data-warehouse-dataops
Bumps [pyspark](https://github.com/apache/spark) from 2.4.4 to 3.2.2. Commits 78a5825 Preparing Spark release v3.2.2-rc1 ba978b3 [SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases 001d8b0 [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to...
On PR, only QA pipeline should get triggered
Bumps [pyspark](https://github.com/apache/spark) from 2.4.4 to 3.3.2. Commits 5103e00 Preparing Spark release v3.3.2-rc1 307ec98 [MINOR][SS] Fix setTimeoutTimestamp doc 7205567 [SPARK-40819][SQL][FOLLOWUP] Update SqlConf version for nanosAsLong configura... 3ec9b05 [SPARK-40819][SQL][3.3] Timestamp nanos behaviour...