Azure-Databricks-Airlift

Databricks notebooks covering data engineering and data science workloads (Microsoft Airlift Agenda)

Data Engineering Notebooks

• Reading Data Basics
• Transformations & Actions
• Integration with Azure Data Services
  • Azure Event Hub
  • Azure SQL Data Warehouse
  • Azure Cosmos DB
• Delta Lakes
  • Batch Jobs
  • Streaming Jobs
  • Optimization

Data Science Notebooks

• Intro to DataFrames (3 parts)
• Intro to Structured Streaming
• Spark ML Basics
• Spark ML Streaming
• Machine Learning Pipelines
• Convolutional Neural Networks
• Transfer Learning
• Horovod (Distributed Learning)