data-engineering topic

Learn how to design, develop, deploy and iterate on production-grade ML applications.

GokuMohandas

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates t...

mlrun

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

kwai

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

swoop-inc

Accelerate data science

d6t

Documentation for data enthusiasts

polakowo

Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊

ploomber

Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a...

dataplane-app

Beneath is a serverless real-time data platform ⚡️

beneath-hq

Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow

alanchn31