Ismail Dawoodjee
Results
2
repositories owned by
Ismail Dawoodjee
GreatEx
20
Stars
6
Forks
Watchers
A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.
aws-data-pipeline
17
Stars
6
Forks
Watchers
A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from locally hosted Airflow containers. The end product is a Superset d...