modern-data-warehouse-dataops
modern-data-warehouse-dataops copied to clipboard
Incorporate Data Generator from Brian
DoD:
- Data Generator sinks the Parking Sensor data into a storage account that is provisioned as part of the TF script.
- Rename container in the TF deployment to reflect Data Source. Currently, we just have "main" container
- location: utilities/data_generator
- Add README on how to run generator.
Note: the storage account will be used for different purpose (ie. Config storage).
Depends on #848
NOTE: May have to update ``lakehouse_ddls.yaml` (see #862 ) to match the schema used by the generator.