modern-data-warehouse-dataops icon indicating copy to clipboard operation
modern-data-warehouse-dataops copied to clipboard

Incorporate Data Generator from Brian

Open devlace opened this issue 1 year ago • 0 comments

DoD:

  • Data Generator sinks the Parking Sensor data into a storage account that is provisioned as part of the TF script.
  • Rename container in the TF deployment to reflect Data Source. Currently, we just have "main" container
  • location: utilities/data_generator
  • Add README on how to run generator.

Note: the storage account will be used for different purpose (ie. Config storage).

Depends on #848

NOTE: May have to update ``lakehouse_ddls.yaml` (see #862 ) to match the schema used by the generator.

devlace avatar Nov 11 '24 09:11 devlace