delta-oms
delta-oms copied to clipboard
DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-...
Delta OMS stopped working after January 31, 2024. There were no changes to our Delta OMS deployment nor the cluster's runtime version. The only change in the environment recently was...
Integrate with Unity Catalog based workspaces
You could simplify this a bit, with an internal mapping case class between spark conf and oms conf and also establish required fields that way. something like this. You can...
Curious to get your thoughts on collecting stats in more of the old-fashioned way to collect and store stats for non-delta tables. Obviously, this would be less performant but I...
Add support for collating Delta Pipeline metrics into the centralized OMS
Use Databricks Terraform provider (https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs) to automate DeltaOMS setup.
**Feature Request** When configuring DeltaOMS with Unity Catalog support, currently users must specify a storage location (such as S3/ADLS/DBFS) for OMS tables, even if the OMS database is in a...