Guenia Izquierdo Delgado

icon company @databricks

Results 33 issues of Guenia Izquierdo Delgado

[Investigate] How to make logs more useful

3 comment

When we run multiple workspaces, how do we make logs more explicit? One idea could be to add the current workspace to every log/printf line

Validate that all billable cluster states have `total_cost` > 0 and not null

1 comment

data quality

[DOCS] Clarify how to read from multi-region audit system tables

Update docs to reflect the fact that System Audit table contains regional data only, so multi-region deployments should follow the same configuration as multi-account.

Ensure that `driver_node_type_id` is not null in JRCP

data quality

[Investigate] Review actions in job_run that are not currently considered in the rest of the pipeline

1 comment

Review actions outside of `snapimpute, create, reset, update, delete, resetJobAcl, changeJobAcl` to determine if they need to be included in the pipeline downstream

data quality

Check for missing interactive cluster details in cluster table

2 comment

A customer reported this, and it might be happening on internal deployment as well. I believe @mohanbaabu1996 has examples

question
data quality

[Investigate] Check reasons why job_run_cluster_util could be outside of the 0-1 range

data quality

Ensure that `node_type_ids` and `driver_node_type_id` are not null in CLSF

data quality

Some clusters data is incomplete in cluster_gold

1 comment

In our internal deployment, `num_workers` and `driver_node_type` are NULL for a few clusters (interactive, not new, and active) We should review

data quality

[INVESTIGATE] Investigate reasons for Job Run vs JRCP discrepancies

There are cases where there are missing JobRuns in JRCP. We know one of the reasons is jobs running on warehouses, investigate and document any other reasons, along with a...

data quality