dataform icon indicating copy to clipboard operation
dataform copied to clipboard

Bigquery labels not associated with jobs

Open mguidoti opened this issue 1 year ago • 2 comments

It would be nice to have these labels also associated with jobs, for governance and cost-tracking related goals.

I noticed that this was discussed in the past, and that there was a PR that solved the issue, but I'm still not seeing them in there (checking on INFORMATION_SCHEMA.JOBS). I can only see these labels in the query field, under the table definition.

Here's how I defined the labels:

config {
  database: require('includes/project_ids').first2,
  type: "table",
  tags: ["second-attempt"],
  bigquery: {
    labels: {
    "lemoncake-env": "dev"
    }
  }
}

Is this the expected behavior? Or am I doing something wrong?

Thanks in advance,

mguidoti avatar Nov 12 '24 15:11 mguidoti

Can confirm this is no longer working.

astorrs avatar Nov 12 '24 18:11 astorrs

Our understanding here is that this works in the Dataform CLI, but the labels are not set on the jobs when using Dataform in Cloud. We are tracking that request here: https://issuetracker.google.com/issues/333755528

lewish avatar Nov 22 '24 13:11 lewish