ACL permissions not applied to notebook jobs created by DBT Python model

[case-k-git]

Describe the bug

A clear and concise description of what the bug is. What command did you run? What happened?

ACL permissions not applied to notebook jobs created by DBT Python model

Steps To Reproduce

In as much detail as possible, please provide steps to reproduce the issue. Sample data that triggers the issue, example model code, etc is all very helpful here.

1. Create configs and set create_notebook: True

config.yaml python_job_config

version: 2
models:
- name: test
  config:
    materialized: table
    python_job_config:
      grants:
        view: [{"group_name": "<group_name>"}]
    database:<catalgo_name>
    schema:<schema_name>
    submission_method: all_purpose_cluster
    create_notebook: True
    cluster_id: "<cluster_id>"

OR access_control_list

version: 2
models:
- name: test
  config:
    materialized: table
    access_control_list:
    [{"group_name": "<group_name>", "permission_level": "CAN_VIEW"}]
    database:<catalgo_name>
    schema:<schema_name>
    submission_method: all_purpose_cluster
    create_notebook: True
    cluster_id: "<cluster_id>"

2. Create sample DBT Python model

def model(dbt, session):
    dbt.config(
        materialized='table',
        tags=['test'],
    )
    return session.sql("SELECT current_timestamp() AS createdtime")

3. Execute python model with --debug option

 dbt run  --target=nonprod --select tag:test --debug

We can confirm that the access_control_list is being passed from debug logs, but the created notebook jobs do not have the expected permissions, even when granted via python_job_config grants. Only the Owner or Admin roles have access.

'access_control_list': [{'service_principal_name': '<service_principal_name>', 'permission_level': 'IS_OWNER'}, {'group_name': '<group_name>', 'permission_level': 'CAN_VIEW'}], 'queue': {'enabled': True}} and additional_job_settings={additional_job_settings}

Expected behavior

A clear and concise description of what you expected to happen.

Grant the permission which is defined by python_job_config

grants:
    view: [{"group_name": "<group_name>"}]

Screenshots and log output

If applicable, add screenshots or log output to help explain your problem.

Only the Owner or Admin roles have access. There is no grants of python_job_config.

System information

The output of dbt --version:

Core:
  - installed: 1.9.4
  - latest:    1.9.4 - Up to date!

Plugins:
  - databricks: 1.10.1 - Up to date!
  - spark:      1.9.2  - Up to date!

The operating system you're using:

The output of python --version:

Additional context

Add any other context about the problem here.

I am working on to fix this issue.

[benc-db]

Thanks for reporting and the PR :)

[case-k-git]

I notice this would be same. Not notebook job though. https://github.com/databricks/dbt-databricks/issues/1003