[BUG]: `create-uber-principal` command failed when updating the SQL warehouse config

[qziyuan]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

1. create-uber-principal will fail with ERROR [d.l.ucx.create-uber-principal] InvalidParameterValue: Endpoint security policy is required and must be one of NONE, DATA_ACCESS_CONTROL, PASSTHROUGH. when updating the SQL warehouse config to add the uber principal to data_access_config. This can be fixed by adding security_policy to the set_workspace_warehouse_config api call

2. Furthermore, the same api call is still failing, after above is fixed, with this error: databricks.sdk.errors.platform.InvalidParameterValue: enable_serverless_compute is required.. For a workspace with serverless enabled, the undocumented enable_serverless_compute field must be provided in the api request body, but python SDK does not support this field. UCX may have to call the REST API directly instead of using python SDK, if the SDK cannot support this field in the near future.

Expected Behavior

No response

Steps To Reproduce

No response

Cloud

Azure

Operating System

macOS

Version

latest via Databricks CLI

Relevant log output

No response

[qziyuan]

1. PR #2409 will fix 1st Endpoint security policy is required and must be one of NONE, DATA_ACCESS_CONTROL, PASSTHROUGH. error.
2. The 2nd enable_serverless_compute is required. error is pending upstream issue https://github.com/databricks/databricks-sdk-py/issues/305. PR #2409 will provide a workaround by printing the data access config in logs which can be then manually applied into the admin UI.