ucx
ucx copied to clipboard
databrickslabs
Metastore (Table) upgrade guide
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 89.39%. Comparing base (
e1d27d5) to head (f0f6ace).
Additional details and impacted files
@@ Coverage Diff @@
## main #1607 +/- ##
=======================================
Coverage 89.39% 89.39%
=======================================
Files 95 95
Lines 11895 11895
Branches 2080 2080
=======================================
Hits 10633 10633
Misses 863 863
Partials 399 399
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
![codecov[bot] avatar](https://avatars.githubusercontent.com/in/254?v=4 "Published by a pub.dev verified publisher"){kind=small}
❌ 167/168 passed, 1 failed, 25 skipped, 2h33m57s total
❌ test_running_real_validate_groups_permissions_job_fails: databricks.labs.blueprint.parallel.ManyError: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table. (21.527s)
databricks.labs.blueprint.parallel.ManyError: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8131980421959922', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GXf5g: https://DATABRICKS_HOST#setting/accounts/groups/503669280686828
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GXf5g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='503669280686828', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GXf5g: https://accounts.CLOUD_ENVdatabricks.net/users/groups/208120428278981/members
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GXf5g', entitlements=[], external_id=None, groups=[], id='208120428278981', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006B4474884DB66
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006B4474884DB66')
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006B4474884DB66 [group_name admins CAN_USE] -> [group_name ucx_GXf5g CAN_USE]
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smufz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smufz
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smufz', metastore_id=None, name='ucx_smufz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
20:04 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xbq3/config.yml) doesn't exist.
20:04 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
20:04 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
20:04 INFO [databricks.labs.ucx.install] Fetching installations...
20:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
20:05 DEBUG [tests.integration.conftest] Waiting for clusters to start...
20:05 DEBUG [tests.integration.conftest] Waiting for clusters to start...
20:05 INFO [databricks.labs.ucx.install] Installing UCX v0.23.2+2320240517200506
20:05 INFO [databricks.labs.ucx.install] Creating ucx schemas...
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('global_init_scripts', <class 'databricks.labs.ucx.assessment.init_scripts.GlobalInitScriptInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('grants', <class 'databricks.labs.ucx.hive_metastore.grants.Grant'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('tables', <class 'databricks.labs.ucx.hive_metastore.tables.Table'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('workspace_objects', <class 'databricks.labs.ucx.workspace_access.generic.WorkspaceObjectInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('groups', <class 'databricks.labs.ucx.workspace_access.groups.MigratedGroup'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('table_failures', <class 'databricks.labs.ucx.hive_metastore.tables.TableError'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('external_locations', <class 'databricks.labs.ucx.hive_metastore.locations.ExternalLocation'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('submit_runs', <class 'databricks.labs.ucx.assessment.jobs.SubmitRunInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('policies', <class 'databricks.labs.ucx.assessment.clusters.PolicyInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('permissions', <class 'databricks.labs.ucx.workspace_access.base.Permissions'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('mounts', <class 'databricks.labs.ucx.hive_metastore.locations.Mount'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('CLOUD_ENV_service_principals', <class 'databricks.labs.ucx.assessment.CLOUD_ENV.AzureServicePrincipalInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('jobs', <class 'databricks.labs.ucx.assessment.jobs.JobInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('table_size', <class 'databricks.labs.ucx.hive_metastore.table_size.TableSize'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('clusters', <class 'databricks.labs.ucx.assessment.clusters.ClusterInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('pipelines', <class 'databricks.labs.ucx.assessment.pipelines.PipelineInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('migration_status', <class 'databricks.labs.ucx.hive_metastore.migration_status.MigrationStatus'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('workflow_problems', <class 'databricks.labs.ucx.source_code.jobs.JobProblem'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('udfs', <class 'databricks.labs.ucx.hive_metastore.udfs.Udf'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('logs', <class 'databricks.labs.ucx.installer.logs.LogRecord'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table.
20:05 CRITICAL [databricks.labs.blueprint.parallel] All 'deploy tables' tasks failed!!!
20:05 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 498, in _create_database
raise err
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 487, in _create_database
deploy_schema(self._sql_backend, self._config.inventory_database)
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 85, in deploy_schema
Threads.strict(
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict
raise ManyError(errs)
databricks.labs.blueprint.parallel.ManyError: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
20:05 CRITICAL [databricks.labs.blueprint.parallel] All 'installing components' tasks failed!!!
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8131980421959922', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GXf5g: https://DATABRICKS_HOST#setting/accounts/groups/503669280686828
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GXf5g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='503669280686828', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GXf5g: https://accounts.CLOUD_ENVdatabricks.net/users/groups/208120428278981/members
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GXf5g', entitlements=[], external_id=None, groups=[], id='208120428278981', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006B4474884DB66
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006B4474884DB66')
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006B4474884DB66 [group_name admins CAN_USE] -> [group_name ucx_GXf5g CAN_USE]
20:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smufz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smufz
20:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smufz', metastore_id=None, name='ucx_smufz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
20:04 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xbq3/config.yml) doesn't exist.
20:04 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
20:04 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
20:04 INFO [databricks.labs.ucx.install] Fetching installations...
20:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
20:05 DEBUG [tests.integration.conftest] Waiting for clusters to start...
20:05 DEBUG [tests.integration.conftest] Waiting for clusters to start...
20:05 INFO [databricks.labs.ucx.install] Installing UCX v0.23.2+2320240517200506
20:05 INFO [databricks.labs.ucx.install] Creating ucx schemas...
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('global_init_scripts', <class 'databricks.labs.ucx.assessment.init_scripts.GlobalInitScriptInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('grants', <class 'databricks.labs.ucx.hive_metastore.grants.Grant'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('tables', <class 'databricks.labs.ucx.hive_metastore.tables.Table'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('workspace_objects', <class 'databricks.labs.ucx.workspace_access.generic.WorkspaceObjectInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('groups', <class 'databricks.labs.ucx.workspace_access.groups.MigratedGroup'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('table_failures', <class 'databricks.labs.ucx.hive_metastore.tables.TableError'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('external_locations', <class 'databricks.labs.ucx.hive_metastore.locations.ExternalLocation'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('submit_runs', <class 'databricks.labs.ucx.assessment.jobs.SubmitRunInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('policies', <class 'databricks.labs.ucx.assessment.clusters.PolicyInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('permissions', <class 'databricks.labs.ucx.workspace_access.base.Permissions'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('mounts', <class 'databricks.labs.ucx.hive_metastore.locations.Mount'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('CLOUD_ENV_service_principals', <class 'databricks.labs.ucx.assessment.CLOUD_ENV.AzureServicePrincipalInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('jobs', <class 'databricks.labs.ucx.assessment.jobs.JobInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('table_size', <class 'databricks.labs.ucx.hive_metastore.table_size.TableSize'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('clusters', <class 'databricks.labs.ucx.assessment.clusters.ClusterInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('pipelines', <class 'databricks.labs.ucx.assessment.pipelines.PipelineInfo'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('migration_status', <class 'databricks.labs.ucx.hive_metastore.migration_status.MigrationStatus'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('workflow_problems', <class 'databricks.labs.ucx.source_code.jobs.JobProblem'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('udfs', <class 'databricks.labs.ucx.hive_metastore.udfs.Udf'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table.
20:05 ERROR [databricks.labs.blueprint.parallel] deploy tables('logs', <class 'databricks.labs.ucx.installer.logs.LogRecord'>) task failed: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 27, in deploy_table
self._sql_backend.create_table(f"hive_metastore.{self._inventory_schema}.{name}", klass)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 57, in create_table
self.execute(ddl)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 142, in execute
self._sql.execute(sql, catalog=catalog, schema=schema)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 242, in execute
self._raise_if_needed(status)
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 479, in _raise_if_needed
raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table.
20:05 CRITICAL [databricks.labs.blueprint.parallel] All 'deploy tables' tasks failed!!!
20:05 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
Traceback (most recent call last):
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 498, in _create_database
raise err
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 487, in _create_database
deploy_schema(self._sql_backend, self._config.inventory_database)
File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 85, in deploy_schema
Threads.strict(
File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict
raise ManyError(errs)
databricks.labs.blueprint.parallel.ManyError: Detected 20 failures: BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`CLOUD_ENV_service_principals`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/CLOUD_ENV_service_principals') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`clusters`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/clusters') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`external_locations`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/external_locations') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`global_init_scripts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/global_init_scripts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`grants`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/grants') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`groups`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/groups') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`jobs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/jobs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`logs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/logs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`migration_status`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/migration_status') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`mounts`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/mounts') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`permissions`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/permissions') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`pipelines`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/pipelines') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`policies`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/policies') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`submit_runs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/submit_runs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_failures`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_failures') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`table_size`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/table_size') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`tables`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/tables') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`udfs`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/udfs') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workflow_problems`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workflow_problems') is not empty and also not a Delta table., BadRequest: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table ('`hive_metastore`.`ucx_smufz`.`workspace_objects`'). The associated location ('dbfs:/user/hive/warehouse/ucx_smufz.db/workspace_objects') is not empty and also not a Delta table.
20:05 CRITICAL [databricks.labs.blueprint.parallel] All 'installing components' tasks failed!!!
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0006B4474884DB66 [group_name admins CAN_USE] -> [group_name ucx_GXf5g CAN_USE]
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0006B4474884DB66')
20:05 INFO [databricks.labs.ucx.install] Deleting UCX v0.23.2+2320240517200509 from https://DATABRICKS_HOST
20:05 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_smufz
20:05 INFO [databricks.labs.ucx.install] Deleting jobs
20:05 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted
20:05 INFO [databricks.labs.ucx.install] Deleting cluster policy
20:05 INFO [databricks.labs.ucx.install] Deleting secret scope
20:05 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8131980421959922', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_GXf5g', entitlements=[], external_id=None, groups=[], id='208120428278981', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_GXf5g', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='503669280686828', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8131980421959922', type=None, value='8131980421959922')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
20:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smufz', metastore_id=None, name='ucx_smufz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
Running from acceptance #3298
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}