Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Test failure: test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-hiveserde-tables-in-place-experimental] #4669

@github-actions

Description

@github-actions
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-hiveserde-tables-in-place-experimental]: AssertionError: Workflow failed: migrate-external-hiveserde-tables-in-place-experimental (23m43.782s)
AssertionError: Workflow failed: migrate-external-hiveserde-tables-in-place-experimental
assert False
[gw0] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
14:49 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9/config.yml) doesn't exist.
14:49 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
14:49 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
14:49 INFO [databricks.labs.ucx.install] Fetching installations...
14:49 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9 is corrupted. Skipping...
14:49 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
14:49 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:49 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:49 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+None20251008144945
14:49 INFO [databricks.labs.ucx.install] Creating ucx schemas...
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
14:50 INFO [databricks.labs.ucx.install] Creating dashboards...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9/README for the next steps.
14:50 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
14:50 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/324690711033507
14:50 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
14:50 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/324690711033507/runs/173857181940942
14:50 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/324690711033507
14:50 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:52 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/640217906958112
14:52 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
14:52 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/640217906958112/runs/470263191761071
14:52 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/640217906958112
14:52 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:49 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9/config.yml) doesn't exist.
14:49 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
14:49 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
14:49 INFO [databricks.labs.ucx.install] Fetching installations...
14:49 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9 is corrupted. Skipping...
14:49 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
14:49 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:49 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:49 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+None20251008144945
14:49 INFO [databricks.labs.ucx.install] Creating ucx schemas...
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
14:49 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
14:50 INFO [databricks.labs.ucx.install] Creating dashboards...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
14:50 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
14:50 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:50 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.60L9/README for the next steps.
14:50 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
14:50 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/324690711033507
14:50 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
14:50 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/324690711033507/runs/173857181940942
14:50 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/324690711033507
14:50 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:52 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/640217906958112
14:52 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
14:52 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/640217906958112/runs/470263191761071
14:52 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/640217906958112
14:52 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:12 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+None20251008144945 from https://DATABRICKS_HOST
15:12 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sqc2q
15:12 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=494534993986256, as it is no longer needed
15:12 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=358732995677484, as it is no longer needed
15:12 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=415110857759618, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=384693014335802, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=324690711033507, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=143866075557652, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=22781363619411, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=612051736706376, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=934628128093336, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=640217906958112, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=475890512415330, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=445838731906656, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1076015640316106, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=70583833355552, as it is no longer needed
15:13 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1099171264454405, as it is no longer needed
15:13 INFO [databricks.labs.ucx.install] Deleting cluster policy
15:13 INFO [databricks.labs.ucx.install] Deleting secret scope
15:13 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw0] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #654

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions