Added metrics for immutable folder usage by andrewnester · Pull Request #7168 · databricks/cli

andrewnester · 2026-10-23T11:59:04Z

Changes

Added metrics for immutable folder usage

Why

Capturing usage and how long it takes to upload

Tests

Updated acceptance test golden files

github-actions · 2026-10-23T12:04:44Z

Commit: c78207f39 | Workflow run

Regression test report

Selected 11 changed tests (limit=20, 0 not selected)

14 tests: regression=14 unreleased=0 coverage=0 failing=0

test	branch	main (`640f288`)	latest (v1.22.1)
TestAccept/bundle/resource_deps/job_tasks/DMS=	✅	❌	❌
TestAccept/bundle/resource_deps/job_tasks/DMS=true	✅	❌	❌
TestAccept/bundle/resource_deps/resources_var/DMS=	✅	❌	❌
TestAccept/bundle/resource_deps/resources_var/DMS=true	✅	❌	❌
TestAccept/bundle/resource_deps/tf_path_only_error/DMS=	✅	❌	❌
TestAccept/bundle/resource_deps/tf_path_only_error/DMS=true	✅	❌	❌
TestAccept/bundle/telemetry/deploy-app-lifecycle-started/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-compute-type/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-experimental/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-immutable-snapshot/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-name-prefix/custom/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-name-prefix/mode-development/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy-whl-artifacts/DMS=	✅	❌	❌
TestAccept/bundle/telemetry/deploy/DMS=	✅	❌	❌

TestAccept/bundle/resource_deps/job_tasks/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle deploy\nUploading hello.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...\nCreated jobs.foo\nCreated jobs.test_job\nFiles: 2 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_python_wheel_task true\nhas_serverless_compute true\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set false\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	actual  : "\n>>> [CLI] bundle deploy\nUploading hello.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...\nCreated jobs.foo\nCreated jobs.test_job\nFiles: 2 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_python_wheel_task true\nhas_serverless_compute true\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set false\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -20,3 +20,2 @@
        	            	 has_serverless_compute true
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/resource_deps/job_tasks/DMS=
        	Messages:   	bundle/resource_deps/job_tasks/output.txt vs /tmp/TestAcceptbundleresource_depsjob_tasksDMS=4204779785/002/output.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/resource_deps/job_tasks/DMS=true: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle deploy\nUploading hello.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...\nCreated jobs.foo\nCreated jobs.test_job\nFiles: 2 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_python_wheel_task true\nhas_serverless_compute true\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set false\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	actual  : "\n>>> [CLI] bundle deploy\nUploading hello.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...\nCreated jobs.foo\nCreated jobs.test_job\nFiles: 2 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_python_wheel_task true\nhas_serverless_compute true\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set false\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -20,3 +20,2 @@
        	            	 has_serverless_compute true
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/resource_deps/job_tasks/DMS=true
        	Messages:   	bundle/resource_deps/job_tasks/output.txt vs /tmp/TestAcceptbundleresource_depsjob_tasksDMS=true1922073574/002/output.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/resource_deps/resources_var/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/resource_deps/resources_var/output.txt
        +++ /tmp/TestAcceptbundleresource_depsresources_varDMS=1292550327/002/output.txt
        @@ -47,7 +47,6 @@
         has_classic_interactive_compute false
         has_classic_job_compute false
         has_serverless_compute false
        -immutable_snapshot_used false
         local.cache.attempt true
         local.cache.hit true
         permissions_section_set false

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/resource_deps/resources_var/DMS=true: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/resource_deps/resources_var/output.txt
        +++ /tmp/TestAcceptbundleresource_depsresources_varDMS=true2800156748/002/output.txt
        @@ -47,7 +47,6 @@
         has_classic_interactive_compute false
         has_classic_job_compute false
         has_serverless_compute false
        -immutable_snapshot_used false
         local.cache.attempt true
         local.cache.hit true
         permissions_section_set false
        
FAIL

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/resource_deps/tf_path_only_error/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1094
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "experimental.use_legacy_run_as false\nhas_tf_only_references true\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.hit true\npresets_name_prefix_is_set false\nrun_as_set false\n"
        	            	actual  : "experimental.use_legacy_run_as false\nhas_tf_only_references true\nlocal.cache.attempt true\nlocal.cache.hit true\npresets_name_prefix_is_set false\nrun_as_set false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,3 +2,2 @@
        	            	 has_tf_only_references true
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/resource_deps/tf_path_only_error/DMS=
        	Messages:   	bundle/resource_deps/tf_path_only_error/out.telemetry.txt vs /tmp/TestAcceptbundleresource_depstf_path_only_errorDMS=3725424762/001/out.telemetry.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/resource_deps/tf_path_only_error/DMS=true: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1094
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "experimental.use_legacy_run_as false\nhas_tf_only_references true\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.hit true\npresets_name_prefix_is_set false\nrun_as_set false\n"
        	            	actual  : "experimental.use_legacy_run_as false\nhas_tf_only_references true\nlocal.cache.attempt true\nlocal.cache.hit true\npresets_name_prefix_is_set false\nrun_as_set false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,3 +2,2 @@
        	            	 has_tf_only_references true
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/resource_deps/tf_path_only_error/DMS=true
        	Messages:   	bundle/resource_deps/tf_path_only_error/out.telemetry.txt vs /tmp/TestAcceptbundleresource_depstf_path_only_errorDMS=true2883583365/001/out.telemetry.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-app-lifecycle-started/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/telemetry/deploy-app-lifecycle-started/output.txt
        +++ /tmp/TestAcceptbundletelemetrydeploy-app-lifecycle-startedDMS=3361110234/002/output.txt
        @@ -94,10 +94,6 @@
               "value": false
             },
             {
        -      "key": "immutable_snapshot_used",
        -      "value": false
        -    },
        -    {
               "key": "app_lifecycle_started",
               "value": true
             }

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-compute-type/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/telemetry/deploy-compute-type/output.txt
        +++ /tmp/TestAcceptbundletelemetrydeploy-compute-typeDMS=1909250505/002/output.txt
        @@ -33,8 +33,6 @@
         has_serverless_compute true
         has_spark_python_task true
         has_spark_python_task true
        -immutable_snapshot_used false
        -immutable_snapshot_used false
         local.cache.attempt true
         local.cache.attempt true
         local.cache.hit true

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-experimental/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/telemetry/deploy-experimental/output.txt
        +++ /tmp/TestAcceptbundletelemetrydeploy-experimentalDMS=1355951646/002/output.txt
        @@ -20,7 +20,6 @@
         has_classic_job_compute false
         has_serverless_compute false
         has_spark_python_task true
        -immutable_snapshot_used false
         local.cache.attempt true
         local.cache.miss true
         permissions_section_set false

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-immutable-snapshot/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n=== First deploy uploads the snapshot\n\n>>> [CLI] bundle deploy\nCreated internal_immutable_snapshots.immutable\nCreated jobs.foo\nFiles: 0 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\nimmutable_snapshot_used true\n\n>>> print_snapshot_upload_duration_included\ntrue\n\n=== Second deploy finds the snapshot already uploaded\n\n>>> [CLI] bundle deploy\nFiles: 0 uploaded, 0 deleted\nResources: 0 created, 0 changed, 0 deleted, 2 unchanged\n\n>>> print_telemetry_bool_values\nimmutable_snapshot_used true\n\n>>> print_snapshot_upload_duration_included\nfalse\n"
        	            	actual  : "\n=== First deploy uploads the snapshot\n\n>>> [CLI] bundle deploy\nCreated internal_immutable_snapshots.immutable\nCreated jobs.foo\nFiles: 0 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\n\nExit code: 1\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -10,18 +10,4 @@
        	            	 >>> print_telemetry_bool_values
        	            	-immutable_snapshot_used true
        	            	 
        	            	->>> print_snapshot_upload_duration_included
        	            	-true
        	            	+Exit code: 1
        	            	 
        	            	-=== Second deploy finds the snapshot already uploaded
        	            	-
        	            	->>> [CLI] bundle deploy
        	            	-Files: 0 uploaded, 0 deleted
        	            	-Resources: 0 created, 0 changed, 0 deleted, 2 unchanged
        	            	-
        	            	->>> print_telemetry_bool_values
        	            	-immutable_snapshot_used true
        	            	-
        	            	->>> print_snapshot_upload_duration_included
        	            	-false
        	            	-
        	Test:       	TestAccept/bundle/telemetry/deploy-immutable-snapshot/DMS=
        	Messages:   	bundle/telemetry/deploy-immutable-snapshot/output.txt vs /tmp/TestAcceptbundletelemetrydeploy-immutable-snapshotDMS=479981752/002/output.txt
    acceptance_test.go:1131: Test produced unexpected files:
        .databricks/.gitignore
        .databricks/bundle/default/deployment.json
        .databricks/bundle/default/resources.json
        .databricks/bundle/default/snapshots/6074fe9a83011453a966cd95d940c1ca3b2cc8e09d7735c91ad177bbc1fa670d-01a1820a-09ba-7ed9-b9d7-d8af438152af.zip

latest (v1.22.1):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n=== First deploy uploads the snapshot\n\n>>> [CLI] bundle deploy\nCreated internal_immutable_snapshots.immutable\nCreated jobs.foo\nFiles: 0 uploaded, 0 deleted\nResources: 2 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\nimmutable_snapshot_used true\n\n>>> print_snapshot_upload_duration_included\ntrue\n\n=== Second deploy finds the snapshot already uploaded\n\n>>> [CLI] bundle deploy\nFiles: 0 uploaded, 0 deleted\nResources: 0 created, 0 changed, 0 deleted, 2 unchanged\n\n>>> print_telemetry_bool_values\nimmutable_snapshot_used true\n\n>>> print_snapshot_upload_duration_included\nfalse\n"
        	            	actual  : "\n=== First deploy uploads the snapshot\n\n>>> [CLI] bundle deploy\nWarning: unknown field: sync_mode\n  at workspace\n  in databricks.yml:5:3\n\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...\nCreated jobs.foo\nFiles: 2 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\n\nExit code: 1\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -4,24 +4,14 @@
        	            	 >>> [CLI] bundle deploy
        	            	-Created internal_immutable_snapshots.immutable
        	            	+Warning: unknown field: sync_mode
        	            	+  at workspace
        	            	+  in databricks.yml:5:3
        	            	+
        	            	+Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        	            	 Created jobs.foo
        	            	-Files: 0 uploaded, 0 deleted
        	            	-Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
        	            	+Files: 2 uploaded, 0 deleted
        	            	+Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        	            	 
        	            	 >>> print_telemetry_bool_values
        	            	-immutable_snapshot_used true
        	            	 
        	            	->>> print_snapshot_upload_duration_included
        	            	-true
        	            	+Exit code: 1
        	            	 
        	            	-=== Second deploy finds the snapshot already uploaded
        	            	-
        	            	->>> [CLI] bundle deploy
        	            	-Files: 0 uploaded, 0 deleted
        	            	-Resources: 0 created, 0 changed, 0 deleted, 2 unchanged
        	            	-
        	            	->>> print_telemetry_bool_values
        	            	-immutable_snapshot_used true
        	            	-
        	            	->>> print_snapshot_upload_duration_included
        	            	-false
        	            	-
        	Test:       	TestAccept/bundle/telemetry/deploy-immutable-snapshot/DMS=
        	Messages:   	bundle/telemetry/deploy-immutable-snapshot/output.txt vs /tmp/TestAcceptbundletelemetrydeploy-immutable-snapshotDMS=3550975902/002/output.txt
    acceptance_test.go:1131: Test produced unexpected files:
        .databricks/.gitignore
        .databricks/bundle/default/deployment.json
        .databricks/bundle/default/resources.json
        .databricks/bundle/default/sync-snapshots/54bc39b549c4453e.json

TestAccept/bundle/telemetry/deploy-name-prefix/custom/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle deploy\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/custom-prefix/default/files...\nCreated schemas.foo\nFiles: 1 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_serverless_compute false\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set true\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	actual  : "\n>>> [CLI] bundle deploy\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/custom-prefix/default/files...\nCreated schemas.foo\nFiles: 1 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_serverless_compute false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set true\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -17,3 +17,2 @@
        	            	 has_serverless_compute false
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/telemetry/deploy-name-prefix/custom/DMS=
        	Messages:   	bundle/telemetry/deploy-name-prefix/custom/output.txt vs /tmp/TestAcceptbundletelemetrydeploy-name-prefixcustomDMS=3422514807/002/output.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-name-prefix/mode-development/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle deploy\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/development-prefix/development/files...\nCreated schemas.foo\nFiles: 1 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_serverless_compute false\nimmutable_snapshot_used false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set true\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	actual  : "\n>>> [CLI] bundle deploy\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/development-prefix/development/files...\nCreated schemas.foo\nFiles: 1 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n\n>>> print_telemetry_bool_values\ndms_compat_auto true\ndms_undeclared_deploying_user false\ndms_undeclared_group false\ndms_undeclared_other_user false\ndms_undeclared_service_principal false\nexperimental.use_legacy_run_as false\nhas_classic_interactive_compute false\nhas_classic_job_compute false\nhas_serverless_compute false\nlocal.cache.attempt true\nlocal.cache.miss true\npermissions_section_set false\npresets_name_prefix_is_set true\npython_wheel_wrapper_is_set false\nrun_as_set false\nskip_artifact_cleanup false\nstate_path_in_deployer_home true\nstate_path_in_other_user_home false\nstate_path_is_shared false\nstate_path_other false\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -17,3 +17,2 @@
        	            	 has_serverless_compute false
        	            	-immutable_snapshot_used false
        	            	 local.cache.attempt true
        	Test:       	TestAccept/bundle/telemetry/deploy-name-prefix/mode-development/DMS=
        	Messages:   	bundle/telemetry/deploy-name-prefix/mode-development/output.txt vs /tmp/TestAcceptbundletelemetrydeploy-name-prefixmode-development3374469625/002/output.txt

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy-whl-artifacts/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/telemetry/deploy-whl-artifacts/output.txt
        +++ /tmp/TestAcceptbundletelemetrydeploy-whl-artifactsDMS=2510661583/002/output.txt
        @@ -35,8 +35,6 @@
         has_classic_job_compute false
         has_serverless_compute false
         has_serverless_compute false
        -immutable_snapshot_used false
        -immutable_snapshot_used false
         local.cache.attempt true
         local.cache.attempt true
         local.cache.hit true

latest (v1.22.1): same output as main (640f288)

TestAccept/bundle/telemetry/deploy/DMS=: branch ✅ | main (640f288) ❌ | latest (v1.22.1) ❌

main (640f288):

acceptance_test.go:1341: Diff:
        --- bundle/telemetry/deploy/out.telemetry.txt
        +++ /tmp/TestAcceptbundletelemetrydeployDMS=2355855804/001/out.telemetry.txt
        @@ -125,10 +125,6 @@
                     {
                       "key": "deployment_history_enabled",
                       "value": false
        -            },
        -            {
        -              "key": "immutable_snapshot_used",
        -              "value": false
                     }
                   ],
                   "bundle_mode": "TYPE_UNSPECIFIED",

latest (v1.22.1): same output as main (640f288)

eng-dev-ecosystem-bot · 2026-10-23T12:21:32Z

Integration test report

Commit: c78207f

Run: 40671222299

	Env	🔄flaky	✅pass	🙈skip	Time
✅	aws linux-2core-8gb		281	26	6:19
✅	aws-windows-latest-4core-16gb		283	24	3:20
✅	azure linux-2core-8gb		280	26	6:07
✅	azure-windows-latest-4core-16gb		282	24	4:38
🔄	gcp linux-2core-8gb	2	279	26	6:06
✅	gcp-windows-latest-4core-16gb		283	24	3:28

	Test Name	gcp linux-2core-8gb
🔄	TestFilerWorkspaceNotebook	🔄f
🔄	TestFilerWorkspaceNotebook/sqlNb.sql	🔄f

Top 6 slowest tests (at least 2 minutes):

duration	env	testname
3:57	azure linux-2core-8gb	TestAccept
3:45	aws linux-2core-8gb	TestAccept
3:43	gcp linux-2core-8gb	TestAccept
3:23	gcp-windows-latest-4core-16gb	TestAccept
3:19	azure-windows-latest-4core-16gb	TestAccept
3:14	aws-windows-latest-4core-16gb	TestAccept

eng-dev-ecosystem-bot · 2026-10-28T14:39:48Z

Integration test report

Commit: 2fa09b7

Run: 40679376775

	Env	🔄flaky	✅pass	🙈skip	Time
🔄	aws linux-2core-8gb	3	1495	1220	180:42
✅	aws-windows-latest-4core-16gb		1423	1245	183:50
🔄	azure linux-2core-8gb	3	1342	1272	144:39
🔄	azure-windows-latest-4core-16gb	5	1265	1297	147:53
✅	gcp linux-2core-8gb		1332	1277	152:34
✅	gcp-windows-latest-4core-16gb		1257	1302	161:33

9 interesting tests: 9 flaky

	Test Name	aws linux-2core-8gb	azure linux-2core-8gb	azure-windows-latest-4core-16gb
🔄	TestAccept	🔄f	🔄f	🔄f
🔄	TestAccept/bundle/config-remote-sync/multiple_resources	✅p	🔄f	🙈s
🔄	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true	✅p	🔄f
🔄	TestAccept/bundle/invariant/no_drift	🔄f	✅p	✅p
🔄	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=	🔄f	✅p	✅p
🔄	TestAccept/bundle/resources/pipelines/lakeflow-pipeline	✅p	✅p	🔄f
🔄	TestAccept/bundle/resources/pipelines/lakeflow-pipeline/DMS=	✅p	✅p	🔄f
🔄	TestFsCpFileToNonExistentDir	✅p	✅p	🔄f
🔄	TestFsCpFileToNonExistentDir/uc-volumes_to_local	✅p	✅p	🔄f

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
18:14	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
15:57	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DMS=true
13:33	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
11:23	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
10:58	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
10:00	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
9:26	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:14	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:03	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:28	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:03	azure linux-2core-8gb	TestAccept/bundle/deploy/spark-jar-task/DMS=
7:57	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:56	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:54	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:41	aws linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:38	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:38	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
7:33	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:29	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
7:28	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
7:27	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:27	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:24	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:21	aws-windows-latest-4core-16gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:19	azure linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
7:18	aws-windows-latest-4core-16gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
7:17	aws linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:14	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:12	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:03	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
6:57	azure linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
6:56	aws linux-2core-8gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
6:56	gcp linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
6:46	aws linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:41	azure linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:39	aws linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:37	gcp linux-2core-8gb	TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:11	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:10	aws-windows-latest-4core-16gb	TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
6:04	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:03	aws linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:53	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
5:48	aws-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:47	azure linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:42	azure-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:40	gcp linux-2core-8gb	TestAccept/bundle/resources/apps/lifecycle-started/DMS=
5:40	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:38	gcp-windows-latest-4core-16gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:23	gcp linux-2core-8gb	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:22	aws linux-2core-8gb	TestAccept/bundle/deploy/spark-jar-task/DMS=true

Added metrics for immutable folder usage

b02cd99

andrewnester requested review from a team as code owners October 23, 2026 11:59

andrewnester requested review from chrisst and pietern October 23, 2026 11:59

github-actions Bot added the DABs DABs related issues label Oct 23, 2026

updated changelog

c6f6331

janniklasrose reviewed Oct 27, 2026

View reviewed changes

Comment thread .nextchanges/bundles/immutable-snapshot-telemetry.md Outdated

Comment thread bundle/metrics/metrics.go Outdated

Comment thread acceptance/bundle/telemetry/deploy-immutable-snapshot/script

andrewnester and others added 2 commits October 28, 2026 10:54

Merge branch 'main' into feat/immutable/add-metric

8c43a16

fixes

c78207f

andrewnester requested a review from janniklasrose October 28, 2026 10:19

janniklasrose approved these changes Oct 28, 2026

View reviewed changes

andrewnester added this pull request to the merge queue Oct 28, 2026

Merged via the queue into main with commit 2fa09b7 Oct 28, 2026
27 checks passed

andrewnester deleted the feat/immutable/add-metric branch October 28, 2026 11:21

Navigation Menu

Repository navigation

Added metrics for immutable folder usage - #7168

Added metrics for immutable folder usage#7168
andrewnester merged 4 commits into
mainfrom
feat/immutable/add-metric

andrewnester commented Oct 23, 2026

Uh oh!

github-actions Bot commented Oct 23, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Oct 23, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Oct 28, 2026

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

andrewnester commented Oct 23, 2026

Changes

Why

Tests

Uh oh!

github-actions Bot commented Oct 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Regression test report

Uh oh!

eng-dev-ecosystem-bot commented Oct 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Oct 28, 2026

Integration test report

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actions Bot commented Oct 23, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented Oct 23, 2026 •

edited

Loading