Skip to content

Conversation

@denik
Copy link
Contributor

@denik denik commented Oct 15, 2025

Why

When CloudSlow tests are added to known_failures.txt then TestAccept shows up as "RECOVERED" even though there are no subtests that actually recovered. This PR does not fix that but at least includes those skipped tests in the output so one can understand the reason for "RECOVERED" status.

…ilures.txt

When cloud slow tests are added to known_failures.txt then TestAccept
shows up as recovered even though there are no subtests that actually
recovered. This PR does not fix that but at least includes those skipped
tests in the output so one can understand the reason for 'RECOVERED'
@denik
Copy link
Contributor Author

denik commented Oct 15, 2025

Example output for #3766 (comment)

TestAccept/bundle/integration_whl/interactive_single_user is new addition

Env 🔄flaky 💚RECOVERED 🙈SKIP ✅pass 🙈skip
💚 aws linux 1 1 321 544
💚 aws windows 1 1 322 543
💚 aws-ucws linux 1 1 437 440
💚 aws-ucws windows 1 1 438 439
💚 azure linux 1 1 321 543
💚 azure windows 1 1 322 542
💚 azure-ucws linux 1 1 437 439
💚 azure-ucws windows 1 1 438 438
🔄 gcp linux 3 1 1 317 545
🔄 gcp windows 3 1 1 318 544
8 failing tests:
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
TestAccept 💚R 💚R 💚R 💚R 💚R 💚R 💚R 💚R 💚R 💚R
TestAccept/bundle/deployment/bind/cluster ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f ✅p
TestAccept/bundle/deployment/bind/dashboard ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f
TestAccept/bundle/integration_whl/interactive_single_user 🙈S 🙈S 🙈S 🙈S 🙈S 🙈S 🙈S 🙈S 🙈S 🙈S
TestAccept/bundle/resources/pipelines/update ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f
TestAccept/bundle/resources/pipelines/update/DATABRICKS_BUNDLE_ENGINE=direct-exp ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f
TestAccept/bundle/templates/default-python/integration_classic ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f ✅p
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.9 ✅p ✅p ✅p ✅p ✅p ✅p ✅p ✅p 🔄f ✅p

@denik denik enabled auto-merge October 15, 2025 11:21
@denik denik temporarily deployed to test-trigger-is October 15, 2025 11:22 — with GitHub Actions Inactive
@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Oct 15, 2025

Run: 18527194329

Env 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip
💚​ aws linux 1 1 321 544
💚​ aws windows 1 1 322 543
🔄​ aws-ucws linux 9 1 1 428 440
🔄​ aws-ucws windows 9 1 1 429 439
💚​ azure linux 1 1 321 543
💚​ azure windows 1 1 322 542
🔄​ azure-ucws linux 7 1 1 430 439
🔄​ azure-ucws windows 7 1 1 431 438
🔄​ gcp linux 2 1 1 318 545
🔄​ gcp windows 5 1 317 544
17 failing tests:
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🔄​f
TestAccept/bundle/deployment/bind/dashboard ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p ✅​p 🔄​f ✅​p ✅​p
TestAccept/bundle/deployment/bind/dashboard/recreation ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p ✅​p 🔄​f ✅​p ✅​p
TestAccept/bundle/integration_whl/interactive_single_user 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
TestAccept/bundle/resources/dashboards/detect-change ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f ✅​p ✅​p ✅​p
TestAccept/bundle/resources/dashboards/generate_inplace ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p
TestAccept/bundle/resources/dashboards/nested-folders ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p
TestAccept/bundle/resources/dashboards/simple ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p
TestAccept/bundle/resources/dashboards/simple_outside_bundle_root ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p
TestAccept/bundle/resources/dashboards/simple_syncroot ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f ✅​p ✅​p ✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct-exp/DLT=no/NBOOK=yes/PY=yes ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct-exp/DLT=yes/NBOOK=no/PY=yes ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f ✅​p
TestAccept/bundle/templates/default-python/integration_classic ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.9 ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestDashboardAssumptions_WorkspaceImport ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p 🔄​f 🔄​f ✅​p ✅​p
TestFsCpFileToDir ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
TestFsCpFileToDir/dbfs_to_local ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f

@denik denik added this pull request to the merge queue Oct 16, 2025
Merged via the queue into main with commit 7e5ad79 Oct 16, 2025
13 checks passed
@denik denik deleted the denik/gh_parse_KNOWN_SKIP branch October 16, 2025 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants