Investigate flaky E2E tests that causes the pipeline build to fail

[alexholub113]

Microsoft.Identity.Web Library

Microsoft.Identity.Web

Microsoft.Identity.Web version

2.11.1

Web app

Sign-in users

Web API

Protected web APIs (validating tokens)

Token cache serialization

In-memory caches

Description

Pipeline task:
task: VSTest@2
displayName: 'Run E2E tests'
inputs:
testSelector: 'testAssemblies'
testAssemblyVer2: |
tests\E2E Tests\WebAppUiTests\bin*\WebAppUiTests.dll
tests\E2E Tests\TokenAcquirerTests\bin*\TokenAcquirerTests.dll
tests\E2E Tests\NET 7 tests\IntegrationTests\bin**\IntegrationTests.dll
searchFolder: '$(System.DefaultWorkingDirectory)'
rerunFailedTests: true
rerunMaxAttempts: '3'
runInParallel: false
codeCoverageEnabled: true
failOnMinTestsNotRun: false
minimumExpectedTests: '1'
runSettingsFile: 'build\CodeCoverage.runsettings'

Tests:

• WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFunctionsCorrectlyAsync
• WebAppUiTests.WebAppCallsApiCallsGraphLocally.ChallengeUser_MicrosoftIdFlow_LocalApp_ValidEmailPasswordCreds_TodoAppFunctionsCorrectlyAsync
• WebAppUiTests.WebAppCallsApiCallsGraphLocally.ChallengeUser_MicrosoftIdFlow_LocalApp_ValidEmailPasswordCreds_CallsDownStreamApiWithCiamAsync
• WebAppUiTests.WebAppCallsApiCallsGraphLocally.ChallengeUser_MicrosoftIdFlow_LocalApp_ValidEmailPasswordCreds_CallsDownStreamApiWithCiamAsync

Reproduction steps

• Execute the tests
• Monitor and investigate the test execution and note any failures or flaky behavior.

Error message

No response

Id Web logs

flaky-tests-pipeline-log.txt

Relevant code snippets

-

Regression

No response

Expected behavior

Root causes are found, and tests are run successfully.

[jennyf19]

#3188