[E2E] fix flaky config tests with temp_env
#2105
Merged
[E2E] fix flaky config tests with temp_env
#2105