Skip to content

Commit ffffbf8

Browse files
ausphamabhishek-nexthop
authored andcommitted
ci: add expected result to pr tests (sonic-net#21859)
Description of PR Summary: Due to recent internal discussion, there might be some false positive if EXPECTED_RESULT: "SUCCESS" is not set especially in combination with TEST_PLAN_STOP_ON_FAILURE: False To address this, we should always set this parameter for our critical test. Signed-off-by: Austin Pham <austinpham@microsoft.com>
1 parent ed68749 commit ffffbf8

2 files changed

Lines changed: 9 additions & 0 deletions

File tree

.azure-pipelines/pr_test_template.yml

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -85,6 +85,7 @@ jobs:
8585
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
8686
MGMT_BRANCH: $(BUILD_BRANCH)
8787
COMMON_EXTRA_PARAMS: "--disable_sai_validation "
88+
EXPECTED_RESULT: "SUCCESS"
8889
${{ each param in parameters.OVERRIDE_PARAMS }}:
8990
${{ param.key }}: ${{ param.value }}
9091

@@ -120,6 +121,7 @@ jobs:
120121
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
121122
MGMT_BRANCH: $(BUILD_BRANCH)
122123
COMMON_EXTRA_PARAMS: "--disable_sai_validation "
124+
EXPECTED_RESULT: "SUCCESS"
123125
${{ each param in parameters.OVERRIDE_PARAMS }}:
124126
${{ param.key }}: ${{ param.value }}
125127

@@ -154,6 +156,7 @@ jobs:
154156
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
155157
MGMT_BRANCH: $(BUILD_BRANCH)
156158
COMMON_EXTRA_PARAMS: "--disable_sai_validation "
159+
EXPECTED_RESULT: "SUCCESS"
157160
${{ each param in parameters.OVERRIDE_PARAMS }}:
158161
${{ param.key }}: ${{ param.value }}
159162

@@ -188,6 +191,7 @@ jobs:
188191
COMMON_EXTRA_PARAMS: "--disable_loganalyzer --disable_sai_validation "
189192
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
190193
MGMT_BRANCH: $(BUILD_BRANCH)
194+
EXPECTED_RESULT: "SUCCESS"
191195
${{ each param in parameters.OVERRIDE_PARAMS }}:
192196
${{ param.key }}: ${{ param.value }}
193197

@@ -227,6 +231,7 @@ jobs:
227231
{"name": "bgp/test_bgp_fact.py", "param": "--neighbor_type=sonic --enable_macsec --macsec_profile=128_SCI,256_XPN_SCI"},
228232
{"name": "macsec", "param": "--neighbor_type=sonic --enable_macsec --macsec_profile=128_SCI,256_XPN_SCI"}
229233
]'
234+
EXPECTED_RESULT: "SUCCESS"
230235
${{ each param in parameters.OVERRIDE_PARAMS }}:
231236
${{ param.key }}: ${{ param.value }}
232237

@@ -264,6 +269,7 @@ jobs:
264269
SPECIFIC_PARAM: '[
265270
{"name": "dash/test_dash_vnet.py", "param": "--skip_dataplane_checking"}
266271
]'
272+
EXPECTED_RESULT: "SUCCESS"
267273
${{ each param in parameters.OVERRIDE_PARAMS }}:
268274
${{ param.key }}: ${{ param.value }}
269275

@@ -300,6 +306,7 @@ jobs:
300306
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
301307
MGMT_BRANCH: $(BUILD_BRANCH)
302308
COMMON_EXTRA_PARAMS: "--disable_sai_validation "
309+
EXPECTED_RESULT: "SUCCESS"
303310
${{ each param in parameters.OVERRIDE_PARAMS }}:
304311
${{ param.key }}: ${{ param.value }}
305312

@@ -335,5 +342,6 @@ jobs:
335342
KVM_IMAGE_BRANCH: $(BUILD_BRANCH)
336343
MGMT_BRANCH: $(BUILD_BRANCH)
337344
COMMON_EXTRA_PARAMS: "--disable_sai_validation "
345+
EXPECTED_RESULT: "SUCCESS"
338346
${{ each param in parameters.OVERRIDE_PARAMS }}:
339347
${{ param.key }}: ${{ param.value }}

.azure-pipelines/sonic_vpp/sonic-vpp-nightly.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,3 +49,4 @@ stages:
4949
KVM_IMAGE_BUILD_PIPELINE_ID: "2818"
5050
COMMON_EXTRA_PARAMS: "--disable_sai_validation --disable_loganalyzer"
5151
STOP_ON_FAILURE: "False"
52+
EXPECTED_RESULT: "SUCCESS"

0 commit comments

Comments
 (0)