[test_announce_routes.py] Makes the bgp status unstable. #2390
Description
Description
Hi, when I run test_announce_routes.py, an unusual circumstance happens.
After applying t1 topology and deploying the minigraph. The ip bgp sum result (looks normal):
admin@str-msn2700-01:~$ show ip bgp sum
IPv4 Unicast Summary:
BGP router identifier 10.1.0.32, local AS number 65100 vrf-id 0
BGP table version 33
RIB entries 65, using 11960 bytes of memory
Peers 32, using 669440 KiB of memory
Peer groups 4, using 256 bytes of memory
Neighbhor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd NeighborName
10.0.0.1 4 65200 97 116 0 0 0 00:04:36 1 ARISTA01T2
10.0.0.3 4 65200 105 190 0 0 0 00:05:02 1 ARISTA02T2
10.0.0.5 4 65200 102 180 0 0 0 00:04:50 1 ARISTA03T2
10.0.0.7 4 65200 89 107 0 0 0 00:04:13 1 ARISTA04T2
10.0.0.9 4 65200 104 186 0 0 0 00:04:59 1 ARISTA05T2
10.0.0.11 4 65200 81 98 0 0 0 00:03:49 1 ARISTA06T2
10.0.0.13 4 65200 103 185 0 0 0 00:04:57 1 ARISTA07T2
10.0.0.15 4 65200 105 190 0 0 0 00:05:02 1 ARISTA08T2
10.0.0.17 4 65200 105 190 0 0 0 00:05:02 1 ARISTA09T2
10.0.0.19 4 65200 101 179 0 0 0 00:04:50 1 ARISTA10T2
10.0.0.21 4 65200 102 180 0 0 0 00:04:53 1 ARISTA11T2
10.0.0.23 4 65200 105 191 0 0 0 00:05:02 1 ARISTA12T2
10.0.0.25 4 65200 103 182 0 0 0 00:04:54 1 ARISTA13T2
10.0.0.27 4 65200 100 147 0 0 0 00:04:47 1 ARISTA14T2
10.0.0.29 4 65200 104 186 0 0 0 00:04:59 1 ARISTA15T2
10.0.0.31 4 65200 102 180 0 0 0 00:04:51 1 ARISTA16T2
10.0.0.33 4 64001 90 108 0 0 0 00:04:17 1 ARISTA01T0
10.0.0.35 4 64002 87 104 0 0 0 00:04:09 1 ARISTA02T0
10.0.0.37 4 64003 85 102 0 0 0 00:04:02 1 ARISTA03T0
10.0.0.39 4 64004 105 190 0 0 0 00:05:02 1 ARISTA04T0
10.0.0.41 4 64005 102 181 0 0 0 00:04:54 1 ARISTA05T0
10.0.0.43 4 64006 105 190 0 0 0 00:05:01 1 ARISTA06T0
10.0.0.45 4 64007 102 180 0 0 0 00:04:53 1 ARISTA07T0
10.0.0.47 4 64008 102 180 0 0 0 00:04:52 1 ARISTA08T0
10.0.0.49 4 64009 103 182 0 0 0 00:04:56 1 ARISTA09T0
10.0.0.51 4 64010 103 182 0 0 0 00:04:55 1 ARISTA10T0
10.0.0.53 4 64011 105 190 0 0 0 00:05:02 1 ARISTA11T0
10.0.0.55 4 64012 102 180 0 0 0 00:04:51 1 ARISTA12T0
10.0.0.57 4 64013 103 182 0 0 0 00:04:55 1 ARISTA13T0
10.0.0.59 4 64014 105 190 0 0 0 00:05:02 1 ARISTA14T0
10.0.0.61 4 64015 102 180 0 0 0 00:04:52 1 ARISTA15T0
10.0.0.63 4 64016 105 190 0 0 0 00:05:02 1 ARISTA16T0
Total number of neighbors 32
However, when I run test_announce_routes.py, after it passed, the ip bgp sum result (abnormal):
admin@str-msn2700-01:~$ show ip bgp sum
IPv4 Unicast Summary:
BGP router identifier 10.1.0.32, local AS number 65100 vrf-id 0
BGP table version 10281
RIB entries 5533, using 1018072 bytes of memory
Peers 33, using 690360 KiB of memory
Peer groups 4, using 256 bytes of memory
Neighbhor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd NeighborName
10.0.0.1 4 65200 961 2862 0 0 1146 00:00:11 615 ARISTA01T2
10.0.0.3 4 65200 938 3347 0 0 1828 00:12:21 1354 ARISTA02T2
10.0.0.5 4 65200 228 2095 0 0 0 00:00:45 Connect ARISTA03T2
10.0.0.7 4 65200 880 3482 0 0 1610 00:11:32 1269 ARISTA04T2
10.0.0.9 4 65200 1056 3177 0 0 1995 00:12:18 1586 ARISTA05T2
10.0.0.11 4 65200 854 2472 0 0 986 00:00:08 236 ARISTA06T2
10.0.0.13 4 65200 1062 2801 0 0 1197 00:00:13 614 ARISTA07T2
10.0.0.15 4 65200 400 1766 0 0 0 00:00:01 46 ARISTA08T2
10.0.0.17 4 65200 1169 2982 0 0 999 00:00:06 235 ARISTA09T2
10.0.0.19 4 65200 1610 2960 0 0 2204 00:12:09 2661 ARISTA10T2
10.0.0.21 4 65200 1089 2247 0 0 1146 00:00:11 615 ARISTA11T2
10.0.0.23 4 65200 781 3743 0 0 1433 00:12:21 1043 ARISTA12T2
10.0.0.25 4 65200 913 4174 0 0 993 00:12:13 1306 ARISTA13T2
10.0.0.27 4 65200 837 3138 0 0 1197 00:00:17 992 ARISTA14T2
10.0.0.29 4 65200 236 2237 0 0 0 00:00:04 Connect ARISTA15T2
10.0.0.31 4 65200 1106 2073 0 0 0 00:00:00 46 ARISTA16T2
10.0.0.33 4 64001 230 3064 0 0 0 00:00:02 0 ARISTA01T0
10.0.0.35 4 64002 222 4076 0 0 1014 00:11:28 33 ARISTA02T0
10.0.0.37 4 64003 220 3272 0 0 0 00:00:02 0 ARISTA03T0
10.0.0.39 4 64004 240 3760 0 0 1415 00:12:21 33 ARISTA04T0
10.0.0.41 4 64005 239 3950 0 0 0 00:00:07 OpenConfirm ARISTA05T0
10.0.0.43 4 64006 244 4116 0 0 966 00:00:07 33 ARISTA06T0
10.0.0.45 4 64007 237 4385 0 0 780 00:12:12 33 ARISTA07T0
10.0.0.47 4 64008 237 4395 0 0 770 00:12:11 33 ARISTA08T0
10.0.0.49 4 64009 242 3336 0 0 0 00:00:02 Connect ARISTA09T0
10.0.0.51 4 64010 238 3308 0 0 0 00:00:10 OpenConfirm ARISTA10T0
10.0.0.53 4 64011 245 3719 0 0 967 00:00:09 33 ARISTA11T0
10.0.0.55 4 64012 236 3725 0 0 1440 00:12:10 33 ARISTA12T0
10.0.0.57 4 64013 238 3677 0 0 2125 00:00:50 33 ARISTA13T0
10.0.0.59 4 64014 244 3949 0 0 986 00:00:07 33 ARISTA14T0
10.0.0.61 4 64015 240 3760 0 0 946 00:00:09 33 ARISTA15T0
10.0.0.63 4 64016 240 4042 0 0 1134 00:12:21 33 ARISTA16T0
Total number of neighbors 32
Wait for 2 minutes, it appears like:
admin@str-msn2700-01:~$ show ip bgp sum
IPv4 Unicast Summary:
BGP router identifier 10.1.0.32, local AS number 65100 vrf-id 0
BGP table version 116385
RIB entries 1, using 184 bytes of memory
Peers 32, using 669440 KiB of memory
Peer groups 4, using 256 bytes of memory
Neighbhor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd NeighborName
10.0.0.1 4 65200 9294 6635 0 0 0 00:04:37 Connect ARISTA01T2
10.0.0.3 4 65200 2774 6183 0 0 0 00:07:21 Connect ARISTA02T2
10.0.0.5 4 65200 3423 3272 0 0 0 00:03:20 Connect ARISTA03T2
10.0.0.7 4 65200 9648 8719 0 0 0 00:03:20 Connect ARISTA04T2
10.0.0.9 4 65200 9270 8853 0 0 0 00:03:21 Connect ARISTA05T2
10.0.0.11 4 65200 8934 6660 0 0 0 00:03:19 Connect ARISTA06T2
10.0.0.13 4 65200 12566 9693 0 0 0 00:03:21 Connect ARISTA07T2
10.0.0.15 4 65200 8861 5899 0 0 0 00:03:21 Connect ARISTA08T2
10.0.0.17 4 65200 12773 9030 0 0 0 00:03:21 Connect ARISTA09T2
10.0.0.19 4 65200 3555 6667 0 0 0 00:07:22 Connect ARISTA10T2
10.0.0.21 4 65200 10810 6657 0 0 0 00:03:20 Connect ARISTA11T2
10.0.0.23 4 65200 8757 8161 0 0 0 00:03:21 Connect ARISTA12T2
10.0.0.25 4 65200 11913 10538 0 0 0 00:03:21 Connect ARISTA13T2
10.0.0.27 4 65200 9681 9234 0 0 0 00:03:21 Connect ARISTA14T2
10.0.0.29 4 65200 7775 7477 0 0 0 00:03:21 Connect ARISTA15T2
10.0.0.31 4 65200 11347 6889 0 0 0 00:03:19 Connect ARISTA16T2
10.0.0.33 4 64001 294 11810 0 0 0 00:03:21 Connect ARISTA01T0
10.0.0.35 4 64002 263 10147 0 0 0 00:03:24 Connect ARISTA02T0
10.0.0.37 4 64003 274 10540 0 0 0 00:03:21 Connect ARISTA03T0
10.0.0.39 4 64004 287 9144 0 0 0 00:03:20 Connect ARISTA04T0
10.0.0.41 4 64005 280 11593 0 0 0 00:03:21 Connect ARISTA05T0
10.0.0.43 4 64006 288 10374 0 0 0 00:03:19 Connect ARISTA06T0
10.0.0.45 4 64007 290 11336 0 0 0 00:03:25 Connect ARISTA07T0
10.0.0.47 4 64008 284 10944 0 0 0 00:03:21 Connect ARISTA08T0
10.0.0.49 4 64009 290 9682 0 0 0 00:03:21 Connect ARISTA09T0
10.0.0.51 4 64010 289 9172 0 0 0 00:03:21 Connect ARISTA10T0
10.0.0.53 4 64011 288 9681 0 0 0 00:03:24 Connect ARISTA11T0
10.0.0.55 4 64012 282 11396 0 0 0 00:03:24 Connect ARISTA12T0
10.0.0.57 4 64013 295 11032 0 0 0 00:03:22 Connect ARISTA13T0
10.0.0.59 4 64014 292 10201 0 0 0 00:03:24 Connect ARISTA14T0
10.0.0.61 4 64015 290 9738 0 0 0 00:03:24 Connect ARISTA15T0
10.0.0.63 4 64016 280 10669 0 0 0 00:03:24 Connect ARISTA16T0
Check the connection, the connection losts:
root@str-msn2700-01:/home/admin# ping 10.0.0.1
PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.
^C
--- 10.0.0.1 ping statistics ---
5 packets transmitted, 0 received, 100% packet loss, time 4088ms
root@str-msn2700-01:/home/admin# ping 10.0.0.9
PING 10.0.0.9 (10.0.0.9) 56(84) bytes of data.
^C
--- 10.0.0.9 ping statistics ---
5 packets transmitted, 0 received, 100% packet loss, time 4098ms
root@str-msn2700-01:/home/admin# ping 10.0.0.17
PING 10.0.0.17 (10.0.0.17) 56(84) bytes of data.
^C
--- 10.0.0.17 ping statistics ---
5 packets transmitted, 0 received, 100% packet loss, time 4093ms
But if I did not run test_announce_routes.py, the connection between the DUT and VMs are good.
Steps to reproduce the issue:
- Deploy t1 topology and minigraph
- Run test_announce_routes.py
- show ip bgp sum
Describe the results you received:
BGP status abnormal
Describe the results you expected:
The BGP status is not affected by test_announce_routes.py.
Additional information you deem important:
**Output of `show version`:**
```
root@str-msn2700-01:/home/admin# show ver
SONiC Software Version: SONiC.201911.17-ce724860
Distribution: Debian 9.13
Kernel: 4.9.0-11-2-amd64
Build commit: ce72486
Build date: Sun Oct 18 16:55:43 UTC 2020
Built by: johnar@jenkins-worker-12
Platform: x86_64-ruijie_b6510-48vs8cq-r0
HwSKU: B6510-48VS8CQ
ASIC: broadcom
Serial Number: AAA1234567891
Uptime: 15:50:20 up 1:46, 1 user, load average: 0.17, 0.67, 1.05
Docker images:
REPOSITORY TAG IMAGE ID SIZE
127.0.0.1:5000/syncd latest f306f2a7add9 436MB
docker-syncd-brcm 201911.17-ce724860 f306f2a7add9 436MB
docker-syncd-brcm latest f306f2a7add9 436MB
docker-sonic-telemetry 201911.17-ce724860 b782558335f3 353MB
docker-sonic-telemetry latest b782558335f3 353MB
docker-router-advertiser 201911.17-ce724860 4d9706c73b71 289MB
docker-router-advertiser latest 4d9706c73b71 289MB
docker-platform-monitor 201911.17-ce724860 0595aedb5d87 357MB
docker-platform-monitor latest 0595aedb5d87 357MB
docker-fpm-frr 201911.17-ce724860 a601aa0c90bf 335MB
docker-fpm-frr latest a601aa0c90bf 335MB
docker-lldp-sv2 201911.17-ce724860 e97b555c5365 312MB
docker-lldp-sv2 latest e97b555c5365 312MB
docker-dhcp-relay 201911.17-ce724860 717cd23b0feb 299MB
docker-dhcp-relay latest 717cd23b0feb 299MB
docker-database 201911.17-ce724860 dc7d78de3f33 289MB
docker-database latest dc7d78de3f33 289MB
docker-sflow 201911.17-ce724860 7a99bb98e627 315MB
docker-sflow latest 7a99bb98e627 315MB
docker-orchagent 201911.17-ce724860 24bb4482327f 333MB
docker-orchagent latest 24bb4482327f 333MB
docker-teamd 201911.17-ce724860 acdb960180b4 314MB
docker-teamd latest acdb960180b4 314MB
docker-nat 201911.17-ce724860 af2737ab92fa 316MB
docker-nat latest af2737ab92fa 316MB
docker-sonic-mgmt-framework 201911.17-ce724860 3dec0115ebbc 431MB
docker-sonic-mgmt-framework latest 3dec0115ebbc 431MB
docker-snmp-sv2 201911.17-ce724860 bf38a6316a09 348MB
docker-snmp-sv2 latest bf38a6316a09 348MB
```
**Attach debug file `sudo generate_dump`:**
```
NA
```