[sonic-yang-models]: First version of yang models for Port, VLan, Interface, PortChannel, loopback and ACL. by praveen-li · Pull Request #3730 · sonic-net/sonic-buildimage

praveen-li · 2019-11-08T16:59:15Z

[sonic-yang-models]: First version of yang models for Port, VLan, Interface, PortChannel, loopback and ACL.

YANG models as per Guidelines.

Guideline doc: https://github.com/Azure/SONiC/blob/master/doc/mgmt/SONiC_YANG_Model_Guidelines.md

[sonic-yang-models/tests]: YANG model test code and JSON input for testing.

[sonic-yang-models/setup.py]: Build infra for yang models.

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

- What I did
Created Yang model for Sonic.
Tables: PORT, VLAN, VLAN_INTERFACE, VLAN_MEMBER, ACL_RULE, ACL_TABLE, INTERFACE.

Created build infra files using which a new package (sonic-yang-models) can be build and can be deployed on sonic switches. Yang models will be part of this new package.

- How I did it
Wrote yang models based on Guideline doc:
https://github.com/Azure/SONiC/blob/master/doc/mgmt/SONiC_YANG_Model_Guidelines.md
and
https://github.com/Azure/SONiC/wiki/Configuration.

Wrote python wheel Package infra which runs test for these Yang models using a json files which consists configuration as per yang models. These configs are for negative tests, which means we want to test that most must condition, pattern and when condition works as expected.

- How to verify it
Build Logs and testing:
———————————————————————————————————

/sonic/src/sonic-yang-models /sonic
running test
running egg_info
writing top-level names to sonic_yang_models.egg-info/top_level.txt
writing dependency_links to sonic_yang_models.egg-info/dependency_links.txt
writing sonic_yang_models.egg-info/PKG-INFO
reading manifest file 'sonic_yang_models.egg-info/SOURCES.txt'
writing manifest file 'sonic_yang_models.egg-info/SOURCES.txt'
running build_ext

----------------------------------------------------------------------
Ran 0 tests in 0.000s

OK
running bdist_wheel
running build
running build_py
(Reading database ... 155852 files and directories currently installed.)
Preparing to unpack .../libyang_1.0.73_amd64.deb ...
Unpacking libyang (1.0.73) over (1.0.73) ...
Setting up libyang (1.0.73) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
Processing triggers for man-db (2.7.6.1-2) ...
(Reading database ... 155852 files and directories currently installed.)
Preparing to unpack .../libyang-cpp_1.0.73_amd64.deb ...
Unpacking libyang-cpp (1.0.73) over (1.0.73) ...
Setting up libyang-cpp (1.0.73) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
(Reading database ... 155852 files and directories currently installed.)
Preparing to unpack .../python3-yang_1.0.73_amd64.deb ...
Unpacking python3-yang (1.0.73) over (1.0.73) ...
Setting up python3-yang (1.0.73) ...
INFO:YANG-TEST:module: sonic-vlan is loaded successfully
ERROR:YANG-TEST:Could not get module: sonic-head
INFO:YANG-TEST:module: sonic-portchannel is loaded successfully
INFO:YANG-TEST:module: sonic-acl is loaded successfully
INFO:YANG-TEST:module: sonic-loopback-interface is loaded successfully
ERROR:YANG-TEST:Could not get module: sonic-port
INFO:YANG-TEST:module: sonic-interface is loaded successfully
INFO:YANG-TEST:
------------------- Test 1: Configure a member port in VLAN_MEMBER table which does not exist.---------------------
libyang[0]: Leafref "/sonic-port:sonic-port/sonic-port:PORT/sonic-port:PORT_LIST/sonic-port:port_name" of value "Ethernet156" points to a non
-existing leaf. (path: /sonic-vlan:sonic-vlan/VLAN_MEMBER/VLAN_MEMBER_LIST[vlan_name='Vlan100'][port='Ethernet156']/port)
INFO:YANG-TEST:Configure a member port in VLAN_MEMBER table which does not exist. Passed

INFO:YANG-TEST:
------------------- Test 2: Configure non-existing ACL_TABLE in ACL_RULE.---------------------
libyang[0]: Leafref "/sonic-acl:sonic-acl/sonic-acl:ACL_TABLE/sonic-acl:ACL_TABLE_LIST/sonic-acl:ACL_TABLE_NAME" of value "NOT-EXIST" points
to a non-existing leaf. (path: /sonic-acl:sonic-acl/ACL_RULE/ACL_RULE_LIST[ACL_TABLE_NAME='NOT-EXIST'][RULE_NAME='Rule_20']/ACL_TABLE_NAME)
INFO:YANG-TEST:Configure non-existing ACL_TABLE in ACL_RULE. Passed

INFO:YANG-TEST:
------------------- Test 3: Configure IP_TYPE as ARP and ICMPV6_CODE in ACL_RULE.---------------------
libyang[0]: When condition "boolean(IP_TYPE[.='ANY' or .='IP' or .='IPV6' or .='IPv6ANY'])" not satisfied. (path: /sonic-acl:sonic-acl/ACL_RU
LE/ACL_RULE_LIST[ACL_TABLE_NAME='NO-NSW-PACL-V4'][RULE_NAME='Rule_40']/ICMPV6_CODE)
INFO:YANG-TEST:Configure IP_TYPE as ARP and ICMPV6_CODE in ACL_RULE. Passed
INFO:YANG-TEST:

INFO:YANG-TEST:
------------------- Test 4: Configure IP_TYPE as ipv4any and SRC_IPV6 in ACL_RULE.---------------------
libyang[0]: When condition "boolean(IP_TYPE[.='ANY' or .='IP' or .='IPV6' or .='IPv6ANY'])" not satisfied. (path: /sonic-acl:sonic-acl/ACL_RU
LE/ACL_RULE_LIST[ACL_TABLE_NAME='NO-NSW-PACL-V4'][RULE_NAME='Rule_20']/SRC_IPV6)
INFO:YANG-TEST:Configure IP_TYPE as ipv4any and SRC_IPV6 in ACL_RULE. Passed

------------------- Test 5: Configure l4_src_port_range as 99999-99999 in ACL_RULE---------------------
libyang[0]: Value "99999-99999" does not satisfy the constraint "([0-9]{1,4}|[0-5][0-9]{4}|[6][0-4][0-9]{3}|[6][5][0-2][0-9]{2}|[6][5][3][0-5]{2}|[6][5][3][6][0-5])-([0-9]{1,4}|[0-5][0-9]{4}|[6][0-4][0-9]{3}|[6][5][0-2][0-9]{2}|[6][5][3][0-5]{2}|[6][5][3][6][0-5])" (range, length, or pattern). (path: /sonic-acl:sonic-acl/ACL_RULE/ACL_RULE_LIST[ACL_TABLE_NAME='NO-NSW-PACL-V6'][RULE_NAME='Rule_20']/L4_SRC_PORT_RANGE)
INFO:YANG-TEST:Configure l4_src_port_range as 99999-99999 in ACL_RULE Passed

INFO:YANG-TEST:
------------------- Test 6: Configure empty string as ip-prefix in INTERFACE table.---------------------
libyang[0]: Invalid value "" in "ip-prefix" element. (path: /sonic-interface:sonic-interface/INTERFACE/INTERFACE_LIST[interface='Ethernet8'][ip-prefix='']/ip-prefix)
INFO:YANG-TEST:Configure empty string as ip-prefix in INTERFACE table. Passed

INFO:YANG-TEST:
------------------- Test 7: Configure Wrong family with ip-prefix for VLAN_Interface Table---------------------
libyang[0]: Must condition "(contains(../ip-prefix, ':') and current()='IPv6') or                               (contains(../ip-prefix, '.') and current()='IPv4')" not satisfied. (path: /sonic-vlan:sonic-vlan/VLAN_INTERFACE/VLAN_INTERFACE_LIST[vlanid='100'][ip-prefix='2a04:5555:66:7777::1/64']/family)
INFO:YANG-TEST:Configure Wrong family with ip-prefix for VLAN_Interface Table Passed

INFO:YANG-TEST:
------------------- Test 8: Configure IP_TYPE as ARP and DST_IPV6 in ACL_RULE.---------------------
libyang[0]: When condition "boolean(IP_TYPE[.='ANY' or .='IP' or .='IPV6' or .='IPV6ANY'])" not satisfied. (path: /sonic-acl:sonic-acl/ACL_RULE/ACL_RULE_LIST[ACL_TABLE_NAME='NO-NS
W-PACL-V6'][RULE_NAME='Rule_20']/DST_IPV6)
INFO:YANG-TEST:Configure IP_TYPE as ARP and DST_IPV6 in ACL_RULE. Passed

INFO:YANG-TEST:
------------------- Test 9: Configure INNER_ETHER_TYPE as 0x080C in ACL_RULE.---------------------
libyang[0]: Value "0x080C" does not satisfy the constraint "(0x88CC|0x8100|0x8915|0x0806|0x0800|0x86DD|0x8847)" (range, length, or pattern). (path: /sonic-acl:sonic-acl/ACL_RULE/ACL_RULE_LIST[ACL_TABLE_NAME='NO-NSW-PACL-V4'][RULE_NAME='Rule_40']/INNER_ETHER_TYPE)
INFO:YANG-TEST:Configure INNER_ETHER_TYPE as 0x080C in ACL_RULE. Passed

INFO:YANG-TEST:
------------------- Test 10: Add dhcp_server which is not in correct ip-prefix format.---------------------
libyang[0]: Invalid value "10.186.72.566" in "dhcp_servers" element. (path: /sonic-vlan:sonic-vlan/VLAN/VLAN_LIST/dhcp_servers[.='10.186.72.566'])
INFO:YANG-TEST:Add dhcp_server which is not in correct ip-prefix format. Passed

INFO:YANG-TEST:
------------------- Test 11: Configure undefined acl_table_type in ACL_TABLE table.---------------------
libyang[0]: Invalid value "LAYER3V4" in "type" element. (path: /sonic-acl:sonic-acl/ACL_TABLE/ACL_TABLE_LIST[ACL_TABLE_NAME='NO-NSW-PACL-V6']/type)
INFO:YANG-TEST:Configure undefined acl_table_type in ACL_TABLE table. Passed

INFO:YANG-TEST:
------------------- Test 12: Configure undefined packet_action in ACL_RULE table.---------------------
libyang[0]: Invalid value "SEND" in "PACKET_ACTION" element. (path: /sonic-acl:sonic-acl/ACL_RULE/ACL_RULE_LIST/PACKET_ACTION)
INFO:YANG-TEST:Configure undefined packet_action in ACL_RULE table. Passed

INFO:YANG-TEST:
------------------- Test 13: Configure wrong value for tagging_mode.---------------------
libyang[0]: Invalid value "non-tagged" in "tagging_mode" element. (path: /sonic-vlan:sonic-vlan/VLAN_MEMBER/VLAN_MEMBER_LIST/tagging_mode)
INFO:YANG-TEST:Configure wrong value for tagging_mode. Passed

INFO:YANG-TEST:
------------------- Test 14: Configure vlan-id in VLAN_MEMBER table which does not exist in VLAN  table.---------------------
libyang[0]: Leafref "../../../VLAN/VLAN_LIST/vlanid" of value "200" points to a non-existing leaf. (path: /sonic-vlan:sonic-vlan/VLAN_MEMBER/VLAN_MEMBER_LIST[vlanid='200'][port='Ethernet0']/vlanid)
libyang[0]: Leafref "../../../VLAN/VLAN_LIST/vlanid" of value "200" points to a non-existing leaf. (path: /sonic-vlan:sonic-vlan/VLAN_MEMBER/VLAN_MEMBER_LIST[vlanid='200'][port='Ethernet0']/vlanid)
INFO:YANG-TEST:Configure vlan-id in VLAN_MEMBER table which does not exist in VLAN  table. Passed

INFO:YANG-TEST:All Test Passed
../../target/debs/stretch/libyang0.16_0.16.105-1_amd64.deb installtion failed
../../target/debs/stretch/libyang-cpp0.16_0.16.105-1_amd64.deb installtion failed
../../target/debs/stretch/python2-yang_0.16.105-1_amd64.deb installtion failed
YANG Tests passed
Passed: pyang -f tree ./yang-models/*.yang > ./yang-models/sonic_yang_tree
copying tests/yangModelTesting.py -> build/lib/tests
copying tests/test_sonic_yang_models.py -> build/lib/tests
copying tests/__init__.py -> build/lib/tests
running egg_info
writing top-level names to sonic_yang_models.egg-info/top_level.txt
writing dependency_links to sonic_yang_models.egg-info/dependency_links.txt
writing sonic_yang_models.egg-info/PKG-INFO
reading manifest file 'sonic_yang_models.egg-info/SOURCES.txt'
writing manifest file 'sonic_yang_models.egg-info/SOURCES.txt'
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/tests
copying build/lib/tests/yangModelTesting.py -> build/bdist.linux-x86_64/wheel/tests
copying build/lib/tests/test_sonic_yang_models.py -> build/bdist.linux-x86_64/wheel/tests
copying build/lib/tests/__init__.py -> build/bdist.linux-x86_64/wheel/tests
running install_data
creating build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data
creating build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data
creating build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-head.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-acl.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-interface.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-loopback-interface.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-port.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-portchannel.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models
copying ./yang-models/sonic-vlan.yang -> build/bdist.linux-x86_64/wheel/sonic_yang_models-1.0.data/data/yang-models

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

praveen-li · 2019-11-12T17:30:11Z

retest this please

praveen-li · 2019-11-13T05:47:45Z

retest this please

src/sonic-yang-mgmt/yang-models/sonic-vlan.yang

src/sonic-yang-mgmt/tests/libyang-python-tests/sample-yang-models/sonic-acl.yang

sonic-slave-jessie/Dockerfile.j2

src/sonic-yang-mgmt/yang-models/sonic-acl.yang

src/sonic-yang-mgmt/yang-models/sonic-head.yang

src/sonic-yang-mgmt/yang-models/sonic-interface.yang

src/sonic-yang-mgmt/yang-models/sonic-port.yang

lgtm-com · 2020-04-07T00:41:18Z

This pull request introduces 2 alerts when merging 2f3d1854003cd3f2eb939f57d80ef4512bc1ab16 into 7bc8f12 - view on LGTM.com

new alerts:

1 for Unused import
1 for Module is imported with 'import' and 'import from'

…erface, PortChannel, lopback and ACL. YANG models as per Guidelines. Guideline doc: https://github.com/Azure/SONiC/blob/master/doc/mgmt/SONiC_YANG_Model_Guidelines.md [sonic-yang-models/tests]: YANG model test code and JSON input for testing. [sonic-yang-models/setup.py]: Build infra for yang models. Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

…ment. Changes: Find path of dependencies of os environment. Moving test file in separate dir. sonic-slave-jessie/Dockerfile.j2: Remove ijson pkg. Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

praveen-li · 2020-04-09T17:08:27Z

@renukamanavalan @lguohan
I have resolved all LGTM issues, and also made sure the build passes. Only VS is failing due to empty host list.

Kindly review, approve and merge. Thx a lot.

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

lguohan · 2020-04-09T18:01:11Z

retest vsimage please

praveen-li · 2020-04-10T17:10:08Z

retest vsimage please

src/sonic-yang-models/yang-models/sonic-head.yang

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

Changes: 1.) Changing sonic-head to sonic-types. 2.) change prefix from head to stypes. Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

praveen-li · 2020-04-13T23:16:26Z

Resolved all pending comments. Thx

praveen-li · 2020-04-14T18:53:35Z

@renukamanavalan , I notice that test passes with last build. I have removed organization names, also have converted sonic-head to sonic-types. Plz let me know if any other comments.

Please note for leaf names, I have used this page: https://github.com/Azure/SONiC/wiki/Configuration. Which suggests ACL_RULE, FLEX_COUNTER_TABLE have all leaves in uppercase. Rest tables have all leaves in lower case, but table name is in uppercase. Thx

…atically (#22026) #### Why I did it src/sonic-utilities ``` * 6e93f44 - (HEAD -> master, origin/master, origin/HEAD) Add Arista-7060X6-64PE-C224O8, Arista-7060X6-64PE-C256S2 to generic_config_updater (#3804) (18 hours ago) [rick-arista] * 208474c - Add scope to field validator.[redo PR: 3675] (#3805) (2 days ago) [Xincun Li] * a363c7f - [SmartSwitch] Extend reboot script for rebooting SmartSwitch (#3566) (6 days ago) [Vasundhara Volam] * 5e3b132 - [hash] update GH frontend with IPV6_FLOW_LABEL for ECMP/LAG switch hash configuration (#3730) (7 days ago) [Andriy Yurkiv] * 706f97e - [Techsupport] Add show route-map command to frr dumps in techsupport (#3797) (7 days ago) [Sudharsan Dhamal Gopalarathnam] * 1ec0540 - Fix the switch level Voq counter to use switch_id Oid instead of counter name for PACKET_INTEGRITY counter (#3769) (7 days ago) [saksarav-nokia] ``` #### How I did it #### How to verify it #### Description for the changelog

dutta-partha reviewed Nov 22, 2019

View reviewed changes

src/sonic-yang-mgmt/yang-models/sonic-vlan.yang Outdated Show resolved Hide resolved

praveen-li force-pushed the sonnic-yang-mgmt-msft branch from de3c076 to fa42047 Compare December 12, 2019 20:03

praveen-li changed the title ~~[yang-models]: First version of yang models for Port, VLan and ACL.~~ [yang-models]: First version of yang models for Port, VLan, Interface… …, PortChannel and ACL. Dec 13, 2019

praveen-li changed the title ~~[yang-models]: First version of yang models for Port, VLan, Interface… …, PortChannel and ACL.~~ [yang-models]: First version of yang models for Port, VLan, Interface, PortChannel and ACL. Dec 13, 2019

renukamanavalan self-requested a review December 17, 2019 01:23

renukamanavalan self-assigned this Dec 17, 2019

renukamanavalan reviewed Dec 27, 2019

View reviewed changes

src/sonic-yang-mgmt/tests/libyang-python-tests/sample-yang-models/sonic-acl.yang Outdated Show resolved Hide resolved

renukamanavalan reviewed Jan 14, 2020

View reviewed changes

praveen-li force-pushed the sonnic-yang-mgmt-msft branch from fa42047 to 195e7c0 Compare March 11, 2020 18:55

praveen-li changed the title ~~[yang-models]: First version of yang models for Port, VLan, Interface, PortChannel and ACL.~~ [sonic-yang-models]: First version of yang models for Port, VLan, Interface, PortChannel, loopback and ACL. Mar 11, 2020

praveen-li force-pushed the sonnic-yang-mgmt-msft branch 2 times, most recently from 3282190 to 7614f1f Compare March 20, 2020 19:07

praveen-li force-pushed the sonnic-yang-mgmt-msft branch from d275630 to 2f3d185 Compare April 7, 2020 00:28

Praveen Chaudhary added 7 commits April 8, 2020 12:22

[sonic-yang-models/setup.py]: Find path of dependencies of os environ…

d46aed4

…ment. Changes: Find path of dependencies of os environment. Moving test file in separate dir. sonic-slave-jessie/Dockerfile.j2: Remove ijson pkg. Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-extension.yang]: Add sonic-extension file.

41397df

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-yang-models-py3.mk]: Add sonic-yang-models-py3.mk file.

fc81b6f

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-yang-models/LICENSE]: Changing license to APACHE.

a538f18

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-extension.yang]: Re-add sonic-extension file.

5715f6f

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-yang-models/setup.py]: Address LGTM issues and rebasing.

cbe2046

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

praveen-li force-pushed the sonnic-yang-mgmt-msft branch from 2f3d185 to cbe2046 Compare April 8, 2020 19:27

[sonic-head.yang]: Removing duplicate definition of extension.

3113ca5

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

renukamanavalan reviewed Apr 11, 2020

View reviewed changes

src/sonic-yang-models/yang-models/sonic-head.yang Show resolved Hide resolved

renukamanavalan reviewed Apr 11, 2020

View reviewed changes

src/sonic-yang-models/yang-models/sonic-head.yang Outdated Show resolved Hide resolved

renukamanavalan reviewed Apr 11, 2020

View reviewed changes

src/sonic-yang-models/yang-models/sonic-head.yang Outdated Show resolved Hide resolved

Praveen Chaudhary added 2 commits April 13, 2020 12:18

[yang-models]: Remove Organization specific details.

808d9e6

Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

[sonic-yang-models/yang-models]: Changing sonic-head to sonic-types.

e8eff6b

Changes: 1.) Changing sonic-head to sonic-types. 2.) change prefix from head to stypes. Signed-off-by: Praveen Chaudhary pchaudhary@linkedin.com

lguohan approved these changes Apr 14, 2020

View reviewed changes

renukamanavalan merged commit a02255e into sonic-net:master Apr 14, 2020

praveen-li deleted the sonnic-yang-mgmt-msft branch April 15, 2020 18:30

renukamanavalan mentioned this pull request Apr 18, 2020

[sonic-yang-mgmt]: sonic-yang-mgmt package for configuration validation. #3861

Merged

lguohan added the Port Breakout 🔱 label May 1, 2020

praveen-li mentioned this pull request Mar 18, 2021

Split yang tests into multiple files #6939

Merged

4 tasks

Conversation

praveen-li commented Nov 8, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

praveen-li commented Nov 12, 2019

Uh oh!

praveen-li commented Nov 13, 2019

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

lgtm-com bot commented Apr 7, 2020

Uh oh!

praveen-li commented Apr 9, 2020

Uh oh!

lguohan commented Apr 9, 2020

Uh oh!

praveen-li commented Apr 10, 2020

Uh oh!

Uh oh!

Uh oh!

Uh oh!

praveen-li commented Apr 13, 2020

Uh oh!

praveen-li commented Apr 14, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

praveen-li commented Nov 8, 2019 •

edited

Loading