create new test to verify incremental config changes via CLI

[joej164]

incremental_config_t1_eight_output.log
incremental_config_t0_eight_output.log

Description of PR

Adding a test to verify the incremental config cli components

Summary:
Adds new test that will walk the incremental config sections of the cli

NOTE: The command config portchannel member add doesn't add both members so this test fails.

Type of change

• [] Bug fix
• [] Testbed and Framework(new/improvement)
• Test case(new/improvement)

Approach

How did you do it?

Wrote commands to update the DUT, then did show commands to verify the command actually worked.

How did you verify/test it?

using show commands

Any platform specific information?

The DUT needs at least 2 active Ethernet interfaces

Supported testbed topology if it's a new test case?

most t0 and t1 testbeds should work. This was tested on a t0-8 and t1-8 topology.

Documentation

I updated the README.text.md file

Test Results

Command: ansible-playbook -i lab test_sonic.yml -e testbed_name=t0-eight -e testcase_name=incremental_config

Results:
PLAY RECAP *********************************************************************
lab-ignw-seastone-dut-li1 : ok=114 changed=38 unreachable=0 failed=0

Monday 26 August 2019 22:37:26 +0000 (0:00:00.067) 0:01:59.614 *********

TASK: test : create inactive interface list ---------------------------- 15.20s
TASK: test : pull current portchannel status ---------------------------- 5.45s
TASK: test : pull current portchannel status ---------------------------- 4.65s
TASK: test : verify the ports have been removed ------------------------- 4.60s
TASK: test : pull out lines from output for the portchannel ports ------- 4.02s
TASK: test : verify the portchannel has been removed -------------------- 3.89s
TASK: test : add initial role to the device ----------------------------- 3.52s
TASK: test : copy test files -------------------------------------------- 3.21s
TASK: test : add members to the portchannel ----------------------------- 2.79s
TASK: test : remove the members from the port channel ------------------- 2.76s
TASK: test : Get interface facts ---------------------------------------- 2.11s
TASK: test : Verify port channel interfaces are up correctly ------------ 2.04s
TASK: test : gather system version information -------------------------- 1.80s
TASK: test : get the current state of the roles ------------------------- 1.78s
TASK: test : get the current state of the roles ------------------------- 1.71s
TASK: test : update the role to allow everything ------------------------ 1.65s
TASK: test : get the current state of the roles ------------------------- 1.64s
TASK: test : validate all interfaces are up after test ------------------ 1.59s
TASK: test : Ansible | List all known variables and facts --------------- 1.55s
TASK: test : delete the acl --------------------------------------------- 1.43s

Command: ansible-playbook -i lab test_sonic.yml -e testbed_name=t1-eight -e testcase_name=incremental_config

Results:
PLAY RECAP *********************************************************************
lab-ignw-seastone-dut-li1 : ok=110 changed=40 unreachable=0 failed=0

Monday 26 August 2019 23:33:41 +0000 (0:00:00.078) 0:01:44.199 *********

TASK: test : create inactive interface list ---------------------------- 15.17s
TASK: test : add initial role to the device ----------------------------- 3.52s
TASK: test : copy test files -------------------------------------------- 3.22s
TASK: test : add members to the portchannel ----------------------------- 2.76s
TASK: test : remove the members from the port channel ------------------- 2.74s
TASK: test : pull current portchannel status ---------------------------- 2.41s
TASK: test : verify the ports have been removed ------------------------- 2.37s
TASK: test : pull current portchannel status ---------------------------- 2.37s
TASK: test : pull out lines from output for the portchannel ports ------- 1.97s
TASK: test : gather system version information -------------------------- 1.83s
TASK: test : verify the portchannel has been removed -------------------- 1.81s
TASK: test : get the current state of the roles ------------------------- 1.74s
TASK: test : get the current state of the roles ------------------------- 1.70s
TASK: test : get the current state of the roles ------------------------- 1.69s
TASK: test : Ansible | List all known variables and facts --------------- 1.62s
TASK: test : validate all interfaces are up after test ------------------ 1.61s
TASK: test : update the role to allow everything ------------------------ 1.59s
TASK: test : delete the acl --------------------------------------------- 1.46s
TASK: test : confirm IP was removed from the interface ------------------ 1.38s
TASK: test : confirm IP was added to the interface ---------------------- 1.35s

[joej164]

closing to modify based on request to verify traffic works is transmitted on the interface

[joej164]

improved test by requiring to use active interfaces

[praveen-li]

I notice PTF usage on apr-clear already, I think we need PTF traffic test here as well. Thx,