Optimize sleep in test/systemtests

[vhosakot]

The Contiv system tests in netplugin/test/systemtests call time.Sleep() 151 times in code, many of them in loops. Due to this, the time needed to run these system tests is high. Netplugin CI needs 2.5 hours to run them.

This PR optimizes and reduces the sleeps in system tests' code in the following areas:

1. Add polling code in contivModelClient.go to poll for the status of the objects AppProfile, EndpointGroup, Global, Network, Rule after creating (httpPost) and deleting (httpDelete) them.
2. Remove sleep in the tests and poll for the status of objects AppProfile, EndpointGroup, Global, Network, Rule after creating and deleting them.
3. Remove unwanted sleep in code.
4. Reduce sleep in code wherever needed.
5. Optimize polling interval in code when checking things like:
   • Node is reloaded
   • Etcd and consul are restarted
   • Interface is flapped
   • VTEPs are verified
   • ACI gateway is restarted
   • Checking for the status of Netplugin after starting and stopping it
   • k8s pods are deleted

Signed-off-by: Vikram Hosakote [email protected]

[vhosakot]

build PR

[unclejack]

build PR

[unclejack]

build PR

[unclejack]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[unclejack]

build PR

[vhosakot]

build PR

[dseevr]

@vhosakot contivModelClient.go changes can't be made under vendor. You will need to make edits in the contivmodel repo or possibly back in the modelgen repo and vendor them in

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

build PR

[vhosakot]

Since this has taken a long time, moving it to backlog, and I'm working on other high-priority Contiv tickets.

Please do not close this PR. I'll work on it later when this PR gets higher priority.