This section contains list of system test cases that have been automated for SEBA.

TestCaseTest Description/VerificationPriorityTestCase ID

Implemented

POD

(Yes/No)

Implemented

SiaB

(Yes/No)

JenkinsJob

where test is run

Verify End-end ping with

ONU in Correct Location

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with correct ONU location
  • Validate successful authentication/DHCP/E2E ping
Hightest1  in ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test by removing ONU from Whitelist,

and re-add ONU to Whitelist for a

successful ping

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with correct ONU location
  • Validate successful authentication/DHCP/E2E ping
  • Remove ONU from whitelist
  • Validate failed authentication/DHCP/E2E ping
  • Add ONU to whitelist
  • Validate successful authentication/DHCP/E2E ping
Hightest2: ATT_Test001

Yes

Yes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test with ONU in Wrong Location

and re-add ONU in Correct Location

for a successful ping

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with correct ONU location
  • Validate successful authentication/DHCP/E2E ping
  • Update whitelist with wrong ONU location
  • Validate failed authentication/DHCP/E2E ping
  • Update whitelist with correct ONU location
  • Validate successful authentication/DHCP/E2E ping
Hightest3: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test by Removing Subscriber and

re-creating the Subscriber for a

successful ping

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with correct ONU location
  • Validate successful authentication/DHCP/E2E ping
  • Remove subscriber model
  • Validate successful authentication (expected with the ONF pod setup) but failed DHCP/E2E ping
  • Recreate subscriber model
  • Validate successful authentication/DHCP/E2E ping
Hightest4: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test by Skipping Subscriber Provisioning and re-provisioning Subscriber

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with correct ONU location and skip provisioning subscriber
  • Validate successful authentication (expected with the ONF pod setup) but failed DHCP/E2E ping
  • Provision subscriber
  • Validate successful authentication/DHCP/E2E ping
Hightest5: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test by skipping Authentication

Validates failed authentication/DHCP/E2E Ping with the following scenario:

  • Configure whitelist with correct ONU location and skip RG authentication
  • Validate failed DHCP/E2E Ping
Hightest6: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test with ONU not in Whitelist

Validates failed E2E Ping Connectivity and object states for the given scenario:

  • Skip whitelist configuration for ONU
  • Validate authentication fails
  • Validate that DHCP/E2E ping fail
Hightest7: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test with ONU not in Whitelist and by skipping Subscriber

Provisioning

Validates E2E Ping Connectivity and object states for the given scenario:

  • Skip whitelist configuration for ONU and subscriber provisioning
  • Validate successful authentication but DHCP/E2E pings fails
  • Configure whitelist with correct ONU location
  • Validate successful authentication (expected with the ONF pod setup) but failed DHCP/E2E ping
  • Provision subscriber
  • Validate successful authentication/DHCP/E2E ping
Hightest8: ATT_Test001YesYes

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/

Test with ONU in Wrong Location

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with wrong ONU location
  • Validate that authentication/DHCP/E2E ping fail
High

test9: ATT_Test001

YesYes
https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/

Test with ONU in Wrong Location and Skip Subscriber Provisioning,

Then fix ONU in Correct Location and Provision Subscriber

Validates E2E Ping Connectivity and object states for the given scenario:

  • Configure whitelist with wrong ONU location and skip subscriber provisioning
  • Validate failed authentication/DHCP/E2E ping
  • Configure whitelist with correct ONU location
  • Validate successful authentication (expected with the ONF pod setup) but failed DHCP/E2E ping
  • Provision subscriber
  • Validate successful authentication/DHCP/E2E ping
Hightest10: ATT_Test001YesYes
https://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha16_cord-6.1_test/
Data Plane Failures
  • Reboot RG

  • Reboot OLT

  • Reboot Fabric Switch (Leaf attached to OLT)

HighDataPlane_FailureTests.robotDoneNohttps://jenkins.opencord.org/view/ATT-Workflow/job/build_att-workflow_flex-ocp-cord-voltha-master_master_test/
Upgrade Tests
  • Possibly after testing a successful build -> upgrade helm charts and re-test

  • Perform tests after any upgrade of helm charts

  • Matrix of upgradable versions is required

  • Validate migrations are successful and tests succeed after migration

Low
NoNo
Test scale using BBSim
  • Use BBSim to scale SEBA with 16 ONUs (one OLT) and test scale and performance on the POD

  • Implemented in a SIAB virtual pod environment

  • Test has ability to dynamically scale
MediumBBSIMScale.robotNoYeshttps://jenkins.opencord.org/job/BBSIM-Validation-Voltha-master/

https://docs.google.com/document/d/1DP_TGnkcr2shac0Xts6O377C8aRkpxtRwWS7ewwE7zo/edit?ts=5bca45a1#heading=h.8krbs1uxvqmv