Gary Wu | cd47a01 | 2018-11-30 07:18:36 -0800 | [diff] [blame] | 1 | .. This work is licensed under a Creative Commons Attribution 4.0 |
| 2 | International License. http://creativecommons.org/licenses/by/4.0 |
| 3 | Copyright 2018 Huawei Technologies Co., Ltd. All rights reserved. |
| 4 | |
| 5 | .. _docs_vcpe: |
| 6 | |
Gary Wu | e4a2df8 | 2018-11-29 12:49:09 -0800 | [diff] [blame] | 7 | vCPE Use Case |
| 8 | ---------------------------- |
| 9 | |
| 10 | Description |
| 11 | ~~~~~~~~~~~ |
| 12 | vCPE use case is based on Network Enhanced Residential Gateway architecture specified in Technical Report 317 (TR-317), which defines how service providers deploy residential broadband services like High Speed Internet Access. The use case implementation has infrastructure services and customer service. The common infrastructure services are deployed first and shared by all customers. The use case demonstrates ONAP capabilities to design, deploy, configure and control sophisticated services. |
| 13 | |
| 14 | More details on the vCPE Use Case can be found on wiki page https://wiki.onap.org/pages/viewpage.action?pageId=3246168 |
| 15 | |
| 16 | Source Code |
| 17 | ~~~~~~~~~~~ |
Yang Xu | cbf3f2d | 2019-06-24 08:31:16 -0400 | [diff] [blame] | 18 | vcpe test scripts: https://git.onap.org/integration/tree/test/vcpe?h=dublin |
Gary Wu | e4a2df8 | 2018-11-29 12:49:09 -0800 | [diff] [blame] | 19 | |
| 20 | How to Use |
| 21 | ~~~~~~~~~~ |
| 22 | Most part of the use case has been automated by vcpe scripts. For the details on how to run the scripts, please refer to the use case tutorial on https://wiki.onap.org/display/DW/vCPE+Use+Case+Tutorial%3A+Design+and+Deploy+based+on+ONAP. |
| 23 | |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 24 | Here are the main steps to run the use case in Integration lab environment, where vCPE script is pre-installed on Rancher node under /root/integration/test/vcpe: |
| 25 | |
| 26 | 1. Run Robot script from Rancher node to onboard VNFs, create and distribute models for vCPE four infrastructure services, i.e. infrastructure, brg, bng and gmux |
| 27 | |
| 28 | :: |
| 29 | |
| 30 | demo-k8s.sh onap init |
| 31 | |
Yang Xu | 587704d | 2019-06-26 08:44:10 -0400 | [diff] [blame] | 32 | 2. Add customer SDN-ETHERNET-INTERNET (see the use case tutorial wiki page for detail) |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 33 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 34 | 3. Add route on sdnc cluster VM node, which is the cluster VM node where pod sdnc-sdnc-0 is running on. This will allow ONAP SDNC to configure BRG later on. |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 35 | |
| 36 | :: |
| 37 | |
| 38 | ip route add 10.3.0.0/24 via 10.0.101.10 dev ens3 |
| 39 | |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 40 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 41 | 4. Install Python and other Python libraries |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 42 | |
| 43 | :: |
| 44 | |
| 45 | integration/test/vcpe/bin/setup.sh |
| 46 | |
| 47 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 48 | 5. Change the Openstack env parameters and one customer service related parameter in vcpecommon.py |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 49 | |
| 50 | :: |
| 51 | |
| 52 | cloud = { |
| 53 | '--os-auth-url': 'http://10.12.25.2:5000', |
| 54 | '--os-username': 'xxxxxxxxxx', |
| 55 | '--os-user-domain-id': 'default', |
| 56 | '--os-project-domain-id': 'default', |
| 57 | '--os-tenant-id': 'xxxxxxxxxxxxxxxx' if oom_mode else '1e097c6713e74fd7ac8e4295e605ee1e', |
| 58 | '--os-region-name': 'RegionOne', |
| 59 | '--os-password': 'xxxxxxxxxxx', |
| 60 | '--os-project-domain-name': 'xxxxxxxxx' if oom_mode else 'Integration-SB-07', |
| 61 | '--os-identity-api-version': '3' |
| 62 | } |
| 63 | |
| 64 | common_preload_config = { |
| 65 | 'oam_onap_net': 'xxxxxxxx' if oom_mode else 'oam_onap_lAky', |
| 66 | 'oam_onap_subnet': 'xxxxxxxxxx' if oom_mode else 'oam_onap_lAky', |
| 67 | 'public_net': 'xxxxxxxxx', |
| 68 | 'public_net_id': 'xxxxxxxxxxxxx' |
| 69 | } |
| 70 | |
| 71 | :: |
| 72 | |
| 73 | # CHANGEME: vgw_VfModuleModelInvariantUuid is in rescust service csar, open service template with filename like service-VcpesvcRescust1118-template.yml and look for vfModuleModelInvariantUUID under groups vgw module metadata. |
| 74 | self.vgw_VfModuleModelInvariantUuid = 'xxxxxxxxxxxxxxx' |
| 75 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 76 | 6. Initialize vcpe |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 77 | |
| 78 | :: |
| 79 | |
| 80 | vcpe.py init |
| 81 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 82 | 7. Run a command from Rancher node to insert vcpe customer service workflow entry in SO catalogdb. You should be able to see a sql command printed out from the above step output at the end, and use that sql command to replace the sample sql command below (inside the double quote) and run it from Rancher node: |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 83 | |
| 84 | :: |
| 85 | |
Yang Xu | 587704d | 2019-06-26 08:44:10 -0400 | [diff] [blame] | 86 | kubectl exec dev-mariadb-galera-mariadb-galera-0 -- mysql -uroot -psecretpassword catalogdb -e "INSERT INTO service_recipe (ACTION, VERSION_STR, DESCRIPTION, ORCHESTRATION_URI, SERVICE_PARAM_XSD, RECIPE_TIMEOUT, SERVICE_TIMEOUT_INTERIM, CREATION_TIMESTAMP, SERVICE_MODEL_UUID) VALUES ('createInstance','1','vCPEResCust 2019-06-03 _04ba','/mso/async/services/CreateVcpeResCustService',NULL,181,NULL, NOW(),'6c4a469d-ca2c-4b02-8cf1-bd02e9c5a7ce')" |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 87 | |
Bartek Grzybowski | 6358aa3 | 2019-10-30 13:46:43 +0100 | [diff] [blame^] | 88 | 8. Run Robot to create and distribute for vCPE customer service. This step assumes step 1 has successfully distributed all vcpe models except customer service model |
Yang Xu | 587704d | 2019-06-26 08:44:10 -0400 | [diff] [blame] | 89 | |
| 90 | :: |
| 91 | |
| 92 | ete-k8s.sh onap distributevCPEResCust |
| 93 | |
Bartek Grzybowski | f816c30 | 2019-11-06 15:26:37 +0100 | [diff] [blame] | 94 | 10. Instantiate vCPE infra services |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 95 | |
| 96 | :: |
| 97 | |
| 98 | vcpe.py infra |
| 99 | |
Bartek Grzybowski | 19199da | 2019-11-07 12:44:46 +0100 | [diff] [blame] | 100 | 11. From Rancher node run vcpe healthcheck command to check connectivity from sdnc to brg and gmux, and vpp configuration of brg and gmux. |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 101 | |
| 102 | :: |
| 103 | |
Bartek Grzybowski | 4baa51c | 2019-09-10 13:50:15 +0200 | [diff] [blame] | 104 | healthcheck-k8s.py --namespace <namespace name> --environment <env name> |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 105 | |
Bartek Grzybowski | 19199da | 2019-11-07 12:44:46 +0100 | [diff] [blame] | 106 | 12. Instantiate vCPE customer service. |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 107 | |
Yang Xu | 587704d | 2019-06-26 08:44:10 -0400 | [diff] [blame] | 108 | :: |
| 109 | |
| 110 | vcpe.py customer |
| 111 | |
Bartek Grzybowski | f816c30 | 2019-11-06 15:26:37 +0100 | [diff] [blame] | 112 | 13. Update libevel.so in vGMUX VM and restart the VM. This allows vGMUX to send events to VES collector in close loop test. See tutorial wiki for details |
Yang Xu | 587704d | 2019-06-26 08:44:10 -0400 | [diff] [blame] | 113 | |
Bartek Grzybowski | f816c30 | 2019-11-06 15:26:37 +0100 | [diff] [blame] | 114 | 14. Run heatbridge. The heatbridge command usage: demo-k8s.sh <namespace> heatbridge <stack_name> <service_instance_id> <service> <oam-ip-address>, please refer to vCPE tutorial page on how to fill in those paraemters. See an example as following: |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 115 | |
| 116 | :: |
| 117 | |
| 118 | ~/integration/test/vcpe# ~/oom/kubernetes/robot/demo-k8s.sh onap heatbridge vcpe_vfmodule_e2744f48729e4072b20b_201811262136 d8914ef3-3fdb-4401-adfe-823ee75dc604 vCPEvGMUX 10.0.101.21 |
| 119 | |
Bartek Grzybowski | f816c30 | 2019-11-06 15:26:37 +0100 | [diff] [blame] | 120 | 15. Start closed loop test by triggering packet drop VES event, and monitor if vGMUX is restarting. You may need to run the command twice if the first run fails |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 121 | |
| 122 | :: |
| 123 | |
| 124 | vcpe.py loop |
| 125 | |
| 126 | |
Gary Wu | e4a2df8 | 2018-11-29 12:49:09 -0800 | [diff] [blame] | 127 | Test Status |
| 128 | ~~~~~~~~~~~~~~~~~~~~~ |
Yang Xu | aa08503 | 2019-06-17 09:44:34 -0400 | [diff] [blame] | 129 | The use case has been tested for Dublin release, the test report can be found on https://wiki.onap.org/display/DW/vCPE+%28Heat%29+-+Dublin+Test+Status |
Gary Wu | e4a2df8 | 2018-11-29 12:49:09 -0800 | [diff] [blame] | 130 | |
| 131 | Known Issues and Workaround |
| 132 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
Yang Xu | 4c9c471 | 2019-06-19 01:56:35 -0400 | [diff] [blame] | 133 | 1) NATs are installed on BRG and vBNG. In order to allow SDNC to send BRG configuration message through vBNG, SDNC host VM IP address is preloaded on BRG and vBNG during VM instantiation, and provisioned into the NATs. If SDNC changes its host VM, SDNC host VM IP changes and we need to manually update the IP in /opt/config/sdnc_ip.txt. Then run: |
Gary Wu | e4a2df8 | 2018-11-29 12:49:09 -0800 | [diff] [blame] | 134 | |
| 135 | :: |
| 136 | |
| 137 | root>vppctl tap delete tap-0 |
| 138 | root>vppctl tap delete tap-1 |
| 139 | root>/opt/nat_service.sh |
| 140 | root>vppctl restart |
| 141 | |
Yang Xu | 5ee1c38 | 2019-06-26 22:46:31 -0400 | [diff] [blame] | 142 | 2) During vCPE customer service instantiation, though vGW should come up successfully BRG vxlan tunnel configuration is likely to fail in SDNC cluster environment due to SDNC unreachable to BRG. See more detail in JIRA INT-1127. One workaround is to run vCPE use case with SDNC cluster disabled. |
Michal Ptacek | 7a008fd | 2019-09-11 12:04:35 +0000 | [diff] [blame] | 143 | |
| 144 | 3) In some Openstack environments (e.g. Ocata version), there is an issue with DHCP anti-spoofing rules preventing BRG to receive DHCP reply (Option 82) from DHCP. By default Openstack neutron is using *IptablesFirewallDriver*, which is actively inserting *Prevent DHCP Spoofing by VM* rules into linuxbridge firewall rules. This feature should prevent mailicious traffic from rogue VM inside Openstack, however it's affecting also vCPE usecase. Manual tweaking of fw rules is not persistent and those rules are automatically regenerated, but one can disable this logic by switching to *neutron.agent.firewall.NoopFirewallDriver*. More details can be found on https://codesomniac.com/2017/07/how-to-run-a-dhcp-server-as-openstack-instance/ |
| 145 | |
Bartek Grzybowski | f1d0a8b | 2019-09-12 09:51:34 +0200 | [diff] [blame] | 146 | **NOTE:** To propagate change in firewall_driver one needs to restart neutron-linuxbridge-agent and also openstack-nova-compute services. |
Michal Ptacek | 7a008fd | 2019-09-11 12:04:35 +0000 | [diff] [blame] | 147 | |
Bartek Grzybowski | f1d0a8b | 2019-09-12 09:51:34 +0200 | [diff] [blame] | 148 | Additionally Neutron's Port Security Extension Driver is by default preventing any routing functions of an instance (be it a router or VNF). Hence for smoothest vCPE experience it's advised to either disable the packet filtering by setting port_security_enabled flag for a network/port to "False" or alternatively add allowed_address_pairs to relevant VNFs ports with appropriate network prefixes. Port security driver can be also disabled globally, for more insight into Port Security Extension Driver please visit https://wiki.openstack.org/wiki/Neutron/ML2PortSecurityExtensionDriver |