| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 1 | .. This work is licensed under a |
| 2 | Creative Commons Attribution 4.0 International License. |
| 3 | .. integration-CICD: |
| 4 | |
| 5 | .. integration_main-doc: |
| 6 | |
| 7 | CI/CD |
| 8 | ===== |
| 9 | |
| 10 | .. important:: |
| 11 | Integration team deals with 2 different CI/CD systems. |
| 12 | |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 13 | - Jenkins CI/CD, CI managed by LF IT and CD by Integration team |
| 14 | - GitLab-ci managed by Integration and OOM team |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 15 | |
| 16 | Continuous Integration |
| 17 | ---------------------- |
| 18 | |
| 19 | The CI part provides the following features: |
| 20 | |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 21 | - Repository verification (format of the INFO.yaml) |
| 22 | - Patchset verification thanks to json/yaml/python/go/rst/md linters. These Jenkins |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 23 | verification jobs are hosted in the ci-management repository. They can vote |
| 24 | +1/-1 on patchset submission. Integration team systematically enables linters |
| 25 | on any new repository |
| 26 | - Docker build: Integration team builds testsuite dockers and xtesting dockers. |
| 27 | These dockers are built then pushed to Nexus through a jjb also hosted in the |
| 28 | ci-management repository. |
| 29 | |
| 30 | The different verification chains are defined in https://jenkins.onap.org/: |
| 31 | |
| 32 | - CSIT: https://jenkins.onap.org/view/CSIT/ |
| 33 | - testsuite: https://jenkins.onap.org/view/testsuite/ |
| 34 | - integration: https://jenkins.onap.org/view/integration/ |
| 35 | - integration-terragrunt: https://jenkins.onap.org/view/integration-terragrunt/ |
| 36 | - testsuite-robot-utils: https://jenkins.onap.org/view/testsuite-robot-utils/ |
| 37 | |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 38 | The Jenkins jobs (jjb) are hosted in https://git.onap.org/ci-management/. |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 39 | |
| 40 | Continuous Deployment |
| 41 | --------------------- |
| 42 | |
| 43 | There are 2 Continuous Deployment architectures. |
| 44 | |
| 45 | Jenkins CD on Windriver/Intel lab |
| 46 | .................................. |
| 47 | |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 48 | The CD part on Windriver/Intel is based on Jenkins. |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 49 | |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 50 | It is based on a standalone VM hosting a Jenkins server. |
| 51 | The credentials of this VM as well as the Jenkins server have been provided to |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 52 | integration committers. |
| 53 | |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 54 | Several jobs can be triggered from this Jenkins interface. |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 55 | Historically several chains were run daily (staging/release) but due to |
| 56 | performance issues, they have all been stopped. |
| 57 | Only SB-00 has been kept for use case support. |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 58 | The Jenkins interface was however used to launch the installation of SB-00. |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 59 | |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 60 | This Jenkins script is leveraging resources available in OOM and integration |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 61 | repositories. |
| 62 | |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 63 | The replacement of this CD by a GitLab runner based CD to unify the CD |
| Lasse Kaihlavirta | 2d2888a | 2020-11-18 16:54:36 +0200 | [diff] [blame] | 64 | management was planned, but finalizing the operation in Guilin was not possible |
| 65 | due to performance issues. |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 66 | |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 67 | GitLab CD |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 68 | ......... |
| 69 | |
| 70 | This CD is leveraging public gitlab-ci mechanism and used to deploy several ONAP |
| 71 | labs: |
| 72 | |
| 73 | - Daily Master: daily run using OOM Master |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 74 | - Daily Guilin: daily run using the last stable version during Honolulu Release |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 75 | processing |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 76 | - Daily Honolulu: daily run setup at RC0 (candidate dockers available for integration) |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 77 | - Weekly Master: run once a week with longer tests |
| morganrol | 81dc70f | 2021-04-06 19:57:44 +0200 | [diff] [blame] | 78 | - Weekly Honolulu: run once a week with longer tests |
| mrichomme | 9643b0c | 2020-11-14 22:36:57 +0100 | [diff] [blame] | 79 | - Gating: run on OOM, clamp or SO patchset submission. It means a full ONAP |
| 80 | deployment on demand based on new patchset declared in gerrit. |
| 81 | |
| 82 | See :ref:`Integration CI guideline <integration-ci>` for details. |