commit	93eb04ba8d148cf202baf5038d9ac88f30873145	[log] [tgz]
author	dglFromAtt <dgl@research.att.com>	Wed Jul 08 17:35:25 2020 -0400
committer	dglFromAtt <dgl@research.att.com>	Wed Jul 08 17:35:32 2020 -0400
tree	04d38341dfcf31e81b65d243446d2ba0b2b7165a
parent	e6f219098e97c4b2d41fc32c514f551e93bcdf78 [diff]

tree: 04d38341dfcf31e81b65d243446d2ba0b2b7165a

README.md

============LICENSE_START==========================================

org.onap.dmaap

===================================================================

Copyright © 2018 AT&T Intellectual Property. All rights reserved.

===================================================================

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License.

============LICENSE_END============================================

ECOMP is a trademark and service mark of AT&T Intellectual Property.

DMaaP Bus Controller API

Data Movement as a Platform (DMaaP) Bus Controller provides an API for other ONAP infrastructure components to provision DMaaP resources. A typical DMaaP resource is a Data Router Feed or a Message Router Topic, and their associated publishers and subscribers. Other infrastucture resources such as DR Nodes and MR Clusters are also provisioned through this API.

Sub-components

This project produces the following mvn modules in their respective sub-directories:

dmaap-bc is a docker image intended to be used to instantiate the DMaaP Bus Controller container
dbc-client is a docker image intended to serve as a temporary http client of the Bus Controller API. It will be instantiated in a container that is a Helm hook (e.g. post-install hook) that knows how to invoke the Bus Controller API.

Build Instructions for a Continuous Integration environment using Jenkins

When this component is included in a Continuous Integration environment, such as structured by the Linux Foundation, the artifacts can be created and deployed via Jenkins. The following maven targets are currently supported in the Build step:

clean install

Build Instructions for external developers

This project is organized as a mvn project for a docker image. After cloning from this git repo:

mvn clean install

Docker Packaging

We can utilize docker to build and register the buscontroller container in a local dev repository.


<assuming DOCKER_HOST is set appropriately for your environment>

$ mvn -P docker

ONAP deployment

Two styles of deployment are supported for ONAP.

OOM - by the time of Release Casablanca, this is the preferred deployment method which relies on a kubernetes environment, and uses helm charts. Buscontroller is part of a larger overall dmaap chart which also deploys Message Router and Data Router. See https://gerrit.onap.org/r/#/admin/projects/oom
HEAT - an older style deployment which assumes VM running docker.

ONAP OOM Deployment

The default DMaaP charts for an OOM deployment should be able to be used without modification because the interdependencies between components rely on kubernetes service names. However, overrides can be made to the buscontroller values.yaml file (found in oom/kubernetes/dmaap/charts/dmaap-bus-controller/values.yaml) as needed.

Following a convention where Release is set to the component name (--name=dmaap) and using a dev namespace:

<clone oom>
cd kubernetes
<edit values.yaml if necessary>
make dmaap
helm install dmaap --debug --name=dmaap --namespace=dev

ONAP Heat deployment

Prior to starting container, place environment specific vars in /tmp/docker-databus-controller.conf on the Docker host, and map that file to /opt/app/config/conf. Run the buscontroller image which starts execution of the dmaapbc deploy command, which will update the container runtime properties appropriately, and start the Bus Controller.

For example, in ONAP Future Lab environment, /tmp/docker-databus-controller.conf looks like:


# DMaaP Bus Controller OpenSource environment vars
CONT_DOMAIN=demo.dmaap.onap.org
DMAAPBC_INSTANCE_NAME=ONAPfuture

#   The https port
#   set to 0 if certificate is not ready
DMAAPBC_INT_HTTPS_PORT=0

DMAAPBC_KSTOREFILE=/opt/app/dcae-certificates
DMAAPBC_KSTOREPASS=foofoofoo
DMAAPBC_PVTKEYPASS=barbarbar

DMAAPBC_PG_ENABLED=true
DMAAPBC_PGHOST=zldciad1vipstg00.simpledemo.openecomp.org
DMAAPBC_PGCRED=test234-ftl

DMAAPBC_DRPROV_FQDN=zldciad1vidrps00.simpledemo.openecomp.org

DMAAPBC_AAF_URL=https://aafapi.${CONT_DOMAIN}:8100/proxy/

DMAAPBC_TOPICMGR_USER=m99751@dmaapBC.openecomp.org
DMAAPBC_TOPICMGR_PWD=enc:zyRL9zbI0py3rJAjMS0dFOnYfEw_mJhO
DMAAPBC_ADMIN_USER=m99501@dcae.openecomp.org
DMAAPBC_ADMIN_PWD=enc:YEaHwOJrwhDY8a6usetlhbB9mEjUq9m

DMAAPBC_PE_ENABLED=false
DMAAPBC_PE_AAF_ENV=TBD

Then the following steps could be used to pull and run the Bus Controller. (onap-nexus is just an example)

$ 
$ docker pull nexus3.onap.org:10003/onap/dmaap/dmaap-bc:latest
$ docker run -d -p 18080:8080 -p 18443:8443 -v /tmp/docker-databus-controller.conf:/opt/app/config/conf nexus3.onap.org:10003/onap/dmaap/dmaap-bc:latest

Properties

This section is intended to describe the behavior customization of Bus Controller that can be obtained via properties file used by the dbcapi library. By default, this file is located in etc/dmaapbc.properties. However, a java argument -DConfigFile can be set to a different path. (Our kubernetes deployment relies on this and points to a configmap, for example.)

The table below lists all the settings, default values (if not set), and shows any explicit setting in ONAP oom kubernetes deployment.

|-|-|-|-| | Property | Description | Default | ONAP Kubernetes Setting | |-|-|-|-| |UseAAF | Flag for whether AAF authz API is to be used | false | false | |-|-|-|-| |csit | Flag for stubbing out many southbound calls in a CSIT environment | No | No | |-|-|-|-| |DR.provhost | FQDN of Data Router Provisioning Server (deprecated - now set via API) | notSet | dcae-drps.domain.not.set | |-|-|-|-| |ProvisioningURI | URI to retrieve dynamic DR configuration | /internal/prov | /internal/prov | |-|-|-|-| |Feed.deleteHandling | indicator for handling feed delete request | DeleteOnDR | SimulateDelete | | | DeleteOnDR - means use the DR API to DELETE a feed. (default for backwards compatibility) | | | | | SimulateDelete - means preserve the feed on DR (after cleaning it up), and mark as DELETED in DBCL. | | | |-|-|-|-| |UsePGSQL | flag indicates whether to retain data in Postgresql | false | true | | | when false, objects will be kept in memory but will be | | | | | lost on restart and not shared between instances | | | |-|-|-|-| |DB.host | FQDN or service name of Postresql host | dcae-pstg-write-ftl.domain.notset.com | dbc-pg-primary | |-|-|-|-| |DB.name | name of Postresql database | dmaap | | |-|-|-|-| |DB.schema | name of database schema | public | | |-|-|-|-| |DB.user | username for Postgresql access | dmaap_admin | | |-|-|-|-| |DB.cred | password for Postrgresql access | test234-ftl | onapdemodb | |-|-|-|-| |MR.multisite | Indicates if there can be multiple sites (locations) where MR is deployed | true | false | |-|-|-|-| |MR.CentralCname | FQDN or service name of MR (deployed in central if multilocation is true) | MRcname.not.set | message-router | |-|-|-|-| |MR ClientDeleteLevel | MR Client Delete thoroughness | 0 | 1 | | | 0 = don't delete | | | | | 1 = delete from persistent store (PG) | | | | | 2 = delete from persistent store (PG) and authorization store (AAF) | | | |-|-|-|-| |MR.TopicFactoryNS | AAF namespace used to create perms for MR topics | MR.topicFactoryNS.not.set | org.onap.dmaap.mr.topicFactory | |-|-|-|-| |MR.TopicMgrRole | AAF Role used by Buscontroller to create topics on MR | MR.TopicMgrRole.not.set | org.onap.dmaap-bc-topic-mgr.client | |-|-|-|-| |MR.projectID | Value for some constructs of fully qualified topic names | 99999 | ONAP | |-|-|-|-| |cadi.properties | Path to CADI properties file | /opt/app/osaaf/local/org.onap.dmaap-bc.props | /opt/app/osaaf/lcoal/org.onap.dmaap-bc.props | |-|-|-|-| |aaf.URL | URL of the AAF server | https://authentication.domain.netset.com:8100/proxy/ | https://aaf-service.onap:8100/ | |-|-|-|-| |aaf.TopicMgrUser | AAF Identity of Topic Mgr | noMechId@domain.netset.com | dmaap-bc-topic-mgr@dmaap-bc-topic-mgr.onap.org | |-|-|-|-| |aaf.TopicMgrPassword | AAF Credential for Topic Mgr | notSet | demo123456! | |-|-|-|-| |aaf.AdminUser | AAF Identity of user with Admin role for API namespace | noMechId@domain.netset.com | aaf_admin@people.osaaf.org | |-|-|-|-| |aaf.AdminPassword | AAF credential of AdminUser | notSet | demo123456! | |-|-|-|-| |aaf.NsOwnerIdentity | AAF Identity to be used as topic Namespace owner | notSet | aaf_admin@people.osaaf.org | |topicNsRoot | AAF namespace value used to create FQTN | org.onap.dcae.dmaap | org.onap.dcae.dmaap | |-|-|-|-| |CredentialCodeKeyfile | location of the codec keyfile used to decrypt passwords | LocalKey | etc/LocalKey | | | in this properties file before they are passed to AAF | LocalKey | etc/LocalKey | |-|-|-|-| |AafDecryption.Class | Specifies the Class to be used for decryption | org.onap.dmaap.dbcapi.aaf.ClearDecrypt | | |-|-|-|-| |ApiNamespace | Root namespace for AAF perms related to dbcapi access | apiNamespace.not.set | org.onap.dmaap-bc.api | |-|-|-|-| |ApiPermission.Class | the Class that determines if a call to API is authorized| allow | | |-|-|-|-| |MM.ProvRole | AAF Role of client publishing MM prov cmds | notSet | org.onap.dmaap-bc-mm-prov.prov | |-|-|-|-| |MM.ProvUserMechId | AAF Identity when publishing to MM command topic | notSet | dmaap-bc-mm-prov@dmaap-bc-mm-prov.onap.org| |-|-|-|-| |MM.ProvUserPwd | AAF credenital for ProvUserMechId | notSet | demo123456! | |-|-|-|-| |MM.AgentRole | AAF Role of client susbcribing to MM command topic | notSet | org.onal.dmaap-bc-mm-prov.agent | |-|-|-|-| |DR.provApi | Version name of DR API (ONAP or AT&T) | ONAP | ONAP | |-|-|-|-| |DR.onBehalfHeader | String for "On Behalf Of" HTTP Header in DR API | X-DR-ON-BEHALF-OF | X-DR-ON-BEHALF-OF | |-|-|-|-| |DR.feedContentType | Value for Content-Type Header in DR Feed API | application/vnd.dr.feed | application/vnd.dr.feed | |-|-|-|-| |DR subContentType | Value for Content-Type Header in DR Subscription API | application/vnd.dr.subscription | application/vnd.dr.subscription | |-|-|-|-| |HttpAllowed | flag indicating whether http is supported | false | true | |-|-|-|-| |IntHttpPort | Internal port for http service | 80 | 8080 | |-|-|-|-| |IntHttpsPort | Internal port for https service (0 if no cert is avail) | 443 | 8443 | |-|-|-|-| |ExtHttpsPort | Externally advertised port for https service (deprecated)| 443 | 443 | |-|-|-|-| |KeyStoreType | Format of Java keystore | jks | jks | |-|-|-|-| |KeyStoreFile | Path to java keystore | etc/keystore | etc/keystore | |-|-|-|-| |KeyStorePassword | Password for keystore | changeit | | |-|-|-|-| |KeyPassword | Password for private key in the https keystore | changeit | | |-|-|-|-| |TrustStoreType | Format of Trust Store file | jks | jks | |-|-|-|-| |TrustStoreFile | Path to Trust Store file | | etc/org.onap.dmaap-bc.trust.jks | |-|-|-|-| |TrustStorePassword | Password for Trust Store | | | |-|-|-|-| |QuiesceFile | Path to file which signals needs to queiesce | | etc/SHUTDOWN | |-|-|-|-|

Environment Variables

The following environment variables can be set in the container environment to further effect behavior:

DMAAPBC_WAIT_TOEXIT=Y when set this will attempt to keep the dmaap-bc container running. Sometimes needed to get a better look at logs when the main proces is exiting for some reason.
CONFIGMAP_ROOT defaults to /opt/app/config/conf but can be overwritten if needed. This value serves as the root to where the buscontroller.env file is found.
CONFIGMAP_PROPS defaults to /opt/app/config/conf/dmaapbc.properties but can be overwritten if needed