| Chengkai Yan | 7f278e3 | 2018-11-06 16:32:03 +0100 | [diff] [blame] | 1 | .. This work is licensed under a Creative Commons Attribution 4.0 International License. |
| 2 | .. http://creativecommons.org/licenses/by/4.0 |
| 3 | |
| 4 | Architecture |
| 5 | ============ |
| 6 | |
| 7 | Introduction |
| 8 | """""""""""" |
| maximesson | c762eb1 | 2019-04-04 14:43:43 +0000 | [diff] [blame] | 9 | DataFile Collector (DFC) is a part of DCAEGEN2. Some information about DFC and the reasons of its implementation can be |
| 10 | found here: `5G bulk PM wiki page`_. |
| Chengkai Yan | 7f278e3 | 2018-11-06 16:32:03 +0100 | [diff] [blame] | 11 | |
| 12 | .. _5G bulk PM wiki page: https://wiki.onap.org/display/DW/5G+-+Bulk+PM |
| 13 | |
| 14 | DFC will handle the collection of bulk PM data flow: |
| 15 | 1. Subscribes to fileReady DMaaP topic |
| 16 | 2. Collects the file from the xNF |
| 17 | 3. Sends new event to DataRouter with file. |
| 18 | |
| 19 | |
| 20 | DFC is delivered as one **Docker container** which hosts application server and can be started by `docker-compose`. |
| 21 | See `Delivery`_ for more information about the docker container. |
| 22 | |
| 23 | .. _Delivery: ./delivery.html |
| 24 | |
| 25 | Functionality |
| 26 | """"""""""""" |
| 27 | .. image:: ../../images/DFC.png |
| 28 | |
| 29 | Interaction |
| 30 | """"""""""" |
| 31 | DFC will interact with the DMaaP Message Router and with the Data Router via secured protocol, using json files. |
| 32 | So far, the implemented protocols are sftp and ftp(e)s. |
| maximesson | c762eb1 | 2019-04-04 14:43:43 +0000 | [diff] [blame] | 33 | |
| 34 | Retry mechanism |
| 35 | """"""""""""""" |
| 36 | DFC is designed to retry downloading and publishing of files in order to recover from temporary faults. |
| 37 | Each time an event is received, DFC will try to download and and publish each previously unpublished file in the event. |
| 38 | The event is received from the Message Router (MR), the files are fetched from a PNF and are published to Data Router |
| 39 | (DR). |
| 40 | Both fetching of a file and publishing is retried a number of times with an increasing delay between each attempt. |
| 41 | After a number of attempts, the DFC will log an error message and give up. Failing of processing of one file does not |
| 42 | affect the handling of others. |