| *** Settings *** |
| Library OperatingSystem |
| Library RequestsLibrary |
| Library Process |
| |
| Resource ../../resources/common-keywords.robot |
| |
| *** Variables *** |
| ${CONSUL_UPL_APP} /usr/bin/curl -v http://127.0.0.1:8500/v1/kv/dfc_app0?dc=dc1 -X PUT -H 'Accept: application/json' -H 'Content-Type: application/json' -H 'X-Requested-With: XMLHttpRequest' --data-binary @${SIMGROUP_ROOT}/consul/c12_feed2_PM_MEAS.json |
| ${CONSUL_GET_APP} /usr/bin/curl -v http://127.0.0.1:8500/v1/kv/dfc_app0?raw |
| ${CBS_GET_MERGED_CONFIG} /usr/bin/curl -v http://127.0.0.1:10000/service_component_all/dfc_app0 |
| |
| *** Test Cases *** |
| |
| ######### Single file, SFTP |
| |
| Verify single event with single 1MB SFTP file. From event poll to published file |
| [TAGS] DFC_FUNCTIONAL_1 |
| [Documentation] Verify single event with single SFTP 1MB file from event poll to published file. |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh stderr=STDOUT |
| Log To Console Dfc containter clean: ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| Set Environment Variable MR_TC --tc100 |
| Set Environment Variable DR_TC --tc normal |
| Set Environment Variable DR_REDIR_TC --tc normal |
| Set Environment Variable MR_GROUPS OpenDcae-c12:PM_MEAS_FILES |
| Set Environment Variable MR_FILE_PREFIX_MAPPING PM_MEAS_FILES:A |
| Set Environment Variable DR_REDIR_FEEDS 2:A |
| Set Environment Variable FTP_FILE_PREFIXES A |
| Set Environment Variable NUM_FTPFILES 1 |
| Set Environment Variable NUM_PNFS 1 |
| Set Environment Variable FILE_SIZE 1MB |
| Set Environment Variable FTP_TYPE SFTP |
| Set Environment Variable NUM_FTP_SERVERS 1 |
| Set Environment Variable DR_FEEDS 2:A |
| Set Environment Variable DRR_SIM_IP drsim_redir |
| Set Environment Variable SFTP_SIMS sftp-server0:22 |
| Set Environment Variable FTPS_SIMS ftpes-server-vsftpd0:21 |
| |
| ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| Log To Console Simulator-start: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_UPL_APP} shell=yes |
| Log To Console Consul APP write: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_GET_APP} shell=yes |
| Log To Console Consul APP read: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CBS_GET_MERGED_CONFIG} shell=yes |
| Log To Console CBS merged configuration: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Sleep 10 |
| |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| Log To Console Dfc-start: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| DR Redir Sim Downloaded Volume Equal 1 000 000 #Verify 1 000 000 bytes published file data in DR redir sim |
| |
| ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Verify single event with single 5MB SFTP file. From event poll to published file |
| [TAGS] DFC_FUNCTIONAL_2 |
| [Documentation] Verify single event with single SFTP 5MB file from event poll to published file. |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh stderr=STDOUT |
| Log To Console Dfc containter clean: ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| Set Environment Variable MR_TC --tc101 |
| Set Environment Variable DR_TC --tc normal |
| Set Environment Variable DR_REDIR_TC --tc normal |
| Set Environment Variable MR_GROUPS OpenDcae-c12:PM_MEAS_FILES |
| Set Environment Variable MR_FILE_PREFIX_MAPPING PM_MEAS_FILES:A |
| Set Environment Variable DR_REDIR_FEEDS 2:A |
| Set Environment Variable FTP_FILE_PREFIXES A |
| Set Environment Variable NUM_FTPFILES 1 |
| Set Environment Variable NUM_PNFS 1 |
| Set Environment Variable FILE_SIZE 5MB |
| Set Environment Variable FTP_TYPE SFTP |
| Set Environment Variable NUM_FTP_SERVERS 1 |
| Set Environment Variable DR_FEEDS 2:A |
| Set Environment Variable DRR_SIM_IP drsim_redir |
| Set Environment Variable SFTP_SIMS sftp-server0:22 |
| Set Environment Variable FTPS_SIMS ftpes-server-vsftpd0:21 |
| |
| ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| Log To Console Simulator-start: ${cli_cmd_output.stdout} |
| MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_UPL_APP} shell=yes |
| Log To Console Consul APP write: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_GET_APP} shell=yes |
| Log To Console Consul APP read: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CBS_GET_MERGED_CONFIG} shell=yes |
| Log To Console CBS merged configuration: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Sleep 10 |
| |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| Log To Console Dfc-start: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| DR Redir Sim Downloaded Volume Equal 5 000 000 #Verify 5 000 000 bytes published file data in DR redir sim |
| |
| ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process docker stop $(docker ps -aq) shell=yes |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process docker rm $(docker ps -aq) shell=yes |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Sleep 10 |
| |
| Verify single event with single 50MB SFTP file. From event poll to published file |
| [TAGS] DFC_FUNCTIONAL_3 |
| [Documentation] Verify single event with single SFTP 50MB file from event poll to published file. |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh |
| Set Environment Variable MR_TC --tc102 |
| Set Environment Variable DR_TC --tc normal |
| Set Environment Variable DR_REDIR_TC --tc normal |
| Set Environment Variable MR_GROUPS OpenDcae-c12:PM_MEAS_FILES |
| Set Environment Variable MR_FILE_PREFIX_MAPPING PM_MEAS_FILES:A |
| Set Environment Variable DR_REDIR_FEEDS 2:A |
| Set Environment Variable FTP_FILE_PREFIXES A |
| Set Environment Variable NUM_FTPFILES 1 |
| Set Environment Variable NUM_PNFS 1 |
| Set Environment Variable FILE_SIZE 50MB |
| Set Environment Variable FTP_TYPE SFTP |
| Set Environment Variable NUM_FTP_SERVERS 1 |
| Set Environment Variable DR_FEEDS 2:A |
| Set Environment Variable DRR_SIM_IP drsim_redir |
| Set Environment Variable SFTP_SIMS sftp-server0:22 |
| Set Environment Variable FTPS_SIMS ftpes-server-vsftpd0:21 |
| |
| ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| Log To Console Simulator-start: ${cli_cmd_output.stdout} |
| MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_UPL_APP} shell=yes |
| Log To Console Consul APP write: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CONSUL_GET_APP} shell=yes |
| Log To Console Consul APP read: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ${cli_cmd_output}= Run Process ${CBS_GET_MERGED_CONFIG} shell=yes |
| Log To Console CBS merged configuration: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Sleep 10 |
| |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| Log To Console Dfc-start: |
| Log To Console ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| DR Redir Sim Downloaded Volume Equal 50 000 000 #Verify 50 000 000 bytes published file data in DR redir sim |
| |
| ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| Log ${cli_cmd_output.stdout} ${cli_cmd_output.stderr} |
| |
| ######### Single file, FTPS |
| # Temporarily removed due to issues with the certificates for the ftsp server simulator cert. |
| #Verify single event with single 1MB FTPS file. From event poll to published file |
| # [TAGS] DFC_FUNCTIONAL_10 |
| # [Documentation] Verify single event with single FTPS 1MB file from event poll to published file. |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh |
| # Set Environment Variable MR_TC --tc200 |
| # Set Environment Variable DR_TC --tc normal |
| # Set Environment Variable DR_REDIR_TC --tc normal |
| # Set Environment Variable NUM_FTPFILES 1 |
| # Set Environment Variable NUM_PNFS 1 |
| # Set Environment Variable FILE_SIZE 1MB |
| # Set Environment Variable FTP_TYPE FTPS |
| # ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| # MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| # DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| # Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| # DR Redir Sim Downloaded Volume Equal 1 000 000 #Verify 1 000 000 bytes published file data in DR redir sim |
| # ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| # |
| #Verify single event with single 5MB FTPS file. From event poll to published file |
| # [TAGS] DFC_FUNCTIONAL_11 |
| # [Documentation] Verify single event with single FTPS 5MB file from event poll to published file. |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh |
| # Set Environment Variable MR_TC --tc201 |
| # Set Environment Variable DR_TC --tc normal |
| # Set Environment Variable DR_REDIR_TC --tc normal |
| # Set Environment Variable NUM_FTPFILES 1 |
| # Set Environment Variable NUM_PNFS 1 |
| # Set Environment Variable FILE_SIZE 5MB |
| # Set Environment Variable FTP_TYPE FTPS |
| # ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| # MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| # DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| # Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| # DR Redir Sim Downloaded Volume Equal 5 000 000 #Verify 5 000 000 bytes published file data in DR redir sim |
| # ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| # |
| #Verify single event with single 50MB FTPS file. From event poll to published file |
| # [TAGS] DFC_FUNCTIONAL_12 |
| # [Documentation] Verify single event with single FTPS 50MB file from event poll to published file. |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/../dfc-containers-clean.sh |
| # Set Environment Variable MR_TC --tc202 |
| # Set Environment Variable DR_TC --tc normal |
| # Set Environment Variable DR_REDIR_TC --tc normal |
| # Set Environment Variable NUM_FTPFILES 1 |
| # Set Environment Variable NUM_PNFS 1 |
| # Set Environment Variable FILE_SIZE 50MB |
| # Set Environment Variable FTP_TYPE FTPS |
| # ${cli_cmd_output}= Run Process ./simulators-start.sh cwd=${SIMGROUP_ROOT} |
| # MR Sim Emitted Files Equal 0 #Verify 0 file emitted from MR sim |
| # DR Sim Published Files Equal 0 #Verify 0 file published to DR sim |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-start.sh cwd=${DFC_ROOT} |
| # Wait Until Keyword Succeeds 1 minute 10 sec MR Sim Emitted Files Equal 1 #Verify 1 file emitted from MR sim |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Query Not Published Equal 1 #Verify 1 query response for not published files |
| # Wait Until Keyword Succeeds 1 minute 10 sec DR Sim Published Files Equal 1 #Verify 1 file published to DR sim |
| # DR Redir Sim Downloaded Volume Equal 50 000 000 #Verify 50 000 000 bytes published file data in DR redir sim |
| # ${cli_cmd_output}= Run Process ${SIMGROUP_ROOT}/simulators-kill.sh |
| # ${cli_cmd_output}= Run Process ${DFC_ROOT}/dfc-kill.sh |
| # |
| |
| *** Keywords *** |
| |