Increase robustness for TCA
Enhanced TCA robustness against unprovisioned topics.
When the configuration tells TCA to subscribe to a non-existent MR topic,
TCA will attempt but stop because subscribing to such topics resulted
failure. The enhancements implemented here will test for sub topic, and if
non-existent, make a publish to create the topic.
Additional enhancements include:
1. restart TCA is the number of workers is below expected (3);
2. allow MR subscriber group and id be set via environment variables
DMAAPSUBGROUP and DMAAPSUBID.
3. Minor version is bumped.
Issue-ID: DCAEGEN2-502
Change-Id: I3414a96706a1b720184cd657324db4d11db12590
Signed-off-by: Lusheng Ji <lji@research.att.com>
diff --git a/tca-cdap-container/Dockerfile b/tca-cdap-container/Dockerfile
index 5cd1267..2c57ff2 100644
--- a/tca-cdap-container/Dockerfile
+++ b/tca-cdap-container/Dockerfile
@@ -16,13 +16,15 @@
FROM caskdata/cdap-standalone:4.1.2
-RUN apt-get update && apt-get install -y netcat jq iputils-ping wget vim
+RUN apt-get update && apt-get install -y netcat jq iputils-ping wget vim curl
COPY get-tca.sh /opt/tca/get-tca.sh
RUN /opt/tca/get-tca.sh
COPY tca_app_config.json /opt/tca/tca_app_config.json
COPY tca_app_preferences.json /opt/tca/tca_app_preferences.json
COPY restart.sh /opt/tca/restart.sh
RUN chmod 755 /opt/tca/restart.sh
+COPY mr-watchdog.sh /opt/tca/mr-watchdog.sh
+RUN chmod 755 /opt/tca/mr-watchdog.sh
#COPY host.aliases /etc/host.aliases
#RUN echo "export HOSTALIASES=/etc/host.aliases" >> /etc/profile