[k6] Add JVM warmup phase (#2)
To account for JVM warmup effect, the k6 test suite is run twice:
initially, the whole test suite is run without recording results.
- Added environment variables to allow setting total CM-handles and
batch size for registration. By reducing total CM-handles during
warm-up, many more operations will be run.
Issue-ID: CPS-2264
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: Ib1d1e76d31719d788a3e026797faa0a425b320a2
diff --git a/k6-tests/ncmp/run-all-tests.sh b/k6-tests/ncmp/run-all-tests.sh
index 80231b9..f67b6ef 100755
--- a/k6-tests/ncmp/run-all-tests.sh
+++ b/k6-tests/ncmp/run-all-tests.sh
@@ -31,6 +31,12 @@
pushd "$(dirname "$0")" || exit 1
+echo 'Warming up JVM (warmup results will not be recorded)'
+for test_script in "${ALL_TEST_SCRIPTS[@]}"; do
+ echo "[warmup] k6 run $test_script"
+ k6 --quiet -e TOTAL_CM_HANDLES=1000 -e REGISTRATION_BATCH_SIZE=10 -e K6_MODULE_NAME="$test_script" run "$test_script" > /dev/null
+done
+
printf "Test Case\tCondition\tLimit\tActual\tResult\n" > summary.log
number_of_failures=0