summaryrefslogtreecommitdiff
path: root/INSTALL
diff options
context:
space:
mode:
authorRichard Levitte <levitte@openssl.org>2019-09-11 11:05:11 +0200
committerRichard Levitte <levitte@openssl.org>2019-09-12 14:38:00 +0200
commite3d9a6b5f0157d92aa5bbfdb0f95fd55be9a0396 (patch)
treeb23eea44c997f5de0dbb2ff6de3594e1600364da /INSTALL
parentf3503cb0f6ffe19c03c731b4b6069f26584917b4 (diff)
downloadopenssl-new-e3d9a6b5f0157d92aa5bbfdb0f95fd55be9a0396.tar.gz
Rework test/run_tests.pl to support selective verbosity and TAP copy
This includes a complete rework of how we use TAP::Harness, by adding a TAP::Parser subclass that allows additional callbacks to be passed to perform what we need. The TAP::Parser callbacks we add are: ALL to print all the TAP output to a file (conditionally) to collect all the TAP output to an array (conditionally) EOF to print all the collected TAP output (if there is any) if any subtest failed To get TAP output to file, the environment variable HARNESS_TAP_COPY must be defined, with a file name as value. That file will be overwritten unconditionally. To get TAP output displayed on failure, the make variable VERBOSE_FAILURE or VF must be defined with a non-emoty value. Additionally, the output of test recipe names has been changed to only display its basename. Reviewed-by: Matt Caswell <matt@openssl.org> (Merged from https://github.com/openssl/openssl/pull/9862)
Diffstat (limited to 'INSTALL')
-rw-r--r--INSTALL14
1 files changed, 10 insertions, 4 deletions
diff --git a/INSTALL b/INSTALL
index 9ea1f11513..c02ceb1255 100644
--- a/INSTALL
+++ b/INSTALL
@@ -911,11 +911,17 @@
malfunction with Perl). You may want increased verbosity, that
can be accomplished like this:
- $ make VERBOSE=1 test # Unix
+ Verbosity on failure only (make macro VERBOSE_FAILURE or VF):
- $ mms /macro=(VERBOSE=1) test ! OpenVMS
+ $ make VF=1 test # Unix
+ $ mms /macro=(VF=1) test ! OpenVMS
+ $ nmake VF=1 test # Windows
- $ nmake VERBOSE=1 test # Windows
+ Full verbosity (make macro VERBOSE or V):
+
+ $ make V=1 test # Unix
+ $ mms /macro=(V=1) test ! OpenVMS
+ $ nmake V=1 test # Windows
If you want to run just one or a few specific tests, you can use
the make variable TESTS to specify them, like this:
@@ -926,7 +932,7 @@
And of course, you can combine (Unix example shown):
- $ make VERBOSE=1 TESTS='test_rsa test_dsa' test
+ $ make VF=1 TESTS='test_rsa test_dsa' test
You can find the list of available tests like this: