diff options
author | Stefano Lattarini <stefano.lattarini@gmail.com> | 2011-06-30 14:55:43 +0200 |
---|---|---|
committer | Stefano Lattarini <stefano.lattarini@gmail.com> | 2011-07-21 17:30:22 +0200 |
commit | 15400bca303910d059f1a68f94b25cffb1a8ac2f (patch) | |
tree | 893ce00eb9d71804211809c4ee62b481494e384a /tests/parallel-tests.test | |
parent | 61b2bb0d647ea5f192e49f5f5885009ea83968be (diff) | |
download | automake-15400bca303910d059f1a68f94b25cffb1a8ac2f.tar.gz |
parallel-tests: new recognized test result 'ERROR'
* lib/am/check.am ($(TEST_SUITE_LOG)): Recognize a new test result
`ERROR'. Use it when encountering unreadable test logs (previously
a simple `FAIL' was used in this situations).
* lib/test-driver: Set the global test result to `ERROR' when the
test exit status is 99. When doing colorized output, color `ERROR'
results in magenta.
* doc/automake.texi (Log files generation and test results
recording): Update by also listing `ERROR' among the list of valid
`:test-results:' arguments.
* NEWS: Update.
* tests/trivial-test-driver: Update.
* tests/parallel-tests.test: Likewise.
* tests/parallel-tests-harderror.test: Likewise.
* tests/parallel-tests-no-spurious-summary.test: Likewise.
* tests/test-driver-global-log.test: Likewise.
* tests/test-driver-recheck.test: Likewise.
* tests/test-driver-custom-multitest-recheck.test: Likewise.
* tests/test-driver-custom-multitest-recheck2.test: Likewise.
* tests/test-driver-custom-multitest.test: Likewise.
* tests/test-driver-custom-no-html.test: Likewise.
* tests/test-driver-end-test-results.test: Likewise.
* tests/color.test: Likewise. Also, make stricter, and also test
from VPATH.
* tests/color2.test: Likewise, and improve syncing with color.test.
* tests/parallel-tests-exit-statuses.test: New test.
* tests/parallel-tests-console-output.test: Likewise.
* tests/Makefile.am (TESTS): Update.
Diffstat (limited to 'tests/parallel-tests.test')
-rwxr-xr-x | tests/parallel-tests.test | 9 |
1 files changed, 6 insertions, 3 deletions
diff --git a/tests/parallel-tests.test b/tests/parallel-tests.test index f046c3f28..95f78e736 100755 --- a/tests/parallel-tests.test +++ b/tests/parallel-tests.test @@ -68,10 +68,13 @@ $AUTOMAKE -a $MAKE check >stdout && { cat stdout; Exit 1; } cat stdout -# There should be two errors: bar.test is a hard error. -test `grep -c '^FAIL' stdout` -eq 2 +# There should be one failure and one hard error. +test `grep -c '^FAIL:' stdout` -eq 1 +test `grep -c '^ERROR:' stdout` -eq 1 test -f mylog.log -test `grep -c '^FAIL' mylog.log` -eq 2 +cat mylog.log +test `grep -c '^FAIL:' mylog.log` -eq 1 +test `grep -c '^ERROR:' mylog.log` -eq 1 test -f baz.log test -f bar.log test -f foo.log |