diff options
author | Stefano Lattarini <stefano.lattarini@gmail.com> | 2012-04-06 13:12:25 +0200 |
---|---|---|
committer | Stefano Lattarini <stefano.lattarini@gmail.com> | 2012-04-06 21:29:30 +0200 |
commit | 8a5096d150cf9803b8963768b7366cd68edcce03 (patch) | |
tree | a49c0e54876b8b9877d7ca2df386377e7b6037d1 /t/tap-out-of-order.sh | |
parent | f8e822bbc197f01fc722aa6def7cddb4182e3c66 (diff) | |
download | automake-8a5096d150cf9803b8963768b7366cd68edcce03.tar.gz |
tests: rename 'tests/' => 't/', '*.test' => '*.sh'
When we (soon) convert the Automake testsuite to a non-recursive
make setup, we'll have to fix the entries of $(TESTS) to be
prepended with the subdirectory they are in; this will increase
the length of $(TESTS), and thus increase the possibility of
exceeding the command-line length limits on some systems (most
notably, MinGW/MSYS). See automake bug#7868 for more information.
Thus we rename the 'tests/' subdirectory to 't/', and each 'x.test'
script in there to 'x.sh'; this way, the $(TESTS) entry 'foo.test'
will become 't/foo.sh', which have the same number of characters.
* tests/: Rename ...
* t/: ... to this.
* t/*.test: Rename ...
* t/*.sh: ... to this.
* t/.gitignore: Removed as obsolete.
* t/defs: Adjust.
* t/gen-testsuite-part: Likewise.
* t/list-of-tests.mk: Likewise.
* t/ccnoco.sh: Likewise.
* t/ccnoco3.sh: Likewise.
* t/self-check-cleanup.tap: Likewise.
* t/self-check-dir.tap: Likewise.
* t/self-check-me.tap: Likewise.
* t/self-check-reexec.tap: Likewise.
* README: Likewise.
* bootstrap: Likewise
* configure.ac: Likewise.
* Makefile.am: Likewise.
* .gitignore: Likewise.
* syntax-check.mk: Likewise.
Signed-off-by: Stefano Lattarini <stefano.lattarini@gmail.com>
Diffstat (limited to 't/tap-out-of-order.sh')
-rwxr-xr-x | t/tap-out-of-order.sh | 81 |
1 files changed, 81 insertions, 0 deletions
diff --git a/t/tap-out-of-order.sh b/t/tap-out-of-order.sh new file mode 100755 index 000000000..d9f36a251 --- /dev/null +++ b/t/tap-out-of-order.sh @@ -0,0 +1,81 @@ +#! /bin/sh +# Copyright (C) 2011-2012 Free Software Foundation, Inc. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2, or (at your option) +# any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +# TAP support: +# - out-of-order test results + +am_parallel_tests=yes +. ./defs || Exit 1 + +. "$am_testauxdir"/tap-setup.sh || fatal_ "sourcing tap-setup.sh" + +cat > a.test <<END +1..3 +ok +not ok 2 # TODO +ok 71 +END + +cat > b.test <<END +1..5 +ok 1 +ok 2 +ok 4 foo # SKIP mu +not ok 2 bar # TODO um +ok 5 +END + +cat > c.test <<END +1..4 +ok 1 +ok foo +ok 4 - zardoz +not ok 3 +END + +# This is documented as an "test out of sequence" error in the +# TAP::Parser documentation. Keep it in sync with the example +# there. +cat > d.test <<'END' +1..5 +ok 1 +ok 2 +ok 15 +ok 16 +ok 17 +END + +TESTS='a.test b.test c.test d.test' $MAKE -e check >stdout \ + && { cat stdout; Exit 1; } +cat stdout + +count_test_results total=17 pass=8 fail=0 xpass=0 xfail=1 skip=0 error=8 + +test `$FGREP -c ': a.test' stdout` -eq 3 +test `$FGREP -c ': b.test' stdout` -eq 5 +test `$FGREP -c ': c.test' stdout` -eq 4 +test `$FGREP -c ': d.test' stdout` -eq 5 + +grep '^ERROR: a\.test 71 # OUT-OF-ORDER (expecting 3)$' stdout +grep '^ERROR: b\.test 4 foo # OUT-OF-ORDER (expecting 3)$' stdout +grep '^ERROR: b\.test 2 bar # OUT-OF-ORDER (expecting 4)$' stdout +grep '^ERROR: c\.test 4 - zardoz # OUT-OF-ORDER (expecting 3)$' stdout +grep '^ERROR: c\.test 3 # OUT-OF-ORDER (expecting 4)$' stdout +grep '^ERROR: d\.test 15 # OUT-OF-ORDER (expecting 3)$' stdout +grep '^ERROR: d\.test 16 # OUT-OF-ORDER (expecting 4)$' stdout +grep '^ERROR: d\.test 17 # OUT-OF-ORDER (expecting 5)$' stdout + +: |