summaryrefslogtreecommitdiff
path: root/tests
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'maint'Stefano Lattarini2011-05-313-4/+9
|\ | | | | | | | | | | | | * maint: automake, aclocal: honour configure-time AUTOCONF and AUTOM4TE build: the user can override AUTOM4TE, AUTORECONF and AUTOUPDATE too tests/README: fix example about `make -e' usage
| * build: the user can override AUTOM4TE, AUTORECONF and AUTOUPDATE tooStefano Lattarini2011-05-302-1/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Our build system allows the user to override AUTOCONF and AUTOHEADER at configure time, and honours these overrides in our testsuite. But it didn't do the same with AUTOM4TE, AUTORECONF and AUTOUPDATE. This change fixes that inconsistency. * configure.ac (am_AUTOM4TE, am_AUTOUPDATE, am_AUTORECONF): New AC_SUBSTitutions. Update comments. * tests/defs.in ($AUTOUPDATE): Default to `@am_AUTOUPDATE@' now. ($AUTOM4TE): New variable, defaulting to `@am_AUTOM4TE@'. ($AUTORECONF): New variable, defaulting to `@am_AUTORECONF@'. * doc/Makefile.am ($(srcdir)/amhello-1.0.tar.gz): Update.
| * tests/README: fix example about `make -e' usageRalf Wildenhues2011-05-221-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | * tests/README (Section "Writing test cases" subsection "Do"): When some variable is never initialized in the Makefile, `-e' is not necessary in order to override it. DESTDIR is such a variable: we ensure that we do not ever initialize it. And as such, it is quite portable to use: $ make DESTDIR=/foo/bar install and in fact, quite widely used. So our example about when `make -e' is required, which references the `DESTDIR' variable, is poorly chosen, if not downright wrong. Rewrite it to use `prefix' as the overridden variable instead.
* | testsuite: each test case depends on `defs-static'Stefano Lattarini2011-05-272-4/+4
| | | | | | | | | | * tests/Makefile.am ($(TEST_LOGS)): Depends on `defs-static' too. Simplify comments.
* | Merge branch 'maint'Stefano Lattarini2011-05-206-15/+24
|\ \ | |/ | | | | | | | | | | * maint: testsuite: avoid re-running few tests with 'parallel-tests' option testsuite: allow tests to avoid the use of 'parallel-tests' option tests/README: update obsoleted advice
| * testsuite: avoid re-running few tests with 'parallel-tests' optionStefano Lattarini2011-05-204-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some tests in our testsuite use the 'simple-tests' driver only marginally, or simply as a mean to conveniently check unrelated invariants. It makes little sense to force these tests to also run with the 'parallel-tests' Automake option active, as doing so offers no real gain in coverage, while often causing a measurable overhead in execution time (for an already too-slow testsuite). * tests/pr401.test (parallel_tests): Define to "no", to prevent the generation of a sibling test script using the 'parallel-tests' driver. * tests/pr401b.test: Likewise. * tests/pr401c.test: Likewise.
| * testsuite: allow tests to avoid the use of 'parallel-tests' optionStefano Lattarini2011-05-202-3/+13
| | | | | | | | | | | | | | | | * tests/gen-parallel-tests: Do not generate "siblings" for tests that explicitly define the `parallel_tests', whether to "yes" or to any other value. Extend heading comments to give a rationale for this behaviour. * tests/README: Update.
| * tests/README: update obsoleted adviceStefano Lattarini2011-05-201-8/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/README (Section "Writing test cases" subsection "Do"): Do not suggest to use the `*-p.test' pattern for the names of hand-written tests which use the `parallel-tests' Automake option. Not only is this not respected by the existing tests, but it is more likely to cause conflicts with auto-generated tests. So, suggest to *avoid* using the `*-p.test' pattern in names of hand-written tests instead. (Section "Writing test cases" subsection "Do not"): When suggesting not to override Makefile variables using command line arguments, do not use the badly outdated variables `U' and 'ANSI2KNR' in the example; instead, use the more common and typical `DESTDIR'.
* | Merge branch 'maint'Stefano Lattarini2011-05-191-1/+1
|\ \ | |/ | | | | | | * maint: test defs: rename requirement 'non-cross' -> 'native'
| * test defs: rename requirement 'non-cross' -> 'native'Stefano Lattarini2011-05-191-1/+1
| | | | | | | | | | | | | | | | * tests/defs.in (non-cross): Rename requirement ... (native): ... to this, which is clearer and fits the existing lingo better. Suggestion by Ralf Wildenhues.
* | Merge branch 'maint'Stefano Lattarini2011-05-151-3/+47
|\ \ | |/ | | | | | | * maint: testsuite: be more cross-compile friendly
| * testsuite: be more cross-compile friendlyStefano Lattarini2011-05-151-3/+47
| | | | | | | | | | | | | | | | * tests/defs.in (cross_compiling): New subroutine. (am__tool_prefix): New internal variable. (gcc, g++, gcj): Force the use of the correct "tool prefix" when cross compiling. (gfortran, g77, non-cross): New requirements.
* | Merge branch 'test-repeated-options-portability-fix'Stefano Lattarini2011-05-151-4/+8
|\ \
| * | tests: fix portability issues in 'repeated-options.test'Stefano Lattarini2011-05-151-4/+8
| | | | | | | | | | | | | | | | | | * tests/repeated-options.test: Do not assume that object files have `.o' suffix and executables have no default suffix; instead, use `$(OBJEXT)' and `$(EXEEXT)'.
* | | Merge branch 'maint'Stefano Lattarini2011-05-071-2/+2
|\ \ \ | | |/ | |/| | | | | | | * maint: tests: fix spurious failure of txinfo21.test on FreeBSD
| * | tests: fix spurious failure of txinfo21.test on FreeBSDStefano Lattarini2011-05-071-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | * tests/txinfo21.test: Use the `is_newest' subroutine instead of the `ls -t' hack to to determine whether a file has been updated. This is required because at least FreeBSD `ls' do not sort files with the same timestamp in alphabetical order when using the `-t' option.
* | | Merge branch 'test-extradep-fix'Stefano Lattarini2011-05-072-6/+12
|\ \ \
| * | | tests: fix spurious failure of extradep.test on FreeBSDStefano Lattarini2011-05-072-6/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/extradep.test: When using `ls -t' to determine whether a file has been updated, make sure to use as reference a file whose timestamp is expected to be *strictly* older that that of the file being checked. This is required because at least FreeBSD `ls' do not sort files with the same timestamp in alphabetical order when using the `-t' option. * tests/extradep2.test: Likewise.
* | | | Merge branch 'maint'Stefano Lattarini2011-05-041-0/+10
|\ \ \ \ | | |/ / | |/| | | | | | | | | | | | | | With some edits to `tests/defs' and `ChangeLog', to reflect the fact that in master we already had a `yacc' requirement, and no more had an explicitly-recognized `bison' requirement.
| * | | tests defs: allow requirements for compilers (mostly dummy)Stefano Lattarini2011-05-041-1/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Most of the new requirements that are now accepted in `$required' as consequence of this patch are still dummy. They are planned to be implemented only in master (or in some derived branch), but having them here (even just as no-op) will allow for an easier integration/backporting of potential new testcases. * tests/defs.in (cc, c++, fortran, fortran77): New requirements, still dummy. (flex): New requirement, picking LEX for configure. (lex): New requirement, alias for `flex'. A more appropriate implementation, looking for a generic `lex' program, will follow in the future. (yacc): New requirement, alias for `bison'. A more appropriate implementation, looking for a generic `yacc' program, will follow in the future.
* | | | Merge branch 'tests-man-fixes'Stefano Lattarini2011-05-032-0/+6
|\ \ \ \
| * | | | tests: add forgotten test scripts to $(TESTS)Stefano Lattarini2011-05-032-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/Makefile.am (TESTS): Added test scripts man[678].test, which have been present on the filesystem and in the repository, but which had erroneously been left out from $(TESTS).
* | | | | tests: ensure verbose printing of captured make outputStefano Lattarini2011-05-032-4/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/libtool7.test: Ensure verbose printing of captured make output. * tests/libtool9.test: Likewise.
* | | | | tests: fix spurious failure in 'color2.test'Stefano Lattarini2011-05-031-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/color2.test: If $MAKE contains command-line arguments (as in e.g., "make -j2"), expect's directive "spawn $env(MAKE)" fails spuriously, because it tries to run "$MAKE" as a single command. Fix this with proper uses of the TCL `eval' builtin.
* | | | | tests: fix self check spurious failure with older bash versionsStefano Lattarini2011-05-011-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/self-check-cleanup.test: Add trailing `:' to the test code passed to $SHELL, otherwise older versions of bash (at least 2.05 and 3.2.39) fail to correctly remove the temporary directory in the exit trap.
* | | | | testsuite: more environment sanitizationStefano Lattarini2011-04-295-17/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/defs: Move the checks verifying that the variables `me', `parallel_tests' and `required' aren't set in the environment ... * tests/defs-static.in: ... in here, with some optimizations to avoid useless forks. Also, do the same checks for the variables `original_AUTOMAKE' and `original_ACLOCAL' too. * tests/self-check-env-sanitize.test: Update. * tests/Makefile.am (TESTS_ENVIRONMENT): Unset also variables `original_AUTOMAKE' and `original_ACLOCAL'.
* | | | | Merge branch 'am-tests-environment-fix-merge'Stefano Lattarini2011-04-241-4/+4
|\ \ \ \ \
| * | | | | tests: fix spurious failure (non-renamed AM_TESTS_SETUP usage)Stefano Lattarini2011-04-241-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/parallel-tests-reset-term.test: Use AM_TESTS_ENVIRONMENT instead of AM_TESTS_SETUP (which has been removed in commit v1.11-349-g12f48fa). Fix spurious failure introduced by merge `v1.11-781-gfeed175'.
* | | | | | Merge branch 'maint'Stefano Lattarini2011-04-241-4/+15
|\ \ \ \ \ \ | | |_|/ / / | |/| | | |
| * | | | | Merge branch 'parallel-tests-testname-vpath-fix' into maintStefano Lattarini2011-04-241-4/+15
| |\ \ \ \ \
| | * | | | | tests: fix spurious failure in a test on TESTS (VPATH-related)Stefano Lattarini2011-04-241-4/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * check-tests-in-builddir.test: When not using the parallel-tests option, do not check that VPATH components are not present in the displayed test name, since the simple-tests driver do not try to strip them.
* | | | | | | Merge branch 'fix-env-selfcheck'Stefano Lattarini2011-04-241-0/+1
|\ \ \ \ \ \ \
| * | | | | | | tests: fix spurious failure in self-check-env-sanitize.testStefano Lattarini2011-04-241-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/self-check-env-sanitize.test: Open file descriptor `5' to stdout. Fix spurious failure introduced by merge `v1.11-788-g3b0c8d5'.
* | | | | | | | Merge branch 'maint'Stefano Lattarini2011-04-235-0/+68
|\ \ \ \ \ \ \ \ | | |/ / / / / / | |/| | | | | |
| * | | | | | | test: self check subroutines for skipping/failing of testsStefano Lattarini2011-04-233-0/+49
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/self-check-report.test: New test. * tests/Makefile.am (TESTS): Update.
| * | | | | | | test defs: new subroutines for test skipping/failing.Jim Meyering2011-04-232-12/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/defs.in (Exit): Move definition of this function earlier. (warn_, skip_, fail_, framework_failure_): New functions, inspired to the homonyms in gnulib's tests/init.sh. ($stderr_fileno_): New global variable, used by the new functions above. * tests/README: Updated. From a suggestion by Ralf Wildenhues.
* | | | | | | | Merge branch 'maint'Stefano Lattarini2011-04-234-37/+1
|\ \ \ \ \ \ \ \ | |/ / / / / / / | | / / / / / / | |/ / / / / / |/| | | | | |
| * | | | | | tests: fix typo (copy & paste blunder) in heading commentStefano Lattarini2011-04-231-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/maintclean-vpath.test: Correctly refer to the sister test as `maintclean.test', not as `maintclean-vpath.test'.
| * | | | | | tests: remove redundant test `mclean.test'Stefano Lattarini2011-04-233-33/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/mclean.test: Remove, it's a weak grepping test completely superseded by the much more complete `maintclean.test'. * tests/Makefile.am (TESTS): Update.
* | | | | | | Merge branch 'maint'Stefano Lattarini2011-04-234-11/+30
|\ \ \ \ \ \ \ | |/ / / / / /
| * | | | | | testsuite: more environment sanitizationStefano Lattarini2011-04-224-10/+30
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/defs.in: Sanity check: abort if any of `parallel_tests' or `required' is in the environment. ($sed_unindent_prog): Initialize to empty, to avoid interferences from the environment. * tests/self-check-me-in-env.test: Renamed to ... * tests/self-check-env-sanitize.test: ... this, and extended. * tests/Makefile.am (TESTS): Update. (TESTS_ENVIRONMENT): Unset variables `parallel_tests' and `required'. Adjust comments.
* | | | | | | tests: in self-checks, use $SHELL, not /bin/shStefano Lattarini2011-04-191-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/self-check-me-in-env.test: Include `./defs-static' to get the definition of `$SHELL'. Use `$SHELL' instead of `/bin/sh' to execute the tests.
* | | | | | | tests: prefer AM_TESTS_ENVIRONMENT to TESTS_ENVIRONMENTStefano Lattarini2011-04-192-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/Makefile.am (TESTS_ENVIRONMENT): Renamed to ... (AM_TESTS_ENVIRONMENT): ... this.
* | | | | | | Merge branch 'me-override-fix'Stefano Lattarini2011-04-194-0/+41
|\ \ \ \ \ \ \ | |/ / / / / / | | | / / / / | |_|/ / / / |/| | | | |
| * | | | | tests: don't allow `$me' to be overridden from the environmentStefano Lattarini2011-04-194-0/+41
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/defs.in: Sanity check: abort if $me is in the environment. * tests/self-check-me-in-env.test: New test. * tests/Makefile.am (TESTS_ENVIRONMENT): Unset variable `me'. (TESTS): Update. Suggestion by Ralf Wildenhues.
* | | | | | Merge branch 'am-tests-environment'Stefano Lattarini2011-04-193-10/+10
|\ \ \ \ \ \
| * | | | | | check: rename AM_TESTS_SETUP -> AM_TESTS_ENVIRONMENTStefano Lattarini2011-04-183-10/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The AM_TESTS_SETUP naming was not a good one after all. It may be technically more correct than AM_TESTS_ENVIRONMENT, but the latter is a better one simply because it is easier to remember, and even if you've never heard of it and only know the semantics of TESTS_ENVIRONMENT, you can have a straightforward way to figure out how AM_TESTS_ENVIRONMENT would work. * tests/check.am (am__check_pre): Update. * doc/automake.in (Simple Tests using parallel-tests): Update. * tests/parallel-tests-am_tests_setup.test: Renamed ... * tests/parallel-tests-am_tests_environment.test: ... to this, and updated. * tests/Makefile.am (TESTS): Update. Suggestion and motivation by Ralf Wildenhues.
* | | | | | | Merge branch 'maint'Stefano Lattarini2011-04-171-6/+9
|\ \ \ \ \ \ \ | | |/ / / / / | |/| | | | |
| * | | | | | test defs: allow overriding of `$me'Stefano Lattarini2011-04-171-1/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/defs.in ($me): Allow overriding by the including test script. Add some explicative comments.
* | | | | | | coverage: more tests on the parallel-tests driverStefano Lattarini2011-04-174-0/+164
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * tests/parallel-tests-interrupt.test: New test. * tests/parallel-tests-reset-term.test: Likewise. * tests/Makefile.am (TESTS): Update.