summaryrefslogtreecommitdiff
path: root/testsuite/driver/testlib.py
Commit message (Collapse)AuthorAgeFilesLines
...
* Pass the test name to the test optionsIan Lynagh2013-02-071-93/+90
| | | | | | | | This allows them to give framework failures. I also had to change how setTestOpts works. Now, rather than applying the options to the directory's "default options", it just stores the options to be applied for each test (i.e. once we know the test name).
* Change how the testsuite driver handles copying the test optionsIan Lynagh2013-02-071-5/+3
| | | | | We now deepcopy the options for each test, which means that the test helpers don't need to worry about sharing.
* Rename some argumentsIan Lynagh2013-02-071-4/+4
|
* Define 'when' and 'unless' helpersIan Lynagh2013-02-071-11/+11
| | | | This will reduce the number of helper functions that we need
* Simplify driver code slightlyIan Lynagh2013-02-071-2/+1
|
* Add a TEST="..." line to testsuite outputIan Lynagh2013-02-071-0/+13
| | | | | This gives hte list of tests with unexpected results, so that you can easily run them again.
* Make failing perf test output easier to readIan Lynagh2013-02-061-10/+23
|
* Eliminate *_num_fieldIan Lynagh2013-02-061-49/+11
| | | | We now use *_range_field everywhere instead
* Fix cabal01 on WindowsIan Lynagh2013-02-051-1/+1
| | | | | | | We were getting a Creating library file: dist\build\libHStest-1.0-ghc7.7.20130205.dll.a message on stderr. We can't turn it off, so now the test just normalises it away.
* Handle ^C better when threads are being used tooIan Lynagh2013-02-021-5/+15
|
* When the testsuite is ^Ced, print the summary anywayIan Lynagh2013-02-021-1/+14
|
* Make numeric-only test names a framework failureIan Lynagh2013-01-251-1/+1
|
* Make do_test catch and re-raise KeyboardInterruptIan Lynagh2013-01-251-0/+2
| | | | | This means that hitting ^C now stops the testsuite from running, rather than just killing the current test.
* Clean the .hpc directoriesIan Lynagh2013-01-241-0/+5
|
* Use .hpc.<testname> for the hpc directoryIan Lynagh2013-01-241-4/+4
| | | | | All tests used to use .hpc, which caused failures when running in parallel.
* Don't allow '/' characters in test namesIan Lynagh2013-01-241-1/+1
|
* Add a (currently very permissive) test name checkIan Lynagh2013-01-221-0/+2
| | | | | We now get a framework failure if a test name doesn't match ^[a-zA-Z0-9][a-zA-Z0-9._/-]*$
* Remove a stray colon from the framework fail messagesIan Lynagh2013-01-221-1/+1
|
* Add better support for .cmm test files.Austin Seipp2013-01-171-1/+7
| | | | | | Fixes Trac #7573. Signed-off-by: Austin Seipp <mad.one@gmail.com>
* Add a test for #7563Ian Lynagh2013-01-121-0/+12
|
* Fix Word2Float# test on 32-bitJohan Tibell2013-01-071-0/+6
|
* Only run dynamicToo001 if we have both vanilla and dynamic librariesIan Lynagh2012-12-141-0/+36
|
* Remove the 'alone' modifierIan Lynagh2012-11-171-3/+0
|
* Add if_compiler_debugged to testsuite driverIan Lynagh2012-11-101-0/+6
| | | | arrowfail001 currently fails only when DEBUG is defined.
* The asm tests pass on Linux, but not OS XIan Lynagh2012-10-131-1/+1
|
* Fix memcpy when -fPIC is onIan Lynagh2012-10-131-0/+1
| | | | We get a reference to memcpy@plt rather than memcpy
* ghcilink001 is expected to fail when ghci is dynamicIan Lynagh2012-10-121-0/+6
| | | | dynamic ghci can't load .a files
* Run all the 'alone' tests at the end of the testsuite runIan Lynagh2012-10-111-20/+22
| | | | | This is more efficient than having to wait for all threads to finish before each 'alone' test.
* Copy the flag lists before altering themIan Lynagh2012-10-111-3/+3
| | | | They are mutable values, so altering them affects other tests too
* Add 'high_memory_usage' as an alias for 'alone'Ian Lynagh2012-10-111-0/+3
|
* Add an outputdir test optionIan Lynagh2012-10-111-2/+37
| | | | | This makes it possible to share source files between tests, without having the .o/.hi files overlap
* Make it possible to test the generated assemblyJohan Tibell2012-10-091-1/+53
| | | | | | | | | | | | | | | | | | | | | | | | | | | This test framework feature is inspired by a similar feature in LLVM. The programmer writes a bit of Cmm #include "Cmm.h" // Large memcpy's should lower to calls. callMemcpy { W_ dst, src; prim %memcpy(dst "ptr", src "ptr", 1024, 4) []; } and asserts what the generated assembly should look like, modulo register naming. callMemcpy: movq ; Move arguments into place movq movl movl call memcpy Patch edited and updated by Simon Marlow, and I also added a test for unrolling memcpy and a simple constant-propagation test.
* We weren't generating a stats file for tests that only had ↵Simon Peyton Jones2012-10-031-1/+1
| | | | | | stats_range_fields perf tests I fixed this in a plausible looking way, similar to compiler_stats_range/num fields.
* Add support for per-test timeout adjustment (timeout_multiplier), and ↵Edward Z. Yang2012-09-251-8/+18
| | | | | | tighten up #367 test. Signed-off-by: Edward Z. Yang <ezyang@mit.edu>
* Print stdout diff even if stderr diff alrady fails (#7247)Joachim Breitner2012-09-211-2/+4
|
* Add some haddock space usage testsIan Lynagh2012-08-141-0/+5
|
* dead code: guess_compiler_flags()Simon Marlow2012-05-221-9/+0
|
* Rename package-conf flags to package-db.Paolo Capriotti2012-05-151-2/+2
|
* Driver tweakIan Lynagh2012-05-081-4/+4
|
* Allow OS-specific test outputs in the driverIan Lynagh2012-05-011-0/+1
|
* Simplify the stdout-* filename generation in the driverIan Lynagh2012-05-011-17/+8
|
* Testsuite driver tweak for WindowsIan Lynagh2012-04-271-3/+9
| | | | | This handles the case where we redirect stdout/stderr to a file, but the command fails quickly and the file is not actually created.
* fix bug in stats checkingSimon Marlow2012-04-261-2/+2
|
* Add combined_output option.Paolo Capriotti2012-04-231-4/+14
| | | | | | | | | Added an option to combine stdout and stderr into a single file. This is useful for ghci scripts that produce interleaved errors and normal output. Also modified check_stderr_ok so that it normalizes stderr in the same way as compile tests.
* Remove some out-of-date normalisationIan Lynagh2012-02-161-4/+0
|
* add req_smpSimon Marlow2012-02-161-0/+4
|
* Allow perf bounds to be specified as base + percentage deviationSimon Marlow2012-02-161-3/+44
| | | | | | | | | | | | | | | | | | | | | | | | | This makes it much easier to update the bounds. Instead of coming up with a suitable (min,max) pair, you just give e.g. (base, 10) to allow 10% deviation from the base figure, which can be pasted from the error. e.g. previously: - # expected value: 458700632 (amd64/Linux): - if_wordsize(64, - compiler_stats_num_field('bytes allocated', 440000000, - 480000000)), now: + if_wordsize(64, # sample from amd64/Linux 15/2/2012 + compiler_stats_range_field('bytes allocated', 360243576, 10)), Note: use stats_range_field rather than stats_num_field. I left support for the old way for now so that we can do a gradual migration. (next I suppose we should make it so that 'make accept' works for perf tests, but that's for another day)
* Make the compiler_always_flags modifiable on a per-test basisSimon Marlow2012-02-161-5/+6
| | | | Motivation: we wanted to disable -dcore-lint for the perf tests
* Add normalise_exe for removing ".exe" extensions in output on WindowsSimon Marlow2012-01-171-0/+7
|
* Count the number of tests that failed due to reqlib()Simon Marlow2012-01-061-6/+17
| | | | | | | | | | | | | | OVERALL SUMMARY for test run started at Fri Jan 6 09:46:46 GMT 2012 82 total tests, which gave rise to 820 test cases, of which 0 caused framework failures 818 were skipped 0 expected passes 2 had missing libraries <--- 0 expected failures 0 unexpected passes 0 unexpected failures
View Lorry Controller Status