summaryrefslogtreecommitdiff
path: root/testsuite/driver/testlib.py
Commit message (Collapse)AuthorAgeFilesLines
...
* add test for #5747Simon Marlow2012-01-061-0/+8
|
* Ignore IDLE in .prof.sample (fix spurious profthreaded failures)Simon Marlow2011-11-301-1/+1
|
* add req_shared_libs and use itSimon Marlow2011-11-161-0/+4
|
* Set -no-hs-main if the test is not Haskell codeSimon Marlow2011-11-161-0/+6
| | | | Required by the changes to GHC to generate main() when linking.
* Fix meaning of the only_ways field (fixed cgrun057(normal) in validate)Simon Marlow2011-11-161-1/+1
| | | | | | | | | | | | | The default setting for only_ways was [], which meant "all ways". However, it's really useful to have [] mean "no ways". In cgrun057 I used only_ways(prof_ways) to mean "only run this in the profiling ways", but if profiling is disabled then prof_ways = [] and this doesn't do what we want. Profiling is normally disabled in validate, but I had it enabled because I was testing profiling. So now only_ways defaults to None, which means "all ways", and [] now means "no ways".
* remove accidentally-left-in debugging outputSimon Marlow2011-11-141-2/+0
|
* shouldn't fail the test if we are accepting outputSimon Marlow2011-11-091-4/+8
|
* normalise slashes in error messagesSimon Marlow2011-11-091-0/+2
| | | | Fixes various Windows test failures (T3103, plugins04)
* allow error message normalisation to be customisedSimon Marlow2011-11-091-9/+23
|
* Don't give normalised diff outputIan Lynagh2011-11-051-5/+0
| | | | | | It is in general illegible (e.g. all newlines have been removed), and in the rare cases you really need it then you can diff the normalised outputs manually.
* some more profiling testsSimon Marlow2011-11-021-0/+4
|
* code for comparing profile outputsSimon Marlow2011-11-021-1/+48
| | | | | | | To add a sample profile, create a file <test>.prof.sample. The test driver normalises the file to remove the actual data (timing and allocations), so that the test will compare the shape of the profile and the entry counts only.
* Add more Safe Haskell tests for new designDavid Terei2011-10-251-3/+3
|
* Merge branch 'master' of http://darcs.haskell.org/testsuiteIan Lynagh2011-10-181-15/+21
|\
| * generalise cmd_prefix to a general function to transform the commandSimon Marlow2011-10-181-15/+21
| |
* | Get rid of the multisrc* test typesIan Lynagh2011-10-181-15/+2
| | | | | | | | | | | | | | They added too much complexity for their very few uses. Fixes: framework failure for tc251(runTest) Unhandled exception: too many values to unpack
* | Catch any uncaught exceptions in test_common_workIan Lynagh2011-10-181-89/+92
|/ | | | | | | | Before, the testsuite just printed Unhandled exception in thread started by <function test_common_thread at 0x188bde8> [...] and carried on when using multiple threads, whereas it would just fall over in single-threaded mode.
* Have multi[src,mod] test ways clean up after themselves.David Terei2011-10-111-0/+6
|
* add a test for foreign imports in GHCiSimon Marlow2011-10-061-0/+3
|
* Tell python to let us use the "with X:" syntaxIan Lynagh2011-09-251-8/+4
| | | | This fixes the testsuite driver with python 2.5. Patch from Florian Weimer.
* Don't use "with lock" syntax in the driverIan Lynagh2011-09-241-1/+8
| | | | | Older versions of python, including that on the Windows nightly builder, throw "SyntaxError: invalid syntax".
* Rejig how performance test stats are storedIan Lynagh2011-09-181-6/+10
| | | | | | In particular, this allows more specific results to be specified, e.g. if_wordsize(64, stats_num_field('foo', 50, 54)), if_platform('x86_64-apple-darwin', stats_num_field('foo', 62, 66)),
* Don't clean tests that we aren't runningIan Lynagh2011-09-051-7/+8
| | | | | | | | This can make it a lot faster to run a single test. You can run make CLEANUP=1 CLEAN_ONLY=YES to clean everything without running any tests.
* Improve check-files-written modeIan Lynagh2011-09-041-20/+48
| | | | Also look for files that are written but aren't cleaned
* Improve the check-files-written testsuite driver codeIan Lynagh2011-09-041-17/+23
|
* Check explicitly for writes to ghci_historyIan Lynagh2011-09-011-4/+16
|
* Improve the check-files-written testsuite driver functionalityIan Lynagh2011-09-011-21/+68
|
* Use True/False rather than 1/0 for opts.aloneIan Lynagh2011-08-081-1/+1
|
* Add support for checking whether files are written by more than one testIan Lynagh2011-08-071-9/+122
| | | | | | | | | | | | | | | | | | | | Work in progress, but largely works. Known issues: * only supported when using the timeout program * 'test.strace' files aren't cleaned, as they end up in the root directory rather than the test's directory * Doesn't yet track what the current directory is, so finds several files like "A.o" being written by multiple tests (and conversely, may be missing writes to the same file from different directories) * Lots of tests write to $HOME/.ghc/ghci_history. We should probably be passing ghci a flag to stop this from happening. * Some .strace lines aren't understood yet, causing framework failures * One .strace file can cause muiltiple framework failures, if it contains lots of lines that aren't understood Performance: Threads fast testsuite time fast testsuite time with checks 1 16:36.14 25:16.07 5 5:33.95 8:04.05
* Testcase for objective-c++ compilation (trac #5150)Peter Wortmann2011-08-061-0/+5
|
* Fix a framework failure on Windows when accepting output, and allowSimon Marlow2011-08-031-13/+8
| | | | | accepting output when the output file does not exist (it is now created).
* support globbing in extra_clean([...])Simon Marlow2011-08-031-4/+5
|
* fix a bug in displaying diffs when there is no expected outputSimon Marlow2011-07-201-2/+2
|
* When the output files differ, present the diffs between the *actual*Simon Marlow2011-07-201-4/+10
| | | | | | | output, not the normalised output. The latter may have newlines removed, making the diff unreadable. I broke this recently, but it was only working by accident, now it is working by design (and is commented, to boot).
* Fix a driver problem with older versions of pythonIan Lynagh2011-07-191-1/+3
|
* Fix some (significant!) white spaceIan Lynagh2011-07-141-1/+1
|
* Remove used of python 2.5 featureDavid Terei2011-07-141-12/+15
|
* Make and use a req_interp helperIan Lynagh2011-07-131-0/+4
| | | | | Tests can now specify that they require the interpreter (i.e. that they use one of ghci, annotations, TH, etc).
* Handle missing stderr filesIan Lynagh2011-07-131-3/+10
| | | | Sometimes, "prog 2> err" won't actually create err on Windows.
* Clean .comp.stats filesIan Lynagh2011-07-081-1/+1
|
* Improvements to testsuite to allow more complex testsDavid Terei2011-07-061-55/+103
|
* Fix spurious failure in ghcpkg05 in the nightly buildSimon Marlow2011-06-281-3/+3
|
* Expect 4006 to fail on msysIan Lynagh2011-06-231-0/+12
| | | | | | | In the 65001 codepage, we can't even cat the expected output on msys: $ cat 4006.stdout It works here cat: write error: Permission denied
* Print the reason tests fail in the testsuite summary (#5024)Ian Lynagh2011-06-171-6/+36
|
* When tests return 'fail', return a 'reason' tooIan Lynagh2011-06-171-38/+52
| | | | We don't do anything with the reason yet, but we will shortly...
* Show directories in testsuite summary; partially fixes #5024Ian Lynagh2011-06-151-21/+28
|
* Fix bug in mutlisrc compile not picking up compilation errors.David Terei2011-06-141-1/+3
|
* Add test for new ghc mem* prim opsDavid Terei2011-05-311-9/+24
|
* Tests for trac #5025.Austin Seipp2011-04-031-0/+5
| | | | | Also teach the testsuite how to compile objective-c code with .m as a suffix.
* cope if the compiler doesn't tell us the "Global Package DB"Simon Marlow2010-12-031-10/+12
|