summaryrefslogtreecommitdiff
path: root/selftest/wscript
Commit message (Collapse)AuthorAgeFilesLines
* selftest: pass location of perl executable from waf to test-envsUri Simchoni2017-12-221-0/+3
| | | | | | | | | | | | | | | | | | | | Many perl scripts in the codebase are executables with a "/usr/bin/perl" shebang. Running them as executables is not portable as some OS's have a different location for the perl interpreter. During the configuration process, waf finds the location of the perl interpreter. Some or all invocations of perl scripts from within test environment setup code are actually "$PERL <script>", but since PERL env var is typically not set, this amounts to the unportable "<script>", which invokes /usr/bin/perl. This patch exports the location of perl as found by the configuration process to the test environment, causing "$PERL <script>" to be "<correct place of perl interpreter> <script>". Signed-off-by: Uri Simchoni <uri@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* selftest: use an additional directory of knownfail/flapping filesDouglas Bagnall2017-06-031-1/+5
| | | | | | | | | | | This makes it easier to add a temporary knownfail to cover a patch series. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Sat Jun 3 13:55:41 CEST 2017 on sn-devel-144
* selftest: Actually run python3 tests during the selftestAndrew Bartlett2017-05-201-0/+4
| | | | | | | | | | | These previously only ran if the develper was using EXTRA_PYTHON in their OS environment Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Sat May 20 02:26:33 CEST 2017 on sn-devel-144
* selftest: Disable RODC tests with MIT KDCAndreas Schneider2017-04-291-1/+1
| | | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlet <abartlet@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* selftest: Start MIT KDC if Kerberos is from MITAndreas Schneider2017-04-291-0/+3
| | | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlet <abartlet@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* waf --test-list takes a filename argumentDouglas Bagnall2017-02-101-1/+0
| | | | | Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* script/autobuild.py: try make test TESTS=samba3.*ktest for samba-systemkrb5Stefan Metzmacher2017-01-101-0/+4
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* selftest/wscript: format perftest as jsonDouglas Bagnall2016-08-311-1/+4
| | | | | | | This makes it easier to use with common web-based graphing systems. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* selftest: add an option to specify the test listDouglas Bagnall2016-08-311-1/+8
| | | | | | | | | | | | | | | | | | | | This can be used to override the default test lists used by `make test` and `make perftest`. This tests can either be programmatically generated (as is done for the defaults -- see selftest/tests.py for an example), or from a static list. For the generated lists, append a pipe symbol: make test TEST_LIST='/bin/sh /tmp/tests.sh|' and omit the pipe for a static list: make test TEST_LIST='/tmp/tests.txt' There are likely other useful modes of operation -- see `perldoc open` for the wondrous details. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* make perftest: for performance testingDouglas Bagnall2016-08-311-4/+12
| | | | | | | | | | This runs a selection of subunit tests and reduces the output to only the time it takes to run each test. The tests are listed in selftest/perf_tests.py. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* selftest: Remove binary mappings from the build system.Adrian Cochrane2015-06-081-9/+1
| | | | | | Signed-off-by: Adrian Cochrane <adrianc@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* selftest: use env.SELFTEST_PREFIX to define subunit_cacheStefan Metzmacher2015-01-191-1/+1
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* selftest: Always enable dns fakeing.Andreas Schneider2014-12-181-2/+6
| | | | | | | | FIXME: This should be removed once we fixed adding records to the DNS server using nsupdate! Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* selftest: Define if we should fake dns resolving.Andreas Schneider2014-12-181-0/+3
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* selftest: Preload resolv_wrapper in selftest.Andreas Schneider2014-12-181-0/+1
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Don't assume st/subunit being present means it was generated by the current ↵Jelmer Vernooij2014-11-301-6/+8
| | | | | | | | | | | process. This fixes --list. Change-Id: I75fc765757e06861cf3bb489246e0845564a1123 Signed-off-by: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Print number of slow tests from script rather than wscript.Jelmer Vernooij2014-11-241-3/+2
| | | | | | | | | | Change-Id: I6eaa0803b95cc81f514a2176f4e06f1e3fff4077 Signed-Off-By: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Jelmer Vernooij <jelmer@samba.org> Autobuild-Date(master): Mon Nov 24 13:06:46 CET 2014 on sn-devel-104
* build: fix check for subunit file when selftest prefix is givenMichael Adam2014-10-301-2/+3
| | | | | | | | Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Thu Oct 30 22:45:45 CET 2014 on sn-devel-104
* selftest: only use Options.options.SELFTEST_PREFIX if it's not the defaultStefan Metzmacher2014-10-301-3/+6
| | | | | | | | | | | | | The --with-selftest-prefix option is typically specified as argument to './configure' ! Overwriting it for 'waf testonly' should only happen with an explicit 'waf testonly --with-selftest-prefix=/some/path'. This fixes a regression introduced by commit edc1cedf932de2bc068da9a5db844ac4c48f4324 (selftest: Actually honor --with-selftest-prefix). Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* selftest: report the 10 slowest tests (by default) make the number configurableMatthieu Patou2014-10-171-0/+10
| | | | | | | Change-Id: Ib1cf50199d110827a25cf198b40738f3c72cbe17 Signed-off-by: Matthieu Patou <mat@matws.net> Reviewed-by: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* selftest: Actually honor --with-selftest-prefix.Jelmer Vernooij2014-10-141-7/+11
| | | | | | Change-Id: Ie8c995a273781309224e17b8970a864479444036 Signed-Off-By: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Don't import into testr when --load-list was specified, as testr willJelmer Vernooij2014-10-141-1/+3
| | | | | | | | take care of that itself. Change-Id: I3d57f4cfafdd48751dfbd145f220dc5cf000ec3f Signed-Off-By: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Run duplicate symbol check as just another test, rather than as part of "waf ↵Jelmer Vernooij2014-10-141-3/+0
| | | | | | | | | | | | test". This allows it to be scheduled independently as part of a parallel test run, and reduces the overhead of "waf test". Change-Id: I780fd2c4dd711ed27df73f56de98e7f1ffd53aaf Signed-Off-By: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Bug: https://bugzilla.samba.org/show_bug.cgi?id=10875
* selftest: Preload socket_wrapper.Andreas Schneider2014-04-171-0/+1
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* selftest: Preload nss_wrapperAndreas Schneider2014-04-171-0/+1
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* selftest: Pass uid_wrapper library to selftest and preload it.Andreas Schneider2014-04-171-0/+2
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* selftest: Use the absolute path to the ldb modules.Andreas Schneider2014-02-211-1/+1
| | | | | | | This fixes 'make test' on Fedora with external ldb. Reviewed-by: Guenther Deschner <gd@samba.org> Reviewed-by: Alexander Bokovoy <ab@samba.org>
* selftest: setup {NMBD,WINBINDD,SMBD}_VALGRINDStefan Metzmacher2013-12-111-0/+3
| | | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* selftest: VFSLIBDIR is not needed, the waf build knows where to find modules ↵Andrew Bartlett2013-05-281-1/+0
| | | | | | | | | | | | | automatically This is why was relinks on install, because it is fixing these internal variables up. Andrew Bartlett Reviewed-by: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: David Disseldorp <ddiss@samba.org>
* Tests: avoid adding python options that are functions in the envMatthieu Patou2013-01-211-1/+6
| | | | | | | This fix errors when running test --testenv --screen Signed-off-by: Matthieu Patou <mat@matws.net> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* build: Use ntlm_auth from source3 as the only ntlm_auth installed on the systemAndrew Bartlett2012-11-221-1/+1
| | | | | | | | | | The ntlm_auth4 binary is untested, and is missing major features compared with the source3 binary. The two are being slowly merged, but I have not finished that. Andrew Bartlett Reviewed-by: Andreas Schneider <asn@samba.org>
* selftest: Add --random-order option.Jelmer Vernooij2012-10-271-0/+4
|
* samba4-tests: Move 'samba.tests.source' up.Jelmer Vernooij2012-09-271-1/+2
| | | | | | | | We would like to run this as early as possible so we get a quick failure when there is trailing whitespace. Autobuild-User(master): Jelmer Vernooij <jelmer@samba.org> Autobuild-Date(master): Thu Sep 27 20:26:27 CEST 2012 on sn-devel-104
* lib/param: Also enable vlp when --enable-selftest is specifiedAndrew Bartlett2012-08-061-0/+4
|
* TDB2: make SAMBA use tdb1 again for the moment.Rusty Russell2012-06-191-3/+0
| | | | | | | Otherwise the following surgery will break the SAMBA build and testsuite. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* build: rename build targets smbclient -> smbclient4 and smbclient3 -> smbclientMichael Adam2012-05-311-2/+2
| | | | | Autobuild-User: Michael Adam <obnox@samba.org> Autobuild-Date: Thu May 31 06:36:55 CEST 2012 on sn-devel-104
* selftest: add a binary mapping for smbclient4Michael Adam2012-05-311-0/+1
|
* build: rename build targets nmblookup -> nmblookup4 and nmblookup3 -> nmblookupMichael Adam2012-05-311-2/+2
|
* selftest: add a binary mapping for nmblookup4Michael Adam2012-05-311-0/+1
|
* selftest: Run only the samba3 tests on builds without the AD DCAndrew Bartlett2012-05-241-1/+6
| | | | | Autobuild-User: Andrew Bartlett <abartlet@samba.org> Autobuild-Date: Thu May 24 11:51:40 CEST 2012 on sn-devel-104
* build: Add --enable-coverage option to build with gcov supportAndrew Bartlett2012-02-101-0/+7
| | | | | | This allows running lcov over the output. Andrew Bartlett
* selftest: Fix the exit code of make test when run in buildfarmAmitay Isaacs2012-02-031-0/+2
| | | | | | | | | | | | | | | | | | When make test is run in buildfarm environment (RUN_FROM_BUILD_FARM=1), last process in make test pipeline is subunit-filter. This subunit-filter is responsible for converting failure test result to xfail for known failures. While converting failures to xfail, it sets exitcode=1. If this is the last process in the pipeline make test fails, which is the observed behavior in buildfarm. In autobuild, there is additional process in the pipeline format-subunit which processes the output of subunit-filter and correctly terminates with exit code=0. The buildfarm make test failure is fixed by adding extra filter-subunit in the pipeline, as the extra filter-subunit exits correctly with exit code=0. Autobuild-User: Amitay Isaacs <amitay@samba.org> Autobuild-Date: Fri Feb 3 07:00:04 CET 2012 on sn-devel-104
* selftest: Do not run symbol check if setting up testenvAmitay Isaacs2012-01-131-1/+1
| | | | | Autobuild-User: Amitay Isaacs <amitay@samba.org> Autobuild-Date: Fri Jan 13 03:11:20 CET 2012 on sn-devel-104
* selftest: Add --flapping argument to filter-subunit.Jelmer Vernooij2011-12-051-1/+1
|
* selftest: Split out flapping tests into a separate file.Jelmer Vernooij2011-12-051-1/+1
|
* selftest: Don't generate subunit file when writing subunit to stdout.Jelmer Vernooij2011-11-301-5/+3
|
* selftest: Prevent error about unfinished test command when using --list.Jelmer Vernooij2011-11-301-1/+1
|
* selftest: Don't use fancy subunit formatters when generating a test list.Jelmer Vernooij2011-11-301-8/+11
|
* build: only run symbol checking if running all testsAndrew Tridgell2011-11-101-0/+7
| | | | | | this makes it much faster to run 1 test Pair-Programmed-With: Amitay Isaacs <amitay@gmail.com>
* selftest: Have only one set of selftest knownfail and skip filesAndrew Bartlett2011-10-281-26/+4
| | | | | | | | | | | Listing tests that are not ever proposed (eg samba4.* in the samba3 selftest) is not an error, so just combine the lists. This is being done because some folks trying to learn how our 'make test' works are having trouble following the distributed nature of the selftest system. Andrew Bartlett