summaryrefslogtreecommitdiff
path: root/script/autobuild.py
Commit message (Collapse)AuthorAgeFilesLines
* autobuild: Do not require cmocka to be installed for samba-libs to buildAndrew Bartlett2017-04-191-1/+1
| | | | | | | | | | cmocka does not have an install target, but is a depencency of ldb for the tests Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andrew Bartlet <abartlet@samba.org> Autobuild-User(master): Andreas Schneider <asn@cryptomilk.org> Autobuild-Date(master): Wed Apr 19 19:43:15 CEST 2017 on sn-devel-144
* autobuild: Stop waf uninstall from removing test_tmpdirMartin Schwenke2017-03-211-0/+5
| | | | | | | | | | | | | | | | | | | Most of the autobuild tasks run "make distcheck", which does a recursive "waf configure make install uninstall". "waf uninstall" (via BuildContext.install() in Build.py) removes empty directories all the way up the directory tree. This means that it removes test_tmpdir, if it is empty, and any empty directories above it. While this is arguably a waf bug, the simplest solution is to make test_tmpdir non-empty so it don't get removed. BUG: https://bugzilla.samba.org/show_bug.cgi?id=12703 Signed-off-by: Martin Schwenke <martin@meltin.net> Reviewed-by: Stefan Metzmacher <metze@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Tue Mar 21 10:37:08 CET 2017 on sn-devel-144
* autobuild: Add nopython environment to test --disable-python builds (but ↵Andrew Bartlett2017-03-101-1/+17
| | | | | | | | | | | | | | without tests) This ensures we keep this option building as we extend our use of python. The rule is that new features and changes to existing features that require python are most welcome, they just need to be disabled for the minimalistic targets we still ecourage Samba on, that typically just want smbd Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
* script/autobuild.py: ignore missing test_tmpdirStefan Metzmacher2017-02-211-1/+1
| | | | | | | It is still unknown what removes it... Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org>
* script/autobuild.py: try to make TMPDIR handling more verboseStefan Metzmacher2017-01-121-4/+7
| | | | | | | | This hopefully gives some hints regarding flakey tests where the tmpdir is not available. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: add a do_print() wrapper function that flushes after ↵Stefan Metzmacher2017-01-121-18/+23
| | | | | | | each message Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: export PYTHONUNBUFFERED=1Stefan Metzmacher2017-01-121-0/+2
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: cleanup the task subdirs when they're done.Stefan Metzmacher2017-01-121-0/+4
| | | | | | | This hopefully reduces the used space on the memdisk. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: use --enable-developer and --picky-developer for the ↵Stefan Metzmacher2017-01-121-1/+2
| | | | | | | ctdb build Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net>
* script/autobuild.py: try make test TESTS=samba3.*ktest for samba-systemkrb5Stefan Metzmacher2017-01-101-1/+1
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: create tmpdir for each try and export it as TMPDIRStefan Metzmacher2016-12-171-0/+4
| | | | | | | | This way the compiler and other tools hopefully don't use /tmp anymore. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: cleanup testbase/prefix before each retryStefan Metzmacher2016-12-171-1/+3
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: remove pointless mkdir/rmdir commandsStefan Metzmacher2016-12-171-2/+0
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: don't add subdirs of testbase to cleanup_listStefan Metzmacher2016-12-171-3/+0
| | | | | | | We already have testbase in there. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* autobuild: add system-mitkrb5 build environment.Günther Deschner2016-09-291-1/+16
| | | | | | | | | | | | We finally need to make sure the build with MIT Kerberos does not break all the time. Guenther Pair-Programmed-With: Stefan Metzmacher <metze@samba.org> Signed-off-by: Guenther Deschner <gd@samba.org> Signed-off-by: Stefan Metzmacher <metze@samba.org>
* autobuild: disable abi check on O3 buildDouglas Bagnall2016-08-311-1/+1
| | | | | Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* autobuild --restrict-tests to test a restricted setDouglas Bagnall2016-08-311-1/+20
| | | | | | | | This allows autobuild to be used as a test framework for running particular Samba tests in a cloud environment. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* autobuild: remove unused argumentDouglas Bagnall2016-08-311-2/+2
| | | | | | | | The "tasklist" parameter is the same as the global "tasks" variable, but only the latter is used. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* script/autobuild.py: include the branch name in the outputStefan Metzmacher2016-08-111-5/+5
| | | | | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Thu Aug 11 08:38:47 CEST 2016 on sn-devel-144
* script/autobuild.py: check for AUTOBUILD_SKIP_SAMBA_O3 environment variableStefan Metzmacher2016-08-041-0/+3
| | | | | | | | | | We need to skip the samba-o3 target on older systems like sn-devel-104. BUG: https://bugzilla.samba.org/show_bug.cgi?id=12108 Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* autobuild: run the samba-o3 target by defaultMichael Adam2016-05-131-1/+1
| | | | | Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* autobuild: add a target samba-o3 that is built with -O3Michael Adam2016-05-131-0/+9
| | | | | | | | Only run quicktest against the ad_dc env. This currently just takes some 6 odd minutes. Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* autobuild: fix typo in autobuild success subject lineGarming Sam2016-05-051-1/+1
| | | | | | | | Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Autobuild-User(master): Garming Sam <garming@samba.org> Autobuild-Date(master): Thu May 5 04:15:16 CEST 2016 on sn-devel-144
* autobuild: Return the last 50 log linesGarming Sam2016-05-031-1/+18
| | | | | | | | This means that you don't have to deal with tars for quickly determining the cause of a failure. Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Revert "autobuild: Return the last 50 log lines"Stefan Metzmacher2016-03-231-12/+1
| | | | | | | | | | | | | | | | | | | | | This reverts commit aab2f39bb7ff330fbb01da4021c096e69a429d2e. This breaks if log_base is an https url... Traceback (most recent call last): File "script/autobuild.py", line 744, in <module> elapsed_time, log_base=options.log_base) File "script/autobuild.py", line 608, in email_failure f = open("%s/%s.stdout" % (log_base, failed_tag), 'r') IOError: [Errno 2] No such file or directory: 'https://git.samba.org/uri/samba-autobuild/ctdb.stdout' Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Volker Lendecke <vl@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Wed Mar 23 18:59:17 CET 2016 on sn-devel-144
* autobuild: Return the last 50 log linesGarming Sam2016-03-221-1/+12
| | | | | | | | | | | This means that you don't have to deal with tars for quickly determining the cause of a failure. Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Tue Mar 22 11:39:38 CET 2016 on sn-devel-144
* script/autobuild.py: use --extra-python=/usr/bin/python3 by defaultStefan Metzmacher2016-02-151-6/+12
| | | | | | | | | | export AUTOBUILD_NO_EXTRA_PYTHON=1 can overwrite this if required. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Mon Feb 15 14:28:27 CET 2016 on sn-devel-144
* autobuild: Use make -j on samba-libs/samba-static build as wellAndrew Bartlett2016-01-051-4/+4
| | | | | | | We need this build to be fast when split out as a seperate VM Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Put the static build in another stanzaAndrew Bartlett2016-01-051-7/+9
| | | | | | | | | | | | This will allow it to run on a different VM in travis-ci and so keep us below the 50min limit. Because we do not rebuild the libs (and real world static builds are likely to have internal libs), this changes us to build them internally. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Use cp --recursive --link --archiveAndrew Bartlett2016-01-051-4/+7
| | | | | | | | | | | | | | | | | | | | | This works on waf based builds as source files are not modified during the build TODO: In order to make sure build doesn't influence each other, we need to add something like: try: if options.rebase is not None: rebase_tree(options.rebase, rebase_branch=options.branch) + run_cmd("find -type f | xargs chmod -w", show=True, dir=test_master) except Exception: But that means we need to change the way 'make distcheck' works for the standalone libraries. For now this will help to reduce the (mem)disk usage of an autobuild a lot. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Give a clearer failure messageAndrew Bartlett2016-01-051-0/+18
| | | | | | | | | | | | This helps when autobuild.py is used in --tail mode and where there is neither e-mail nor access to the logs.tar.gz Working back to find where the error happened is typically quite difficult, as many failures are actually due to the cleanup. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* script/autobuild.py: exclude !pytalloc-util and !pyldb-util from bundling in ↵Stefan Metzmacher2015-10-311-1/+1
| | | | | | | | | | | samba-libs We need to make sure we're really not bundling any of these. BUG: https://bugzilla.samba.org/show_bug.cgi?id=11458 Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jelmer Vernooij <jelmer@samba.org>
* autobuild: Confirm we can build without --enable-developerAndrew Bartlett2015-10-231-4/+5
| | | | | | | We also confirm that such builds do not contain the NTVFS file server Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* autobuild: add some system information to the autobuild tarballDouglas Bagnall2015-10-211-0/+12
| | | | | | | | | | When running multiple autobuilds on VMs with various parameters, you can easily get confused about which was which, and the tarball doesn't help much. This adds an extra file with information about the system. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* script/autobuild.py: make sure --nonshared-binary=smbtorture,smbd/smbd keeps ↵Stefan Metzmacher2015-08-201-1/+6
| | | | | | | | | | | | | | working - It's very useful to have a static smbtorture binary that can be copied arround. - It's sometimes also useful to have a static smbd binary in order avoid runtime overhead via do_lookup_x() (in ld*.so), note that Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org> Autobuild-User(master): Ralph Böhme <slow@samba.org> Autobuild-Date(master): Thu Aug 20 19:10:19 CEST 2015 on sn-devel-104
* script/autobuild.py: test some --with-{static,shared}-modules combinationsStefan Metzmacher2015-08-201-1/+16
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org>
* script/autobuild.py: use -Wmissing-prototypes and --picky-developer for ↵Stefan Metzmacher2015-08-201-1/+2
| | | | | | | samba-libs* Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org>
* script/autobuild.py: split out a samba_libs_configure variableStefan Metzmacher2015-08-201-5/+11
| | | | | | | The avoids too long lines. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org>
* autobuild email mentions the elapsed timeDouglas Bagnall2015-06-101-9/+18
| | | | | | | | | | | This is occasionally very useful. When it is not, it is easily ignored. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Wed Jun 10 13:26:21 CEST 2015 on sn-devel-104
* autobuild: Add test for cross-compilation infrastructureUri Simchoni2015-05-201-3/+15
| | | | | | | | | | | | | | | | | | | | | | | With added option to generate cross-answers by cross-execute script, a test is added to verify that at least for tested build environments, the infrastructure is self-consistent. The test runs samba configuration in three modes: 1. Native 2. Cross compile with cross-execute, using the build machine as its own target 3. Cross compile with cross-answers, using the answers generated in step 2 The build environments created by the three processes are then tested to be equal. Signed-off-by: Uri Simchoni <urisimchoni@gmail.com> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Alexander Bokovoy <ab@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Wed May 20 14:10:05 CEST 2015 on sn-devel-104
* autobuild: Add options to set mail host and send e-mail with logsAndrew Bartlett2015-04-151-23/+45
| | | | | | | | | | | This helps when running the script in a cloud instance as it is cheapest to shut it down once run Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Jelmer Vernooij <jelmer@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Wed Apr 15 08:41:37 CEST 2015 on sn-devel-104
* autobuild: Do not consider IDL.pm and Expr.pm changes to make a build badAndrew Bartlett2015-04-151-0/+1
| | | | | | | | This allows a different yapp to be installed on the build host without failing the whole autobuild Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Jelmer Vernooij <jelmer@samba.org>
* autobuild: Do not wait when running just one targetAndrew Bartlett2015-04-151-0/+5
| | | | | | | This avoids having to remember to specify AUTOBUILD_RANDOM_SLEEP_OVERRIDE manually Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Jelmer Vernooij <jelmer@samba.org>
* Pass --recursive to 'git clone' in autobuild.Jelmer Vernooij2015-03-301-2/+2
| | | | | | | | This makes it possible to use submodules in Samba. Change-Id: Iccb1876b1daf82864b18486f2dca9036d7d3c75c Signed-Off-By: Jelmer Vernooij <jelmer@samba.org> Reviewed-by: David Disseldorp <ddiss@samba.org>
* autobuild: Remove ntdb targetVolker Lendecke2015-03-171-17/+2
| | | | | Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* script/autobuild.py: build the samba target with --with-profiling-dataStefan Metzmacher2015-03-061-1/+1
| | | | | | | | | | | | In future we may get also runtime tests for profiling... Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Mon Dec 15 16:20:14 CET 2014 on sn-devel-104 (cherry picked from commit 4958fcdfa30fd9d8dc51ceafaab35721e61e72c7)
* autobuild: adapt a commentMichael Adam2014-12-171-1/+1
| | | | | | | | | | | | The configure-option --with-cluster-support now only builds against the included ctdb, and it also builds the ctdb component. The comment in autobuild.py this patch changes was still from the olden days... Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Volker Lendecke <vl@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Wed Dec 17 21:13:44 CET 2014 on sn-devel-104
* script/autobuild.py: use --picky-developer for the samba-ctdb targetStefan Metzmacher2014-12-171-1/+1
| | | | | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Amitay Isaacs <amitay@gmail.com> Autobuild-User(master): Amitay Isaacs <amitay@samba.org> Autobuild-Date(master): Wed Dec 17 11:52:25 CET 2014 on sn-devel-104
* Revert "script/autobuild.py: build the samba target with --with-profiling-data"Stefan Metzmacher2014-12-161-1/+1
| | | | | | | | | | | | | | | | This reverts commit 4958fcdfa30fd9d8dc51ceafaab35721e61e72c7. This only works for a single user on a system, as only one can create the sysv shared memory segment. In future we'll use a tdb instead of sysv shared memory, then we can readd this. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Tue Dec 16 11:25:47 CET 2014 on sn-devel-104
* script/autobuild.py: build the samba target with --with-profiling-dataStefan Metzmacher2014-12-151-1/+1
| | | | | | | | | | In future we may get also runtime tests for profiling... Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Mon Dec 15 16:20:14 CET 2014 on sn-devel-104