summaryrefslogtreecommitdiff
path: root/script
Commit message (Collapse)AuthorAgeFilesLines
* autobuild: fix quoting of --restrict-testsJamie McClymont2018-01-051-1/+1
| | | | | | | | | | | | Currently, passing multiple tests causes those other than the first to be passed to make, causing failures. Signed-off-by: Jamie McClymont <jamiemcclymont@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Douglas Bagnall <dbagnall@samba.org> Autobuild-Date(master): Fri Jan 5 02:51:09 CET 2018 on sn-devel-144
* tests: replace traffic_summary test with python blackbox testGary Lockyer2017-08-173-5065/+0
| | | | | | | | | | | | | | Replace the shell subunit test for script/traffic_summary.pl with a python black box test. This involves moving the test files to more standard locations. Signed-off-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz> Autobuild-User(master): Douglas Bagnall <dbagnall@samba.org> Autobuild-Date(master): Thu Aug 17 07:59:38 CEST 2017 on sn-devel-144
* scripts: Scripts to replay and generate samba trafficGary Lockyer2017-08-172-0/+425
| | | | | | | | | | | | | | | | | | | | | | | | Scripts to generate representative network traffic and replay this to a samba instance. For load testing, performance profiling and capacity planning. traffic_learner process a file generated by traffic_summary and generate a model that can be used by traffic_replay to generate samba network traffic. traffic_replay Replay a summary file generated by traffic_summary, or use a model created by traffic_learner to generate network traffic. Signed-off-by: Gary Lockyer <gary@catalyst.net.nz> Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz> Pair-programmed-with: Garming Sam <garming@catalyst.net.nz> Pair-programmed-with: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Pair-Programmed-With: Andrew Bartlett <abartlet@samba.org> Pair-Programmed-With: Tim Beale <timbeale@catalyst.net.nz>
* traffic_summary: avoid uninitialised variable warningDouglas Bagnall2017-08-171-1/+1
| | | | | Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* autobuild: Use new selftest.pl feature to run only some environmentsAndrew Bartlett2017-06-301-3/+3
| | | | | | | This is cleaner than test filtering with regular expressions Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* autobuild: Do not require cmocka to be installed for samba-libs to buildAndrew Bartlett2017-04-191-1/+1
| | | | | | | | | | cmocka does not have an install target, but is a depencency of ldb for the tests Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andrew Bartlet <abartlet@samba.org> Autobuild-User(master): Andreas Schneider <asn@cryptomilk.org> Autobuild-Date(master): Wed Apr 19 19:43:15 CEST 2017 on sn-devel-144
* lib: Add pam_wrapper 1.0.3Andreas Schneider2017-04-071-0/+1
| | | | | Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* script/compare_cc_results.py: ignore all LIB*_WRAPPER_SO_PATH valuesStefan Metzmacher2017-04-071-3/+8
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* autobuild: Stop waf uninstall from removing test_tmpdirMartin Schwenke2017-03-211-0/+5
| | | | | | | | | | | | | | | | | | | Most of the autobuild tasks run "make distcheck", which does a recursive "waf configure make install uninstall". "waf uninstall" (via BuildContext.install() in Build.py) removes empty directories all the way up the directory tree. This means that it removes test_tmpdir, if it is empty, and any empty directories above it. While this is arguably a waf bug, the simplest solution is to make test_tmpdir non-empty so it don't get removed. BUG: https://bugzilla.samba.org/show_bug.cgi?id=12703 Signed-off-by: Martin Schwenke <martin@meltin.net> Reviewed-by: Stefan Metzmacher <metze@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Tue Mar 21 10:37:08 CET 2017 on sn-devel-144
* autobuild: Add nopython environment to test --disable-python builds (but ↵Andrew Bartlett2017-03-101-1/+17
| | | | | | | | | | | | | | without tests) This ensures we keep this option building as we extend our use of python. The rule is that new features and changes to existing features that require python are most welcome, they just need to be disabled for the minimalistic targets we still ecourage Samba on, that typically just want smbd Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
* scripts/traffic_summary: documentation typoDouglas Bagnall2017-03-101-1/+1
| | | | | Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* script: Add test script for traffic_summary.plGary Lockyer2017-03-011-0/+47
| | | | | | | | | | | | Add the test script for traffic_summary.pl, test data in previous commit. Signed-off-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Douglas Bagnall <dbagnall@samba.org> Autobuild-Date(master): Wed Mar 1 09:01:07 CET 2017 on sn-devel-144
* script: Add script to provide an anonymous summary from tsharkGary Lockyer2017-03-011-0/+707
| | | | | | | | | | The tshark command needs to output a PDML XML stream, which this command will read. The summary is intended not to expose private or customer data while allowing a good view on the range and frequency of the network traffic. Signed-off-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* script: Add test data for traffic_summary.plGary Lockyer2017-03-012-0/+5018
| | | | | | | | | | This network capture summary tool will be added in the next commit This sample is taken from make test under SOCKET_WRAPPER_PCAP_FILE Signed-off-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* script/autobuild.py: ignore missing test_tmpdirStefan Metzmacher2017-02-211-1/+1
| | | | | | | It is still unknown what removes it... Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org>
* script/autobuild.py: try to make TMPDIR handling more verboseStefan Metzmacher2017-01-121-4/+7
| | | | | | | | This hopefully gives some hints regarding flakey tests where the tmpdir is not available. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: add a do_print() wrapper function that flushes after ↵Stefan Metzmacher2017-01-121-18/+23
| | | | | | | each message Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: export PYTHONUNBUFFERED=1Stefan Metzmacher2017-01-121-0/+2
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: cleanup the task subdirs when they're done.Stefan Metzmacher2017-01-121-0/+4
| | | | | | | This hopefully reduces the used space on the memdisk. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: use --enable-developer and --picky-developer for the ↵Stefan Metzmacher2017-01-121-1/+2
| | | | | | | ctdb build Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net>
* script/release.sh: fix off by 1 error in announce.${tagname}.mail.txt creationStefan Metzmacher2017-01-121-2/+3
| | | | | | | | | | Pair-Programmed-With: Karolin Seeger <kseeger@samba.org> Signed-off-by: Stefan Metzmacher <metze@samba.org> Signed-off-by: Karolin Seeger <kseeger@samba.org> Autobuild-User(master): Karolin Seeger <kseeger@samba.org> Autobuild-Date(master): Thu Jan 12 15:34:25 CET 2017 on sn-devel-144
* script/autobuild.py: try make test TESTS=samba3.*ktest for samba-systemkrb5Stefan Metzmacher2017-01-101-1/+1
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
* script/autobuild.py: create tmpdir for each try and export it as TMPDIRStefan Metzmacher2016-12-171-0/+4
| | | | | | | | This way the compiler and other tools hopefully don't use /tmp anymore. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: cleanup testbase/prefix before each retryStefan Metzmacher2016-12-171-1/+3
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: remove pointless mkdir/rmdir commandsStefan Metzmacher2016-12-171-2/+0
| | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/autobuild.py: don't add subdirs of testbase to cleanup_listStefan Metzmacher2016-12-171-3/+0
| | | | | | | We already have testbase in there. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* autobuild: add system-mitkrb5 build environment.Günther Deschner2016-09-291-1/+16
| | | | | | | | | | | | We finally need to make sure the build with MIT Kerberos does not break all the time. Guenther Pair-Programmed-With: Stefan Metzmacher <metze@samba.org> Signed-off-by: Guenther Deschner <gd@samba.org> Signed-off-by: Stefan Metzmacher <metze@samba.org>
* script/release.sh: use 8 byte gpg key idsStefan Metzmacher2016-09-021-6/+6
| | | | | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org> Autobuild-User(master): Jeremy Allison <jra@samba.org> Autobuild-Date(master): Fri Sep 2 22:05:33 CEST 2016 on sn-devel-144
* autobuild: disable abi check on O3 buildDouglas Bagnall2016-08-311-1/+1
| | | | | Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* autobuild --restrict-tests to test a restricted setDouglas Bagnall2016-08-311-1/+20
| | | | | | | | This allows autobuild to be used as a test framework for running particular Samba tests in a cloud environment. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* autobuild: remove unused argumentDouglas Bagnall2016-08-311-2/+2
| | | | | | | | The "tasklist" parameter is the same as the global "tasks" variable, but only the latter is used. Signed-off-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Reviewed-by: Garming Sam <garming@catalyst.net.nz>
* script/autobuild.py: include the branch name in the outputStefan Metzmacher2016-08-111-5/+5
| | | | | | | | Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Michael Adam <obnox@samba.org> Autobuild-Date(master): Thu Aug 11 08:38:47 CEST 2016 on sn-devel-144
* script/autobuild.py: check for AUTOBUILD_SKIP_SAMBA_O3 environment variableStefan Metzmacher2016-08-041-0/+3
| | | | | | | | | | We need to skip the samba-o3 target on older systems like sn-devel-104. BUG: https://bugzilla.samba.org/show_bug.cgi?id=12108 Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org> Reviewed-by: Michael Adam <obnox@samba.org>
* autobuild: Don't compare socket wrapper so_path for xc checkMichael Adam2016-07-111-1/+2
| | | | | | | | | | This uses the build-directory which, hence is not the same. Achieve this by adding the path itself and the whole defines dictionary to the exclude list. Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Uri Simchoni <uri@samba.org> Reviewed-by: Amitay Isaacs <amitay@gmail.com>
* autobuild: run the samba-o3 target by defaultMichael Adam2016-05-131-1/+1
| | | | | Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* autobuild: add a target samba-o3 that is built with -O3Michael Adam2016-05-131-0/+9
| | | | | | | | Only run quicktest against the ad_dc env. This currently just takes some 6 odd minutes. Signed-off-by: Michael Adam <obnox@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* autobuild: fix typo in autobuild success subject lineGarming Sam2016-05-051-1/+1
| | | | | | | | Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Autobuild-User(master): Garming Sam <garming@samba.org> Autobuild-Date(master): Thu May 5 04:15:16 CEST 2016 on sn-devel-144
* autobuild: Return the last 50 log linesGarming Sam2016-05-031-1/+18
| | | | | | | | This means that you don't have to deal with tars for quickly determining the cause of a failure. Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
* Revert "autobuild: Return the last 50 log lines"Stefan Metzmacher2016-03-231-12/+1
| | | | | | | | | | | | | | | | | | | | | This reverts commit aab2f39bb7ff330fbb01da4021c096e69a429d2e. This breaks if log_base is an https url... Traceback (most recent call last): File "script/autobuild.py", line 744, in <module> elapsed_time, log_base=options.log_base) File "script/autobuild.py", line 608, in email_failure f = open("%s/%s.stdout" % (log_base, failed_tag), 'r') IOError: [Errno 2] No such file or directory: 'https://git.samba.org/uri/samba-autobuild/ctdb.stdout' Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Volker Lendecke <vl@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Wed Mar 23 18:59:17 CET 2016 on sn-devel-144
* autobuild: Return the last 50 log linesGarming Sam2016-03-221-1/+12
| | | | | | | | | | | This means that you don't have to deal with tars for quickly determining the cause of a failure. Signed-off-by: Garming Sam <garming@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Tue Mar 22 11:39:38 CET 2016 on sn-devel-144
* script/release.sh: generate announce.${tagname}.patch.txt in ↵Karolin Seeger2016-02-151-0/+34
| | | | | | | | | | | | | | announcement_samba_rc() This was only done in announcement_samba_stable() before. Pair-Programmed-With: Stefan Metzmacher <metze@samba.org> Signed-off-by: Karolin Seeger <kseeger@samba.org> Signed-off-by: Stefan Metzmacher <metze@samba.org> Autobuild-User(master): Karolin Seeger <kseeger@samba.org> Autobuild-Date(master): Mon Feb 15 17:41:49 CET 2016 on sn-devel-144
* script/release.sh: improve error messages if the tag verification failsKarolin Seeger2016-02-151-2/+8
| | | | | | | | | This makes it more obvious if a gpg key is expired. Pair-Programmed-With: Stefan Metzmacher <metze@samba.org> Signed-off-by: Karolin Seeger <kseeger@samba.org> Signed-off-by: Stefan Metzmacher <metze@samba.org>
* script/autobuild.py: use --extra-python=/usr/bin/python3 by defaultStefan Metzmacher2016-02-151-6/+12
| | | | | | | | | | export AUTOBUILD_NO_EXTRA_PYTHON=1 can overwrite this if required. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Michael Adam <obnox@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Mon Feb 15 14:28:27 CET 2016 on sn-devel-144
* autobuild: Use make -j on samba-libs/samba-static build as wellAndrew Bartlett2016-01-051-4/+4
| | | | | | | We need this build to be fast when split out as a seperate VM Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Put the static build in another stanzaAndrew Bartlett2016-01-051-7/+9
| | | | | | | | | | | | This will allow it to run on a different VM in travis-ci and so keep us below the 50min limit. Because we do not rebuild the libs (and real world static builds are likely to have internal libs), this changes us to build them internally. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Use cp --recursive --link --archiveAndrew Bartlett2016-01-051-4/+7
| | | | | | | | | | | | | | | | | | | | | This works on waf based builds as source files are not modified during the build TODO: In order to make sure build doesn't influence each other, we need to add something like: try: if options.rebase is not None: rebase_tree(options.rebase, rebase_branch=options.branch) + run_cmd("find -type f | xargs chmod -w", show=True, dir=test_master) except Exception: But that means we need to change the way 'make distcheck' works for the standalone libraries. For now this will help to reduce the (mem)disk usage of an autobuild a lot. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* autobuild: Give a clearer failure messageAndrew Bartlett2016-01-051-0/+18
| | | | | | | | | | | | This helps when autobuild.py is used in --tail mode and where there is neither e-mail nor access to the logs.tar.gz Working back to find where the error happened is typically quite difficult, as many failures are actually due to the cleanup. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
* script/autobuild.py: exclude !pytalloc-util and !pyldb-util from bundling in ↵Stefan Metzmacher2015-10-311-1/+1
| | | | | | | | | | | samba-libs We need to make sure we're really not bundling any of these. BUG: https://bugzilla.samba.org/show_bug.cgi?id=11458 Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Jelmer Vernooij <jelmer@samba.org>
* autobuild: Confirm we can build without --enable-developerAndrew Bartlett2015-10-231-4/+5
| | | | | | | We also confirm that such builds do not contain the NTVFS file server Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Jeremy Allison <jra@samba.org>
* script/release.sh: make it possible to create stable .x releases (x >= 1)Stefan Metzmacher2015-10-211-131/+352
| | | | | | | | | | This version was used to create samba-4.3.1. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Karolin Seeger <kseeger@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Wed Oct 21 14:27:53 CEST 2015 on sn-devel-104