summaryrefslogtreecommitdiff
path: root/tests/runtests.pl
Commit message (Collapse)AuthorAgeFilesLines
* runtests: revert the mistaken edit of $CURLDaniel Stenberg2020-10-191-1/+1
| | | | Regression from c4693adc62
* runtests: return error if no tests ranDaniel Stenberg2020-10-151-3/+3
| | | | | | | | | ... and make TESTFAIL stand out a little better by adding newlines before and after. Reported-by: Marc Hörsken Issue: #6052 Closes #6053
* CI/tests: fix invocation of tests for CMake buildsSergei Nikulov2020-10-141-2/+2
| | | | | | | | | | | Update appveyor.yml to set env variable TFLAGS and run tests Remove curly braces due to CMake error (${TFLAGS} -> $TFLAGS) Move testdeps build to build step (per review comments) Reviewed-by: Marc Hörsken Closes #6066 Fixes #6052
* CI/tests: use verification curl for test reporting APIsMarc Hoersken2020-10-131-6/+6
| | | | | | | | | | Avoid using our own, potentially installed, curl for the test reporting APIs in case it is broken. Reviewed-by: Daniel Stenberg Preparation for #6049 Closes #6063
* runtests.pl: use $LIBDIR variable instead of hardcoded pathMarc Hoersken2020-10-081-3/+3
| | | | | Reviewed-by: Daniel Stenberg Closes #6051
* runtests: add %repeat[]% for test filesDaniel Stenberg2020-10-041-0/+7
| | | | | | | ... and use this new keywords in all the test files larger than 50K to reduce their sizes and make them a lot easier to read and understand. Closes #6040
* runtests: provide curl's version string as %VERSION for testsDaniel Stenberg2020-10-021-1/+4
| | | | | | | | ... so that we can check HTTP requests for User-Agent: curl/%VERSION Update 600+ test cases accordingly. Closes #6037
* runtests: allow generating a binary sequence from hexDaniel Stenberg2020-10-021-0/+7
|
* imap: make imap_send use dynbuf for the send buffer managementDaniel Stenberg2020-09-251-1/+1
| | | | | | Reuses the buffer and thereby reduces number of mallocs over a transfer. Closes #6010
* runtests: allow creating files without newlinesDaniel Stenberg2020-09-141-0/+4
| | | | Closes #5946
* curl: add --output-dirDaniel Stenberg2020-08-241-5/+11
| | | | | | | | Works with --create-dirs and with -J Add test 3008, 3009, 3011, 3012 and 3013 to verify. Closes #5637
* runtests: make cleardir() erase dot files tooDaniel Stenberg2020-08-231-1/+1
| | | | | | Because test cases might use dot files. Closes #5838
* runtests: avoid 'fail to start' repeated messages in attempt loopsDaniel Stenberg2020-08-211-14/+13
| | | | Closes #5834
* runtests: clear pid variables when failing to start a serverDaniel Stenberg2020-08-211-58/+28
| | | | | | | | | ... as otherwise the parent doesn't detect the failure and believe it actually worked to start. Reported-by: Christian Weisgerber Bug: https://curl.haxx.se/mail/lib-2020-08/0018.html Closes #5834
* TLS naming: fix more Winssl and Darwinssl leftoversDaniel Stenberg2020-08-081-8/+6
| | | | | | | | | | | | | The CMake option is now called CMAKE_USE_SCHANNEL The winbuild flag is USE_SCHANNEL The CI jobs and build scripts only use the new names and the new name options Tests now require 'Schannel' (when necessary) Closes #5795
* runtests: run the DICT server on a random port numberDaniel Stenberg2020-08-071-44/+25
| | | | | | Removed support for -b (base port number) Closes #5783
* runtests: move the TELNET server to a dynamic portDaniel Stenberg2020-08-061-33/+28
| | | | | | | Rename the port variable to TELNETPORT to better match the existing pattern. Closes #5785
* runtests: move the smbserver to use a dynamic port numberDaniel Stenberg2020-08-051-32/+25
| | | | Closes #5782
* runtests: run the http2 tests on a random port numberDaniel Stenberg2020-08-051-16/+23
| | | | Closes #5779
* runtests: move the gnutls-serv tests to a dynamic portDaniel Stenberg2020-08-051-38/+26
| | | | | | Affects test 320, 321, 322 and 324. Closes #5778
* runtests: support dynamicly base64 encoded sections in testsDaniel Stenberg2020-08-041-0/+20
| | | | | | | | | | | | | | | | | | This allows us to make test cases to use base64 at run-time and still use and verify information determined at run-time, such as the IMAP test server's port number in test 842. This change makes 12 tests run again that basically never ran since we moved to dynamic port numbers. ftpserver.pl is adjusted to load test instructions and test number from the preprocessed test file. FILEFORMAT.md now documents the new base64 encoding syntax. Reported-by: Marcel Raad Fixes #5761 Closes #5775
* runtests.pl: treat LibreSSL and BoringSSL as OpenSSLMarcel Raad2020-08-021-1/+1
| | | | | | | This makes the tests that require the OpenSSL feature also run for those two compatible libraries. Closes https://github.com/curl/curl/pull/5762
* content_encoding: add zstd decoding supportGilles Vollant2020-07-121-0/+5
| | | | | | | | | include zstd curl patch for Makefile.m32 from vszakats and include Add CMake support for zstd from Peter Wu Helped-by: Viktor Szakats Helped-by: Peter Wu Closes #5453
* tests: add https-proxy support to the test suiteDaniel Stenberg2020-05-141-29/+79
| | | | | | | Initial test 1630 added with basic HTTPS-proxy use. HTTPS-proxy is like HTTP proxy but with a full TLS connection to the proxy. Closes #5399
* CMake: fix runtests.pl with CMake, add new test targetsPeter Wu2020-05-121-3/+20
| | | | | | | | | | | | | | | | | | | * runtests.pl: - Fix out-of-tree build under CMake when srcdir is not set. Default srcdir to the location of runtests.pl. - Add a hack to allow CMake to use the TFLAGS option as documented in tests/README and used in scripts/travis/script.sh. * Bump CMake version to 3.2 for USES_TERMINAL, dropping Debian Jessie support (no one should care, it is already EOL.). * Remove CTest since it defines its own 'test' target with no tests since all unittests are already broken and not built by default. * Add new test targets based on the options from Makefile.am. Since new test targets are rarely added, I opted for duplicating the runtests.pl options as opposed to creating a new Makefile.inc file. Use top-level target names (test-x) instead of x-test since that is used by CI and others. Closes #5358
* runtests: remove ftp2 support, not usedDaniel Stenberg2020-05-121-20/+1
| | | | | | | We once supported two separate ftp instances in the test suite. Has not been used the last decade. Closes #5375
* runtests: show elapsed test time with higher precision (ms)Daniel Stenberg2020-05-071-1/+1
|
* runtests: set +x mode againDaniel Stenberg2020-05-061-0/+0
|
* runtests: remove sleep callsDaniel Stenberg2020-05-031-19/+0
| | | | | | | | Remove many one second sleeps that were done *after* each newly started test server already has been verified. They should not have any purpose there. Closes #5323
* tests: add support for SSH server variant specific transfer pathsMarc Hoersken2020-05-021-0/+11
| | | | | | | | OpenSSH for Windows requires paths in the format of /C:/ instead of the pseudo-POSIX paths /cygdrive/c/ or just /c/ Reviewed-by: Daniel Stenberg Closes #5298
* runtests: make the logmsg from the ssh server only show in verboseDaniel Stenberg2020-05-021-1/+1
|
* runtests: fix typo in the existence of disabled tests checkerEmil Engler2020-04-301-1/+1
| | | | Closes #5316
* tests: tests: run stunnel for HTTPS and FTPS on dynamic portsDaniel Stenberg2020-04-301-58/+72
| | | | | | | | | As stunnel is an external tool and it has no specific option to export the actually used port number when asked to listen to 0, runtests instead iterates over ten randomly picked high number ports and sticks to the first one stunnel can listen to. Closes #5267
* tests: pick a random port number for SSHDaniel Stenberg2020-04-301-56/+76
| | | | | | | Since sshd doesn't have such an option by itself, we iterate over a series of random ports until one works. Closes #5273
* runtests: check for the disabled tests relative srcdirDaniel Stenberg2020-04-251-1/+1
| | | | | | | | | | To make it work correctly for out-of-tree builds. Follow-up to 75e8feb6fb08b Bug: https://github.com/curl/curl/pull/5288#issuecomment-619346389 Reported-by: Marcel Raad Closes #5297
* runtests: revert commenting out a line I did for debuggingDaniel Stenberg2020-04-251-1/+1
| | | | Follow-up to 11091cd4d. It was not meant to be pushed!
* runtests: when <killserver> mentions http, kill http/2 tooDaniel Stenberg2020-04-251-57/+9
| | | | | | | | | | | Since the http2 test server is a mere proxy that needs to know about the dynamic port the HTTP server is using, it too needs to get restarted when the http server is killed. A regression caused by 80d6515. Fixes #5289 Closes #5291
* tests: make runtests check that disabled tests existsDaniel Stenberg2020-04-241-1/+7
| | | | | | | ... and error out if so. Removed '536' from DISABLED as there is no such test file. Closes #5288
* tests: run the RTSP test server on a dynamic port numberDaniel Stenberg2020-04-201-14/+11
| | | | | | To avoid port collisions. Closes #5272
* tests: add %NOLISTENPORT and use itDaniel Stenberg2020-04-201-0/+2
| | | | | | | | | | | | The purpose with this variable is to provide a port number that is reasonably likely to not have a listener on the local host so that tests can try connect failures against it. It uses port 47 - "reserved" according to IANA. Updated six tests to use it instead of the previous different ports. Assisted-by: Emil Engler Closes #5270
* tests: run the SOCKS test server on a dynamic port numberDaniel Stenberg2020-04-201-6/+7
| | | | Closes #5266
* tests: run the TFTP test server on a dynamic port numberDaniel Stenberg2020-04-201-14/+13
| | | | | | | Picking a dynamic unused port is better than a fixed to avoid the collision risk. Closes #5265
* runtests: always put test number in servercmd fileDaniel Stenberg2020-04-201-8/+4
|
* runtests: use a unix domain socket path with the pid in the nameDaniel Stenberg2020-04-191-1/+1
| | | | | | | To make it impossible for test cases to access the file name without using the proper variable for the purpose. Closes #5264
* runtests: dummy init the ports variables to avoid warningsDaniel Stenberg2020-04-191-30/+32
| | | | ... and generate something that can help debug test cases.
* tests: move pingpong server to dynamic listening portDaniel Stenberg2020-04-181-53/+55
| | | | | | | | FTP, IMAP, POP3, SMTP and their IPv6 versions are now all on dynamic ports Test 842-845 are unfortunately a bit hard to move over to this concept right now and require "default port" still...
* tests: introduce preprocessed test casesDaniel Stenberg2020-04-181-110/+106
| | | | | | | | | | | | The runtests script now always performs variable replacement on the entire test source file before the test gets executed, and saves the updated version in a temporary file (log/test[num]) so that all test case readers/servers can use that version (if present) and thus enjoy the powers of test case variable substitution. This is necessary to allow complete port number freedom. Test 309 is updated to work with a non-fixed port number thanks to this.
* tests: run the sws server on "any port"Daniel Stenberg2020-04-181-21/+25
| | | | | | | Makes the test servers for HTTP and Gopher pop up on a currently unused port and runtests adapts to that! Closes #5247
* tests: support hex encoded data and mqtt serverDaniel Stenberg2020-04-141-4/+91
| | | | The mqtt server is started using a "random" port.
* tests: add Windows compatible pidwait like pidkill and pidtermMarc Hoersken2020-04-111-1/+1
| | | | Related to #5188