summaryrefslogtreecommitdiff
path: root/tests/runtests.pl
Commit message (Collapse)AuthorAgeFilesLines
* TLS naming: fix more Winssl and Darwinssl leftoversDaniel Stenberg2020-08-081-8/+6
| | | | | | | | | | | | | The CMake option is now called CMAKE_USE_SCHANNEL The winbuild flag is USE_SCHANNEL The CI jobs and build scripts only use the new names and the new name options Tests now require 'Schannel' (when necessary) Closes #5795
* runtests: run the DICT server on a random port numberDaniel Stenberg2020-08-071-44/+25
| | | | | | Removed support for -b (base port number) Closes #5783
* runtests: move the TELNET server to a dynamic portDaniel Stenberg2020-08-061-33/+28
| | | | | | | Rename the port variable to TELNETPORT to better match the existing pattern. Closes #5785
* runtests: move the smbserver to use a dynamic port numberDaniel Stenberg2020-08-051-32/+25
| | | | Closes #5782
* runtests: run the http2 tests on a random port numberDaniel Stenberg2020-08-051-16/+23
| | | | Closes #5779
* runtests: move the gnutls-serv tests to a dynamic portDaniel Stenberg2020-08-051-38/+26
| | | | | | Affects test 320, 321, 322 and 324. Closes #5778
* runtests: support dynamicly base64 encoded sections in testsDaniel Stenberg2020-08-041-0/+20
| | | | | | | | | | | | | | | | | | This allows us to make test cases to use base64 at run-time and still use and verify information determined at run-time, such as the IMAP test server's port number in test 842. This change makes 12 tests run again that basically never ran since we moved to dynamic port numbers. ftpserver.pl is adjusted to load test instructions and test number from the preprocessed test file. FILEFORMAT.md now documents the new base64 encoding syntax. Reported-by: Marcel Raad Fixes #5761 Closes #5775
* runtests.pl: treat LibreSSL and BoringSSL as OpenSSLMarcel Raad2020-08-021-1/+1
| | | | | | | This makes the tests that require the OpenSSL feature also run for those two compatible libraries. Closes https://github.com/curl/curl/pull/5762
* content_encoding: add zstd decoding supportGilles Vollant2020-07-121-0/+5
| | | | | | | | | include zstd curl patch for Makefile.m32 from vszakats and include Add CMake support for zstd from Peter Wu Helped-by: Viktor Szakats Helped-by: Peter Wu Closes #5453
* tests: add https-proxy support to the test suiteDaniel Stenberg2020-05-141-29/+79
| | | | | | | Initial test 1630 added with basic HTTPS-proxy use. HTTPS-proxy is like HTTP proxy but with a full TLS connection to the proxy. Closes #5399
* CMake: fix runtests.pl with CMake, add new test targetsPeter Wu2020-05-121-3/+20
| | | | | | | | | | | | | | | | | | | * runtests.pl: - Fix out-of-tree build under CMake when srcdir is not set. Default srcdir to the location of runtests.pl. - Add a hack to allow CMake to use the TFLAGS option as documented in tests/README and used in scripts/travis/script.sh. * Bump CMake version to 3.2 for USES_TERMINAL, dropping Debian Jessie support (no one should care, it is already EOL.). * Remove CTest since it defines its own 'test' target with no tests since all unittests are already broken and not built by default. * Add new test targets based on the options from Makefile.am. Since new test targets are rarely added, I opted for duplicating the runtests.pl options as opposed to creating a new Makefile.inc file. Use top-level target names (test-x) instead of x-test since that is used by CI and others. Closes #5358
* runtests: remove ftp2 support, not usedDaniel Stenberg2020-05-121-20/+1
| | | | | | | We once supported two separate ftp instances in the test suite. Has not been used the last decade. Closes #5375
* runtests: show elapsed test time with higher precision (ms)Daniel Stenberg2020-05-071-1/+1
|
* runtests: set +x mode againDaniel Stenberg2020-05-061-0/+0
|
* runtests: remove sleep callsDaniel Stenberg2020-05-031-19/+0
| | | | | | | | Remove many one second sleeps that were done *after* each newly started test server already has been verified. They should not have any purpose there. Closes #5323
* tests: add support for SSH server variant specific transfer pathsMarc Hoersken2020-05-021-0/+11
| | | | | | | | OpenSSH for Windows requires paths in the format of /C:/ instead of the pseudo-POSIX paths /cygdrive/c/ or just /c/ Reviewed-by: Daniel Stenberg Closes #5298
* runtests: make the logmsg from the ssh server only show in verboseDaniel Stenberg2020-05-021-1/+1
|
* runtests: fix typo in the existence of disabled tests checkerEmil Engler2020-04-301-1/+1
| | | | Closes #5316
* tests: tests: run stunnel for HTTPS and FTPS on dynamic portsDaniel Stenberg2020-04-301-58/+72
| | | | | | | | | As stunnel is an external tool and it has no specific option to export the actually used port number when asked to listen to 0, runtests instead iterates over ten randomly picked high number ports and sticks to the first one stunnel can listen to. Closes #5267
* tests: pick a random port number for SSHDaniel Stenberg2020-04-301-56/+76
| | | | | | | Since sshd doesn't have such an option by itself, we iterate over a series of random ports until one works. Closes #5273
* runtests: check for the disabled tests relative srcdirDaniel Stenberg2020-04-251-1/+1
| | | | | | | | | | To make it work correctly for out-of-tree builds. Follow-up to 75e8feb6fb08b Bug: https://github.com/curl/curl/pull/5288#issuecomment-619346389 Reported-by: Marcel Raad Closes #5297
* runtests: revert commenting out a line I did for debuggingDaniel Stenberg2020-04-251-1/+1
| | | | Follow-up to 11091cd4d. It was not meant to be pushed!
* runtests: when <killserver> mentions http, kill http/2 tooDaniel Stenberg2020-04-251-57/+9
| | | | | | | | | | | Since the http2 test server is a mere proxy that needs to know about the dynamic port the HTTP server is using, it too needs to get restarted when the http server is killed. A regression caused by 80d6515. Fixes #5289 Closes #5291
* tests: make runtests check that disabled tests existsDaniel Stenberg2020-04-241-1/+7
| | | | | | | ... and error out if so. Removed '536' from DISABLED as there is no such test file. Closes #5288
* tests: run the RTSP test server on a dynamic port numberDaniel Stenberg2020-04-201-14/+11
| | | | | | To avoid port collisions. Closes #5272
* tests: add %NOLISTENPORT and use itDaniel Stenberg2020-04-201-0/+2
| | | | | | | | | | | | The purpose with this variable is to provide a port number that is reasonably likely to not have a listener on the local host so that tests can try connect failures against it. It uses port 47 - "reserved" according to IANA. Updated six tests to use it instead of the previous different ports. Assisted-by: Emil Engler Closes #5270
* tests: run the SOCKS test server on a dynamic port numberDaniel Stenberg2020-04-201-6/+7
| | | | Closes #5266
* tests: run the TFTP test server on a dynamic port numberDaniel Stenberg2020-04-201-14/+13
| | | | | | | Picking a dynamic unused port is better than a fixed to avoid the collision risk. Closes #5265
* runtests: always put test number in servercmd fileDaniel Stenberg2020-04-201-8/+4
|
* runtests: use a unix domain socket path with the pid in the nameDaniel Stenberg2020-04-191-1/+1
| | | | | | | To make it impossible for test cases to access the file name without using the proper variable for the purpose. Closes #5264
* runtests: dummy init the ports variables to avoid warningsDaniel Stenberg2020-04-191-30/+32
| | | | ... and generate something that can help debug test cases.
* tests: move pingpong server to dynamic listening portDaniel Stenberg2020-04-181-53/+55
| | | | | | | | FTP, IMAP, POP3, SMTP and their IPv6 versions are now all on dynamic ports Test 842-845 are unfortunately a bit hard to move over to this concept right now and require "default port" still...
* tests: introduce preprocessed test casesDaniel Stenberg2020-04-181-110/+106
| | | | | | | | | | | | The runtests script now always performs variable replacement on the entire test source file before the test gets executed, and saves the updated version in a temporary file (log/test[num]) so that all test case readers/servers can use that version (if present) and thus enjoy the powers of test case variable substitution. This is necessary to allow complete port number freedom. Test 309 is updated to work with a non-fixed port number thanks to this.
* tests: run the sws server on "any port"Daniel Stenberg2020-04-181-21/+25
| | | | | | | Makes the test servers for HTTP and Gopher pop up on a currently unused port and runtests adapts to that! Closes #5247
* tests: support hex encoded data and mqtt serverDaniel Stenberg2020-04-141-4/+91
| | | | The mqtt server is started using a "random" port.
* tests: add Windows compatible pidwait like pidkill and pidtermMarc Hoersken2020-04-111-1/+1
| | | | Related to #5188
* runtests: fix warning about using an undefined variableDaniel Stenberg2020-04-091-2/+2
| | | | Follow-up from 4d939ef6ceb2db1
* runtests: provide nicer errormsg when protocol "dump" file is emptyDaniel Stenberg2020-04-081-0/+7
|
* runtests.pl: log host OS as detected by Perl environmentMarc Hoersken2020-04-021-1/+3
|
* schannel: add "best effort" revocation check optionJohannes Schindelin2020-03-181-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Implement new option CURLSSLOPT_REVOKE_BEST_EFFORT and --ssl-revoke-best-effort to allow a "best effort" revocation check. A best effort revocation check ignores errors that the revocation check was unable to take place. The reasoning is described in detail below and discussed further in the PR. --- When running e.g. with Fiddler, the schannel backend fails with an unhelpful error message: Unknown error (0x80092012) - The revocation function was unable to check revocation for the certificate. Sadly, many enterprise users who are stuck behind MITM proxies suffer the very same problem. This has been discussed in plenty of issues: https://github.com/curl/curl/issues/3727, https://github.com/curl/curl/issues/264, for example. In the latter, a Microsoft Edge developer even made the case that the common behavior is to ignore issues when a certificate has no recorded distribution point for revocation lists, or when the server is offline. This is also known as "best effort" strategy and addresses the Fiddler issue. Unfortunately, this strategy was not chosen as the default for schannel (and is therefore a backend-specific behavior: OpenSSL seems to happily ignore the offline servers and missing distribution points). To maintain backward-compatibility, we therefore add a new flag (`CURLSSLOPT_REVOKE_BEST_EFFORT`) and a new option (`--ssl-revoke-best-effort`) to select the new behavior. Due to the many related issues Git for Windows and GitHub Desktop, the plan is to make this behavior the default in these software packages. The test 2070 was added to verify this behavior, adapted from 310. Based-on-work-by: georgeok <giorgos.n.oikonomou@gmail.com> Co-authored-by: Markus Olsson <j.markus.olsson@gmail.com> Signed-off-by: Johannes Schindelin <johannes.schindelin@gmx.de> Closes https://github.com/curl/curl/pull/4981
* runtests: log minimal and maximal used port numbersMarc Hoersken2020-03-101-0/+7
|
* runtests: fix missing use of exe_ext helper functionMarc Hoersken2020-03-071-2/+2
|
* libssh: Fix matching user-specified MD5 hex keyJay Satiro2020-03-071-0/+24
| | | | | | | | | | | Prior to this change a match would never be successful because it was mistakenly coded to compare binary data from libssh to a user-specified hex string (ie CURLOPT_SSH_HOST_PUBLIC_KEY_MD5). Reported-by: fds242@users.noreply.github.com Fixes https://github.com/curl/curl/issues/4971 Closes https://github.com/curl/curl/pull/4974
* polarssl: remove more references and mentionsDaniel Stenberg2020-03-051-5/+0
| | | | | | Assisted-by: Jay Satiro Follow-up to 6357a19ff29dac04 Closes #5036
* tests: wrap ignored test failures in bracesMarc Hoersken2020-03-041-1/+7
|
* tests: try to make sleeping portable by avoiding selectMarc Hoersken2020-03-041-3/+3
| | | | | | | | select does not support just waiting on Windows: https://perldoc.perl.org/perlport.html#select Reviewed-By: Daniel Stenberg Closes #5035
* ci/tests: Make it possible to still run but ignore failing testsMarc Hoersken2020-03-031-15/+43
| | | | | | | This enables the development of a solution for the failing tests by running them on CI while ignoring their result for the overall status. Closes #4994
* ci/tests: Move CI test result creation above environment setupMarc Hoersken2020-03-031-10/+14
| | | | | | This avoids using our test servers as proxy to the AppVeyor API. Closes #5022
* ci/tests: Send test results to AppVeyor for status overviewMarc Hoersken2020-03-031-0/+7
| | | | Closes #5021
* tests: disable SMTP UTF-8 tests on WindowsSteve Holme2020-03-021-0/+3
| | | | | Fixes #4988 Closes #4992
View Lorry Controller Status