summaryrefslogtreecommitdiff
path: root/test/utils
Commit message (Collapse)AuthorAgeFilesLines
* Update ansible-test network test provisioning. (#68220)Matt Clay2020-03-131-3/+0
| | | | | * Update network provisioning defaults. * Update network test requirements.
* Remove test support option from ansible-test.Matt Clay2020-03-108-26/+0
| | | | This option was added to facilitate migration and is no longer needed.
* Remove unused Shippable scripts.Matt Clay2020-03-109-54/+0
|
* Update Shippable test matrix. (#68117)Matt Clay2020-03-092-105/+0
| | | | | | | * Update Shippable test matrix. * Remove unit test groups. * Remove extra windows groups.
* Skip removed windows CI groups after migration.Matt Clay2020-03-041-0/+6
|
* Update test matrix to prepare for migration. (#67983)Matt Clay2020-03-031-0/+1
| | | | | | | | | | | | | | * Split fallaxy tests into their own group. This keeps expected pass/fail tests separate during migration prep. * Move network tests down in matrix. This will help keep pass/fail tests grouped together during migration prep. * Group all incidental tests together. This will keep pass/fail tests separate leading up to migration.
* Automatically enable test plugins after migration.Matt Clay2020-03-033-0/+21
|
* Split unit tests into 3 groups. (#67917)Matt Clay2020-03-011-9/+49
|
* Increase unit test timeout.Matt Clay2020-03-011-1/+1
|
* Increase unit test coverage timeout.Matt Clay2020-03-011-1/+1
|
* Fourth batch of incidental integration tests. (#67873)Matt Clay2020-02-286-0/+38
| | | | | | | | | | | | | | | | | | * Copy in incidental posix tests. * Update incidental test aliases. * Update target names. * Add support plugins. * Fix paths. * Update ignores. * Update integration-aliases sanity test. * Add incidental tests to CI.
* Third batch of incidental integration tests. (#67830)Matt Clay2020-02-271-0/+77
| | | | | | | | | | | | | | | | * Copy in incidental windows tests. * Update incidental test aliases. * Add support plugins. * Update target references. * Update sanity ignores. * Update integration-aliases test. * Add to CI.
* Second batch of incidental integration tests. (#67765)Matt Clay2020-02-257-0/+47
| | | | | | | | | | | | | | | | | | | | | | | | | | * Update incidental test aliases. * Rewrite target references for renamed targets. * Add incidental tests to CI. * Update sanity tests for incidental cloud tests. * Initial copy of incidental tests. * Copy contrib files into test. * Update paths in test. * Add support plugins. * Update plugin to work around missing deps. * Update sanity ignores. * Fix matrix entries. * Remove debug echo.
* First batch of incidental integration tests. (#67717)Matt Clay2020-02-244-0/+62
| | | | | | | | | | | | | | | | | | | | * Initial copy of incidental network tests. * Update incidental test aliases. * Add incidental tests to CI. * Rewrite module references in tests. This should not be necessary once module redirection is supported. * Rewrite target references for renamed targets. * Add support collections for incidental tests. * Add ignores for test support code. * Remove echo used for debugging.
* Remove unused DCI scriptJohn Barker2020-02-241-33/+0
|
* Split hcloud tests into two CI groups. (#67683)Matt Clay2020-02-231-5/+5
| | | | | | | | * Split hcloud tests into two CI groups. This will hopefully resolve CI failures when running with code coverage. * Fix smoketest logic.
* Split vyos tests to avoid timeouts with coverage.Matt Clay2020-02-231-2/+8
|
* Fix up network testing on Shippable. (#67678)Matt Clay2020-02-233-30/+15
| | | This prepares for code coverage collection for initial setup of incidental test coverage.
* Relocate Shippable tools. (#67556)Matt Clay2020-02-192-497/+0
| | | | | | | | | | * Move Shippable tools to hacking directory. These limits the `test/utils/shippable/` directory to scripts required for CI. * Fix `test/utils/shippable/` file classification. * Update package-data sanity test.
* Improve sanity test handling in CI after migration.Matt Clay2020-02-071-2/+13
|
* Improve unit test handling in CI after migration. (#67217)Matt Clay2020-02-071-5/+15
| | | | | | | | * Improve unit test handling in CI after migration. * Fix undefined var in bash 4.3 and earlier. See https://git.savannah.gnu.org/cgit/bash.git/tree/CHANGES?id=3ba697465bc74fab513a26dea700cc82e9f4724e#n878
* Add code coverage target analysis to ansible-test. (#67141)Matt Clay2020-02-051-0/+3
| | | | | | | | | | | | | | | | | * Refactor coverage file enumeration. * Relocate sanitize_filename function. * Support sets when writing JSON files. * Generalize setting of info_stderr mode. * Split out coverage path checking. * Split out collection regex logic. * Improve sanitize_filename type hints and docs. * Clean up coverage erase command. * Fix docs and type hints for initialize_coverage. * Update type hints on CoverageConfig. * Split out logic for finding modules. * Split out arc enumeration. * Split out powershell coverage enumeration. * Raise verbosity level of empty coverage warnings. * Add code coverage target analysis to ansible-test.
* Testing: Add support for AIX platform (#65802)Yanis Guenane2020-01-291-0/+1
|
* Consolidate remote Shippable scripts.Matt Clay2020-01-284-66/+25
|
* Move CI coverage stub to sanity/5. (#66827)Matt Clay2020-01-271-6/+16
|
* Clean up Shippable scripts in tools directory.Matt Clay2020-01-072-2/+32
|
* Increase unit test timeout in CI.Matt Clay2019-11-011-1/+1
|
* Temporarily increase CI timeout.Matt Clay2019-11-011-1/+1
|
* Limit Shippable matrix check to ansible repo.Matt Clay2019-10-011-0/+7
|
* Revert "shippable: temporary bump the timeout for Azure jobs"Gonéri Le Bouder2019-09-091-2/+0
| | | | | | | The Azure timeout should not accure anymore since 173d47d1f429847ca351da92b69a0e05d25bb313. This reverts commit aaa8835311f39db42843efe19bd07c4691009eef.
* Increase unit test timeout to account for long image download times (#61717)Sam Doran2019-09-031-1/+1
|
* shippable: temporary bump the timeout for Azure jobsGonéri Le Bouder2019-08-301-0/+2
|
* Fix ansible-test coverage path handling. (#61528)Matt Clay2019-08-301-2/+43
| | | | * Fix ansible-test coverage path handling. * Split CI unit tests into two groups.
* Add additional group for sanity testsSam Doran2019-08-291-1/+2
| | | | Put validate-modules in its own group
* Fix CI test result placement.Matt Clay2019-08-281-2/+2
|
* Overhaul ansible-test test path handling. (#61416)Matt Clay2019-08-272-46/+61
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove .keep files from test/results/ dirs. * Remove classification of test/results/ dir. * Add results_relative to data context. * Use variables in delegation paths. * Standardize file writing and results paths. * Fix issues reported by PyCharm. * Clean up invocation of coverage command. It now runs through the injector. * Hack to allow intercept_command in cover.py. * Simplify git ignore for test results. * Use test result tmp dir instead of cache dir. * Remove old .pytest_cache reference. * Fix unit test docker delegation. * Show HTML report link. * Clean up more results references. * Move import sanity test output to .tmp dir. * Exclude test results dir from coverage. * Fix import sanity test lib paths. * Fix hard-coded import test paths. * Fix most hard-coded integration test paths. * Fix PyCharm warnings. * Fix import placement. * Fix integration test dir path. * Fix Shippable scripts. * Fix Shippable matrix check. * Overhaul key pair management.
* PowerShell - Added coverage collector (#59009)Jordan Borean2019-08-281-0/+1
| | | | | | | | | | | | | | | | * Added coverage collection for PowerShell - ci_complete ci_coverage * uncomment out coverage uploader call * Generate XML for PowerShell coverage * Use whitelist to exclude coverage run on non content plugins * Remove uneeded ignore entry * Try to reduce diff in cover.py * Fix up coverage report package - ci_complete ci_coverage
* Only run package-data sanity once in CI.Matt Clay2019-08-201-2/+2
|
* Remove Python 2.6 from Windows tests (#60235)Jordan Borean2019-08-081-1/+0
|
* Prepare ansible-test code for relocation. (#60110)Matt Clay2019-08-051-1/+1
| | | | | | | | | | | | * Fix imports in cli.py. * Fix imports in executor.py. * Remove old test/runner/ansible-test entry point. Use the official bin/ansible-test entry point instead, which has been around since Ansible 2.5. * Use bin/ansible-test on Shippable.
* Clean up old ansible-test references and code. (#60103)Matt Clay2019-08-051-1/+1
| | | | | * Remove obsolete ansible-test retry.py. * Use ansible-test from bin/ intead of test/runner/.
* Replace old shippable.py with new check_matrix.py. (#60022)Matt Clay2019-08-053-2/+108
| | | | | This new script does not depend on ansible-test and provides much more robust job matrix testing. It is also run on every job in the matrix now, to detect issues with jobs being re-run after matrix changes are made.
* Update ansible-test to properly skip unit tests.Matt Clay2019-07-311-9/+0
| | | | Unit tests will no longer run on "remote only" Python versions (2.6) for tests which are not "remote" (modules and module_utils).
* Verify package data in setup.py installs all files (#59537)Matt Martz2019-07-241-1/+1
| | | | | | | | | | | | | | | | | | | | | | * Add sanity test to ensure all non-py files are installed * Fix mode and regex * Fix role skel inventory package_data * Add docs * Update package_data for inventory files * Address pylint concerns * Another tweak to package_data * Address review feedback * Change index to 1 * add to ansible-only.txt
* Show ansible-test --explain errors in CI.Matt Clay2019-07-172-4/+4
|
* Add future and metaclass boilerplate to test code.Matt Clay2019-07-123-4/+6
| | | | | | | | Continue to ignore: - test/integration/ - test/legacy/ - test/units/
* Use Python 3.7 to run ansible-test coverage in CI. (#57555)Matt Clay2019-06-071-0/+7
| | | | | Generating XML for coverage reports on Python 3.7 uses far less memory than on Python 2.7. This change should avoid the MemoryError we've been seeing in the nightly coverage runs.
* Limit Python 2.6 units to modules & module_utils. (#57377)Matt Clay2019-06-041-0/+9
|
* Add Hetzner Cloud to CI integration tests.Matt Clay2019-04-091-0/+1
|
* Increase unit test timeout for --coverage.Matt Clay2019-04-051-1/+1
|