Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | [render-test] Use image from the cache for addImage operation | Thiago Marcos P. Santos | 2020-01-08 | 1 | -1/+3 |
| | | | | Instead of trying to read it from the filesystem. | ||||
* | [render-test] Effectively use the offline cache for fixtures | Thiago Marcos P. Santos | 2020-01-08 | 1 | -1/+1 |
| | |||||
* | [test runner] Rendering a single tile in Tile mode | Mikhail Pozdnyakov | 2019-12-18 | 1 | -0/+1 |
| | |||||
* | [render-test] Cleanup on the render tests results | Thiago Marcos P. Santos | 2019-12-16 | 1 | -9/+4 |
| | | | | | Simplify the code path and make it print both rendering error and metrics on fail. | ||||
* | [render-test] Fix metrics passing when failing | Thiago Marcos P. Santos | 2019-12-16 | 1 | -1/+7 |
| | | | | | | Metrics will now fail, but the tool will return 0 when *ONLY* metrics fail, to make the bot continue. We will also run ignored tests and check if they are ignored but passing. | ||||
* | [test runner] Refactor injected probes operations code | Mikhail Pozdnyakov | 2019-12-13 | 1 | -3/+0 |
| | |||||
* | [test runner] Split operations parsing and execution | Mikhail Pozdnyakov | 2019-12-13 | 1 | -13/+17 |
| | |||||
* | [test runner] Introduce TestOperation | Mikhail Pozdnyakov | 2019-12-13 | 1 | -0/+2 |
| | |||||
* | [test runner] Introduce generic TestContext | Mikhail Pozdnyakov | 2019-12-13 | 1 | -4/+18 |
| | |||||
* | [test-runner] Add rebaseline flag | Alexander Shalamov | 2019-12-09 | 1 | -1/+1 |
| | | | | | Rebaseline flag allows to update or create new metric, in cases when metric check is failed or expected metric is missing. | ||||
* | [test runner] Enable test results update from cmd line | Mikhail Pozdnyakov | 2019-11-27 | 1 | -1/+3 |
| | | | | | | | | Added the following command line argument: ``` -u[update], --update=[update] Test results update mode. Supported values are: "default", "platform", "metrics" ``` | ||||
* | [test-runner] Move probe related command line args to manifest | Alexander Shalamov | 2019-11-27 | 1 | -3/+3 |
| | | | | | | | | | | | - Move probe related command line arguments to manifest, example: "probes": ["probeGFX", "probeNetwork", "probeMemory"], "metric_path": "metrics/linux" - Use manifest file name as a postfix for a result page - Move injected probes 'begin' section before map object creation - Generalize artifact storing shell script | ||||
* | [render-test] Add metric_paths into Manifest (#15973) | zmiao | 2019-11-27 | 1 | -0/+1 |
| | | | | | | | | | | * [render-test]Add expected metrics path in manifest file * seperate metrics.json and expected.png * fix expected path parsing * keep expectation path if update is enabled | ||||
* | [test-runner] Add render test runner options for injecting probes | Alexander Shalamov | 2019-11-22 | 1 | -1/+4 |
| | | | | | This allows injection of memory, gfx and network probes before and after operations defined in render test are run. | ||||
* | [render-test] Implement gfx probe for tracking gpu resources | Mikko Pulkki | 2019-10-30 | 1 | -1/+2 |
| | |||||
* | [render-test] Add manifest parser for render-test-runner (#15861) | zmiao | 2019-10-29 | 1 | -3/+8 |
| | | | | | | | | | | * [render-test] Add manifest parser for render-test-runner * [render-test] Refactory manifest parser * [render-test] Parse full manifest file through CLI * [render-test] Add linux probe manifest | ||||
* | [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) | zmiao | 2019-10-23 | 1 | -5/+4 |
| | | | | | | * [render-test] Add configurable path via CLI arguments * [render-test] Change ignore path config | ||||
* | [render-test] Implement fps benchmarking tests (#15803) | Mikko Pulkki | 2019-10-22 | 1 | -0/+3 |
| | |||||
* | [test runner] Command line option for the tests expectations path | Mikhail Pozdnyakov | 2019-10-21 | 1 | -2/+0 |
| | | | | | | -e[expectationsPath], --expectationsPath=[expectationsPath] Test expectations path. | ||||
* | [render-test] Add support for query tests | Juha Alanen | 2019-10-07 | 1 | -1/+4 |
| | |||||
* | [test runner] Test metrics reports. Check metrics results. | Mikhail Pozdnyakov | 2019-08-27 | 1 | -1/+1 |
| | |||||
* | [test runner] Expectations paths are represented with std::vector | Mikhail Pozdnyakov | 2019-08-16 | 1 | -1/+1 |
| | |||||
* | [test-runner] Introduce mapbox-gl-native test expectations | Mikhail Pozdnyakov | 2019-08-16 | 1 | -0/+5 |
| | | | | | | | | The `mapbox-gl-native`-specific render tests expected results will be stored at the `render-test/expected/` subfolder. Test runner will automatically put new expected results there if invoked with `UPDATE=true`. | ||||
* | [core] Implement C++ render test runner | Bruno de Oliveira Abinader | 2019-06-25 | 1 | -0/+28 |