summaryrefslogtreecommitdiff
path: root/render-test/runner.hpp
Commit message (Collapse)AuthorAgeFilesLines
* [render tests][tile mode] Check symbol icons cut-offsMikhail Pozdnyakov2020-04-061-0/+1
|
* [core] Modularize FileSource codebase (#15768)Alexander Shalamov2020-01-131-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [core] Introduce FileSourceManager and use it for default platform impl - Add `FileSourceManager` interface that provides access to `FileSource` instances and means of registering / unregistering `FileSource` factories - Split `DefaultFileSource` into smaller parts - Add `DatabaseFileSource` interface and it's default implementation - Remove inter-dependencies between concrete `FileSource` classes * [build] Add files to next build system * [core] Add generic property setters / getters * [core] Remove setOnlineStatus from OnlineFileSource interface * [core] Hide threading implementation details from DatabaseFileSource interface * [core] Make DB file source methods virtual * [core] Add documentation for DatabaseFileSource and rename one method * [core] Use simple callback instead of ActorRef * [core] Remove ActorRef from OnlineFileSource public header * [core] Add callback to FileSource::forward async API * [core] Pass OfflineRegionDefinition by value * [core] Update tests to use modular file sources * [core] Update unit tests * [core] Update unit tests after rebase * [core] Backport low prio fix for cached requests * [core] Backport pack database * [core] Return removed factory from unRegisterFileSourceFactory * [core] Rename shadowed args in onlinefilesource * [core] Remove simple std::function callback aliases * [core] Expose online file source property keys in public header file * [test-runner] Add proxy file source test runner * [cache] Update mbgl-cache utility to use new file source * [metrics] Rebaseline binary size metrics * [offline] Update offline utility * [core] Update changelog
* [render-test] Use image from the cache for addImage operationThiago Marcos P. Santos2020-01-081-1/+3
| | | | Instead of trying to read it from the filesystem.
* [render-test] Effectively use the offline cache for fixturesThiago Marcos P. Santos2020-01-081-1/+1
|
* [test runner] Rendering a single tile in Tile modeMikhail Pozdnyakov2019-12-181-0/+1
|
* [render-test] Cleanup on the render tests resultsThiago Marcos P. Santos2019-12-161-9/+4
| | | | | Simplify the code path and make it print both rendering error and metrics on fail.
* [render-test] Fix metrics passing when failingThiago Marcos P. Santos2019-12-161-1/+7
| | | | | | Metrics will now fail, but the tool will return 0 when *ONLY* metrics fail, to make the bot continue. We will also run ignored tests and check if they are ignored but passing.
* [test runner] Refactor injected probes operations codeMikhail Pozdnyakov2019-12-131-3/+0
|
* [test runner] Split operations parsing and executionMikhail Pozdnyakov2019-12-131-13/+17
|
* [test runner] Introduce TestOperationMikhail Pozdnyakov2019-12-131-0/+2
|
* [test runner] Introduce generic TestContextMikhail Pozdnyakov2019-12-131-4/+18
|
* [test-runner] Add rebaseline flagAlexander Shalamov2019-12-091-1/+1
| | | | | Rebaseline flag allows to update or create new metric, in cases when metric check is failed or expected metric is missing.
* [test runner] Enable test results update from cmd lineMikhail Pozdnyakov2019-11-271-1/+3
| | | | | | | | Added the following command line argument: ``` -u[update], --update=[update] Test results update mode. Supported values are: "default", "platform", "metrics" ```
* [test-runner] Move probe related command line args to manifestAlexander Shalamov2019-11-271-3/+3
| | | | | | | | | | | - Move probe related command line arguments to manifest, example: "probes": ["probeGFX", "probeNetwork", "probeMemory"], "metric_path": "metrics/linux" - Use manifest file name as a postfix for a result page - Move injected probes 'begin' section before map object creation - Generalize artifact storing shell script
* [render-test] Add metric_paths into Manifest (#15973)zmiao2019-11-271-0/+1
| | | | | | | | | | * [render-test]Add expected metrics path in manifest file * seperate metrics.json and expected.png * fix expected path parsing * keep expectation path if update is enabled
* [test-runner] Add render test runner options for injecting probesAlexander Shalamov2019-11-221-1/+4
| | | | | This allows injection of memory, gfx and network probes before and after operations defined in render test are run.
* [render-test] Implement gfx probe for tracking gpu resourcesMikko Pulkki2019-10-301-1/+2
|
* [render-test] Add manifest parser for render-test-runner (#15861)zmiao2019-10-291-3/+8
| | | | | | | | | | * [render-test] Add manifest parser for render-test-runner * [render-test] Refactory manifest parser * [render-test] Parse full manifest file through CLI * [render-test] Add linux probe manifest
* [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832)zmiao2019-10-231-5/+4
| | | | | | * [render-test] Add configurable path via CLI arguments * [render-test] Change ignore path config
* [render-test] Implement fps benchmarking tests (#15803)Mikko Pulkki2019-10-221-0/+3
|
* [test runner] Command line option for the tests expectations pathMikhail Pozdnyakov2019-10-211-2/+0
| | | | | | -e[expectationsPath], --expectationsPath=[expectationsPath] Test expectations path.
* [render-test] Add support for query testsJuha Alanen2019-10-071-1/+4
|
* [test runner] Test metrics reports. Check metrics results.Mikhail Pozdnyakov2019-08-271-1/+1
|
* [test runner] Expectations paths are represented with std::vectorMikhail Pozdnyakov2019-08-161-1/+1
|
* [test-runner] Introduce mapbox-gl-native test expectationsMikhail Pozdnyakov2019-08-161-0/+5
| | | | | | | | The `mapbox-gl-native`-specific render tests expected results will be stored at the `render-test/expected/` subfolder. Test runner will automatically put new expected results there if invoked with `UPDATE=true`.
* [core] Implement C++ render test runnerBruno de Oliveira Abinader2019-06-251-0/+28
View Lorry Controller Status