summaryrefslogtreecommitdiff
path: root/render-test/runner.cpp
Commit message (Collapse)AuthorAgeFilesLines
* [core] PlacedSymbolData contains layer idMikhail Pozdnyakov2020-04-091-3/+3
|
* [render tests][tile mode] Check symbol icons cut-offsMikhail Pozdnyakov2020-04-061-41/+60
|
* [render tests][tile mode] Enable automatic labels cut-off detectionMikhail Pozdnyakov2020-04-061-1/+62
|
* [core] Introduce Renderer::clearData() instead of keepRenderData map optionsMikhail Pozdnyakov2020-03-201-2/+2
| | | | | | | | | | `Renderer::clearData()` is a better API than the removed `MapOptions::keepRenderData()`: - gives more flexibility to the client - similar to the existing `Renderer::reduceMemoryUse()` - the `MapOptions::keepRenderData()` API implementation could not handle the raise condition, which happened if the new still image request had come before all tiles from the previous requests were loaded. Co-authored-by: Dane Springmeyer <dane@mapbox.com>
* [render tests] Unset `MapOptions::keepRenderData()` flag in tile modeMikhail Pozdnyakov2020-03-181-1/+2
|
* [render test runner] Enable pixel ratio in tile modeMikhail Pozdnyakov2020-03-051-6/+9
|
* [test-runner] Add iOS RenderTestRunner test metrics (#16139)zmiao2020-01-241-1/+1
| | | | | | * [test-runner] Add iOS RenderTestRunner test metrics * [test-runner] Add ios probe metrics
* [test-runner] Enable IOS RenderTestRunner and run it on Firebase (#16111)zmiao2020-01-211-1/+1
| | | | | | | | | | * [test-runner] Setup iOS RenderTestRunner * [test-runner] Make app runnable on firebase * Add iOS platform dependent expectation and ignores; Run prepare script via cmake * Make RenderTestRunner report test status
* [core] Modularize FileSource codebase (#15768)Alexander Shalamov2020-01-131-2/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [core] Introduce FileSourceManager and use it for default platform impl - Add `FileSourceManager` interface that provides access to `FileSource` instances and means of registering / unregistering `FileSource` factories - Split `DefaultFileSource` into smaller parts - Add `DatabaseFileSource` interface and it's default implementation - Remove inter-dependencies between concrete `FileSource` classes * [build] Add files to next build system * [core] Add generic property setters / getters * [core] Remove setOnlineStatus from OnlineFileSource interface * [core] Hide threading implementation details from DatabaseFileSource interface * [core] Make DB file source methods virtual * [core] Add documentation for DatabaseFileSource and rename one method * [core] Use simple callback instead of ActorRef * [core] Remove ActorRef from OnlineFileSource public header * [core] Add callback to FileSource::forward async API * [core] Pass OfflineRegionDefinition by value * [core] Update tests to use modular file sources * [core] Update unit tests * [core] Update unit tests after rebase * [core] Backport low prio fix for cached requests * [core] Backport pack database * [core] Return removed factory from unRegisterFileSourceFactory * [core] Rename shadowed args in onlinefilesource * [core] Remove simple std::function callback aliases * [core] Expose online file source property keys in public header file * [test-runner] Add proxy file source test runner * [cache] Update mbgl-cache utility to use new file source * [metrics] Rebaseline binary size metrics * [offline] Update offline utility * [core] Update changelog
* [render-test] Use image from the cache for addImage operationThiago Marcos P. Santos2020-01-081-3/+12
| | | | Instead of trying to read it from the filesystem.
* [render-test] Effectively use the offline cache for fixturesThiago Marcos P. Santos2020-01-081-4/+4
|
* [test runner] Show all tiles independently in Tile modeMikhail Pozdnyakov2019-12-181-7/+44
|
* [test runner] Rendering a single tile in Tile modeMikhail Pozdnyakov2019-12-181-9/+36
|
* [render-test] Cleanup on the render tests resultsThiago Marcos P. Santos2019-12-161-103/+102
| | | | | Simplify the code path and make it print both rendering error and metrics on fail.
* [render-test] Fix metrics passing when failingThiago Marcos P. Santos2019-12-161-11/+10
| | | | | | Metrics will now fail, but the tool will return 0 when *ONLY* metrics fail, to make the bot continue. We will also run ignored tests and check if they are ignored but passing.
* [test-runner] Fix network probeAlexander Shalamov2019-12-131-3/+7
|
* [render test] Fix probes failure reportsMikhail Pozdnyakov2019-12-131-2/+2
|
* [test runner] Refactor injected probes operations codeMikhail Pozdnyakov2019-12-131-123/+130
|
* [test runner] Split operations parsing and executionMikhail Pozdnyakov2019-12-131-642/+14
|
* [test runner] Introduce TestOperationMikhail Pozdnyakov2019-12-131-9/+16
|
* [test runner] Introduce generic TestContextMikhail Pozdnyakov2019-12-131-55/+62
|
* [test-runner] Don't update nor create metrics baseline for ignored testAlexander Shalamov2019-12-121-1/+3
|
* [test-runner] Fix -Werror=shadow issues in test runnerAlexander Shalamov2019-12-121-19/+18
|
* [test-runner] Add rebaseline flagAlexander Shalamov2019-12-091-5/+21
| | | | | Rebaseline flag allows to update or create new metric, in cases when metric check is failed or expected metric is missing.
* [test-runner] Simplify update option and remove obsolete ifdefsAlexander Shalamov2019-12-091-8/+0
|
* [test runner] Update test commands for Layer::setProperty()Mikhail Pozdnyakov2019-12-031-20/+4
|
* [test-runner] Log all 'probeFileSize' failuresAlexander Shalamov2019-12-021-5/+8
| | | | | If there are multiple file size probes in a test file, it is better to report all failures instead of first failed probe.
* [render-test] Add support for measuring compressed file sizeThiago Marcos P. Santos2019-11-281-1/+15
| | | | | Useful because for platform such as Android, we want to measure the size of the library inside the APK, which is usually compressed.
* [test runner] Enable test results update from cmd lineMikhail Pozdnyakov2019-11-271-6/+7
| | | | | | | | Added the following command line argument: ``` -u[update], --update=[update] Test results update mode. Supported values are: "default", "platform", "metrics" ```
* [test-runner] Move probe related command line args to manifestAlexander Shalamov2019-11-271-13/+12
| | | | | | | | | | | - Move probe related command line arguments to manifest, example: "probes": ["probeGFX", "probeNetwork", "probeMemory"], "metric_path": "metrics/linux" - Use manifest file name as a postfix for a result page - Move injected probes 'begin' section before map object creation - Generalize artifact storing shell script
* [render-test] Add metric_paths into Manifest (#15973)zmiao2019-11-271-175/+221
| | | | | | | | | | * [render-test]Add expected metrics path in manifest file * seperate metrics.json and expected.png * fix expected path parsing * keep expectation path if update is enabled
* [test-runner] Add render test runner options for injecting probesAlexander Shalamov2019-11-221-43/+153
| | | | | This allows injection of memory, gfx and network probes before and after operations defined in render test are run.
* [render-test] Wrap test data inside RenderTestRunner App + Add a new test ↵zmiao2019-11-191-1/+1
| | | | | | | | | | | | app (#15887) * [render-test] Wrap test resources inside app * [render-test] Add test app * fix test app failure * [render-test]add callback + add javaObjectWrapper
* fix -Wfor-loop-analysis and -Wreorder warnings (#15901)Dane Springmeyer2019-11-121-1/+2
|
* [render-test] Implement gfx probe for tracking gpu resourcesMikko Pulkki2019-10-301-4/+141
|
* [render-test] Add manifest parser for render-test-runner (#15861)zmiao2019-10-291-6/+14
| | | | | | | | | | * [render-test] Add manifest parser for render-test-runner * [render-test] Refactory manifest parser * [render-test] Parse full manifest file through CLI * [render-test] Add linux probe manifest
* [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832)zmiao2019-10-231-11/+7
| | | | | | * [render-test] Add configurable path via CLI arguments * [render-test] Change ignore path config
* [render-test] Implement fps benchmarking tests (#15803)Mikko Pulkki2019-10-221-58/+198
|
* [test runner] Improve error messaging for memory metrics testsMikhail Pozdnyakov2019-10-211-12/+9
|
* [test runner] Command line option for the tests expectations pathMikhail Pozdnyakov2019-10-211-9/+0
| | | | | | -e[expectationsPath], --expectationsPath=[expectationsPath] Test expectations path.
* [test runner] Disable memory metrics checks on sanitize buildsMikhail Pozdnyakov2019-10-211-1/+2
|
* [test runner] Tests for memory size metricsMikhail Pozdnyakov2019-10-211-1/+1
|
* [test runner] Threshold for memory metricsMikhail Pozdnyakov2019-10-211-9/+19
|
* [render-test] Add support for collecting network metricsJuha Alanen2019-10-161-0/+53
|
* [render-test] Add tolerance to file-size testsThiago Marcos P. Santos2019-10-141-3/+6
|
* [render-test] Fix UPDATE_METRICS=1 changing the path of file size testsThiago Marcos P. Santos2019-10-111-6/+8
| | | | Should use the exact same path as described on style.json
* [render-test] Make clang-format happyThiago Marcos P. Santos2019-10-101-44/+25
|
* [render-test] Add instruction for verifying file sizeThiago Marcos P. Santos2019-10-101-0/+49
| | | | | | | | | | For a given absolute or relative path, measure the size of the file. This is useful for measuring if the cache has increased as expected after moving a camera or decreased after cleaning up. In a more hackish manner, could be used for collecting binary size statistics of shared libraries.
* [test runner] Fix finding of expected images pathsMikhail Pozdnyakov2019-10-091-2/+2
| | | | | | | Before this change, the found paths to the expected images erroneously included the path to the `metrics.json` file (if this file was present) leading to raising of an unhandled exception.
* [tests] Share common code between test runnersJuha Alanen2019-10-081-114/+1
|
View Lorry Controller Status