summaryrefslogtreecommitdiff
path: root/render-test
Commit message (Collapse)AuthorAgeFilesLines
* [render-test] Fix loggingThiago Marcos P. Santos2020-04-171-0/+2
| | | | Was broken after logging got moved to its own thread.
* [core] PlacedSymbolData contains layer idMikhail Pozdnyakov2020-04-091-3/+3
|
* [render tests][tile mode] Check symbol icons cut-offsMikhail Pozdnyakov2020-04-063-41/+62
|
* [render tests][tile mode] Enable automatic labels cut-off detectionMikhail Pozdnyakov2020-04-064-4/+68
|
* [core] Introduce Renderer::clearData() instead of keepRenderData map optionsMikhail Pozdnyakov2020-03-201-2/+2
| | | | | | | | | | `Renderer::clearData()` is a better API than the removed `MapOptions::keepRenderData()`: - gives more flexibility to the client - similar to the existing `Renderer::reduceMemoryUse()` - the `MapOptions::keepRenderData()` API implementation could not handle the raise condition, which happened if the new still image request had come before all tiles from the previous requests were loaded. Co-authored-by: Dane Springmeyer <dane@mapbox.com>
* [build] Use found code sign identitieszmiao2020-03-191-6/+9
|
* [render tests] Unset `MapOptions::keepRenderData()` flag in tile modeMikhail Pozdnyakov2020-03-181-1/+2
|
* [test][ios] Update iOS render test data setup scriptJuha Alanen2020-03-121-13/+20
|
* [render test runner] Enable pixel ratio in tile modeMikhail Pozdnyakov2020-03-052-27/+39
|
* [build][ios] Refactor iOS test runner CI job configsJuha Alanen2020-02-271-2/+2
|
* [core] FileSourceManager::getFileSource() returns PassRefPtrMikhail Pozdnyakov2020-02-261-1/+1
|
* [core] Consolidate file source keys in the generic FileSource headerMikhail Pozdnyakov2020-02-251-1/+1
| | | | | Thus we do not need to include specific headers to use `{set|get}Property` API with key constants.
* [test-runner] Share common code between test runnersJuha Alanen2020-02-181-9/+0
| | | | Also remove some unnecessary files.
* [test-runner] Share common code between iOS test runnersJuha Alanen2020-02-149-303/+0
|
* [build] Move the `next` buildsystem to the rootThiago Marcos P. Santos2020-02-073-15/+68
| | | | | | | | This will make the `next` buildsystem no longer the `next`, but the `actual`. The idea is to simplify the build, removing scripts, to make the platform buildsystem generated by CMake more compatible with IDEs and make development more streamlined. It will also make cross compilation easier.
* [test-runner] Enable rebaseline for next-ios-render-test-runner (#16147)zmiao2020-01-285-4/+71
|
* [build] Cleanup CircleCI configurationThiago Marcos P. Santos2020-01-284-11/+11
| | | | | - Remove the legacy build jobs - Remove the next- namespace.
* [test-runner] Add iOS RenderTestRunner test metrics (#16139)zmiao2020-01-246-36/+76
| | | | | | * [test-runner] Add iOS RenderTestRunner test metrics * [test-runner] Add ios probe metrics
* [test-runner] Enable IOS RenderTestRunner and run it on Firebase (#16111)zmiao2020-01-2130-1/+907
| | | | | | | | | | * [test-runner] Setup iOS RenderTestRunner * [test-runner] Make app runnable on firebase * Add iOS platform dependent expectation and ignores; Run prepare script via cmake * Make RenderTestRunner report test status
* [core] Modularize FileSource codebase (#15768)Alexander Shalamov2020-01-135-22/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [core] Introduce FileSourceManager and use it for default platform impl - Add `FileSourceManager` interface that provides access to `FileSource` instances and means of registering / unregistering `FileSource` factories - Split `DefaultFileSource` into smaller parts - Add `DatabaseFileSource` interface and it's default implementation - Remove inter-dependencies between concrete `FileSource` classes * [build] Add files to next build system * [core] Add generic property setters / getters * [core] Remove setOnlineStatus from OnlineFileSource interface * [core] Hide threading implementation details from DatabaseFileSource interface * [core] Make DB file source methods virtual * [core] Add documentation for DatabaseFileSource and rename one method * [core] Use simple callback instead of ActorRef * [core] Remove ActorRef from OnlineFileSource public header * [core] Add callback to FileSource::forward async API * [core] Pass OfflineRegionDefinition by value * [core] Update tests to use modular file sources * [core] Update unit tests * [core] Update unit tests after rebase * [core] Backport low prio fix for cached requests * [core] Backport pack database * [core] Return removed factory from unRegisterFileSourceFactory * [core] Rename shadowed args in onlinefilesource * [core] Remove simple std::function callback aliases * [core] Expose online file source property keys in public header file * [test-runner] Add proxy file source test runner * [cache] Update mbgl-cache utility to use new file source * [metrics] Rebaseline binary size metrics * [offline] Update offline utility * [core] Update changelog
* [render-test] Make the manifest mandatoryThiago Marcos P. Santos2020-01-082-8/+6
| | | | At the moment we have an invalid path as default.
* [render-test] Remove positional argumentThiago Marcos P. Santos2020-01-083-43/+20
| | | | Not in use, for running a single test, use -f instead.
* [core] Make it possible to reopen the database read-only for testingThiago Marcos P. Santos2020-01-081-0/+6
| | | | | | Needed for Android, because the database is in readonly filesystem and also because it is annoying to see files modified every time we run the tests.
* [metrics] Use the cache database instead of file paths for fixturesThiago Marcos P. Santos2020-01-081-12/+2
| | | | | Now that we use a cache, we no longer need "asset_path" and "vendor_path".
* [render-test] Use image from the cache for addImage operationThiago Marcos P. Santos2020-01-084-11/+37
| | | | Instead of trying to read it from the filesystem.
* [render-test] Effectively use the offline cache for fixturesThiago Marcos P. Santos2020-01-089-267/+87
|
* [render-test] Add access token to the test manifestThiago Marcos P. Santos2020-01-082-1/+27
| | | | | Needed if we want to run tests online. Will default to the MAPBOX_ACCESS_TOKEN environment value.
* [render-test] Add flag to run tests onlineThiago Marcos P. Santos2020-01-081-3/+11
| | | | | And also make it not go to the network by setting the status explicitly when when the -o flag is not passed.
* [render-test] Add cache database path to the manifestThiago Marcos P. Santos2020-01-082-0/+18
| | | | A path relative to the manifest pointing at the data cache.
* [render-test] Fixed typo and remove unusedThiago Marcos P. Santos2020-01-081-29/+14
|
* [test runner] Show all tiles independently in Tile modeMikhail Pozdnyakov2019-12-181-7/+44
|
* [test runner] Rendering a single tile in Tile modeMikhail Pozdnyakov2019-12-183-11/+40
|
* [render-tests] Fix tests not rendering when both metrics and render failsThiago Marcos P. Santos2019-12-171-5/+7
|
* [render-test] Cleanup on the render tests resultsThiago Marcos P. Santos2019-12-165-120/+129
| | | | | Simplify the code path and make it print both rendering error and metrics on fail.
* [build] Collect and publish new baselinesThiago Marcos P. Santos2019-12-161-1/+1
| | | | Also fail the bot in case there are new baselines.
* [build] Reorganize the render testsThiago Marcos P. Santos2019-12-16100-1216/+5
| | | | | | Move everything that might collect metrics to the metrics/ directory, the only test manifests inside the render-test/ directory are the unit tests of the probes.
* [render-test] Fix metrics passing when failingThiago Marcos P. Santos2019-12-163-16/+32
| | | | | | Metrics will now fail, but the tool will return 0 when *ONLY* metrics fail, to make the bot continue. We will also run ignored tests and check if they are ignored but passing.
* [test runner] Explicitly initialize TestContext POD membersMikhail Pozdnyakov2019-12-141-2/+2
|
* [test-runner] Fix network probeAlexander Shalamov2019-12-131-3/+7
|
* [render test] Fix probes failure reportsMikhail Pozdnyakov2019-12-133-11/+7
|
* [test runner] Refactor injected probes operations codeMikhail Pozdnyakov2019-12-132-126/+130
|
* [test runner] Split operations parsing and executionMikhail Pozdnyakov2019-12-135-663/+805
|
* [test runner] Introduce TestOperationMikhail Pozdnyakov2019-12-132-9/+18
|
* [test runner] Introduce generic TestContextMikhail Pozdnyakov2019-12-132-59/+80
|
* [test-runner] Don't update nor create metrics baseline for ignored testAlexander Shalamov2019-12-123-2/+5
|
* [test-runner] Fix -Werror=shadow issues in test runnerAlexander Shalamov2019-12-121-19/+18
|
* [metrics] Run Android RenderTestRunner bot in rebaseline mode (#16036)zmiao2019-12-111146-53552/+6
|
* [test-runner] Add desctiption for --update commandAlexander Shalamov2019-12-101-1/+4
|
* [test runner] Report absolute path to the results html fileMikhail Pozdnyakov2019-12-101-1/+1
|
* [test-runner] Add rebaseline flagAlexander Shalamov2019-12-093-7/+24
| | | | | Rebaseline flag allows to update or create new metric, in cases when metric check is failed or expected metric is missing.