Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | [test-runner] Simplify update option and remove obsolete ifdefs | Alexander Shalamov | 2019-12-09 | 2 | -33/+12 | |
| | ||||||
* | [metrics] Create gcc8-release metrics configuration | Alexander Shalamov | 2019-12-09 | 1145 | -40096/+0 | |
| | ||||||
* | [metrics] Update render-test-probe-unit-tests memory expectations | Mikhail Pozdnyakov | 2019-12-09 | 4 | -16/+16 | |
| | ||||||
* | [core] Refactoring transform state (#15956) | zmiao | 2019-12-05 | 2 | -4/+4 | |
| | | | | | | | | | | * [core] Refactoring transform state class * [core] update matrix in transform, Fix precision * [core] Make matrix mutable so that we only update them when needed * [core] Add getters for matrices | |||||
* | [test-runner] Make Android RenderTestRunner bot fail when test cases are not ↵ | zmiao | 2019-12-04 | 28 | -14/+342 | |
| | | | | | | | | | | | | | | fully passed (#15994) * [test-runner] Fix failed tests, generate android specific expectations * [test-runner] Check render test runner testing result * [test-runner] Add error case to android ignore list * [test-runner] Update metrics * [test-runner] Move Android render tests with big diff(>0.006) to ignore list | |||||
* | [test-runner] Allow to define filter inside manifest file | Alexander Shalamov | 2019-12-03 | 5 | -7/+17 | |
| | | | | | Command line option is still available and allows to override filter that is defined in a manifest file. | |||||
* | [test runner] Update test commands for Layer::setProperty() | Mikhail Pozdnyakov | 2019-12-03 | 1 | -20/+4 | |
| | ||||||
* | [metrics] Add baselines for formatted-images and line-dasharray render tests | Alexander Shalamov | 2019-12-02 | 9 | -0/+315 | |
| | ||||||
* | [test-runner] Add android RenderTestRunner baseline metrics (#15979) | zmiao | 2019-12-02 | 1136 | -3/+53232 | |
| | | | | | | | | | | * [test-runner] Enable probe-testing android render test runner * [test-runner] Add pixel4 baseline metrics * Add git ignored metrics * Make renderTestrunner run two times with different manifest config | |||||
* | [test-runner] Log all 'probeFileSize' failures | Alexander Shalamov | 2019-12-02 | 1 | -5/+8 | |
| | | | | | If there are multiple file size probes in a test file, it is better to report all failures instead of first failed probe. | |||||
* | [test-runner] Run render tests with metrics on linux | Juha Alanen | 2019-11-29 | 4 | -1/+25 | |
| | ||||||
* | [test-runner] Add baseline metrics for linux | Juha Alanen | 2019-11-29 | 1134 | -0/+39762 | |
| | ||||||
* | [render-test] Add support for measuring compressed file size | Thiago Marcos P. Santos | 2019-11-28 | 3 | -4/+30 | |
| | | | | | Useful because for platform such as Android, we want to measure the size of the library inside the APK, which is usually compressed. | |||||
* | [metrics] Make the parsing of metrics even more strict | Thiago Marcos P. Santos | 2019-11-28 | 1 | -1/+1 | |
| | | | | File must be `metrics.json`. | |||||
* | [render-test] Fix regex matching the directory name | Thiago Marcos P. Santos | 2019-11-27 | 1 | -3/+3 | |
| | | | | | This code was matching `style.json` instead of `metrics.json` if the `style.json` was contained inside `metrics/.../style.json`. | |||||
* | [test runner] Enable test results update from cmd line | Mikhail Pozdnyakov | 2019-11-27 | 3 | -10/+45 | |
| | | | | | | | | Added the following command line argument: ``` -u[update], --update=[update] Test results update mode. Supported values are: "default", "platform", "metrics" ``` | |||||
* | [test-runner] Move probe related command line args to manifest | Alexander Shalamov | 2019-11-27 | 5 | -38/+48 | |
| | | | | | | | | | | | - Move probe related command line arguments to manifest, example: "probes": ["probeGFX", "probeNetwork", "probeMemory"], "metric_path": "metrics/linux" - Use manifest file name as a postfix for a result page - Move injected probes 'begin' section before map object creation - Generalize artifact storing shell script | |||||
* | [render-test] Add metric_paths into Manifest (#15973) | zmiao | 2019-11-27 | 11 | -197/+275 | |
| | | | | | | | | | | * [render-test]Add expected metrics path in manifest file * seperate metrics.json and expected.png * fix expected path parsing * keep expectation path if update is enabled | |||||
* | [test-runner] Add render test runner options for injecting probes | Alexander Shalamov | 2019-11-22 | 3 | -48/+177 | |
| | | | | | This allows injection of memory, gfx and network probes before and after operations defined in render test are run. | |||||
* | [render-test] Adding mvt-fixture to app asset content (#15955) | zmiao | 2019-11-21 | 1 | -0/+1 | |
| | ||||||
* | [build] Build Android release when running render tests | Thiago Marcos P. Santos | 2019-11-21 | 1 | -3/+12 | |
| | ||||||
* | [render-test] Config CircleCi to run RenderTestApp on Firebase with Pixel4 ↵ | zmiao | 2019-11-20 | 1 | -0/+11 | |
| | | | | | (#15951) This reverts commit d2413d4ffffd087b352b6e4edd6e6322a311bc07. | |||||
* | [render-test] Wrap test data inside RenderTestRunner App + Add a new test ↵ | zmiao | 2019-11-19 | 13 | -59/+96 | |
| | | | | | | | | | | | | app (#15887) * [render-test] Wrap test resources inside app * [render-test] Add test app * fix test app failure * [render-test]add callback + add javaObjectWrapper | |||||
* | fix -Wfor-loop-analysis and -Wreorder warnings (#15901) | Dane Springmeyer | 2019-11-12 | 2 | -4/+5 | |
| | ||||||
* | [render-test] Fix render-test manifest confilicted local and member names ↵ | zmiao | 2019-11-05 | 1 | -8/+8 | |
| | | | | (#15888) | |||||
* | [render-test]Fix regex match for testFilter input (#15886) | zmiao | 2019-11-04 | 1 | -2/+2 | |
| | ||||||
* | [render-test] Add gfx probe test cases | Mikko Pulkki | 2019-10-30 | 31 | -1/+266 | |
| | ||||||
* | [render-test] Implement gfx probe for tracking gpu resources | Mikko Pulkki | 2019-10-30 | 4 | -6/+237 | |
| | ||||||
* | [render-test] Add manifest parser for render-test-runner (#15861) | zmiao | 2019-10-29 | 13 | -440/+621 | |
| | | | | | | | | | | * [render-test] Add manifest parser for render-test-runner * [render-test] Refactory manifest parser * [render-test] Parse full manifest file through CLI * [render-test] Add linux probe manifest | |||||
* | [core,android,darwin,qt] Add fields related to feature-state | Juha Alanen | 2019-10-28 | 1 | -7/+13 | |
| | | | | | Move the fields from geometry.hpp/feature.hpp as they are not part of the GeoJSON specification. | |||||
* | [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) | zmiao | 2019-10-23 | 5 | -106/+160 | |
| | | | | | | * [render-test] Add configurable path via CLI arguments * [render-test] Change ignore path config | |||||
* | [test-runner] Run render test runner as a NativeActivity app on android ↵ | zmiao | 2019-10-22 | 18 | -5/+388 | |
| | | | | | | | | | | | | device (#15827) * [test-runner]Add android render-test-runner NativeActivity app * [test-runner] Fix cmake for CI build failure * [test-runner] Update folder location, change app configureation * [test-runner] Add running instruction | |||||
* | [render-test] Implement fps benchmarking tests (#15803) | Mikko Pulkki | 2019-10-22 | 5 | -74/+275 | |
| | ||||||
* | [test runner] Improve error messaging for memory metrics tests | Mikhail Pozdnyakov | 2019-10-21 | 2 | -15/+10 | |
| | ||||||
* | [test runner] Memory metrics expectations for MAC | Mikhail Pozdnyakov | 2019-10-21 | 2 | -0/+19 | |
| | ||||||
* | [test runner] Command line option for the tests expectations path | Mikhail Pozdnyakov | 2019-10-21 | 4 | -30/+38 | |
| | | | | | | -e[expectationsPath], --expectationsPath=[expectationsPath] Test expectations path. | |||||
* | [test runner] Adjust memory metrics test results | Mikhail Pozdnyakov | 2019-10-21 | 5 | -5/+62 | |
| | ||||||
* | [test runner] Disable memory metrics checks on sanitize builds | Mikhail Pozdnyakov | 2019-10-21 | 1 | -1/+2 | |
| | ||||||
* | [test runner] Tests for memory size metrics | Mikhail Pozdnyakov | 2019-10-21 | 11 | -2/+163 | |
| | ||||||
* | [test runner] Threshold for memory metrics | Mikhail Pozdnyakov | 2019-10-21 | 3 | -13/+30 | |
| | ||||||
* | [render-test] Add network metrics test case | Juha Alanen | 2019-10-16 | 13 | -1/+328 | |
| | ||||||
* | [render-test] Add support for collecting network metrics | Juha Alanen | 2019-10-16 | 5 | -1/+202 | |
| | ||||||
* | [test-runner] make render-test a shared lib (#15816) | zmiao | 2019-10-15 | 2 | -2/+16 | |
| | | | | | | | | | | * [test-runner] make render-test a shared lib [test-runner] nit [test-runner] nit again * [test-runner] Remove redundant linked file in cmake | |||||
* | [render-test] Add test for file size tolerance | Thiago Marcos P. Santos | 2019-10-14 | 6 | -0/+92 | |
| | ||||||
* | [render-test] Add tolerance to file-size tests | Thiago Marcos P. Santos | 2019-10-14 | 9 | -16/+27 | |
| | ||||||
* | [render-test] No camelCase on the metrics.json tag | Thiago Marcos P. Santos | 2019-10-11 | 16 | -12/+12 | |
| | | | | It is ugly. | |||||
* | [render-test] Prettyfy metrics output | Thiago Marcos P. Santos | 2019-10-11 | 5 | -5/+57 | |
| | ||||||
* | [render-test] Add more probe tests for file size | Thiago Marcos P. Santos | 2019-10-11 | 13 | -32/+50 | |
| | | | | Also make the tests simpler. | |||||
* | [render-test] Fix UPDATE_METRICS=1 changing the path of file size tests | Thiago Marcos P. Santos | 2019-10-11 | 4 | -9/+11 | |
| | | | | Should use the exact same path as described on style.json | |||||
* | [render-test] Only write metrics if they are available | Thiago Marcos P. Santos | 2019-10-10 | 1 | -18/+20 | |
| | | | | Otherwise the file will have an empty tag. |