diff options
| author | zmiao <miao.zhao@mapbox.com> | 2019-12-04 18:10:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2019-12-04 18:10:58 +0200 |
| commit | e619552a5df5fdfa3c95efa0959ff2da20eac452 (patch) | |
| tree | 3974202bcb6db6ed097141b3f5b153678a2a648b /circle.yml | |
| parent | 1e2cd1e086c3053f1cea075d7641b7f56cc7dfbf (diff) | |
| download | qtlocation-mapboxgl-e619552a5df5fdfa3c95efa0959ff2da20eac452.tar.gz | |
[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)
* [test-runner] Fix failed tests, generate android specific expectations
* [test-runner] Check render test runner testing result
* [test-runner] Add error case to android ignore list
* [test-runner] Update metrics
* [test-runner] Move Android render tests with big diff(>0.006) to ignore list
Diffstat (limited to 'circle.yml')
| -rw-r--r-- | circle.yml | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/circle.yml b/circle.yml index 1290338091..2cd1aa4b37 100644 --- a/circle.yml +++ b/circle.yml @@ -665,6 +665,12 @@ jobs: --device-ids flame --os-version-ids 29 --locales en --orientations portrait --timeout 20m \ --directories-to-pull /sdcard --results-dir render-test-app-${CIRCLE_BUILD_NUM} \ --no-record-video --no-performance-metrics + fi + - run: + name: Retrieve TestResult from gcloud + when: always + command: | + if [[ -n "${GCLOUD_SERVICE_ACCOUNT_JSON}" && -z "${SKIP_FIREBASE:-}" ]]; then testResult=$(gsutil ls gs://test-lab-186672a0qp5bq-ycr70axads3nc/render-test-app-${CIRCLE_BUILD_NUM}/**/*.html) mkdir -p /tmp/tests/render-test-app gsutil cp $testResult /tmp/tests/render-test-app | true |