diff options
| author | Thiago Marcos P. Santos <tmpsantos@gmail.com> | 2019-12-15 01:13:17 +0200 |
|---|---|---|
| committer | Thiago Marcos P. Santos <tmpsantos@gmail.com> | 2019-12-16 22:52:01 +0200 |
| commit | 1c138124a62bf971ace637ac76c752a488e99989 (patch) | |
| tree | e14bb6100abc9dcee123392e8f1a8843c72251ae /render-test/runner.hpp | |
| parent | 65140e3e6012c8aac077f30cd722b12ab6c836d7 (diff) | |
| download | qtlocation-mapboxgl-1c138124a62bf971ace637ac76c752a488e99989.tar.gz | |
[render-test] Fix metrics passing when failing
Metrics will now fail, but the tool will return 0 when *ONLY* metrics
fail, to make the bot continue. We will also run ignored tests and
check if they are ignored but passing.
Diffstat (limited to 'render-test/runner.hpp')
| -rw-r--r-- | render-test/runner.hpp | 8 |
1 files changed, 7 insertions, 1 deletions
diff --git a/render-test/runner.hpp b/render-test/runner.hpp index 7fbe0f7677..9d106c879e 100644 --- a/render-test/runner.hpp +++ b/render-test/runner.hpp @@ -36,8 +36,14 @@ public: class TestRunner { public: enum class UpdateResults { NO, DEFAULT, PLATFORM, METRICS, REBASELINE }; + + struct TestResults { + bool probeFailed; + bool renderFailed; + }; + TestRunner(Manifest, UpdateResults); - bool run(TestMetadata&); + TestResults run(TestMetadata&); void reset(); // Manifest |