diff options
| author | Adam Bookatz <bookatz@google.com> | 2020-05-08 16:31:01 -0700 |
|---|---|---|
| committer | Adam Bookatz <bookatz@google.com> | 2020-05-13 11:16:39 -0700 |
| commit | a71fdb9ef758e2407cdb93de5c2279ec0d79566c (patch) | |
| tree | 48c9d9977f030437ebfa1a78c6ac02e44a137536 /docs/html/sdk/api_diff/13/changes | |
| parent | e9a5ad988462e96155a759f4b0020e533a335e54 (diff) | |
UserLifecycleTests handles crashes
Previously, if a test failed or crashed, no results
would be returned. And if the test 'succeeded', but
with the wrong data (e.g. the secondary user actually
failed to be created), the results would simply display
bad data.
Here, we make it so that *any* test failure will officially
report a value of -10ms.
-10ms was chosen since it is clearly 'wrong' yet won't skew
the dashboard (since the value is not far from 0).
The actual runs will be allowed to proceed, so that more
detailed information will be available in the logs. But
the final reported Benchmark data will be a simple -10ms.
At this point, we take the approach that if one of the four
iterations fail, the entire test is declared to have failed.
This is to highlight failures, since we don't know their
frequency yet. We may change this in the future.
Test: atest UserLifecycleTests (and trigger some failures)
Bug: 137127051
Change-Id: Iab4e4d9c5194976af8e53bc8808a4a16918e0865
Diffstat (limited to 'docs/html/sdk/api_diff/13/changes')
0 files changed, 0 insertions, 0 deletions
