summaryrefslogtreecommitdiff
path: root/docs/html/sdk/api_diff/13/changes
diff options
context:
space:
mode:
authorAdam Bookatz <bookatz@google.com>2020-05-08 16:31:01 -0700
committerAdam Bookatz <bookatz@google.com>2020-05-13 11:16:39 -0700
commita71fdb9ef758e2407cdb93de5c2279ec0d79566c (patch)
tree48c9d9977f030437ebfa1a78c6ac02e44a137536 /docs/html/sdk/api_diff/13/changes
parente9a5ad988462e96155a759f4b0020e533a335e54 (diff)
UserLifecycleTests handles crashes
Previously, if a test failed or crashed, no results would be returned. And if the test 'succeeded', but with the wrong data (e.g. the secondary user actually failed to be created), the results would simply display bad data. Here, we make it so that *any* test failure will officially report a value of -10ms. -10ms was chosen since it is clearly 'wrong' yet won't skew the dashboard (since the value is not far from 0). The actual runs will be allowed to proceed, so that more detailed information will be available in the logs. But the final reported Benchmark data will be a simple -10ms. At this point, we take the approach that if one of the four iterations fail, the entire test is declared to have failed. This is to highlight failures, since we don't know their frequency yet. We may change this in the future. Test: atest UserLifecycleTests (and trigger some failures) Bug: 137127051 Change-Id: Iab4e4d9c5194976af8e53bc8808a4a16918e0865
Diffstat (limited to 'docs/html/sdk/api_diff/13/changes')
0 files changed, 0 insertions, 0 deletions