dart-sdk/tests/lib
Sigmund Cherem a7104c813f [tests] update periodic_timer tests to reduce flakiness.
These tests check for lowerbounds on the time it took to fire an
event. Unfortunately, browsers may complete events ahead of time.
This has caused these tests to be flaky in dart2js and ddc [1]

In a local experiment, we've seen timers complete +-15ms from
the expected time. Most often they are around +-5ms, but those more
extreme cases do happen. Recent flakiness logs show some good samples:
* off by 1ms: [2] and [3]
* off by 4ms: [4]
* off by 13ms: [5]

This CL makes two adjustments to reduce flakiness:
* account for the fact that timers may complete early (checking that
  they are >= than the expected timeout - 40ms)
* increase intervals to 50ms in order to prevent overlap between two
  events in the worse scenario that both happen on the extreme variances
  (+15ms and -15ms respectively).

[1]: https://dart-current-results.web.app/#/filter=lib/async/periodic_timer,dart2js,ddc&showAll
[2]: https://logs.chromium.org/logs/dart/buildbucket/cr-buildbucket/8766776511992750881/+/u/test_results/ignored_flaky_test_failure_logs
[3]: https://logs.chromium.org/logs/dart/buildbucket/cr-buildbucket/8766798962026535617/+/u/test_results/ignored_flaky_test_failure_logs
[4]: https://logs.chromium.org/logs/dart/buildbucket/cr-buildbucket/8767378609439308945/+/u/test_results/ignored_flaky_test_failure_logs
[5]: https://logs.chromium.org/logs/dart/buildbucket/cr-buildbucket/8767357850408867553/+/u/test_results/ignored_flaky_test_failure_logs

Change-Id: Ib46d6f33f5c2b1458f393e8b4c75c84453e73024
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/331210
Reviewed-by: Stephen Adams <sra@google.com>
Commit-Queue: Sigmund Cherem <sigmund@google.com>
2023-10-26 00:56:43 +00:00
..
analyzer Set up new test suites for migrating the tests to NNBD. 2019-11-19 00:18:43 +00:00
async [tests] update periodic_timer tests to reduce flakiness. 2023-10-26 00:56:43 +00:00
collection [flip-modifiers]: prep more tests for the class modifiers flag flip 2023-03-06 20:52:03 +00:00
convert [dart2wasm] Fix string array copy in UTF8 decoder 2023-10-24 12:02:48 +00:00
developer [ dart:developer ] Remove Metrics related classes 2023-03-10 16:50:10 +00:00
fix_data_tests Remove deprecated APIs from dart:developer 2022-07-19 07:10:03 +00:00
html Reland "[dart:html] Throw exception if Window.open opens null window" and 2023-07-06 15:50:48 +00:00
isolate [vm/ffi] Weak RawReceivePorts and NativeCallables 2023-08-14 02:30:11 +00:00
js [dart:js_interop] Add/fix some js_interop helpers 2023-09-23 18:32:59 +00:00
js_interop_unsafe [dart:js_interop] Add/fix some js_interop helpers 2023-09-23 18:32:59 +00:00
math Spelling tests 2023-01-19 16:24:29 +00:00
mirrors [gardening] Remove lib{,_2}/mirrors/typedef_test 2023-10-24 12:17:03 +00:00
typed_data Reapply "[typed_data] Deprecate UnmodifiableUint8ListView and friends" 2023-10-23 18:14:33 +00:00
web [web] remove mirrors patch for web compilers. 2020-07-16 00:12:22 +00:00
lib.status [dart2js] Disable Timeline is performance.measure is absent 2023-10-17 20:23:43 +00:00
lib_analyzer.status Set up new test suites for migrating the tests to NNBD. 2019-11-19 00:18:43 +00:00
lib_app_jit.status Set up new test suites for migrating the tests to NNBD. 2019-11-19 00:18:43 +00:00
lib_dart2js.status [dart2wasm] Rename the dart:wasm library to dart:_wasm. 2023-04-04 11:52:18 +00:00
lib_dartdevc.status [ddc] Unskip tests on canary configs 2023-09-19 20:59:33 +00:00
lib_kernel.status [gardening] Mark all tests as slow in debug-ia32 mode 2022-07-21 10:22:45 +00:00
lib_precompiled.status [testing] Remove --compiler=none from test.py 2022-10-19 08:09:58 +00:00
lib_vm.status [test] Remove ARM64-specific status entries. 2023-10-09 19:30:29 +00:00