dart-sdk/tools
Alexander Thomas 14b1d2feb8 [infra] Make deflaking optional in test.dart
This adds a "--deflake" flag to test.dart. Deflaking will only run if
that flag is set.

Deflaking is time consuming and delays the information that users want
to see when most of the time they know that the result is not caused by
flakiness.

A typical session may look like this:
* Run test.dart with a broad test selector without deflaking.
* Re-run test.dart with a narrow test selector for suspected flakes with
  "--deflake". This second step is optional.

Additionally, a new "--report-flakes" flag is added that can be
used to report test failures for tests known to be flaky.

Change-Id: I543d0b40c32065eb0a50338c55e7050b7887abce
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/102381
Reviewed-by: Jonas Termansen <sortie@google.com>
2019-05-23 12:56:06 +00:00
..
abiversions Reland https://dart-review.googlesource.com/c/sdk/+/96500 2019-03-13 21:03:01 +00:00
android Cherry-pick 031e77eea1 to the analyzer branch. 2018-11-29 22:14:23 +00:00
apps/update_homebrew Generate homebrew script compatible with latest changes 2019-01-10 16:43:34 +00:00
bots Enforce DDC lints 2019-05-20 21:40:38 +00:00
buildtools Cherry-pick 031e77eea1 to the analyzer branch. 2018-11-29 22:14:23 +00:00
dart2js Remove usage of pkg:browser from tools/dart2js/sourceMapViewer 2018-03-21 20:22:10 +00:00
dom New DomExceptions added to browsers. 2019-03-18 15:18:25 +00:00
gardening Remove unnecessary flags for dart2js from test.dart 2019-03-14 22:01:13 +00:00
linux_dist_support/debian [infra] Update debian package metadata 2018-11-07 09:54:46 +00:00
migration Convert a batch of negative tests to multitests. 2018-06-08 19:43:34 +00:00
patches [gardening] Update 3xHEAD apply script. 2019-05-21 14:35:32 +00:00
sdks [fuchsia] Add SDK prebuilts to .gitignore 2018-07-23 18:48:09 +00:00
spec_parser Updated Dart.g, tests & status files to support ui-as-code collections 2019-03-29 13:33:52 +00:00
test_generators Add tests for bug #33660 2018-07-09 11:38:17 +00:00
testing Revert "[Test] Remove some dead code." 2019-05-21 23:47:49 +00:00
.gitignore Reland https://dart-review.googlesource.com/c/sdk/+/96500 2019-03-13 21:03:01 +00:00
3xhead_flutter_hooks.sh [infra] Extend 3head patching to apply patches for flutter/flutter depending on pinned engine commit 2019-02-04 12:37:10 +00:00
addlatexhash.dart Support latest pkg:html in analyzer, analyzer_plugin 2019-04-09 02:06:09 +00:00
approve_results.dart [infra] Fix approve_results race condition checking failing on new builders. 2019-03-27 09:56:22 +00:00
archive_crash.py
build.py [vm/compiler] Instroduce SIMARM_X64 build architecture. 2019-05-06 10:48:08 +00:00
canary.dart
clean_output_directory.py
copy_dart.py
copy_tree.py Fix build when python=python3 2019-04-23 07:48:15 +00:00
create_debian_chroot.sh Update linux distribution support to Debian Jesse 2016-08-17 12:37:42 +02:00
create_debian_packages.py Debian package building should show all output to stdout 2017-10-13 14:18:33 +00:00
create_pkg_manifest.py [fuchsia] Handle host_{cpu,os} vars in DEPS 2019-01-02 16:17:22 +00:00
create_tarball.py [build] Don't add a device to the source tarball. 2018-06-11 21:16:47 +00:00
create_timestamp_file.py Fuchsia: Allows building the full SDK for host and target. 2016-12-13 13:02:52 -08:00
diff_results.dart [Gardening] Add tools/diff_results.dart which can query the test results database and report a diff in test results from two commits 2019-03-07 12:50:10 +00:00
disguised_test.py [infra] Prevent front end unit tests from being approved. 2019-05-03 12:38:22 +00:00
download_abi_dills.py Fix build when python=python3 2019-04-23 07:48:15 +00:00
download_chromium_sysroot.sh Add tools to build Dart with Chromium's sysroot. 2016-08-10 16:04:03 +02:00
download_latest_dev_sdk.py [infra] Download checked in SDKs from CIPD 2018-06-28 16:08:14 +00:00
execute_recorded_testcases.py
FAKE_COMMITS [infra] Switch benchmark builders to Ubuntu 16.04. 2019-04-03 11:42:11 +00:00
find_depot_tools.py GN build on windows 2016-10-04 09:19:07 -07:00
gen_fuchsia_test_manifest.py [infra] Use new GN template to assemble Fuchsia test image 2017-10-24 15:27:58 +00:00
generate_buildfiles.py Fix build when python=python3 2019-04-23 07:48:15 +00:00
generate_idefiles.py [vm] Allow choosing architecture for runtime sources in generate_idefiles.py. 2019-01-11 15:16:34 +00:00
gn.py [vm/compiler] Instroduce SIMARM_X64 build architecture. 2019-05-06 10:48:08 +00:00
gn_helpers.py
line_doc_comments.dart Fix path to pkg/path – .packages resolution works to the root of repo 2017-08-04 11:14:23 -07:00
list_dart_files.py Make list_files.py and list_dart_files.py return absolute paths for GN 2016-12-13 10:01:28 -08:00
list_files.py Make list_files.py and list_dart_files.py return absolute paths for GN 2016-12-13 10:01:28 -08:00
make_bundle_unittest.py
make_version.py Add a option to pass in version file to tools 2019-04-29 16:40:50 +00:00
minidump.py Fix build when python=python3 2019-04-23 07:48:15 +00:00
only_in_release_mode.py
patch_sdk.dart Stop using external deprecated members in front_end 2019-01-15 18:55:10 +00:00
presubmit.sh
promote.py [infra] Make promote.py work with newer versions of gsutil 2019-03-06 12:43:07 +00:00
publish_pkg.py
revert.py
run_abi_tests.py test_matrix.json changes for ABI tests 2019-05-02 19:16:15 +00:00
run_debian_build.sh [infra] Fix debianpackage build 2019-04-01 08:26:46 +00:00
safari_factory_reset.py Revert "Revert "Make Safari tests more robust."" 2016-06-15 04:29:33 -07:00
set_ia32_sysroot.sh [build] Move to Jessie sysroots from Wheezy sysroots. 2018-10-25 15:05:22 +00:00
set_x64_sysroot.sh [build] Move to Jessie sysroots from Wheezy sysroots. 2018-10-25 15:05:22 +00:00
spec_parse.py Updated spec_parser such that it runs with ANTLR v4 2019-03-19 14:06:26 +00:00
status_clean.dart Remove the Dart 1 tests. 2018-10-11 23:45:18 +00:00
task_kill.py [Gardening] Kill any leaked flutter_tester processes before/after 3-head builder work 2019-01-03 15:30:11 +00:00
test.dart [infra] Make deflaking optional in test.dart 2019-05-23 12:56:06 +00:00
test.py Increase file descriptor limit when running test.py on MacOS 2018-10-16 09:25:10 +00:00
upload_abi_dills.sh Include gen_kernel_bytecode in create_sdk so that it can be uploaded by the builders 2019-03-19 19:36:59 +00:00
utils.py Add optional version_file param 2019-05-21 16:24:41 +00:00
VERSION [release] Prepare changelog and version file for 2.3.1 and 2.3.2-dev.0.0 2019-05-21 18:37:58 +00:00
write_dartdoc_options_file.py Add source links to dartdoc output. 2019-02-07 18:46:31 +00:00
write_revision_file.py [Fuchsia] Build only the parts of the SDK that are needed 2017-04-19 09:00:14 -07:00
write_version_file.py [Fuchsia] Build only the parts of the SDK that are needed 2017-04-19 09:00:14 -07:00
yaml2json.dart Mention that libraries.json is generated. 2017-11-01 12:55:42 +00:00
yaml2json.py Add YAML file with VM patch file information. 2017-02-21 13:56:28 +01:00