flutter/dev
Jonah Williams a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests (#68516)
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.

The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5

Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
..
automated_tests Update package:stack_trace dependency to 1.10.0-nullsafety.4 (#68132) 2020-10-16 16:35:20 +02:00
benchmarks Transport e2e based perforamnce test to integration_test and remove duplicate watchPerformance (#67594) 2020-10-17 20:37:03 -07:00
bots Update package:stack_trace dependency to 1.10.0-nullsafety.4 (#68132) 2020-10-16 16:35:20 +02:00
ci Remove Cirrus support for Gold (#67468) 2020-10-08 14:19:42 -05:00
customer_testing Bump meta to 1.3.0-nullsafety.4 (#67744) 2020-10-12 09:50:30 -07:00
devicelab [devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests (#68516) 2020-10-19 14:16:04 -07:00
docs Update dartdoc to 0.35.0 (#67432) 2020-10-07 08:47:05 -07:00
integration_tests Transport e2e based perforamnce test to integration_test and remove duplicate watchPerformance (#67594) 2020-10-17 20:37:03 -07:00
manual_tests Mark keys that match a shortcut, but have no action defined as "not handled". (#67359) 2020-10-19 11:26:50 -07:00
missing_dependency_tests [flutter_tools] remove globals from compilers (#59184) 2020-06-18 10:33:17 -07:00
snippets Update package:stack_trace dependency to 1.10.0-nullsafety.4 (#68132) 2020-10-16 16:35:20 +02:00
tools Update package:stack_trace dependency to 1.10.0-nullsafety.4 (#68132) 2020-10-16 16:35:20 +02:00
tracing_tests Update package:stack_trace dependency to 1.10.0-nullsafety.4 (#68132) 2020-10-16 16:35:20 +02:00
prod_builders.json [devicelab] turn down android X migration gradle tests (#68110) 2020-10-14 13:24:22 -07:00
README.md Add run_if property for existing LUCI try builders (#64180) 2020-08-20 17:28:12 -07:00
try_builders.json [devicelab] turn down android X migration gradle tests (#68110) 2020-10-14 13:24:22 -07:00

This directory contains tools and resources that the Flutter team uses during the development of the framework. The tools in this directory should not be necessary for developing Flutter applications, though of course, they may be interesting if you are curious.

The tests in this directory are run in the framework_tests_misc-* shards.

Luci builder file

try_builders.json and prod_builders.json contain the supported luci try/prod builders for flutter.

try_builders.json

It follows format:

{
    "builders":[
        {
            "name":"yyy",
            "repo":"flutter",
            "taskName":"zzz",
            "enabled":true,
            "run_if":["a/b/", "c/d/**"]
        }
    ]
}
  • enabled(optional): true is the default value if unspecified
  • run_if(optional): will always be triggered if unspecified

prod_builders.json

It follows format:

{
    "builders":[
        {
            "name":"yyy",
            "repo":"flutter",
            "taskName":"zzz",
            "flaky":false
        }
    ]
}

try_builders.json will be mainly used in flutter/cocoon to trigger/update pre-submit flutter luci tasks, whereas prod_builders.json will be mainly used in flutter/cocoon to refresh luci task statuses to dashboard.