development/flutter
development/flutter
1
0
Fork 0
mirror of https://github.com/flutter/flutter synced 2024-10-01 14:04:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
41031 commits 768 branches 973 tags 1.7 GiB
Commit graph

1002 commits

Author SHA1 Message Date
Flutter GitHub Bot dc1f9f183f
Marks Linux_pixel_7pro integration_ui_keyboard_resize to be unflaky (#143440) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro integration_ui_keyboard_resize"
}
-->
The issue https://github.com/flutter/flutter/issues/140645 has been closed, and the test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_pixel_7pro%20integration_ui_keyboard_resize%22).
This test can be marked as unflaky.
 2024-02-14 16:20:09 +00:00
Matan Lurey 56387c0111
Rename external_ui to external_textures. (#143406) 
My understanding is I can do this safely because the task is marked `bringup: true`?

Next PR will remove `bringup` and take down the old tasks.

Partial work towards https://github.com/flutter/flutter/issues/142178.
 2024-02-13 23:22:23 +00:00
Zachary Anderson 9f832218da
Move Windows arm64 tests to bringup true (#143272) 
For https://github.com/flutter/flutter/issues/143271
 2024-02-10 21:21:09 +00:00
Victoria Ashworth d60b681ef7
Move Mac_build_test flutter_gallery__transition_perf_e2e_ios out of staging (#142987) 
Move test out of staging now that https://github.com/flutter/flutter/issues/142917 is fixed.
 2024-02-07 19:24:44 +00:00
Jenn Magder fee1868d89
Run Mac x64 build tests in postsubmit only (#142334) 
It shouldn't be very common for x64 example projects to not build if they built on arm64.  We have other tool tests that would probably catch those issues in presubmit.

Instead run them on postsubmit only to free up limited x64 staging resources.

Follow up from #141206
 2024-02-07 06:41:25 +00:00
Andrew Kolos bf9aa556d2
Mark Windows_android hot_mode_dev_cycle_win__benchmark as no longer flaky (#143016) 
Marked flaky in flutter/flutter#142609

Per the reasons I discuss in [this comment](https://github.com/flutter/flutter/issues/142608#issuecomment-1930868003) on the corresponding issue, I believe this test is probably not actually flaky.

Fixes https://github.com/flutter/flutter/issues/142608
 2024-02-07 03:36:02 +00:00
Victoria Ashworth 809a27ea67
Move Mac_build_test flutter_gallery__transition_perf_e2e_ios to staging (#142918) 
Temporary solution for https://github.com/flutter/flutter/issues/142917.
 2024-02-05 17:29:22 +00:00
Ricardo Amador 3f30dc2e0a
Add a link the different possible Android virtual device configs (#142765) 
*Replace this paragraph with a description of what this PR is changing or adding, and why. Consider including before/after screenshots.*

*List which issues are fixed by this PR. You must list at least one issue. An issue is not required if the PR fixes something trivial like a typo.*

*If you had to change anything in the [flutter/tests] repo, include a link to the migration guide as per the [breaking change policy].*
 2024-02-02 16:13:40 +00:00
Victoria Ashworth 822ebc48e0
Allow all iOS tests to use either iOS 16 or 17 (#142714) 
Undoing https://github.com/flutter/flutter/pull/142323 to allow all iOS tests to use iOS 16 or 17.
 2024-02-02 16:02:08 +00:00
Ricardo Amador c13ebf1e78
Use proto name for emulator version and show cipd package version (#142262) 
Changes to use the proto.textpb config file as the version of the emulator device and show the cipd dependency version in the dependencies so devs know it can be updated.

*List which issues are fixed by this PR. You must list at least one issue. An issue is not required if the PR fixes something trivial like a typo.*
Fixes https://github.com/flutter/flutter/issues/142261

*If you had to change anything in the [flutter/tests] repo, include a link to the migration guide as per the [breaking change policy].*
 2024-02-01 23:48:19 +00:00
Flutter GitHub Bot 2c0cf448bd
Marks Linux_android_emu android views to be unflaky (#142590) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_android_emu android views"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_android_emu%20android%20views%22).
This test can be marked as unflaky.
 2024-02-01 22:42:55 +00:00
Polina Cherkasova 05cd4fd042
Make leak_tracking bots sticked to the left even if bot thinks they are non-flacky. (#142744) 2024-02-01 21:47:54 +00:00
Flutter GitHub Bot 071830663a
Marks Mac_arm64_ios basic_material_app_ios__compile to be unflaky (#142594) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64_ios basic_material_app_ios__compile"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64_ios%20basic_material_app_ios__compile%22).
This test can be marked as unflaky.
 2024-01-31 19:24:05 +00:00
Flutter GitHub Bot 9c107801ed
Marks Mac_arm64 tool_tests_commands to be unflaky (#142593) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 tool_tests_commands"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20tool_tests_commands%22).
This test can be marked as unflaky.
 2024-01-31 18:55:25 +00:00
Flutter GitHub Bot 1d48b60d48
Marks Mac_x64 tool_tests_commands to be unflaky (#142592) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 tool_tests_commands"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20tool_tests_commands%22).
This test can be marked as unflaky.
 2024-01-31 18:45:34 +00:00
Flutter GitHub Bot 0e274f5c7b
Marks Mac_x64_ios integration_test_test_ios to be unflaky (#142595) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64_ios integration_test_test_ios"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64_ios%20integration_test_test_ios%22).
This test can be marked as unflaky.
 2024-01-31 18:42:28 +00:00
Flutter GitHub Bot 62fcc15887
Marks Mac_x64 native_ui_tests_macos to be unflaky (#142598) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 native_ui_tests_macos"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20native_ui_tests_macos%22).
This test can be marked as unflaky.
 2024-01-31 18:34:01 +00:00
Flutter GitHub Bot 2dc7c92205
Marks Mac_x64_ios hot_mode_dev_cycle_ios__benchmark to be unflaky (#142597) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64_ios hot_mode_dev_cycle_ios__benchmark"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64_ios%20hot_mode_dev_cycle_ios__benchmark%22).
This test can be marked as unflaky.
 2024-01-31 18:30:47 +00:00
Flutter GitHub Bot 5efcfba66c
Marks Mac_arm64 native_ui_tests_macos to be unflaky (#142599) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 native_ui_tests_macos"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20native_ui_tests_macos%22).
This test can be marked as unflaky.
 2024-01-31 18:27:46 +00:00
Flutter GitHub Bot 8629dfa283
Marks Windows_android hot_mode_dev_cycle_win__benchmark to be flaky (#142609) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows_android hot_mode_dev_cycle_win__benchmark"
}
-->
Issue link: https://github.com/flutter/flutter/issues/142608
 2024-01-31 18:27:44 +00:00
Flutter GitHub Bot 5f2961d2dd
Marks Mac_arm64_ios integration_test_test_ios to be unflaky (#142596) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64_ios integration_test_test_ios"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64_ios%20integration_test_test_ios%22).
This test can be marked as unflaky.
 2024-01-31 18:01:22 +00:00
Flutter GitHub Bot 347403f2ea
Marks Linux_android_emu android_defines_test to be unflaky (#142591) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_android_emu android_defines_test"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_android_emu%20android_defines_test%22).
This test can be marked as unflaky.
 2024-01-31 17:08:54 +00:00
Flutter GitHub Bot 4af2051f8e
Marks Windows_android native_assets_android to be unflaky (#140042) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows_android native_assets_android"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows_android%20native_assets_android%22).
This test can be marked as unflaky.
 2024-01-31 04:13:30 +00:00
Flutter GitHub Bot 3a442ab4e5
Marks Linux_pixel_7pro complex_layout_scroll_perf_impeller_gles__timeline_summary to be unflaky (#140039) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro complex_layout_scroll_perf_impeller_gles__timeline_summary"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_pixel_7pro%20complex_layout_scroll_perf_impeller_gles__timeline_summary%22).
This test can be marked as unflaky.
 2024-01-31 04:01:29 +00:00
Flutter GitHub Bot 6379378c88
Marks Mac flavors_test_macos to be unflaky (#140647) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac flavors_test_macos"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac%20flavors_test_macos%22).
This test can be marked as unflaky.
 2024-01-31 03:08:36 +00:00
Ian Hickson cd4445345c
Be less verbose in CI for customer_testing, and revert old timeout hack (#139611) 
This PR does two things. First, it reduces the verbosity in the customer_testing shard. We want to be less verbose because it's nigh on impossible to find anything when there's a failure in the verbose logs. Also, some additional comments are added to make following the breadcrumbs easier for the next person.

Second, it reverts a timeout that had been set to 90 minutes a while ago. It's no longer needed.

Fixes https://github.com/flutter/flutter/issues/120901.
 2024-01-30 23:37:23 +00:00
Flutter GitHub Bot bd715036b5
Marks Windows_arm64 plugin_test_windows to be unflaky (#137675) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows_arm64 plugin_test_windows"
}
-->
The issue https://github.com/flutter/flutter/issues/134083 has been closed, and the test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows_arm64%20plugin_test_windows%22).
This test can be marked as unflaky.
 2024-01-30 18:02:52 +00:00
Flutter GitHub Bot 9207b85de8
Marks Mac_pixel_7pro native_assets_android to be unflaky (#141675) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_pixel_7pro native_assets_android"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_pixel_7pro%20native_assets_android%22).
This test can be marked as unflaky.
 2024-01-29 22:16:06 +00:00
Flutter GitHub Bot 1af09dde12
Marks Mac_x64 framework_tests_misc to be unflaky (#142118) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 framework_tests_misc"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20framework_tests_misc%22).
This test can be marked as unflaky.
 2024-01-29 21:02:25 +00:00
Flutter GitHub Bot 259c72a82d
Marks Mac_arm64 framework_tests_misc to be unflaky (#142119) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 framework_tests_misc"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20framework_tests_misc%22).
This test can be marked as unflaky.
 2024-01-29 19:53:21 +00:00
Loïc Sharma f727948f6d
[Windows Arm64] Run plugin test post-submit (#141987) 
The Flutter try pool does not have any Windows Arm64 machines. Thus, any Windows Arm64 pre-submit tests will fail as there's no machines to run them.

This converts the only Windows Arm64 pre-submit test, the plugin test, to run post-submit.

See: https://github.com/flutter/flutter/issues/141986
 2024-01-29 19:10:45 +00:00
Jenn Magder aaa3eba12d
Limit fuchsia_precache in presubmit to engine rolls (#142333) 
This doesn't need to run on every PR in presubmit.  Limit to engine rolls to validate the artifacts have been published.

Fixes https://github.com/flutter/flutter/issues/142330
 2024-01-26 22:34:20 +00:00
Victoria Ashworth e1785b315b
Only use iOS 17 physical devices in staging tests (#142323) 
Don't use iOS 17 devices in pre and post submit tests yet.
 2024-01-26 21:51:43 +00:00
Jenn Magder 91f0878fed
Move iOS content validation devicelab test into tool integration test (#142272) 
The archiving was running in devicelab because certs are needed to codesign (see #73577).  However now the certs are available in chromium bots.  Move the archiving test into the existing tool integration test, and delete the devicelab variant.

arm64:
https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8757886514651624673/+/u/run_test.dart_for_tool_host_cross_arch_tests_shard_and_subshard_None/test_stdout#L6074_4
x64:
https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8757886514651624689/+/u/run_test.dart_for_tool_host_cross_arch_tests_shard_and_subshard_None/test_stdout#L6389_2

Part of https://github.com/flutter/flutter/issues/142070
 2024-01-26 18:04:09 +00:00
Matan Lurey 2f6fdf2650
Start renaming by adding a new bringup: true as an Android emulator. (#142257) 
Part 2 of https://github.com/flutter/flutter/issues/142178.

Supersedes https://github.com/flutter/flutter/pull/142078.

Feedback welcome to avoid reverts!
 2024-01-26 01:07:08 +00:00
godofredoc a6c3ad2310
Update name for android_defines_test. (#142273) 
This is to reuse the global emulator configurations and make it easier to identify this test is running on an emulator.
 2024-01-26 00:16:36 +00:00
godofredoc 8cc944d776
Run a few mac tests only on arm. (#142188) 
Note: some benchmarks will require to be rebaselined.
 2024-01-25 23:05:20 +00:00
godofredoc 3165fa30be
Migrate android_view to linux_android_emu platform. (#142184) 
A new top level platform configuration was created for android emulator tests running on linux vms.

This is also a preparation step to remove adhoc recipes created to run emulator tests.
 2024-01-25 01:15:12 +00:00
auto-submit[bot] 54e9f2dbe6
Reverts "Refactor external_ui → external_textures" (#142173) 
Reverts flutter/flutter#142062
Initiated by: eliasyishak
This change reverts the following previous change:
Original Description:
This PR makes no _behavioral_ changes to executed code, and instead focuses on organization and naming:

1. Almost[^1] anything named `external_ui` is renamed `external_textures`
1. Extended the README to explain the intent of the test, as well as how to run it
1. Renamed `main.dart` and `main_test.dart` to `frame_rate_main.dart` and `frame_rate_test.dart` (we'll add more)
1. Did some refactoring of the test to make it more obvious what is being asserted (i.e. `widgetBuilds` and friends)

Given how complex (and in-flux) this directory is, I'm also requesting either John, Jonah or I review any changes.

[^1]: Except the name of the `.ci.yaml` task, i.e. `name: Linux_pixel_7pro external_ui_integration_test` because I'm apparently not able to change that without creating a new task as `bringup: true` and playing a bit of a dance. Maybe that's worth doing though (in future PRs)?
 2024-01-24 21:41:17 +00:00
Matan Lurey 2e2042ff8e
Refactor external_ui → external_textures (#142062) 
This PR makes no _behavioral_ changes to executed code, and instead
focuses on organization and naming:

1. Almost[^1] anything named `external_ui` is renamed
`external_textures`
1. Extended the README to explain the intent of the test, as well as how
to run it
1. Renamed `main.dart` and `main_test.dart` to `frame_rate_main.dart`
and `frame_rate_test.dart` (we'll add more)
1. Did some refactoring of the test to make it more obvious what is
being asserted (i.e. `widgetBuilds` and friends)

Given how complex (and in-flux) this directory is, I'm also requesting
either John, Jonah or I review any changes.

[^1]: Except the name of the `.ci.yaml` task, i.e. `name:
Linux_pixel_7pro external_ui_integration_test` because I'm apparently
not able to change that without creating a new task as `bringup: true`
and playing a bit of a dance. Maybe that's worth doing though (in future
PRs)?
 2024-01-24 12:44:31 -08:00
Flutter GitHub Bot a0df2c4573
Marks Mac_arm64 build_tests_2_4 to be unflaky (#142115) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 build_tests_2_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20build_tests_2_4%22).
This test can be marked as unflaky.
 2024-01-24 18:11:53 +00:00
Flutter GitHub Bot 07ece1aad2
Marks Mac_x64 build_tests_2_4 to be unflaky (#142111) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 build_tests_2_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20build_tests_2_4%22).
This test can be marked as unflaky.
 2024-01-24 17:56:38 +00:00
Flutter GitHub Bot fdda3b5ac0
Marks Mac_x64 build_tests_1_4 to be unflaky (#142110) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 build_tests_1_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20build_tests_1_4%22).
This test can be marked as unflaky.
 2024-01-24 17:56:35 +00:00
Flutter GitHub Bot a0e0387a80
Marks Mac_x64 build_tests_3_4 to be unflaky (#142112) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 build_tests_3_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20build_tests_3_4%22).
This test can be marked as unflaky.
 2024-01-24 17:55:43 +00:00
godofredoc 5d48b5c8b5
Run some tests explicitly in both arm and x64. (#141910) 
This is part of the process to start running tests on either arm64 or x64 if the host architecture is not important for the test.
 2024-01-24 17:24:12 +00:00
Flutter GitHub Bot 161fd82c7f
Marks Mac_arm64 build_tests_1_4 to be unflaky (#142114) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 build_tests_1_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20build_tests_1_4%22).
This test can be marked as unflaky.
 2024-01-24 15:50:11 +00:00
Flutter GitHub Bot 277366d2cc
Marks Mac_arm64 build_tests_3_4 to be unflaky (#142116) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 build_tests_3_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20build_tests_3_4%22).
This test can be marked as unflaky.
 2024-01-24 15:39:25 +00:00
Flutter GitHub Bot db0ce8a498
Marks Mac_x64 build_tests_4_4 to be unflaky (#142113) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_x64 build_tests_4_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_x64%20build_tests_4_4%22).
This test can be marked as unflaky.
 2024-01-24 15:09:03 +00:00
Flutter GitHub Bot e7ff0e0e8f
Marks Mac_arm64 build_tests_4_4 to be unflaky (#142117) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_arm64 build_tests_4_4"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_arm64%20build_tests_4_4%22).
This test can be marked as unflaky.
 2024-01-24 14:59:41 +00:00
godofredoc 6f7aed593d
Run module_test_ios on arm and x64 (#141815) 
This will ensure the test runs on the supported platforms.
 2024-01-19 22:05:12 +00:00
godofredoc c95bb6fbb3
Add mac_x64_ios configuration. (#141828) 
This is in preparation to allow tests to run on x64 and arm64 if they rely only on the ios phone.
 2024-01-19 03:42:23 +00:00
godofredoc 9d9bd884ea
Run framework_tests_misc in arm64 and x64. (#141797) 
This is to ensure coverage in both platforms.
 2024-01-18 22:40:16 +00:00
Victoria Ashworth c92b20ba97
Run flutter_gallery_ios__start_up test on Mac-14 in staging (#141795) 
Attempting to debug https://github.com/flutter/flutter/issues/141383.
 2024-01-18 20:05:10 +00:00
Zachary Anderson a9d94be0da
Move mac pixel 7 pro test to presubmit: false (#141747) 
The only bot with this configuration in the try pool just died.
 2024-01-17 19:54:51 -08:00
Polina Cherkasova b90a3e4710
Remove non-needed bot and increase time out for leak_tracking. (#141712) 2024-01-17 15:31:38 -08:00
godofredoc 66f5e88e6b
Run build tests on both x64 and arm64. (#141206) 
Most of the builds for mac_x64 can actually run on any available architecture. This is required to use capacity more efficiently.
 2024-01-17 21:20:34 +00:00
Victoria Ashworth 8de818dd2a
Update tests to Xcode 15 (#141706) 
Framework part of https://github.com/flutter/flutter/issues/132237.
 2024-01-17 20:32:12 +00:00
Flutter GitHub Bot 8286f4993d
Marks Windows framework_tests_misc_leak_tracking to be unflaky (#141676) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows framework_tests_misc_leak_tracking"
}
-->
The issue https://github.com/flutter/flutter/issues/140414 has been closed, and the test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows%20framework_tests_misc_leak_tracking%22).
This test can be marked as unflaky.
 2024-01-17 17:37:36 +00:00
godofredoc b9aba43b44
Add contexts to mac_ios targets. (#141494) 
This is required to remove explicit contexts from recipes.
 2024-01-16 19:45:04 +00:00
Qun Cheng 7dc856ab84
Revert "Reverts "Run iOS staging tests with Xcode 15.2"" (#141420) 
Relands "Run iOS staging tests with Xcode 15.2""

Reverts flutter/flutter#141412
 2024-01-12 16:11:22 +00:00
godofredoc e20e95100d
Add osx_sdk context for mac builds. (#141422) 
This is to give ci.yaml the flexibility to select the contexts to execute and remove complexity from recipes.
 2024-01-12 03:00:06 +00:00
auto-submit[bot] 66759d7522
Reverts "Run iOS staging tests with Xcode 15.2" (#141412) 
Reverts flutter/flutter#141392
Initiated by: QuncCccccc
This change reverts the following previous change:
Original Description:
Potential fix for https://github.com/flutter/flutter/issues/141383.
 2024-01-11 22:06:25 +00:00
Victoria Ashworth ef3de359de
Run iOS staging tests with Xcode 15.2 (#141392) 
Potential fix for https://github.com/flutter/flutter/issues/141383.
 2024-01-11 19:17:38 +00:00
Jonah Williams 35903620c8
Add impeller key to skia gold client, Turn on a framework test shard that will run unit tests with --enable-impeller (#141341) 
Redo of https://github.com/flutter/flutter/pull/140985 due to CLA issues.
 2024-01-11 17:57:00 +00:00
Polina Cherkasova 988d1a0679
Add environment variable to leak tracking bots. (#141137) 2024-01-09 14:14:53 -08:00
Casey Hillers 51af82d3db
[ci.yaml] Do not run packaging test on presubmit (#141192) 
This test doesn't support presubmit as runs a separate git clone, which won't contain the presubmit hash.

Fixes https://github.com/flutter/flutter/issues/141188
 2024-01-09 20:02:15 +00:00
Victoria Ashworth 1ec9daa9c2
Run tests on iOS 16 or iOS 17 (#141178) 
Fixes https://github.com/flutter/flutter/issues/141177
 2024-01-09 19:49:21 +00:00
Zachary Anderson e94a2c04c1
Shift mac Pixel 7 Pro tests to prod (#141142) 
Related https://github.com/flutter/flutter/issues/140893
 2024-01-08 18:33:47 -08:00
Zachary Anderson f111459632
Shift some macOS Android tests from Moto G4 to Pixel 7 Pro (#140912) 
Related https://github.com/flutter/flutter/issues/140893
 2024-01-05 08:20:49 -08:00
Polina Cherkasova b2f53e0cde
Temporarily remove env variable for leak tracking bots. (#140978) 
For some reasons there are [failures](https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8759809744202981089/+/u/run_test.dart_for_framework_tests_shard_and_subshard_misc/test_stdout) in leak tracking bots, that do not relate to leak tracking. 

There are two differences between leak tracking bots and 'normal' windows framework bots: 

1. The flag "LEAK_TRACKING": "true". First failures happened before consumption of the flag "LEAK_TRACKING": "true" by testWidgets. Hypothesis: the failures may be caused by mechanisms that sets the env variable. This mechanism is used only by leak tracking bots.
2. bringup: true. 

This PR removes the leak tracking env variable to isolate the first difference and verify if the bots will start passing.
 2024-01-04 19:32:17 +00:00
Victoria Ashworth c9f23d056c
Run half of iOS devicelab tests with Xcode 15 (#140927) 
Since 50% of devicelab bots are on macOS 13, we can upgrade 50% of devicelab tests to Xcode 15.

There are 52 Mac_ios non-bringup tests, this PR updates 26 of them.

There are 4 Mac_arm64_ios non-bringup tests, this PR updates 2 of them.

Part of https://github.com/flutter/flutter/issues/140975
 2024-01-04 18:11:07 +00:00
keyonghan fedf9ece4c
Add Windows leak tracking targets (#140423) 
https://github.com/flutter/flutter/issues/140414
 2024-01-03 23:09:02 +00:00
Flutter GitHub Bot bfcf0c5893
Marks Linux_pixel_7pro native_assets_android to be unflaky (#140866) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro native_assets_android"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_pixel_7pro%20native_assets_android%22).
This test can be marked as unflaky.
 2024-01-03 18:25:15 +00:00
Flutter GitHub Bot 70386a613b
Marks Linux_android hybrid_android_views_integration_test to be unflaky (#140865) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_android hybrid_android_views_integration_test"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_android%20hybrid_android_views_integration_test%22).
This test can be marked as unflaky.
 2024-01-03 13:35:20 +00:00
Flutter GitHub Bot 30c2346806
Marks Linux_pixel_7pro integration_ui_keyboard_resize to be flaky (#140646) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro integration_ui_keyboard_resize"
}
-->
Issue link: https://github.com/flutter/flutter/issues/140645
 2023-12-27 20:25:09 +00:00
godofredoc c73bffe747
Migrate verify_codesigned. (#139328) 
This is part of the migration of adhoc tests to shard tests.

Bug: https://github.com/flutter/flutter/issues/139153
 2023-12-22 01:46:11 +00:00
Victoria Ashworth 2da1ff2d93
Run mac staging tests with Xcode 15 (#140518) 
Run macOS staging tests with Xcode 15 and macOS 13. Also, cleanup some comments.
 2023-12-21 22:01:14 +00:00
Andrew Kolos 9e104eb7c8
Fix flavor conditional asset bundling for macos (#140433) 
Fixes https://github.com/flutter/flutter/issues/140430
Fixes https://github.com/flutter/flutter/issues/140432 while we are at it
 2023-12-21 20:30:21 +00:00
Gray Mackall a3e0fa56a3
Enable android_preview_tool_integration_tests check (#140470) 
Enables the check that was added in https://github.com/flutter/flutter/pull/131901.

Has been passing since https://github.com/flutter/flutter/pull/140099 (30 runs). Not sure what the normal number of successful runs we wait for is before enabling, let me know if we should wait for more data.
 2023-12-21 19:20:43 +00:00
Zachary Anderson 76c8e7387b
Move tests shifted to Pixel 7 from staging to prod (#140438) 2023-12-20 18:57:40 +00:00
Zachary Anderson ea6017ded8
Move hybrid_android_views_integration_test back to Moto G4 (#140421) 
Related https://github.com/flutter/flutter/issues/140420
 2023-12-19 23:44:10 +00:00
Zachary Anderson 0eb7881340
Shift some Linux-hosted tests on moto g4 to pixel 7 (#140389) 2023-12-19 09:30:03 -08:00
Andrew Kolos f8b9748661
Restore and fix flavors_test_macos (#139841) 
Partially resolves[^1] https://github.com/flutter/flutter/issues/139774.

Effectively reverts https://github.com/flutter/flutter/pull/125581.

The main change here is that I deleted and recreated the macos Xcode project for this integration test (hence the large diff). I tried fixing the existing project first, but it was set up quite differently, and—for whatever reason—the integration test would get stuck trying to load `dev/integration_tests/flavors/integration_test/integration_test.dart`.

I verified that this works locally, but I don't know if it's possible to run this on the devicelab try pool to verify that it works on devicelab hardware.

[^1]: I would not close the issue until 1) this PR lands, 2) the integration test consistently passes on CI, and 3) macOS support for flavors is publicly documented.
 2023-12-18 08:52:22 +00:00
Daco Harkes 3b370c8539
[deps] update Android SDK to 34 (#138183) 
Update Android SDK from 33 to 34.

Following the engine update:

* https://github.com/flutter/engine/pull/47839
 2023-12-14 00:55:57 +00:00
Victoria Ashworth 0c280d4788
Unpin mac_toolchain version (#139938) 
mac_toolchain has been updated to no longer have 2 minute slowdown (https://github.com/flutter/flutter/issues/138109), so unpin to use the latest version.
 2023-12-14 00:11:32 +00:00
Gray Mackall 9a72e1c699
Allow plugins to use compileSdkPreview (#131901) 
Fixes https://github.com/flutter/flutter/issues/124748

Based (heavily) off https://github.com/flutter/flutter/pull/104662
 2023-12-12 20:06:04 +00:00
Casey Hillers 815dc96e9b
[ci.yaml] Add missing ci.yaml to runIf of android hot reload tests (#139932) 
https://github.com/flutter/cocoon/pull/3333
 2023-12-11 23:55:52 +00:00
Daco Harkes 6ad755536e
Native assets support for Android (#135148) 
Support for FFI calls with `@Native external` functions through Native assets on Android. This enables bundling native code without any build-system boilerplate code.

For more info see:

* https://github.com/flutter/flutter/issues/129757

### Implementation details for Android.

Mainly follows the design of the previous PRs.

For Android, we detect the compilers inside the NDK inside SDK.

And bundling of the assets is done by the flutter.groovy file.

The `minSdkVersion` is propagated from the flutter.groovy file as well.

The NDK is not part of `flutter doctor`, and users can omit it if no native assets have to be build.
However, if any native assets must be built, flutter throws a tool exit if the NDK is not installed.

Add 2 app is not part of this PR yet, instead `flutter build aar` will tool exit if there are any native assets.
 2023-12-07 16:29:11 +00:00
Casey Hillers 9ef1c2b07a
[ci.yaml] Add runif filters and stricter timeout to packaging_test (#139694) 
https://github.com/flutter/flutter/issues/139597

* Remove beta and stable filters as the Cocoon scheduler doesn't run on these branches
 2023-12-06 23:01:42 +00:00
Christopher Fujino e5c5e15a5b
re-enable windows build_tests (#139599) 
These have all passed since being introduced >20 commits ago:

![Screenshot from 2023-12-05 14-37-41](https://github.com/flutter/flutter/assets/7856010/997f39a1-377c-4e85-a7a1-02bb7e687506)
 2023-12-06 22:46:34 +00:00
Flutter GitHub Bot 32bddf2fe9
Marks Linux_pixel_7pro new_gallery_impeller__transition_perf to be flaky (#139644) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro new_gallery_impeller__transition_perf"
}
-->
Issue link: https://github.com/flutter/flutter/issues/139643
 2023-12-06 10:17:15 -08:00
godofredoc ff881badb7
Move docs to use their own recipe. (#139521) 
This is part of the deprecation of adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
 2023-12-05 17:37:56 +00:00
Christopher Fujino 79d6781b4f
increase sharding of windows build tests (#139503) 
Fixes https://github.com/flutter/flutter/issues/139502
 2023-12-04 23:45:07 +00:00
Jonah Williams c421f65b3b
Add Impeller complex layout impeller benchmarks. (#139490) 
These benchmarks do a nice job of showing CPU overhead, which is useful for many of the microoptimizations we've been doing.
 2023-12-04 19:23:26 +00:00
godofredoc 8412adb981
Migrate docs_test to shard. (#139282) 
This is part of the deprecation of adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
 2023-11-30 21:29:41 +00:00
Zachary Anderson 918e336014
Move Impeller tests on Pixel 7 Pro from staging to prod (#139280) 
These tests are now expected to be reasonably stable, and increases in
flakiness should be reported as part of the regular flaky test triage
process.
 2023-11-30 06:47:12 -08:00
godofredoc cae47c4641
Use the correct recipe on fuchsia_precache. (#139279) 
To run shard tests we need to use flutter_drone recipe.


## Pre-launch Checklist

- [X] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [X] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [X] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [X] I signed the [CLA].
- [X] I listed at least one issue that this PR fixes in the description
above.
- [X] I updated/added relevant documentation (doc comments with `///`).
- [X] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [X] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel
on [Discord].

<!-- Links -->
[Contributor Guide]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#overview
[Tree Hygiene]: https://github.com/flutter/flutter/wiki/Tree-hygiene
[test-exempt]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#tests
[Flutter Style Guide]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo
[Features we expect every widget to implement]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo#features-we-expect-every-widget-to-implement
[CLA]: https://cla.developers.google.com/
[flutter/tests]: https://github.com/flutter/tests
[breaking change policy]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#handling-breaking-changes
[Discord]: https://github.com/flutter/flutter/wiki/Chat
 2023-11-29 18:19:30 -08:00
godofredoc c8101b56a9
Migrate fuchsia_precache to shard tests. (#139202) 
Adhoc tests are being deprecated and existing tests are being migrated to shard tests.

Bug: https://github.com/flutter/flutter/issues/139153
 2023-11-30 00:03:23 +00:00
godofredoc 8b6277e638
Move analysis test to shard tests. (#139161) 
This is part of the effort to deprecated adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
 2023-11-28 23:58:55 +00:00
Victoria Ashworth 358e39137f
Renable macOS 13 tests (#139083) 
A workaround was added for https://github.com/flutter/flutter/issues/138238, so let's re-enable macOS 13 tests
 2023-11-28 16:13:08 +00:00