Commit Graph

899 Commits

Author SHA1 Message Date
Zachary Anderson
a9d94be0da
Move mac pixel 7 pro test to presubmit: false (#141747)
The only bot with this configuration in the try pool just died.
2024-01-17 19:54:51 -08:00
Polina Cherkasova
b90a3e4710
Remove non-needed bot and increase time out for leak_tracking. (#141712) 2024-01-17 15:31:38 -08:00
godofredoc
66f5e88e6b
Run build tests on both x64 and arm64. (#141206)
Most of the builds for mac_x64 can actually run on any available architecture. This is required to use capacity more efficiently.
2024-01-17 21:20:34 +00:00
Victoria Ashworth
8de818dd2a
Update tests to Xcode 15 (#141706)
Framework part of https://github.com/flutter/flutter/issues/132237.
2024-01-17 20:32:12 +00:00
Flutter GitHub Bot
8286f4993d
Marks Windows framework_tests_misc_leak_tracking to be unflaky (#141676)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Windows framework_tests_misc_leak_tracking"
}
-->
The issue https://github.com/flutter/flutter/issues/140414 has been closed, and the test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Windows%20framework_tests_misc_leak_tracking%22).
This test can be marked as unflaky.
2024-01-17 17:37:36 +00:00
godofredoc
b9aba43b44
Add contexts to mac_ios targets. (#141494)
This is required to remove explicit contexts from recipes.
2024-01-16 19:45:04 +00:00
Qun Cheng
7dc856ab84
Revert "Reverts "Run iOS staging tests with Xcode 15.2"" (#141420)
Relands "Run iOS staging tests with Xcode 15.2""

Reverts flutter/flutter#141412
2024-01-12 16:11:22 +00:00
godofredoc
e20e95100d
Add osx_sdk context for mac builds. (#141422)
This is to give ci.yaml the flexibility to select the contexts to execute and remove complexity from recipes.
2024-01-12 03:00:06 +00:00
auto-submit[bot]
66759d7522
Reverts "Run iOS staging tests with Xcode 15.2" (#141412)
Reverts flutter/flutter#141392
Initiated by: QuncCccccc
This change reverts the following previous change:
Original Description:
Potential fix for https://github.com/flutter/flutter/issues/141383.
2024-01-11 22:06:25 +00:00
Victoria Ashworth
ef3de359de
Run iOS staging tests with Xcode 15.2 (#141392)
Potential fix for https://github.com/flutter/flutter/issues/141383.
2024-01-11 19:17:38 +00:00
Jonah Williams
35903620c8
Add impeller key to skia gold client, Turn on a framework test shard that will run unit tests with --enable-impeller (#141341)
Redo of https://github.com/flutter/flutter/pull/140985 due to CLA issues.
2024-01-11 17:57:00 +00:00
Polina Cherkasova
988d1a0679
Add environment variable to leak tracking bots. (#141137) 2024-01-09 14:14:53 -08:00
Casey Hillers
51af82d3db
[ci.yaml] Do not run packaging test on presubmit (#141192)
This test doesn't support presubmit as runs a separate git clone, which won't contain the presubmit hash.

Fixes https://github.com/flutter/flutter/issues/141188
2024-01-09 20:02:15 +00:00
Victoria Ashworth
1ec9daa9c2
Run tests on iOS 16 or iOS 17 (#141178)
Fixes https://github.com/flutter/flutter/issues/141177
2024-01-09 19:49:21 +00:00
Zachary Anderson
e94a2c04c1
Shift mac Pixel 7 Pro tests to prod (#141142)
Related https://github.com/flutter/flutter/issues/140893
2024-01-08 18:33:47 -08:00
Zachary Anderson
f111459632
Shift some macOS Android tests from Moto G4 to Pixel 7 Pro (#140912)
Related https://github.com/flutter/flutter/issues/140893
2024-01-05 08:20:49 -08:00
Polina Cherkasova
b2f53e0cde
Temporarily remove env variable for leak tracking bots. (#140978)
For some reasons there are [failures](https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8759809744202981089/+/u/run_test.dart_for_framework_tests_shard_and_subshard_misc/test_stdout) in leak tracking bots, that do not relate to leak tracking. 

There are two differences between leak tracking bots and 'normal' windows framework bots: 

1. The flag "LEAK_TRACKING": "true". First failures happened before consumption of the flag "LEAK_TRACKING": "true" by testWidgets. Hypothesis: the failures may be caused by mechanisms that sets the env variable. This mechanism is used only by leak tracking bots.
2. bringup: true. 

This PR removes the leak tracking env variable to isolate the first difference and verify if the bots will start passing.
2024-01-04 19:32:17 +00:00
Victoria Ashworth
c9f23d056c
Run half of iOS devicelab tests with Xcode 15 (#140927)
Since 50% of devicelab bots are on macOS 13, we can upgrade 50% of devicelab tests to Xcode 15.

There are 52 Mac_ios non-bringup tests, this PR updates 26 of them.

There are 4 Mac_arm64_ios non-bringup tests, this PR updates 2 of them.

Part of https://github.com/flutter/flutter/issues/140975
2024-01-04 18:11:07 +00:00
keyonghan
fedf9ece4c
Add Windows leak tracking targets (#140423)
https://github.com/flutter/flutter/issues/140414
2024-01-03 23:09:02 +00:00
Flutter GitHub Bot
bfcf0c5893
Marks Linux_pixel_7pro native_assets_android to be unflaky (#140866)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro native_assets_android"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_pixel_7pro%20native_assets_android%22).
This test can be marked as unflaky.
2024-01-03 18:25:15 +00:00
Flutter GitHub Bot
70386a613b
Marks Linux_android hybrid_android_views_integration_test to be unflaky (#140865)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_android hybrid_android_views_integration_test"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_android%20hybrid_android_views_integration_test%22).
This test can be marked as unflaky.
2024-01-03 13:35:20 +00:00
Flutter GitHub Bot
30c2346806
Marks Linux_pixel_7pro integration_ui_keyboard_resize to be flaky (#140646)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro integration_ui_keyboard_resize"
}
-->
Issue link: https://github.com/flutter/flutter/issues/140645
2023-12-27 20:25:09 +00:00
godofredoc
c73bffe747
Migrate verify_codesigned. (#139328)
This is part of the migration of adhoc tests to shard tests.

Bug: https://github.com/flutter/flutter/issues/139153
2023-12-22 01:46:11 +00:00
Victoria Ashworth
2da1ff2d93
Run mac staging tests with Xcode 15 (#140518)
Run macOS staging tests with Xcode 15 and macOS 13. Also, cleanup some comments.
2023-12-21 22:01:14 +00:00
Andrew Kolos
9e104eb7c8
Fix flavor conditional asset bundling for macos (#140433)
Fixes https://github.com/flutter/flutter/issues/140430
Fixes https://github.com/flutter/flutter/issues/140432 while we are at it
2023-12-21 20:30:21 +00:00
Gray Mackall
a3e0fa56a3
Enable android_preview_tool_integration_tests check (#140470)
Enables the check that was added in https://github.com/flutter/flutter/pull/131901.

Has been passing since https://github.com/flutter/flutter/pull/140099 (30 runs). Not sure what the normal number of successful runs we wait for is before enabling, let me know if we should wait for more data.
2023-12-21 19:20:43 +00:00
Zachary Anderson
76c8e7387b
Move tests shifted to Pixel 7 from staging to prod (#140438) 2023-12-20 18:57:40 +00:00
Zachary Anderson
ea6017ded8
Move hybrid_android_views_integration_test back to Moto G4 (#140421)
Related https://github.com/flutter/flutter/issues/140420
2023-12-19 23:44:10 +00:00
Zachary Anderson
0eb7881340
Shift some Linux-hosted tests on moto g4 to pixel 7 (#140389) 2023-12-19 09:30:03 -08:00
Andrew Kolos
f8b9748661
Restore and fix flavors_test_macos (#139841)
Partially resolves[^1] https://github.com/flutter/flutter/issues/139774.

Effectively reverts https://github.com/flutter/flutter/pull/125581.

The main change here is that I deleted and recreated the macos Xcode project for this integration test (hence the large diff). I tried fixing the existing project first, but it was set up quite differently, and—for whatever reason—the integration test would get stuck trying to load `dev/integration_tests/flavors/integration_test/integration_test.dart`.

I verified that this works locally, but I don't know if it's possible to run this on the devicelab try pool to verify that it works on devicelab hardware.

[^1]: I would not close the issue until 1) this PR lands, 2) the integration test consistently passes on CI, and 3) macOS support for flavors is publicly documented.
2023-12-18 08:52:22 +00:00
Daco Harkes
3b370c8539
[deps] update Android SDK to 34 (#138183)
Update Android SDK from 33 to 34.

Following the engine update:

* https://github.com/flutter/engine/pull/47839
2023-12-14 00:55:57 +00:00
Victoria Ashworth
0c280d4788
Unpin mac_toolchain version (#139938)
mac_toolchain has been updated to no longer have 2 minute slowdown (https://github.com/flutter/flutter/issues/138109), so unpin to use the latest version.
2023-12-14 00:11:32 +00:00
Gray Mackall
9a72e1c699
Allow plugins to use compileSdkPreview (#131901)
Fixes https://github.com/flutter/flutter/issues/124748

Based (heavily) off https://github.com/flutter/flutter/pull/104662
2023-12-12 20:06:04 +00:00
Casey Hillers
815dc96e9b
[ci.yaml] Add missing ci.yaml to runIf of android hot reload tests (#139932)
https://github.com/flutter/cocoon/pull/3333
2023-12-11 23:55:52 +00:00
Daco Harkes
6ad755536e
Native assets support for Android (#135148)
Support for FFI calls with `@Native external` functions through Native assets on Android. This enables bundling native code without any build-system boilerplate code.

For more info see:

* https://github.com/flutter/flutter/issues/129757

### Implementation details for Android.

Mainly follows the design of the previous PRs.

For Android, we detect the compilers inside the NDK inside SDK.

And bundling of the assets is done by the flutter.groovy file.

The `minSdkVersion` is propagated from the flutter.groovy file as well.

The NDK is not part of `flutter doctor`, and users can omit it if no native assets have to be build.
However, if any native assets must be built, flutter throws a tool exit if the NDK is not installed.

Add 2 app is not part of this PR yet, instead `flutter build aar` will tool exit if there are any native assets.
2023-12-07 16:29:11 +00:00
Casey Hillers
9ef1c2b07a
[ci.yaml] Add runif filters and stricter timeout to packaging_test (#139694)
https://github.com/flutter/flutter/issues/139597

* Remove beta and stable filters as the Cocoon scheduler doesn't run on these branches
2023-12-06 23:01:42 +00:00
Christopher Fujino
e5c5e15a5b
re-enable windows build_tests (#139599)
These have all passed since being introduced >20 commits ago:

![Screenshot from 2023-12-05 14-37-41](https://github.com/flutter/flutter/assets/7856010/997f39a1-377c-4e85-a7a1-02bb7e687506)
2023-12-06 22:46:34 +00:00
Flutter GitHub Bot
32bddf2fe9
Marks Linux_pixel_7pro new_gallery_impeller__transition_perf to be flaky (#139644)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_pixel_7pro new_gallery_impeller__transition_perf"
}
-->
Issue link: https://github.com/flutter/flutter/issues/139643
2023-12-06 10:17:15 -08:00
godofredoc
ff881badb7
Move docs to use their own recipe. (#139521)
This is part of the deprecation of adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
2023-12-05 17:37:56 +00:00
Christopher Fujino
79d6781b4f
increase sharding of windows build tests (#139503)
Fixes https://github.com/flutter/flutter/issues/139502
2023-12-04 23:45:07 +00:00
Jonah Williams
c421f65b3b
Add Impeller complex layout impeller benchmarks. (#139490)
These benchmarks do a nice job of showing CPU overhead, which is useful for many of the microoptimizations we've been doing.
2023-12-04 19:23:26 +00:00
godofredoc
8412adb981
Migrate docs_test to shard. (#139282)
This is part of the deprecation of adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
2023-11-30 21:29:41 +00:00
Zachary Anderson
918e336014
Move Impeller tests on Pixel 7 Pro from staging to prod (#139280)
These tests are now expected to be reasonably stable, and increases in
flakiness should be reported as part of the regular flaky test triage
process.
2023-11-30 06:47:12 -08:00
godofredoc
cae47c4641
Use the correct recipe on fuchsia_precache. (#139279)
To run shard tests we need to use flutter_drone recipe.


## Pre-launch Checklist

- [X] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [X] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [X] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [X] I signed the [CLA].
- [X] I listed at least one issue that this PR fixes in the description
above.
- [X] I updated/added relevant documentation (doc comments with `///`).
- [X] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [X] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel
on [Discord].

<!-- Links -->
[Contributor Guide]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#overview
[Tree Hygiene]: https://github.com/flutter/flutter/wiki/Tree-hygiene
[test-exempt]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#tests
[Flutter Style Guide]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo
[Features we expect every widget to implement]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo#features-we-expect-every-widget-to-implement
[CLA]: https://cla.developers.google.com/
[flutter/tests]: https://github.com/flutter/tests
[breaking change policy]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#handling-breaking-changes
[Discord]: https://github.com/flutter/flutter/wiki/Chat
2023-11-29 18:19:30 -08:00
godofredoc
c8101b56a9
Migrate fuchsia_precache to shard tests. (#139202)
Adhoc tests are being deprecated and existing tests are being migrated to shard tests.

Bug: https://github.com/flutter/flutter/issues/139153
2023-11-30 00:03:23 +00:00
godofredoc
8b6277e638
Move analysis test to shard tests. (#139161)
This is part of the effort to deprecated adhoc tests.

Bug: https://github.com/flutter/flutter/issues/139153
2023-11-28 23:58:55 +00:00
Victoria Ashworth
358e39137f
Renable macOS 13 tests (#139083)
A workaround was added for https://github.com/flutter/flutter/issues/138238, so let's re-enable macOS 13 tests
2023-11-28 16:13:08 +00:00
Zachary Anderson
e49cc81222
Run platform_channels_benchmarks on Pixel 7 Pro (#139092)
Related to https://github.com/flutter/flutter/issues/138689 for 64-bit
coverage for Dart VM changes in this area

cc @aam
2023-11-27 19:43:09 -08:00
godofredoc
fe7299d318
Migrate customer_testing to sharded tests. (#138659)
This will allow Dart Team to run customer tests as part of monorepo and will be a step forward to remove ad_hoc tests.

Bug: https://github.com/dart-lang/sdk/issues/51042
Bug: https://github.com/flutter/flutter/issues/115476
2023-11-28 00:41:53 +00:00
Flutter GitHub Bot
29c95cda78
Marks Mac_build_test flutter_gallery__transition_perf_e2e_ios to be unflaky (#138886)
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Mac_build_test flutter_gallery__transition_perf_e2e_ios"
}
-->
The test has been passing for [50 consecutive runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Mac_build_test%20flutter_gallery__transition_perf_e2e_ios%22).
This test can be marked as unflaky.
2023-11-22 15:43:15 +00:00