development/flutter
development/flutter
1
0
Fork 0
mirror of https://github.com/flutter/flutter synced 2024-07-17 02:48:33 +00:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity
38834 commits 766 branches 962 tags 1.3 GiB
Commit graph

899 commits

Author SHA1 Message Date
Kate Lovett 309e50173e
Run misc test shard when examples/api/** change (#129433) 
Fixes https://github.com/flutter/flutter/issues/129390

Found in https://github.com/flutter/flutter/pull/129381, changing sample code in `examples/api` did not trigger the misc test shard that executes the tests for `examples/api`.
 2023-06-23 16:46:04 +00:00
godofredoc f582c0c573
Add comments to .ci.yaml that were removed from recipes. (#129321) 
Firebaselab recipe was cleaned up and comments removed. This is adding the still valid comments to the .ci.yaml file.
 2023-06-23 05:10:54 +00:00
gmackall 51f659825e
Unpin path_provider_android (#129205) 
Unpins path_provider_android where it is pinned. Follows the same steps as https://github.com/flutter/flutter/pull/128898.

Fixes https://github.com/flutter/flutter/issues/116376
 2023-06-22 21:22:49 +00:00
godofredoc dffef2715e
Move all the firebase lab device configs to .ci.yaml. (#129219) 
Bug: https://github.com/flutter/flutter/issues/129211
 2023-06-21 01:10:07 +00:00
Jackson Gardner 54e27e3ed5
Update Chrome version for testing (#128447) 
Most of the tests are using Chrome 96.2, which is quite old. Update to Chrome 114.
 2023-06-08 15:37:06 +00:00
Reid Baker b4796915b3
i127682 android api 33 test support (#127689) 
- try to set emulator to version 33 to see what happens

#127682
 2023-05-31 16:38:16 +00:00
godofredoc 7d310e3b1b
Add oriol_33 firebaselab configuration. (#127894) 
This allows to run the api 33 as a separate build.

Bug: https://github.com/flutter/flutter/issues/127884
Bug: https://github.com/flutter/flutter/issues/118736
 2023-05-31 00:19:58 +00:00
keyonghan 2b4e303b5a
Remove legacy xcode properties/dependencies (#127724) 
Now only $flutter/osx_sdk property is being used, and it's safe to remove deprecated entries from ci.yaml.

Part of https://github.com/flutter/flutter/issues/127534
 2023-05-30 23:14:02 +00:00
keyonghan 3eecc217cf
Append $flutter/osx sdk property to existing platforms/targets relying on xcode (#127537) 
Part of https://github.com/flutter/flutter/issues/127534
 2023-05-25 22:47:31 +00:00
keyonghan 784ebdf2a3
Run Mac intel only targets on both intel and arm (#127230) 
The slowness issue was resolved with latest xcode: https://github.com/flutter/flutter/issues/119750, and all these targets should resume on both platforms as before. This will help mitigate high queue time on intel bots.

This PR updates these targets:

- Mac plugin_test_ios: https://github.com/flutter/flutter/issues/119764
- Mac build_tests: https://github.com/flutter/flutter/pull/120620
- Mac plugin_test: https://github.com/flutter/flutter/pull/120714
- Mac plugin_test_macos: https://github.com/flutter/flutter/pull/122212
- Mac framework_tests_misc: https://github.com/flutter/flutter/pull/122618
 2023-05-19 23:22:25 +00:00
Zachary Anderson 31a16f342e
Roll goldctl to f808dcff91b221ae313e540c09d79696cd08b8de (#127218) 
goldctl hasn't been updated in about a year, and an update may be needed to reland https://github.com/flutter/flutter/pull/127110.
 2023-05-19 18:52:50 +00:00
Christopher Fujino 344c9c6af2
mark windows build tests non-bringup (#127059) 
This is a follow-up to aa0a1a7ae1. I was forced to mark these targets bringup in that PR because the targets were technically new (since each name changed 3 -> 4), so this is marking them non-bringup.
 2023-05-18 17:08:21 +00:00
Christopher Fujino aa0a1a7ae1
shard windows build tests 3 -> 4 (#127057) 
Time outs are currently making the tree red.

Fixes https://github.com/flutter/flutter/issues/127004
 2023-05-17 15:49:35 -07:00
godofredoc 25a9efe994
Fix drone_dimensions. (#126953) 
Use drone_dimensions instead of dimensions for builds running on dart-internal. This is required for those builders to select the correct drone type.
 2023-05-16 22:11:21 +00:00
keyonghan 3f01c7e019
Move Mac_build_test flutter_gallery__transition_perf_e2e_ios to prod (#126941) 
Target `Mac_build_test flutter_gallery__transition_perf_e2e_ios` was enabled in staging: https://github.com/flutter/flutter/pull/111164, and it has passed more than 50 runs: https://ci.chromium.org/p/flutter/builders/staging/Mac_build_test%20flutter_gallery__transition_perf_e2e_ios?limit=50. 

Manually enabling it in prod and removing the old `Mac_ios flutter_gallery__transition_perf_e2e_ios`.

The `Mac_build_test` one does the same thing as `Mac_ios` one, but separating build and test steps in separate targets.

Context: https://github.com/flutter/flutter/issues/103542
 2023-05-16 21:46:06 +00:00
Jonah Williams 41abe998ee
[devicelab] add drawPoints benchmark (#126728) 
Add a benchmark that measures the improvements from https://github.com/flutter/engine/pull/41803
 2023-05-15 19:14:58 +00:00
Zachary Anderson 674b1ad0ae
Remove obsolete iOS benchmark (#126862) 
Fixes https://github.com/flutter/flutter/issues/126861
 2023-05-15 19:12:56 +00:00
Reid Baker 159ebf736a
Mark no longer flakey tests as bringup:false (#126281) 
This is a result of auditing the ci.yaml tests marked as bringup true and determining which ones were still flakey. 
Each commit markes one tests as non flakey along with a link of proof of the lack of flakes. 

- Mark new_gallery_impeller__transition_perf as not flakey, #124699 closed, not recent flakes
- No failures in 500 runs for Staging_build_linux analyze https://ci.chromium.org/p/flutter/builders/staging/Staging_build_linux%20analyze\?cursor\=id%3E8782771663962116337\&limit\=200
- No flakes in 600 builds https://ci.chromium.org/p/flutter/builders/staging/Linux%20flutter_packaging_test\?cursor\=id%3E8787892377160059793\&limit\=200
- No flakes in 600 builds https://ci.chromium.org/p/flutter/builders/staging/Mac%20flutter_packaging_test\?cursor\=id%3E8787870631931126673\&limit\=200
- No flakes in 600 builds https://ci.chromium.org/p/flutter/builders/staging/Mac_arm64%20flutter_packaging_test\?cursor\=id%3E8787809799161254193\&limit\=200

#124699 is the only closed bug that was linked for a test that is no longer flakey. Closed status helps the case that flakes are no longer an issue.
 2023-05-15 18:12:52 +00:00
Zachary Anderson 468512e057
Increase test timeout for analyzer_benchmark to 60 minutes (#126586) 
Fixes https://github.com/flutter/flutter/issues/126451
 2023-05-12 08:45:14 -07:00
godofredoc fa117aad28
Add dimensions to release builds. (#126117) 
Release builds running in dart internal require the dimensions to be set explicitly at the target level in ci.yaml.

Bug: https://github.com/flutter/flutter/issues/126116
 2023-05-11 17:28:08 +00:00
keyonghan a7a1ddfb5a
Add cpu: x86 dimension and xcode dependency for Mac_build_test targets (#126482) 
This is a follow up of https://github.com/flutter/flutter/pull/111164.

My local LED was based on `cpu: x86` dimension and `xcode` dependency. But these are missed in the above PR, which caused test failure: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_build_test%20flutter_gallery__transition_perf_e2e_ios/19/overview
 2023-05-11 16:41:26 +00:00
keyonghan 8ab782d08a
Migrate gallery ios tests to build+test (#111164) 
Part of https://github.com/flutter/flutter/issues/103542
 2023-05-10 00:50:11 +00:00
Reid Baker 0fdddd67f9
Test AGP 8.0 using java 17 (#125323) 
- Update Gradle/AGP version and add namespace plus dependencies. 

https://github.com/flutter/flutter/issues/125181
 2023-05-08 15:02:31 +00:00
Drew Roen 9de9a81b80
Bring back the failing build_test's (#126014) 
https://github.com/flutter/flutter/issues/125897

The issue has been resolved, so bringing the tests out of bringup
 2023-05-05 15:54:43 +00:00
Jenn Magder 4f3c989bd3
Remove complex_layout_*__compile benchmarks (#126023) 
Fixes https://github.com/flutter/flutter/issues/126020.
 2023-05-03 23:49:01 +00:00
Flutter GitHub Bot 15bd29c8e2
Marks Linux_android slider_perf_android to be unflaky (#125968) 
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY.
{
  "name": "Linux_android slider_perf_android"
}
-->
The test has been passing for [50 consecutive
runs](https://data.corp.google.com/sites/flutter_infra_metrics_datasite/flutter_check_test_flakiness_status_dashboard/?p=BUILDER_NAME:%22Linux_android%20slider_perf_android%22).
This test can be marked as unflaky.
 2023-05-03 09:22:21 -07:00
Chris Yang 9fcb42d0dd
Update xcode to 14e222b (#125716) 
Framework part of https://github.com/flutter/flutter/issues/125814
 2023-05-02 19:56:17 +00:00
Jenn Magder cc9a3d9d95
Mark microbenchmarks_ios unflaky (#125332) 
This hasn't flaked for > 50 commits which is our threshhold.  Marking as unflaky.
 2023-05-02 19:34:40 +00:00
godofredoc d0069bec94
Mark build_test builds as bringup. (#125898) 
They require an additional dimension to be passed as part of the
.ci.yaml configuration.

Bug: https://github.com/flutter/flutter/issues/125897

## Pre-launch Checklist

- [X] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [X] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [X] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [X] I signed the [CLA].
- [X] I listed at least one issue that this PR fixes in the description
above.
- [X] I updated/added relevant documentation (doc comments with `///`).
- [X] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [X] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel
on [Discord].

<!-- Links -->
[Contributor Guide]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#overview
[Tree Hygiene]: https://github.com/flutter/flutter/wiki/Tree-hygiene
[test-exempt]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#tests
[Flutter Style Guide]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo
[Features we expect every widget to implement]:
https://github.com/flutter/flutter/wiki/Style-guide-for-Flutter-repo#features-we-expect-every-widget-to-implement
[CLA]: https://cla.developers.google.com/
[flutter/tests]: https://github.com/flutter/tests
[breaking change policy]:
https://github.com/flutter/flutter/wiki/Tree-hygiene#handling-breaking-changes
[Discord]: https://github.com/flutter/flutter/wiki/Chat
 2023-05-02 12:22:56 -07:00
Zachary Anderson fef41cfce0
Remove bringup from new_gallery_skia_ios__transition_perf (#125715) 
Final step of https://github.com/flutter/flutter/pull/125663
 2023-04-28 15:31:19 -07:00
Zachary Anderson 50f83fc277
Add back one Skia test on iOS (#125663) 
Fixes https://github.com/flutter/flutter/issues/125648
 2023-04-28 10:41:33 -07:00
Taha Tesser 746cacc501
Add slider_perf_android task to ci.yaml (#125540) 
This adds `devicelab` task `slider_perf_android` to `.ci.yaml`, which was added in https://github.com/flutter/flutter/pull/125296
 2023-04-27 21:32:39 +00:00
Jenn Magder 28e17177fd
Mark module_test_ios tests unflaky (#125498) 
[Dart workaround](https://dart-review.googlesource.com/c/sdk/+/297821 ) to prevent the flake has rolled into the framework.  Mark the tests unflaky so we can detect if it happens again when a fix for the underlying issue lands.

https://github.com/flutter/flutter/issues/125425#issuecomment-1522142360

Reverts https://github.com/flutter/flutter/pull/125426
 2023-04-27 18:09:25 +00:00
Zachary Anderson 1d30a1fc5a
Remove flavors_test_macos (#125581) 
This test has been failing for the past >1000 runs, and is wedging a bot
for 30 minutes as the failure mode is a timeout.

Fixes https://github.com/flutter/flutter/issues/119782
 2023-04-26 14:02:49 -07:00
Zachary Anderson 66fa4c5d30
Remove web compile benchmarks that specify an attached device (#125559) 
Fixes https://github.com/flutter/flutter/issues/125492
 2023-04-26 09:37:56 -07:00
Zachary Anderson 53cba8fd49
Add hostonly web compile size benchmarks (#125518) 
First part of https://github.com/flutter/flutter/issues/125492
 2023-04-25 19:11:12 -07:00
keyonghan 624bdd38b0
Mark module_test_ios flaky (#125426) 
https://github.com/flutter/flutter/issues/125425
 2023-04-24 18:46:50 +00:00
Jenn Magder 9e2e64c7c0
Do not run windows_home_scroll_perf__timeline_summary benchmark in presubmit (#125343) 
Introduced in https://github.com/flutter/flutter/pull/99564.  Checked with @jonahwilliams and this should not be running in presubmit.
 2023-04-24 18:33:21 +00:00
Jenn Magder baafa1991d
Combine flutter_tool_startup devicelab tests (#125226) 
`flutter_tool_startup__windows/linux/macos` were identical. Use the same task for all three.
 2023-04-21 22:33:07 +00:00
keyonghan d186792c00
Update xcode to 14c18 for host only bots (#125211) 
With https://flutter-review.googlesource.com/c/recipes/+/42160, we are
ready to make all tests consistent with xcode 14c18.

> auto label is removed for flutter/flutter, pr: 125211, due to This PR has not met approval requirements for merging. Changes were requested by {jmagman}, please make the needed changes and resubmit this PR. You have project association MEMBER and need 1 more review(s) in order to merge this PR.
> 
> * Merge guidelines: You need at least one approved review if you are already a MEMBER or two member reviews if you are not a MEMBER before re-applying the autosubmit label. **Reviewers**: If you left a comment approving, please use the "approve" review action instead.

Sounds an auto-submit bug. Manually submit.
 2023-04-20 20:50:59 -07:00
Casey Hillers 7d2669b8e7
[ci.yaml] Remove unnecessary use of { (#125058) 
In yaml, indented blocks indicate the following fields are children of the parent indent. The use of curly brackets is unnecessary here
 2023-04-21 00:32:31 +00:00
Zachary Anderson c31467f18c
Stop running "_impeller_" benchmark variants (#125044) 
Impeller is now the default on iOS, so these are redundant.

In a subsequent change, I'll clean up the source files for these.
 2023-04-18 09:54:02 -07:00
Casey Hillers b1f8d5df64
[ci.yaml] Disable packaging_test on release candidates (#124712) 
[ci.yaml] Disable packaging_test on release candidates
 2023-04-12 18:42:23 +00:00
Flutter GitHub Bot 2a5ecb6c48
Marks Linux firebase_abstract_method_smoke_test to be flaky (#124692) 
Marks Linux firebase_abstract_method_smoke_test to be flaky
 2023-04-12 18:29:07 +00:00
Flutter GitHub Bot d15325407e
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be flaky (#124694) 
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be flaky
 2023-04-12 17:52:26 +00:00
Flutter GitHub Bot df48b922ca
Marks Mac_ios animated_blur_backdrop_filter_perf_ios__timeline_summary to be unflaky (#124706) 
Marks Mac_ios animated_blur_backdrop_filter_perf_ios__timeline_summary to be unflaky
 2023-04-12 16:59:43 +00:00
Flutter GitHub Bot 2dfb03fdac
Marks Linux_android animated_blur_backdrop_filter_perf__timeline_summary to be unflaky (#124705) 
Marks Linux_android animated_blur_backdrop_filter_perf__timeline_summary to be unflaky
 2023-04-12 16:58:25 +00:00
Flutter GitHub Bot e68086e910
Marks Linux_android new_gallery_impeller__transition_perf to be flaky (#124700) 
Marks Linux_android new_gallery_impeller__transition_perf to be flaky
 2023-04-12 16:55:44 +00:00
keyonghan cf1891218d
Mark android_semantics_integration_test as flaky (#124638) 
Mark android_semantics_integration_test as flaky
 2023-04-11 23:49:05 +00:00
godofredoc be2aa1c268
Set multiple tests as non flaky. (#124604) 
Set multiple tests as non flaky.
 2023-04-11 20:05:21 +00:00
keyonghan 4c3d7333b1
Mark analyzer_benchmark as unflaky (#124394) 
Mark analyzer_benchmark as unflaky
 2023-04-07 17:20:52 +00:00
keyonghan c7bab2973e
Move analyzer_benchmark_vm to vm (#124147) 
Move analyzer_benchmark_vm to vm
 2023-04-04 22:41:34 +00:00
Jenn Magder f115e280c4
Run web integration tests on x64 or arm Macs (#123714) 
Run web integration tests on x64 or arm Macs
 2023-04-04 01:29:06 +00:00
Jonah Williams 54dbbd76b8
[devicelab] add regular old blur benchmark (#123879) 
[devicelab] add regular old blur benchmark
 2023-03-31 20:54:51 +00:00
Flutter GitHub Bot 91d751f8cd
Marks Mac platform_channel_sample_test_macos to be unflaky (#123702) 2023-03-30 12:37:33 -07:00
Flutter GitHub Bot a8afbfa22e
Marks Windows flutter_packaging_test to be unflaky (#123240) 
Marks Windows flutter_packaging_test to be unflaky
 2023-03-24 04:00:20 +00:00
Flutter GitHub Bot ec7c45948c
Marks Mac_arm64 flutter_packaging_test to be unflaky (#123239) 
Marks Mac_arm64 flutter_packaging_test to be unflaky
 2023-03-23 21:52:20 +00:00
Chris Bracken 674ff1573f
[macOS] Add platform_channel sample/test (#123141) 
Adds a macOS implementation of the platform_channel example,
demonstrating method channels and event channels with a battery power
plugin.

Adds platform_channel_sample_test_macos macOS host test to verify the
sample works.

Issue: https://github.com/flutter/flutter/issues/79204
 2023-03-23 11:56:23 -07:00
Flutter GitHub Bot 49dbb74c38
Marks Mac flutter_packaging_test to be unflaky (#123238) 
Co-authored-by: godofredoc <godofredoc@google.com>
 2023-03-22 18:20:52 -07:00
Flutter GitHub Bot 2a70f7eb10
Marks Linux flutter_packaging_test to be unflaky (#123237) 
Co-authored-by: godofredoc <godofredoc@google.com>
 2023-03-22 16:49:11 -07:00
Flutter GitHub Bot 2cdf078f0f
Marks Linux engine_dependency_proxy_test to be unflaky (#123236) 
Marks Linux engine_dependency_proxy_test to be unflaky
 2023-03-22 18:41:47 +00:00
Flutter GitHub Bot e760624f8a
Marks Linux build_tests_3_3 to be unflaky (#114528) 
Co-authored-by: godofredoc <godofredoc@google.com>
 2023-03-21 20:30:45 -07:00
Flutter GitHub Bot d75f0de604
Marks Linux build_tests_1_3 to be unflaky (#114526) 2023-03-21 19:14:51 -07:00
Jonah Williams 67810d672b
delete sksl benchmarks (#123163) 
delete sksl benchmarks
 2023-03-21 22:52:18 +00:00
Xilai Zhang cf18456755
add dimenstion for arm packaging (#122770) 
Add dimenstion for arm packaging
 2023-03-18 00:40:14 +00:00
godofredoc 1541dd3f25
Re-enable engine dependency proxy test. (#115511) 
Re-enable engine dependency proxy test.
 2023-03-17 03:16:13 +00:00
godofredoc 9f35ed77d7
Use packages/packages recipe. (#122822) 
Use packages/packages recipe.
 2023-03-16 20:52:09 +00:00
Flutter GitHub Bot 5b40de684a
Marks Linux web_long_running_tests_2_5 to be unflaky (#122718) 
Marks Linux web_long_running_tests_2_5 to be unflaky
 2023-03-15 21:52:05 +00:00
godofredoc 77178396c9
Fix globs in runIf configurations. (#122630) 
Fix globs in runIf configurations.
 2023-03-14 22:25:51 +00:00
Jenn Magder 5fd1c2b6a6
Revert "Run Skia gold framework tests on arm64 Mac builders (#122618)" (#122639) 
Revert "Run Skia gold framework tests on arm64 Mac builders"
 2023-03-14 21:55:05 +00:00
Jenn Magder dfab19c1fe
Run Skia gold framework tests on arm64 Mac builders (#122618) 
Run Skia gold framework tests on arm64 Mac builders
 2023-03-14 20:09:16 +00:00
Yegor 091104f8bc
[web] stop using deprecated jsonwire web-driver protocol (#122560) 
[web] stop using deprecated jsonwire web-driver protocol
 2023-03-14 18:25:23 +00:00
stuartmorgan 449a5bc757
Enable plugin_test_linux (#120912) 
Enable plugin_test_linux
 2023-03-09 00:41:34 +00:00
Flutter GitHub Bot ac76dabe67
Marks Windows plugin_test to be flaky (#122201) 
Marks Windows plugin_test to be flaky
 2023-03-08 20:57:54 +00:00
keyonghan c4ca9a4142
Update cmake version to the latest in infra/3pp/tools (#122147) 
Update cmake version to the latest in infra/3pp/tools
 2023-03-08 19:55:47 +00:00
Jenn Magder 244372b303
Run plugin_test_macos on Intel machines (#122212) 
Run plugin_test_macos on Intel machines
 2023-03-08 19:44:37 +00:00
Flutter GitHub Bot 75ccb43c54
Marks Mac_ios hot_mode_dev_cycle_ios__benchmark to be flaky (#120809) 
Marks Mac_ios hot_mode_dev_cycle_ios__benchmark to be flaky
 2023-03-08 00:24:05 +00:00
Michael Goderbauer b9c2d49989
Mark web_long_running_tests_2_5 flaky (#121814) 
Mark web_long_running_tests_2_5 flaky
 2023-03-03 18:35:13 +00:00
stuartmorgan 92bb306bcd
Add curl dependency to plugin_test_linux (#121807) 
Add `curl` dependency to plugin_test_linux
 2023-03-02 19:18:26 +00:00
godofredoc 888b7b9b19
Remove customer testing from recipes cq. (#121734) 
Remove customer testing from recipes cq.
 2023-03-01 21:35:55 +00:00
Flutter GitHub Bot 2159604f89
Marks Mac_ios flutter_gallery_ios_sksl_warmup__transition_perf to be flaky (#121232) 
Marks Mac_ios flutter_gallery_ios_sksl_warmup__transition_perf to be flaky
 2023-03-01 21:21:10 +00:00
Flutter GitHub Bot 46fed5903f
Marks Windows plugin_test to be unflaky (#113711) 
Marks Windows plugin_test to be unflaky
 2023-03-01 01:21:57 +00:00
Flutter GitHub Bot 5dc569f148
Marks Linux run_debug_test_linux to be unflaky (#121237) 
Co-authored-by: Loïc Sharma <737941+loic-sharma@users.noreply.github.com>
 2023-02-23 19:11:17 +00:00
gaaclarke bd5e8db3a3
Turned off bringup for wide gamut color tests. (#120918) 2023-02-21 18:53:11 +00:00
Loïc Sharma 00c0a07fa3
Increase Linux docs_test timeout (#120899) 
The `Linux docs_test` target has timed out repeatedly. This is a short-term mitigation to prevent unnecessary framework tree closures. In the future we should remove docset generation from post-submit `Linux docs_test`. See: https://github.com/flutter/flutter/issues/120901.

See this similar change: https://github.com/flutter/flutter/pull/120718
 2023-02-16 17:35:29 -08:00
stuartmorgan e00241a060
Enable Windows plugin tests (#119345) 
* Fix binary path

* Enable in presubmit
 2023-02-16 21:21:10 +00:00
stuartmorgan e65dfba8e1
Add Linux unit tests to plugin template (#120814) 
* Add Linux unit tests to plugin template

Adds an example native unit test to the plugin template for Linux,
matching the structure we use for our 1P plugin unit tests. Once these
have been added for all platforms+languages, they will be documented on
a new plugin development page to explain their use.

While ideally we would adjust the engine APIs first to allow for testing
the method call handler directly, it's unclear when we will have time
for that work, and for a complex plugin most of the testing wouldn't be
at that layer anyway, so having the structure in place with the
limitations documented is still a significant improvement over having
nothing in the template.

Part of https://github.com/flutter/flutter/issues/82458

* Add creation test

* Add integration tests

* Missing newlines

* test owner

* Typo
 2023-02-15 19:13:11 +00:00
Loïc Sharma a9f43665ca
Fix the flutter run -d linux tests (#120721) 
* Fix the Linux run_debug_test_linux test

* ?

* Also do release

* ??
 2023-02-15 17:43:12 +00:00
Loïc Sharma 2cfca820a3
Force Mac plugin_test to run on x64 bots (#120714) 2023-02-15 00:00:19 +00:00
Loïc Sharma 480c54c370
Increase Linux docs_publish timeout (#120718) 
This target recently caused the tree to close due to a timeout: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20docs_publish/8906/overview

This target consistently takes ~55 minutes, which is very close to its current timeout of 60 minutes. This increases the timeout to make timeouts less likely.
 2023-02-14 13:18:12 -08:00
Loïc Sharma 865422da20
Force Mac tool_integration_tests to run on x64 bots (#120634) 2023-02-13 23:52:35 +00:00
gaaclarke ddebe833b0
Added integration test for wide gamut support. (#119657) 
* Added integration test for wide gamut support.

* cleaned up

* deleted files that can be generated

* switched back to standard flutter in the shell script

* added devicelab task

* removed analysis options

* analyzer

* Fixed task

* made local_run.sh not executable

* analyzer

* removed the logo asset

* added task to ci

* updated pubspec

* analysis errors fixed

* updated pubspec
 2023-02-13 22:33:19 +00:00
Jenn Magder 95fd821ab8
Force Mac build_tests to run on x64 bots (#120620) 2023-02-13 21:23:11 +00:00
Flutter GitHub Bot 957494d9f0
Marks Linux_android flavors_test to be unflaky (#120299) 2023-02-13 17:20:03 +00:00
Xilai Zhang 96823590ec
post submit only (#120411) 2023-02-10 17:29:09 +00:00
Camille Simon 3a514175d3
Remove Android spell check integration test (#120144) 2023-02-08 18:51:52 +00:00
Jenn Magder 71971f2232
Run verify_binaries_codesigned task on release branches (#120141) 
* Run verify_binaries_codesigned on release branches

* Revert branches
 2023-02-07 02:56:38 +00:00
Jenn Magder e627e8d841
Force web_tool_tests to run on x64 builders (#120128) 2023-02-06 23:52:52 +00:00
godofredoc c8e75a8dff
Do not run customer testing on release candidate branches. (#119979) 
These tests try to use a commit contemporary to the framework commit in
customer repositories. This won't work because a CP to the framework
release candidate branch may be recent even though the release candidate
branch can be months old.
 2023-02-04 03:32:26 +00:00
Jenn Magder 909dc30090
Verify Mac artifact codesigning on x64 and arm64 (#119971) 
* Verify Mac artifact codesigning on x64 and arm64

* mac_arm64
 2023-02-04 01:52:05 +00:00
Jenn Magder c24904ddee
Run macOS benchmarks in prod pool to upload metrics (#119963) 2023-02-03 22:38:53 +00:00
Jenn Magder c52215e935
Run Mac hostonly tests on any available arch (#119884) 
* Run Mac hostonly tests on any available arch

* Exception for framework tests
 2023-02-03 22:37:48 +00:00
Jenn Magder 51b05ac7e1
Add mac_benchmark ci.yaml property (#119871) 
* Add mac_benchmark ci.yaml property

* Remove presubmit

* Bringup

* Comma

* gems

* Test animated_complex_opacity_perf_macos__e2e_summary in presubmit

* Try top-level mac_model

* Move dependencies back into tasks

* Add signing dependency

* Revert animated_complex_opacity_perf_macos__e2e_summary test
 2023-02-03 21:36:48 +00:00
Jenn Magder d875899a65
Bump test Chrome version for Mac arm support (#119773) 2023-02-03 00:14:42 +00:00
Ricardo Amador 22bbdf03e0
Android defines target update (#119766) 
* Round 2 with dimensions

* Try with stringified keys

* Forgot a comma

* trying a list of maps.

* Try key value pairs

* Try with kvm only

* try with swarming_dimensions

* Updated with fix in swarming.star

* Attempting to remove the bring up property to verify test is running.

* Remove android from target tags to avoid adb command automatically running in test_utils call.

* Remove the duplicated dependencies in the defines target that exist in the platform
 2023-02-02 20:56:05 +00:00
Flutter GitHub Bot e7d934a014
Marks Linux_android android_choreographer_do_frame_test to be flaky (#119721) 2023-02-02 18:12:56 +00:00
Jenn Magder 34730c79ca
Revert "Run Mac hostonly tests on any available arch (#119762)" (#119784) 
This reverts commit 475fc4ac9d.
 2023-02-02 03:42:17 +00:00
Jenn Magder 475fc4ac9d
Run Mac hostonly tests on any available arch (#119762) 
* Run Mac hostonly presubmit tests on any available arch

* Force all Mac tests to run on arm64 to validate in presubmit

* Go back to web tests on x64

* Run plugin_test_ios on x64

* Try Chrome 110 on arm

* Revert chrome bump, remove forcing arm64

* Update issue number
 2023-02-02 02:34:08 +00:00
Flutter GitHub Bot 1573c12963
Marks Mac_android microbenchmarks to be unflaky (#119727) 2023-02-01 18:53:20 +00:00
Chris Bracken d272a3ab80
Reland: [macos] add flavor options to tool commands (#119564) 
* Reland: [macos] add flavor options to tool commands

Adds --flavor option to flutter run and flutter build. Running against
preexisting devicelab flavor tests for feature parity between macOS,
iOS, and Android.

This relands #118421 by alex-wallen which was reverted in #118858 due to
the following test failures:

The bail-out with "Host and target are the same. Nothing to install."
added in `packages/flutter_tools/lib/src/commands/install.dart`
triggered failures in the following tests, which unconditionally attempt
to install the built app, which is unsupported on desktop since the
host and target are the same:

* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791495589540422465/+/u/run_flutter_view_macos__start_up/test_stdout
* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791496218824259121/+/u/run_complex_layout_win_desktop__start_up/test_stdout
* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791496218165602641/+/u/run_flutter_gallery_win_desktop__start_up/test_stdout

Fixes #64088

* Partial revert: eliminate install check on desktop

The original flavour support patch included a check that triggered a
failure when flutter install is run on desktop OSes. This was
intentional, since the host and target devices are the same and
installation is unnecessary to launch the app on currently-supported
desktop OSes.

Note that Windows UWP apps *do* require installation to run, and we used
to have an install command for those apps, though UWP is no longer
supported.

Since that part of the change was orthogonal to flavour support itself,
I'm reverting that component of the change and we can deal with it
separately if so desired.
 2023-01-31 17:37:46 +00:00
Flutter GitHub Bot 8898f4f198
Marks Mac_android run_debug_test_android to be unflaky (#117468) 2023-01-30 23:26:54 +00:00
Flutter GitHub Bot b2f2bf31c0
Marks Linux run_release_test_linux to be unflaky (#119156) 2023-01-27 19:19:45 +00:00
Flutter GitHub Bot 459c1b78b4
Marks Mac complex_layout_scroll_perf_macos__timeline_summary to be unflaky (#119157) 2023-01-26 18:59:40 +00:00
Flutter GitHub Bot fc02701818
Marks Mac run_debug_test_macos to be unflaky (#117470) 
Co-authored-by: Chris Bracken <chris@bracken.jp>
 2023-01-26 05:25:00 +00:00
stuartmorgan e3c51a2f2a
Add Windows unit tests to plugin template (#118638) 
* Add Windows unit tests to plugin template

Adds an example native unit test to the plugin template for Windows,
matching the format we use for our 1P plugin example app unit tests.
Once these have been added for all platforms+languages, they will be
documented on a new plugin development page to explain their use.

Since we don't appear to be running our current plugin e2e tests for
Windows, this adds a new configuration to run them. I haven't
`led`-tested this, so it may not work, but this will give a starting
point for getting them running.

Part of https://github.com/flutter/flutter/issues/82458

* Minor fix

* Add test owner

* Fix typo

* Fix test feature flag
 2023-01-24 18:23:57 +00:00
Jenn Magder 2e8dd9dd69
Run integration_ui_test_test_macos in prod (#118919) 2023-01-24 01:37:52 +00:00
Jenn Magder 65486163ac
Remove animated_complex_opacity_perf_macos__e2e_summary bringup (#118916) 2023-01-24 01:31:59 +00:00
Ricardo Amador 84071aa2aa
Add todo for linux defines test. (#119035) 
* Add todo for linux defines test.

* Update the linux android defines test to make it bringup: true
 2023-01-23 17:29:16 -08:00
Ricardo Amador 332aed9c88
Revert "Update the Linux Android defines test to use dimensions when selecting a build bot (#118930)" (#119023) 
This reverts commit 392dffeb08.
 2023-01-23 21:45:07 +00:00
Ricardo Amador 392dffeb08
Update the Linux Android defines test to use dimensions when selecting a build bot (#118930) 
* Round 2 with dimensions

* Try with stringified keys

* Forgot a comma

* trying a list of maps.

* Try key value pairs

* Try with kvm only

* try with swarming_dimensions

* Updated with fix in swarming.star
 2023-01-23 20:34:07 +00:00
Jenn Magder 25843bdb5a
Remove macOS impeller benchmarks (#118917) 
* Remove macOS impeller benchmarks

* TESTOWNERS
 2023-01-21 01:34:53 +00:00
Ricardo Amador bae4c1d243
Revert "Update android defines test to use emulator (#118808)" (#118928) 
This reverts commit 49e025d8ac.
 2023-01-21 01:06:14 +00:00
Ricardo Amador 49e025d8ac
Update android defines test to use emulator (#118808) 
* Update android defines test to use emulator

* Need strings in dimensions.

* put dimensions in the wrong spot.

* Add bringup.

* See if the test runs with Linux_android

* Adjusting dimensions

* Dimension fields must be strings.

* Making dimensions a dict.

* Try with swarming.dimension

* The dimension set does not appear to do anything.

* Device type none

* Made target presubmit

* Dimensions again

* Fixed formatting.

* Update since flutter roller fails
 2023-01-20 16:40:19 -08:00
Flutter GitHub Bot 15bc4e466c
Marks Mac_android microbenchmarks to be flaky (#118693) 2023-01-20 22:54:27 +00:00
Flutter GitHub Bot c0ad6add26
Marks Mac plugin_test_macos to be unflaky (#118706) 2023-01-20 21:48:10 +00:00
Jenn Magder 030288d33b
Revert "[macos] add flavor options to commands in the flutter_tool (#118421)" (#118858) 
This reverts commit 73096fd96e.
 2023-01-20 03:46:45 +00:00
Alex Wallen 73096fd96e
[macos] add flavor options to commands in the flutter_tool (#118421) 
* Add new macos target configured for flavors

* Rename Free App copy-Info.plist to Free App Info.plist

* Remove bogus entitlements

* Remove Generated.xcconfig

* Audit project.pbxproj

* Remove unused configs

* share one info.plist

* Modify scheme so that paid app works

* Codesign automatic

* Pipe flavor as scheme into xcodebuild

* Ignore incoming flavor string

* pipe flavor for flutter run to work

* Add devicelab tests

* Error if host and target device are same for flutter install desktop

* Avoid bang (!) by promoting a local.

Co-authored-by: Jenn Magder <magder@google.com>

* Add supportsInstall property

* Override  in test classes

* Add install test on macOS

* Refactor application_package and add tests for package directory

Co-authored-by: a-wallen <stephenwallen@google.com>
Co-authored-by: Jenn Magder <magder@google.com>
 2023-01-19 23:52:16 +00:00
Alex Wallen 22520f54df
[macOS] Add timeline summary benchmarks (#118748) 
* Add new task runner for impeller enabled complex layout test

* Add new target in .ci.yaml

* Claim ownership of complex_layout_scroll_perf_impeller_macos__timeline_summary

* Task runner for non-impeller enabled scroll test

* Add test target for non impeller complex layout scroll

* claim ownership of the last target

* mark as bringup

Co-authored-by: a-wallen <stephenwallen@google.com>
 2023-01-19 21:29:19 +00:00
Jenn Magder 2258590a82
Do not run Mac_arm64_ios run_debug_test_macos in presubmit during iPhone 11 migration (#118828) 2023-01-19 12:50:40 -08:00
yusuf-goog 9b5ea30a9c
Switching over from iOS-15 to iOS-16 in .ci.yaml. (#118807) 
This will run tests on new iphone11 devicelab devices
which are running iOS-16.

Bug:https://github.com/flutter/flutter/issues/117237
 2023-01-19 19:54:10 +00:00
Alex Wallen d53cc4a10f
[macOS] New e2e_summary benchmark fails without Cocoapods. (#118754) 
* Add gems as a dep - fails without

* Add missing entitlements to run app on macos

Co-authored-by: a-wallen <stephenwallen@google.com>
 2023-01-19 08:04:22 +00:00
Ricardo Amador e5c9d065fc
Forgot to remove emulator flag. (#118762) 2023-01-19 01:49:50 +00:00
Alex Wallen 666dccc85e
[macOS] bringup new e2e_summary devicelab test (#118717) 
* Add new task runner for animated_complex_opacity_perf_impeller e2e_summary on macos

* Register new target for macos e2e_summary task

* Claim ownership in TESTOWNERS

* Add task runner for animated complex opacity without impeller

* Register new target in .ci.yaml for non-impeller test

* Claim ownership of non-impeller task

Co-authored-by: a-wallen <stephenwallen@google.com>
 2023-01-18 22:33:49 +00:00
Ricardo Amador f989d551ce
Devicelab android emulator (#113472) 
* Testing whether emulator is possible.

* Adding changes to see if emulator can be used from recipe.

* adding emulator support.

* Add the emulator flag for testing.

* Using string for boolean since it cannot be parsed in properties

* Checking to see if these changes are being used.

* Updated bool back to string

* Remove trailing whitespace from file.
 2023-01-17 22:01:11 +00:00
Nehal Patel 0449030a96
Disable Xcode cache cleanup (#118641) 2023-01-17 22:01:08 +00:00
Jenn Magder 68dd63d66b
Mark Mac_arm64 tool_host_cross_arch_tests not flaky (#118484) 2023-01-13 23:34:33 +00:00
Loïc Sharma cea55d99d0
[Linux] Add a 'flutter run' console output test (#118279) 
* Add Linux support for the UI integration test project

* Add Linux run console test
 2023-01-13 19:17:12 +00:00
Flutter GitHub Bot a523f79233
Marks Mac_ios spell_check_test to be unflaky (#117743) 2023-01-13 16:05:19 +00:00
godofredoc 40c96f17bc
Enable xcode cache cleanup for a few days. (#118419) 
This is to ensure the xcode caches get back to a normal state as they
seem to have gotten into a bad state after updating the xcode version.

Bug: https://github.com/flutter/flutter/issues/118324
Bug: https://github.com/flutter/flutter/issues/118327
Bug: https://github.com/flutter/flutter/issues/118328
 2023-01-13 02:47:02 +00:00
Flutter GitHub Bot f8628b5cb1
Marks Mac_ios platform_views_scroll_perf_non_intersecting_impeller_ios__timeline_summary to be unflaky (#116668) 2023-01-12 02:48:03 +00:00
Flutter GitHub Bot 13ebde6ff1
Marks Mac channels_integration_test to be unflaky (#111571) 2023-01-11 18:20:31 -08:00
Flutter GitHub Bot 727e86079e
Marks Mac_ios complex_layout_scroll_perf_bad_ios__timeline_summary to be unflaky (#111570) 2023-01-11 18:02:30 -08:00
Flutter GitHub Bot 3cee38e80f
Marks Mac_arm64_ios run_debug_test_macos to be unflaky (#117990) 2023-01-10 18:07:09 +00:00
Flutter GitHub Bot 0cd8d8451c
Marks Mac_arm64_android run_debug_test_android to be unflaky (#117469) 2023-01-10 18:07:07 +00:00
Loïc Sharma cb62cfdd1f
Manually mark Windows run_debug_test_windows as unflaky (#118112) 2023-01-10 18:03:15 +00:00
Jenn Magder eaaacdcba9
Allow iOS and macOS plugins to share darwin directory (#115337) 2023-01-09 10:33:03 -08:00
Jenn Magder a02b9d2bff
Update to Xcode 14.2 (#117507) 
* Update to Xcode 14.2

* Only bump for devicelab builders

* Restore presubmit: false
 2023-01-09 18:29:26 +00:00
Camille Simon 9fb1ae839e
[iOS] Add task for spell check integration test (#116222) 
* Add fix and test

* Add test owner

* Print error for testing

* Make sure locale is the problem

* Test capitalization fix

* Take out Android specific test

* Verify eng fix

* Test fix

* Empty-Commit

* Test all tests

* Up string size for testing

* Remove test

* Undo ci.yaml testing changes

* Test android variant:

* Change to testwidgets

* Add widget tester

* Remove android only attempt

* Revert ci.yaml changes
 2022-12-22 02:47:11 +00:00
Siva b3c7fe32ed
enable test_ownership in presubmit (#117414) 2022-12-20 16:08:31 -08:00
godofredoc fa711f77e0
Run packaging on presubtmit. (#116943) 
* Run packaging on presubtmit.

Test release package generation on presubmit.

Bug: https://github.com/flutter/flutter/issues/28618
Bug: https://github.com/flutter/flutter/issues/60706

* Run packaging_test on all branches.
 2022-12-16 02:37:19 +00:00
godofredoc a41c447c8b
Pass dimension explicitly to mac x64 packaging. (#117172) 
Without passing this dimension there is a chance that the build will
run on a arm64 machine.
 2022-12-15 23:19:09 +00:00
godofredoc 0e0f29fc8c
Run packaging builders only on beta and stable. (#117037) 
The packaging recipe is now checking the enabled branches property.

Bug: https://github.com/flutter/flutter/issues/115492
 2022-12-14 18:05:03 +00:00
Flutter GitHub Bot 8e452be2f0
Marks Windows run_release_test_windows to be unflaky (#117071) 2022-12-14 18:04:59 +00:00
Loïc Sharma 41625b6620
Test flutter run does not have unexpected engine logs (#116798) 2022-12-12 22:39:49 +00:00
godofredoc bd0791be3f
Pass drone_dimensions as part of the main target. (#116812) 
* Pass drone_dimensions as part of the main target.

Drone dimensions were passed as properties when the sharding utility is
expecting them in the target.

Bug: https://github.com/flutter/flutter/issues/116794

* Use dimensions instead of drone_dimensions.

* Use a map format.
 2022-12-12 15:17:51 +00:00
godofredoc 1da8f4edc4
Several fixes to packaging builders. (#116800) 
It includes the following changes:

* Adds main as the enabled branches.
* Adds docs_beta and docs_stable to pass the expected gcp project.
* Adds dimensions to packaging arm64 to ensure that it runs on arm64
  bot.

Bug: https://github.com/orgs/flutter/projects/43
 2022-12-09 21:12:24 +00:00
Loïc Sharma bebea0cc6c
[Windows] Add a flutter run console output test (#116626) 
Adds a test to verify the console output of `flutter run --release` on Windows.

Part of: https://github.com/flutter/flutter/issues/111577
 2022-12-08 14:05:53 -08:00
sealesj e52449b641
Add Remaining Packaging Builders (#116683) 
* add stable packaging builders

* update testowners

* consolidate and use enabled_branches

* update to reflect the consolidation
 2022-12-08 17:19:05 +00:00
godofredoc e07240e684
Update docs_deploy builder with the real name. (#116631) 
This is removing the temporary comments and simplifying the name.

Bug: https://github.com/flutter/flutter/issues/115489
 2022-12-07 15:57:02 +00:00
sealesj 1b05653ab2
use deploy suffix (#116533) 2022-12-05 22:21:07 +00:00
sealesj 30fc993cae
Migrate Packaging Builders to .ci.yaml (#115569) 
* packaging builder initial config

* add release scheduler parameter

* remove stables

* add taskname + test owner

* testowner test

* comment structure

* test naming convention

* test adding tags

* add timeout

* prune names

* Update testowners.

* Move packaging to shards section.

* Set packaging as shard.

* Use packaging V2

Co-authored-by: godofredoc <godofredoc@google.com>
 2022-12-05 10:51:40 -05:00
Jonah Williams 08a2635e2b
[devicelab] add benchmark for complex non-intersecting widgets with platform views (#116436) 2022-12-02 21:37:45 +00:00
Flutter GitHub Bot a1b8dc9ea7
Marks Linux_android animated_complex_image_filtered_perf__e2e_summary to be unflaky (#116423) 2022-12-02 11:48:57 -08:00
Drew Roen 0d0febc94d
Add release_build parameter (#116307) 2022-11-30 14:49:07 -08:00
Jonah Williams dfa3d33328
[devicelab] track performance of animated image filter (#115850) 
* [devicelab] track performance of animated image filter

* ++

* make animations repeat and add dispose

* make duration more consistently 10sec
 2022-11-29 01:59:19 +00:00
Drew Roen 511c5341bd
Add test target for release scheduler (#115781) 
* Add test scheduler

* Code review comments - added new line, update comment to include TODO

* Switch target to mimic Linux docs_deploy
 2022-11-28 17:10:25 +00:00
Flutter GitHub Bot 7faacb5f74
Marks Windows_android channels_integration_test_win to be unflaky (#115939) 2022-11-28 16:38:24 +00:00
Christopher Fujino dfdec8984f
[flutter_tools] Remove package:image (#115848) 
* remove ciyaml targets

* remove screenshot_test and package:image

* update-packages

* remove TESTOWNERS entries
 2022-11-22 21:49:57 +00:00
keyonghan eed385132d
Support Host only bots apple signing (#115780) 
* Mac host only codesigning

* consistent
 2022-11-21 23:09:12 +00:00
Camille Simon 7045a8b570
Add Spell Check to Editable Text (iOS) (#110193) 
* Add ios to integration test and comments

* Add licenses

* Fix integration test for ios

* Delete pngs

* Undo changes to integration test

* Undo error

* Add ios task

* Fix task for landing
 2022-11-21 19:11:48 +00:00
Christopher Fujino 84357cbc4f
re-enable firebase release smoke test since infra outage is over (#115402) 2022-11-16 20:45:38 +00:00
Flutter GitHub Bot c940f31822
Marks Mac_ios flavors_test_ios to be unflaky (#115458) 2022-11-16 17:37:23 +00:00
godofredoc 10dc566436
Add drone_dimensions to devicelab_build_test. (#115183) 
This is to allow a single drone to manage all the different subbuilds.

Bug: https://github.com/flutter/flutter/issues/114943
 2022-11-12 00:30:07 +00:00
Christopher Fujino a6e3ec8fad
mark firebase test lab test flaky because of upstream infra issues (#115178) 2022-11-11 23:04:55 +00:00
Alex Wallen 7020f59ace
[tool] Support --flavor option for flutter install. (#114048) 
* Alphabetize setup calls

* Add --flavor as an option for install

* Add verbose logging in install command

* Test that flavors build succeeds with proper flavor and fails with bogus one.

* Remove unused import

* The import was used...

* SQUASH

* Add flavor install test

* Rename test

* Add flavors install integration tests

* correct error message

* remove unused imports

* Delete copy test

* update test target

* Refactor mechanism to read buildInfo

* Remove unused import

* Set affected test targets to bringup: true

Co-authored-by: a-wallen <stephenwallen@google.com>
 2022-11-08 22:53:23 +00:00
Chris Bracken cf0cd067a0
Mark new_gallery__transition_perf as non-flaky (#114694) 
These were marked flaky due to a timeout switching between items in the
Studies list at the top of the screen, which had snap-to-item scroll
physics.

The same flake also affected new_gallery_impeller__transition_perf which
was failing with the same flake, though was separately marked flaky due
to a separate (engine crash) flake documented in:
* https://github.com/flutter/flutter/issues/112577
* https://github.com/flutter/flutter/issues/112438

Leaving the latter marked flaky for the time being while that separate
issue is investigated.

Issue: https://github.com/flutter/flutter/issues/114025
 2022-11-05 17:02:38 -07:00
godofredoc 4fd0a92532
Remove auto_cleanup of xcode caches. (#114719) 
After all the caches have been cleaned and the logic to cleanup runtimes
has landed we may not need to always delete the caches.

Bug: https://github.com/flutter/flutter/issues/114656
 2022-11-05 00:08:15 +00:00
Flutter GitHub Bot 1f7bacff42
Marks Linux build_tests_2_3 to be unflaky (#114527) 2022-11-02 16:56:04 +00:00
keyonghan 70a95d57ce
Mark Linux_android new_gallery__transition_perf flaky (#114429) 2022-11-01 16:50:24 +00:00
keyonghan 0c7ee58696
Make Linux_android android_semantics_integration_test flaky (#114361) 2022-10-31 17:48:06 +00:00
Christopher Fujino a5d5cd7a7b
increase Linux build_test sharding (#114196) 2022-10-28 01:09:23 +00:00
Camille Simon 694b25355d
[Android] Fix spell check integration test guarded function conflict (#113541) 2022-10-24 22:54:18 +00:00
pdblasi-google 8d13c8966b
Followup 113705: Allow the slow tests to break the tree as all tests in that shard previously could (#113846) 2022-10-21 20:21:06 +00:00
pdblasi-google 782baecc50
Resolve 113705: Separated longer running tests from runMisc to prevent flakiness from timeouts (#113784) 2022-10-21 16:02:14 +00:00
godofredoc 3665dd8353
Start generating coverage. (#113587) 2022-10-20 23:02:13 +00:00
godofredoc 30161d4db9
Enable cache cleanup. (#113729) 2022-10-20 16:33:56 +00:00
Flutter GitHub Bot 83a9858fa0
Marks Windows_android channels_integration_test_win to be flaky (#113707) 2022-10-19 18:58:57 +00:00
Jenn Magder 6ad44434ad
Remove bringup from hot_mode_dev_cycle_ios_simulator (#113660) 2022-10-19 18:55:07 +00:00
Jenn Magder 4d28e6d064
Terminate simulator app on "q" (#113581) 2022-10-18 22:26:16 +00:00
godofredoc 10740484d2
Remove cross_arch_tests from recipes cq. (#113569) 2022-10-18 17:11:29 +00:00
Casey Hillers e23a68347e
[ci.yaml] Increase docs targets to use 32 cores (#113465) 2022-10-17 15:58:52 +00:00
Flutter GitHub Bot ea8e00e75a
Marks Windows web_tool_tests_1_2 to be unflaky (#112954) 2022-10-06 17:59:45 +00:00
Flutter GitHub Bot bee1775754
Marks Windows web_tool_tests_2_2 to be unflaky (#112955) 2022-10-06 17:59:43 +00:00
Flutter GitHub Bot 6f652863bb
Marks Mac_android microbenchmarks to be unflaky (#112953) 2022-10-06 17:55:51 +00:00
Flutter GitHub Bot 17514de663
Marks Mac plugin_lint_mac to be unflaky (#112951) 2022-10-06 17:55:48 +00:00
keyonghan be86a91654
Ignore flakiness for Mac_arm64 tool_host_cross_arch_tests (#112999) 2022-10-06 16:35:08 +00:00
Flutter GitHub Bot 61f61c44b4
Marks Windows plugin_test to be flaky (#112940) 2022-10-06 15:48:19 +00:00
godofredoc c99780dea8
Run docs publish on all branches. (#112909) 2022-10-05 04:41:27 +00:00
Camille Simon b94b584298
[Android] Fix spell_check integration test flakiness (#112109) 2022-10-04 19:05:39 +00:00
Jesús S Guerrero 45584b2528
Web subsharding (#112505) 2022-09-28 19:23:35 +00:00
Flutter GitHub Bot cd3beb4f0f
Marks Linux_android new_gallery_impeller__transition_perf to be flaky (#112578) 2022-09-28 19:01:09 +00:00
Flutter GitHub Bot 6e1438c9b5
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be flaky (#112574) 2022-09-28 18:51:57 +00:00
Flutter GitHub Bot 1a5bc32e00
Marks Mac complex_layout_macos__compile to be unflaky (#112556) 2022-09-28 18:16:10 +00:00
Flutter GitHub Bot 92815c9f10
Marks Mac flutter_gallery_macos__compile to be unflaky (#112557) 2022-09-28 18:13:26 +00:00
Jenn Magder 2f0f49f28f
Revert "Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558)" (#112579) 
This reverts commit e0fcdabe7b.
 2022-09-28 11:09:33 -07:00
Flutter GitHub Bot e0fcdabe7b
Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558) 2022-09-28 17:26:24 +00:00
Flutter GitHub Bot c4dd441a12
Marks Windows_android channels_integration_test_win to be unflaky (#112559) 2022-09-28 17:20:03 +00:00
Flutter GitHub Bot 0941737d28
Marks Mac flutter_gallery_macos__start_up to be unflaky (#112088) 2022-09-28 15:34:08 +00:00
Alex Wallen 23d17e3021
Fix integration_ui_test_test_macos (#112507) 2022-09-28 00:37:25 +00:00
Sarang Pal 97b53bc90b
Fix for issue #104104 Add host tag to `tags in .ci.yaml targets (#112454) 2022-09-27 19:39:03 +00:00
Jenn Magder 216aefa140
Remove x64 "tool_host_cross_arch_tests" bringup (#112411) 2022-09-27 17:51:37 +00:00
Harry Terkelsen 9853d886ab
Revert "Remove tool_host_cross_arch_tests bringup" (#112406) 2022-09-26 20:33:45 +00:00
Jenn Magder 11f4d4fc02
Remove tool_host_cross_arch_tests bringup (#112311) 2022-09-26 18:01:16 +00:00
Flutter GitHub Bot ac823ccae6
Marks Mac flutter_view_macos__start_up to be unflaky (#112089) 2022-09-26 17:49:07 +00:00
Alex Wallen b22388ee68
Add a flutter app that can resize itself as integration test app. (#112297) 2022-09-26 17:45:19 +00:00
Flutter GitHub Bot d766269e6f
Marks Mac flutter_tool_startup__macos to be unflaky (#112094) 2022-09-22 17:13:06 +00:00
keyonghan 0eaa6dad9a
Mark Mac plugin_lint_mac as flaky (#112147) 2022-09-22 16:20:50 +00:00
Flutter GitHub Bot 32d944c093
Marks Windows flutter_tool_startup__windows to be unflaky (#112092) 2022-09-22 16:20:48 +00:00
Flutter GitHub Bot 6ddffadca6
Marks Linux flutter_tool_startup__linux to be unflaky (#112093) 2022-09-22 16:19:52 +00:00
Jenn Magder c9edacb172
Always run Mac hostonly builds on x64 by default (#112133) 2022-09-21 17:50:03 -07:00
Xilai Zhang d98c263e30
[codesign] remove beta, stable, dev references in ci.yaml (#112105) 2022-09-21 21:47:43 +00:00
Jenn Magder 442953268f
Run Mac hostonly tests on any available arch (#109889) 2022-09-21 21:38:09 +00:00
Xilai Zhang 99e491e30a
[codesign] bring up verify codesign test on release branches (#112096) 2022-09-21 18:29:23 +00:00
Flutter GitHub Bot 77377b46dd
Marks Mac hello_world_macos__compile to be unflaky (#112090) 2022-09-21 17:59:19 +00:00
Flutter GitHub Bot bdde878631
Marks Mac basic_material_app_macos__compile to be unflaky (#112087) 2022-09-21 17:52:39 +00:00
Flutter GitHub Bot c44407c820
Marks Mac platform_view_macos__start_up to be unflaky (#112091) 2022-09-21 17:52:37 +00:00
keyonghan ccd3d80074
Move android gallery_transition_perf targets to prod (#111584) 2022-09-19 16:03:24 +00:00
jensjoha b7b8b759bc
Add flutter startup benchmark (#111658) 
Add flutter startup benchmark for Linux, Windows and MacOs.

Via guide on https://github.com/flutter/flutter/pull/111461#issuecomment-1247113905
 2022-09-16 08:41:30 +02:00
Alex Wallen 29d508dd53
Add Xcode as dependency of flutter_view_macos__start_up in .ci.yaml (#111624) 2022-09-15 21:54:05 +00:00
Alex Wallen 96b49aae31
[macOS] Add flutter_view example. (#111326) 2022-09-14 23:44:14 +00:00
keyonghan e9d687bbf1
Remove customized runtime for framework targets (#111492) 2022-09-13 21:34:09 +00:00
keyonghan 26a76fe3a0
Mark Mac_android microbenchmarks flaky (#111486) 2022-09-13 16:57:10 +00:00
sealesj 0cbf67576a
Remove Linux_samsung_a02 openpay_benchmarks__scroll_perf (#111415) 2022-09-12 20:58:06 +00:00
Alex Wallen c6d44e25fb
[macOS] Add missing, required dependencies to run platform_view_macos__start_up (#111300) 2022-09-12 19:26:16 +00:00
godofredoc a1dbd0ccec
Revert "Temporarily disable docs tests." (#111278) 2022-09-09 17:59:10 +00:00
godofredoc 9bd751f27a
Temporarily disable docs tests. (#111237) 
This is to reopen the tree while jazzy installation is fixed.

Bug: https://github.com/flutter/flutter/issues/111193
 2022-09-08 20:27:27 -07:00
gaaclarke d2434a2b60
Added platform channel integration tests for macos (#110606) 2022-09-08 22:39:07 +00:00
Alex Wallen 652ff7a5e6
[macOS] Add platform_view_macos__start_up tests devicelab test suite. (#111041) 2022-09-08 19:35:20 +00:00
Alex Wallen eac2329ebf
Re-land [macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110379) 2022-09-08 16:49:17 +00:00
Alex Wallen 2b373903a8
Remove flutter_gallery_mac__start_up as target in .ci.yaml (#111117) 2022-09-07 22:19:21 +00:00
keyonghan ab77e43566
Migrate Linux android gallery e2e and hybrid tests to build+test (#110533) 2022-09-07 20:19:20 +00:00
Flutter GitHub Bot ad1e76a209
Marks Mac_ios native_platform_view_ui_tests_ios to be unflaky (#111107) 2022-09-07 17:22:07 +00:00
Flutter GitHub Bot de0dd063b4
Marks Mac_ios complex_layout_scroll_perf_bad_impeller_ios__timeline_summary to be unflaky (#111106) 2022-09-07 17:09:18 +00:00
keyonghan ad1ce00891
Switch Linux_build_test flutter_gallery__transition_perf to prod (#111047) 2022-09-07 00:27:09 +00:00
keyonghan 2719cd036e
Revert "Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup"" (#110804) 2022-09-01 20:59:37 +00:00
godofredoc 759d0e1b20
Revert "Set linux autoroller as bringup to reopen the tree." (#110748) 2022-09-01 06:07:20 +00:00
godofredoc d8d7b226ce
Set linux autoroller as bringup to reopen the tree. (#110739) 
The build is failing to decrypt the key after it was moved to a
different GCP project. Disabling temporarily to reopen the tree while
the key is regenerated.
 2022-08-31 20:13:34 -07:00
keyonghan 1f236a9b6f
Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup" (#110734) 2022-09-01 00:29:05 +00:00
Jenn Magder 9f6b7dfefc
Do not run desktop benchmarks in presubmit (#110642) 2022-08-31 21:41:20 +00:00
Zachary Anderson c213fd9b9c
Switch Linux_build_test flutter_gallery__transition_perf back to bringup (#110702) 2022-08-31 13:35:52 -07:00