Commit graph

695 commits

Author SHA1 Message Date
Jenn Magder 2f0f49f28f
Revert "Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558)" (#112579)
This reverts commit e0fcdabe7b.
2022-09-28 11:09:33 -07:00
Flutter GitHub Bot e0fcdabe7b
Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558) 2022-09-28 17:26:24 +00:00
Flutter GitHub Bot c4dd441a12
Marks Windows_android channels_integration_test_win to be unflaky (#112559) 2022-09-28 17:20:03 +00:00
Flutter GitHub Bot 0941737d28
Marks Mac flutter_gallery_macos__start_up to be unflaky (#112088) 2022-09-28 15:34:08 +00:00
Alex Wallen 23d17e3021
Fix integration_ui_test_test_macos (#112507) 2022-09-28 00:37:25 +00:00
Sarang Pal 97b53bc90b
Fix for issue #104104 Add host tag to `tags in .ci.yaml targets (#112454) 2022-09-27 19:39:03 +00:00
Jenn Magder 216aefa140
Remove x64 "tool_host_cross_arch_tests" bringup (#112411) 2022-09-27 17:51:37 +00:00
Harry Terkelsen 9853d886ab
Revert "Remove tool_host_cross_arch_tests bringup" (#112406) 2022-09-26 20:33:45 +00:00
Jenn Magder 11f4d4fc02
Remove tool_host_cross_arch_tests bringup (#112311) 2022-09-26 18:01:16 +00:00
Flutter GitHub Bot ac823ccae6
Marks Mac flutter_view_macos__start_up to be unflaky (#112089) 2022-09-26 17:49:07 +00:00
Alex Wallen b22388ee68
Add a flutter app that can resize itself as integration test app. (#112297) 2022-09-26 17:45:19 +00:00
Flutter GitHub Bot d766269e6f
Marks Mac flutter_tool_startup__macos to be unflaky (#112094) 2022-09-22 17:13:06 +00:00
keyonghan 0eaa6dad9a
Mark Mac plugin_lint_mac as flaky (#112147) 2022-09-22 16:20:50 +00:00
Flutter GitHub Bot 32d944c093
Marks Windows flutter_tool_startup__windows to be unflaky (#112092) 2022-09-22 16:20:48 +00:00
Flutter GitHub Bot 6ddffadca6
Marks Linux flutter_tool_startup__linux to be unflaky (#112093) 2022-09-22 16:19:52 +00:00
Jenn Magder c9edacb172
Always run Mac hostonly builds on x64 by default (#112133) 2022-09-21 17:50:03 -07:00
Xilai Zhang d98c263e30
[codesign] remove beta, stable, dev references in ci.yaml (#112105) 2022-09-21 21:47:43 +00:00
Jenn Magder 442953268f
Run Mac hostonly tests on any available arch (#109889) 2022-09-21 21:38:09 +00:00
Xilai Zhang 99e491e30a
[codesign] bring up verify codesign test on release branches (#112096) 2022-09-21 18:29:23 +00:00
Flutter GitHub Bot 77377b46dd
Marks Mac hello_world_macos__compile to be unflaky (#112090) 2022-09-21 17:59:19 +00:00
Flutter GitHub Bot bdde878631
Marks Mac basic_material_app_macos__compile to be unflaky (#112087) 2022-09-21 17:52:39 +00:00
Flutter GitHub Bot c44407c820
Marks Mac platform_view_macos__start_up to be unflaky (#112091) 2022-09-21 17:52:37 +00:00
keyonghan ccd3d80074
Move android gallery_transition_perf targets to prod (#111584) 2022-09-19 16:03:24 +00:00
jensjoha b7b8b759bc
Add flutter startup benchmark (#111658)
Add flutter startup benchmark for Linux, Windows and MacOs.

Via guide on https://github.com/flutter/flutter/pull/111461#issuecomment-1247113905
2022-09-16 08:41:30 +02:00
Alex Wallen 29d508dd53
Add Xcode as dependency of flutter_view_macos__start_up in .ci.yaml (#111624) 2022-09-15 21:54:05 +00:00
Alex Wallen 96b49aae31
[macOS] Add flutter_view example. (#111326) 2022-09-14 23:44:14 +00:00
keyonghan e9d687bbf1
Remove customized runtime for framework targets (#111492) 2022-09-13 21:34:09 +00:00
keyonghan 26a76fe3a0
Mark Mac_android microbenchmarks flaky (#111486) 2022-09-13 16:57:10 +00:00
sealesj 0cbf67576a
Remove Linux_samsung_a02 openpay_benchmarks__scroll_perf (#111415) 2022-09-12 20:58:06 +00:00
Alex Wallen c6d44e25fb
[macOS] Add missing, required dependencies to run platform_view_macos__start_up (#111300) 2022-09-12 19:26:16 +00:00
godofredoc a1dbd0ccec
Revert "Temporarily disable docs tests." (#111278) 2022-09-09 17:59:10 +00:00
godofredoc 9bd751f27a
Temporarily disable docs tests. (#111237)
This is to reopen the tree while jazzy installation is fixed.

Bug: https://github.com/flutter/flutter/issues/111193
2022-09-08 20:27:27 -07:00
gaaclarke d2434a2b60
Added platform channel integration tests for macos (#110606) 2022-09-08 22:39:07 +00:00
Alex Wallen 652ff7a5e6
[macOS] Add platform_view_macos__start_up tests devicelab test suite. (#111041) 2022-09-08 19:35:20 +00:00
Alex Wallen eac2329ebf
Re-land [macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110379) 2022-09-08 16:49:17 +00:00
Alex Wallen 2b373903a8
Remove flutter_gallery_mac__start_up as target in .ci.yaml (#111117) 2022-09-07 22:19:21 +00:00
keyonghan ab77e43566
Migrate Linux android gallery e2e and hybrid tests to build+test (#110533) 2022-09-07 20:19:20 +00:00
Flutter GitHub Bot ad1e76a209
Marks Mac_ios native_platform_view_ui_tests_ios to be unflaky (#111107) 2022-09-07 17:22:07 +00:00
Flutter GitHub Bot de0dd063b4
Marks Mac_ios complex_layout_scroll_perf_bad_impeller_ios__timeline_summary to be unflaky (#111106) 2022-09-07 17:09:18 +00:00
keyonghan ad1ce00891
Switch Linux_build_test flutter_gallery__transition_perf to prod (#111047) 2022-09-07 00:27:09 +00:00
keyonghan 2719cd036e
Revert "Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup"" (#110804) 2022-09-01 20:59:37 +00:00
godofredoc 759d0e1b20
Revert "Set linux autoroller as bringup to reopen the tree." (#110748) 2022-09-01 06:07:20 +00:00
godofredoc d8d7b226ce
Set linux autoroller as bringup to reopen the tree. (#110739)
The build is failing to decrypt the key after it was moved to a
different GCP project. Disabling temporarily to reopen the tree while
the key is regenerated.
2022-08-31 20:13:34 -07:00
keyonghan 1f236a9b6f
Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup" (#110734) 2022-09-01 00:29:05 +00:00
Jenn Magder 9f6b7dfefc
Do not run desktop benchmarks in presubmit (#110642) 2022-08-31 21:41:20 +00:00
Zachary Anderson c213fd9b9c
Switch Linux_build_test flutter_gallery__transition_perf back to bringup (#110702) 2022-08-31 13:35:52 -07:00
Jenn Magder 069f504297
Update CI to use Xcode 14 beta 5 (#110302) 2022-08-31 01:20:09 +00:00
keyonghan 226c63577b
Mark microbenchmarks_impeller_ios flaky (#110633) 2022-08-31 01:18:11 +00:00
keyonghan 171ddeb0e0
Manually deflake targets (#110621) 2022-08-30 22:18:20 +00:00
Stephen (Alex) Wallen f15f9aa293
Add required dependencies for benchmark target (#110510) 2022-08-30 16:27:05 +00:00
Stephen (Alex) Wallen b4c0a125b6
Add required dependencies for complex_layout_macos__start_up target. (#110515) 2022-08-29 21:13:08 +00:00
Stephen (Alex) Wallen 50004bdace
Revert "Add required dependencies for Mac flutter_gallery_macos__compile target." (#110382) 2022-08-26 23:40:09 +00:00
keyonghan 93d8be0e01
Switch to build+test model for flutter_gallery__transition_perf (#110377) 2022-08-26 22:30:23 +00:00
Zachary Anderson 056f11060f
Add several new iOS/Impeller benchmarks (#110358) 2022-08-26 14:06:26 -07:00
Jenn Magder d65d64d194
Revert "[macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110370)" (#110372)
This reverts commit 4770e34859.
2022-08-26 13:48:36 -07:00
Stephen (Alex) Wallen 4770e34859
[macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110370) 2022-08-26 20:24:52 +00:00
Stephen (Alex) Wallen b3ae6ffc9f
Add required dependencies for Mac flutter_gallery_macos__compile target. (#110366) 2022-08-26 19:31:00 +00:00
Stephen (Alex) Wallen d420016587
[macOS] Bring up "complex_layout" devicelab, compilation test for x86. (#110360) 2022-08-26 19:27:31 +00:00
Jonah Williams f0ffc85698
Add bad scroller benchmark (#110362) 2022-08-26 18:50:07 +00:00
Stephen (Alex) Wallen 9a34a60c0c
[macOS] Bring up "flutter_gallery_macos__compile" devicelab, compilation test for x86. (#110356) 2022-08-26 17:29:39 +00:00
Stephen (Alex) Wallen 0d2776fd92
Add missing, required dependencies for complex_layout_macos__start_up (#110352) 2022-08-26 16:50:10 +00:00
Stephen (Alex) Wallen 80a635e4a9
[macOS] Bring up "basic_material_app" devicelab, compile tests for x64 macs. (#110296) 2022-08-26 15:29:14 +00:00
Loïc Sharma 4898f1f5c5
[Windows] Add app startup integration test (#110114)
Add a basic integration test for the Windows's app startup. In a subsequent change (https://github.com/flutter/flutter/pull/109816), this test will be updated to verify the app's window isn't visible until after the first frame has been drawn.

Part of https://github.com/flutter/flutter/issues/41980
2022-08-25 18:54:20 -07:00
Stephen (Alex) Wallen 27bfc511ba
[macOS] Bring up "complex_layout" devicelab, startup tests for x64 (#110100) 2022-08-25 23:35:00 +00:00
Stephen (Alex) Wallen 5705890971
Add Xcode dependencies to Mac hello_world_macos__compile (#110274) 2022-08-25 20:46:13 +00:00
Flutter GitHub Bot bac574ce6e
Marks Windows complex_layout_win_desktop__compile to be unflaky (#110191) 2022-08-24 18:14:04 +00:00
Flutter GitHub Bot 5a33eb520b
Marks Windows hello_world_win_desktop__compile to be unflaky (#110188) 2022-08-24 18:05:58 +00:00
Stephen (Alex) Wallen d71a8a7093
[macOS] Bring up "hello_world" devicelab, compilation test for x86. (#109891) 2022-08-24 18:04:42 +00:00
Flutter GitHub Bot 82f35976b8
Marks Windows flutter_gallery_win_desktop__compile to be unflaky (#110189) 2022-08-24 18:03:42 +00:00
Flutter GitHub Bot 51656e53e7
Marks Windows flutter_gallery_win_desktop__start_up to be unflaky (#110190) 2022-08-24 18:02:43 +00:00
Flutter GitHub Bot 22a59bc832
Marks Windows complex_layout_win_desktop__start_up to be unflaky (#110192) 2022-08-24 18:01:31 +00:00
Flutter GitHub Bot 27f32220c6
Marks Mac_ios flutter_gallery_ios__transition_perf to be unflaky (#110186) 2022-08-24 17:56:16 +00:00
Flutter GitHub Bot 0ae6ef8a3a
Marks Mac_ios flutter_gallery_ios_sksl_warmup__transition_perf to be unflaky (#110187) 2022-08-24 17:54:05 +00:00
Flutter GitHub Bot 5ac3596199
Marks Mac_ios flutter_gallery__transition_perf_e2e_ios to be unflaky (#110185) 2022-08-24 17:18:05 +00:00
Flutter GitHub Bot 3e2e3c9b7f
Marks Mac_arm64_ios build_ios_framework_module_test to be unflaky (#110183) 2022-08-24 17:03:18 +00:00
keyonghan 9ef5017b92
Update open_jdk version version:11 (#110110) 2022-08-23 22:24:21 +00:00
Ricardo Amador 129fa7699f
Moving ios benchmark tests to prod. (#110049)
* Moving io benchmark tests to prod.

* New tasks must be marked bringup: true
2022-08-22 17:10:15 -07:00
Zachary Anderson d79a3d7a19
Remove most benchmarks of SkSL warmup (#110040) 2022-08-22 22:31:54 +00:00
keyonghan 43822a1263
mark flaky (#109890) 2022-08-19 16:25:36 -07:00
Gary Qian 357755f968
Update ci.yaml tests to Android API 33 (#109820) 2022-08-19 17:46:22 +00:00
Camille Simon 5ca8c4d03e
Remove scheduler (#109714) 2022-08-17 21:42:52 +00:00
Flutter GitHub Bot 4cf3288898
Marks Windows_android channels_integration_test_win to be flaky (#109695) 2022-08-17 18:21:24 +00:00
Camille Simon 7db25c36ad
Re-land Add Spell Check to EditableText (#109643) 2022-08-17 16:16:02 +00:00
yaakovschectman 4e068a613e
Bring up new Windows start-up tests (#109618)
* Add Windows startup test

* Add new tests for Windows desktop

* Bring up complex layout tests for Win Desktop

* Bring up flutter_view startup test for Windows

* Add Platform View startup test for Windows

* Fix typo in .ci.yaml

* Make basename variable final

* Link to bug in .ci.yaml
2022-08-17 09:38:41 -04:00
Jonah Williams 0ba88d8b43
Revert "Add Spellcheck to EditableText (Android) (#109334)" (#109631)
This reverts commit ff9fe35682.
2022-08-16 14:30:03 -07:00
Camille Simon ff9fe35682
Add Spellcheck to EditableText (Android) (#109334) 2022-08-16 18:22:45 +00:00
yaakovschectman bba2ac83b1
Add Compilation DeviceLab test for Windows (#109540)
* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete asset from repo

* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete icon

* Use path.basename

Re triggering tests

* Update test owner to desktop team
2022-08-15 16:26:02 -04:00
yusuf-goog 5ac269937f
Making xcode version consistent across .ci.yaml. (#109009) 2022-08-05 02:26:06 +00:00
Jenn Magder 25b3788f4e
Remove android_sdk and open_jdk from some iOS-only tests (#108994) 2022-08-04 21:39:08 +00:00
Flutter GitHub Bot bfca3143c2
Marks Linux_android clipper_cache_perf__e2e_summary to be unflaky (#104088) 2022-08-02 23:24:07 +00:00
keyonghan c6bb9cc0b8
Mark Mac_ios microbenchmarks_ios_flaky flaky (#108820) 2022-08-02 18:58:06 +00:00
Kaushik Iska 611514886b
Reland Linux_samsung_a02 openpay_benchmarks__scroll_perf (#108466) (#108769) 2022-08-02 04:32:06 +00:00
hellohuanlin 176f7d7130
[platform_view]run platform view ui test to physical device (#108642) 2022-07-30 06:36:09 +00:00
Casey Hillers d4e10fd86d
[ci.yaml] Run flutter_plugins only on tip of tree (#108594) 2022-07-29 13:02:06 +00:00
yusuf-goog 4aa3d740af
Remove failing test Linux_android android_lifecycles_test. (#108587) 2022-07-29 00:10:05 +00:00
hellohuanlin b00bfef3c1
[platform_view]add android deps to platform view test (#108585) 2022-07-28 23:42:07 +00:00
Flutter GitHub Bot 4d5e4d4d94
Marks Linux_android new_gallery_impeller__transition_perf to be unflaky (#108458) 2022-07-27 20:13:05 +00:00
keyonghan 6eb602d6c2
Remove Linux_samsung_a02 openpay_benchmarks__scroll_perf (#108466) 2022-07-27 20:09:07 +00:00
Flutter GitHub Bot b7e08dd226
Marks Windows gradle_plugin_bundle_test to be unflaky (#108459) 2022-07-27 20:04:06 +00:00
Flutter GitHub Bot 2756f868b6
Marks Linux_android color_filter_with_unstable_child_perf__e2e_summary to be unflaky (#108457) 2022-07-27 17:04:05 +00:00
keyonghan c0f4475981
ignore flakiness (#108039) 2022-07-27 09:23:17 -07:00
Kaushik Iska 6a5cd3d825
Remove luci scheduling from openpay benchmarks (#108126) 2022-07-21 20:47:06 +00:00
Kaushik Iska f7504f0380
[openpay] Create an OpenPay benchmark (#107838) 2022-07-21 20:01:06 +00:00
Flutter GitHub Bot 94bb1bddf4
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be unflaky (#108030) 2022-07-20 21:54:05 +00:00
Flutter GitHub Bot 08c0b92a1a
Marks Mac_ios cubic_bezier_perf_ios_sksl_warmup__timeline_summary to be unflaky (#108031) 2022-07-20 21:52:06 +00:00
Flutter GitHub Bot 5fb4d10fa1
Marks Windows gradle_plugin_bundle_test to be flaky (#108021) 2022-07-20 21:50:06 +00:00
Flutter GitHub Bot 981e85c14b
Marks Mac_ios new_gallery_impeller_ios__transition_perf to be unflaky (#108032) 2022-07-20 21:48:05 +00:00
ColdPaleLight 1919167540
Added benchmark for early removal of unused raster cache entris mecha… (#107918) 2022-07-20 19:13:06 +00:00
keyonghan 5b94f254f4
Migrate Mac_ios targets to cocoon scheduler (#107944) 2022-07-20 03:57:05 +00:00
keyonghan 6bd3e6e006
Migrate Linux android targets to cocoon scheduler (#107852) 2022-07-19 00:40:07 +00:00
keyonghan 6952408cdf
Migrate Mac/Windows+android targets to cocoon scheduler (#107737) 2022-07-16 00:12:06 +00:00
keyonghan bc097f4b2a
Mark Windows_android flavors_test_win flaky (#107749) 2022-07-16 00:08:06 +00:00
hellohuanlin da8070d6af
Fix native platform view integration test config (#107679) 2022-07-15 22:56:09 +00:00
keyonghan 9b15b4fa2c
Migrate host only targets to cocoon scheduler (#107673) 2022-07-15 00:08:14 +00:00
Flutter GitHub Bot f879bcf9b0
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be unflaky (#107557) 2022-07-14 15:38:07 +00:00
keyonghan 82b843b36f
Migrate bringup post-submit targets to cocoon scheduler (#107483) 2022-07-13 16:50:07 +00:00
Flutter GitHub Bot 78b38b77b9
Marks Linux_android raster_cache_use_memory_perf__e2e_summary to be unflaky (#107165) 2022-07-06 22:32:06 +00:00
stuartmorgan f3717d70d7
Enable Windows platform_channel test (#106973) 2022-07-06 14:21:07 +00:00
stuartmorgan 6c6ae06381
Add Windows to the platform_channels example (#106754) 2022-06-30 14:54:07 +00:00
JsouLiang f0200f0106
Add benchmark case for RasterCache (#103338) 2022-06-29 23:54:10 +00:00
Christopher Fujino f10138f0e6
[flutter_tools] don't run pub_autoroller on release branches (#106830) 2022-06-29 22:52:06 +00:00
Flutter GitHub Bot eb832a2b57
Marks Mac_ios external_ui_integration_test_ios to be flaky (#106807) 2022-06-29 17:30:07 +00:00
Flutter GitHub Bot 0df4885473
Marks Linux_android new_gallery__crane_perf to be unflaky (#106808) 2022-06-29 17:28:07 +00:00
Flutter GitHub Bot f59146ce29
Marks Windows_android channels_integration_test_win to be unflaky (#106812) 2022-06-29 17:26:07 +00:00
Flutter GitHub Bot 88b1e41f7c
Marks Linux_android gradient_static_perf__e2e_summary to be unflaky (#101834) 2022-06-29 10:03:21 -07:00
Christopher Fujino 2657eea5a3
move "Linux packages_autoroller" to prod pool (#106749) 2022-06-28 19:06:07 +00:00
keyonghan 99c195de17
Skip Mac_android run_release_test in presubmit (#106709) 2022-06-28 18:50:06 +00:00
Christopher Fujino 77ad5190e3
[flutter_tools] add packages_autoroller to .ci.yaml as bringup (#106711) 2022-06-28 17:48:07 +00:00
Jonah Williams 98f0c3694b
add old gallery page transition (#106701) 2022-06-27 23:36:06 +00:00
hellohuanlin 0dd0c2edca
[platform_view]Send platform message when platform view is focused (#105050) 2022-06-23 00:01:07 +00:00
Flutter GitHub Bot 1c6da0d653
Marks Mac_ios hot_mode_dev_cycle_ios__benchmark to be unflaky (#106427) 2022-06-22 18:23:08 +00:00
Flutter GitHub Bot 832eb37f71
Marks Windows_android channels_integration_test_win to be flaky (#106031) 2022-06-22 00:17:07 +00:00
Ricardo Amador f6f0d608ba
Update the platform properties for android bots (#106146) 2022-06-17 04:04:06 +00:00
Flutter GitHub Bot 261246b820
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be flaky (#102237) 2022-06-15 21:24:07 +00:00
Flutter GitHub Bot 873d343e09
Marks Mac_ios external_ui_integration_test_ios to be unflaky (#106041) 2022-06-15 17:52:06 +00:00
Flutter GitHub Bot 971f12b0ef
Marks Mac_arm64_ios build_ios_framework_module_test to be flaky (#105610) 2022-06-10 11:53:09 -07:00
keyonghan 7345b05cb6
Enable arm64 module_test_ios and plugin_lint_mac in prod (#105744) 2022-06-09 16:38:09 -07:00
keyonghan 23174b9b6b
Enable two new arm64 ios tests (#105636) 2022-06-09 11:18:11 -07:00
Flutter GitHub Bot f377f61f77
Marks Mac_ios new_gallery_ios__transition_perf to be unflaky (#105627) 2022-06-08 13:53:10 -07:00
Flutter GitHub Bot 71a0634e68
Marks Linux_android flutter_gallery_sksl_warmup__transition_perf to be unflaky (#105623) 2022-06-08 13:48:11 -07:00
Flutter GitHub Bot 08aecd40fe
Marks Linux_android flutter_gallery__transition_perf_with_semantics to be unflaky (#105622) 2022-06-08 13:43:11 -07:00
Flutter GitHub Bot 4c1736e757
Marks Linux_android flutter_gallery__transition_perf_hybrid to be unflaky (#105621) 2022-06-08 13:38:10 -07:00
Flutter GitHub Bot 5b7f94375f
Marks Linux_android flutter_gallery__transition_perf_e2e to be unflaky (#105620) 2022-06-08 13:28:12 -07:00
Flutter GitHub Bot e6d31b9d56
Marks Linux_android flutter_gallery_sksl_warmup__transition_perf_e2e to be unflaky (#105624) 2022-06-08 11:38:10 -07:00
Flutter GitHub Bot c41e7b244d
Marks Linux_android flutter_gallery__transition_perf to be unflaky (#105619) 2022-06-08 11:33:09 -07:00
Flutter GitHub Bot 856fa3ce8e
Marks Linux android views to be unflaky (#105618) 2022-06-08 11:28:11 -07:00
Flutter GitHub Bot 11ed474ef9
Marks Linux_android new_gallery__crane_perf to be flaky (#105612) 2022-06-08 11:18:09 -07:00
Flutter GitHub Bot 13fae53dc5
Marks Linux_android gradient_consistent_perf__e2e_summary to be unflaky (#101833) 2022-06-07 16:23:06 -07:00
Ricardo Amador 80bfc8f35a
Add targets for benchmark tests moved from staging to prod. (#105481)
* Add targets for benchmark tests moved from staging to prod.

* Add bringup:true to new targets.

* Missed a builder for bringup.

* Fix a presubmit that was inadvertently created as true.

* Removed some trailing whitespace causing format check to fail.
2022-06-07 14:11:57 -07:00
keyonghan 7df7e8abad
Use device_type dimension for samsung S10 builders (#105322) 2022-06-03 15:18:11 -07:00
Gary Qian 68d09d6e2a
Upgrade test shards to use android API 32 (#105259) 2022-06-02 18:38:12 -07:00
Ricardo Amador ff110fb958
Add versions to all the dependencies so they are pinned (#104867)
* Updated file to include version for dependencies.

* Updated clang version to use github revision.
2022-06-02 13:11:28 -07:00
godofredoc f4d15dfc0d
For linux builds use machines with 8 cores. (#105083) 2022-06-01 10:43:09 -07:00
yusuf-goog 588f1c93e5
Removing minor iOS version filter value from ci.yaml (#105059) 2022-05-31 15:38:08 -07:00
Jenn Magder 15308b339b
Upgrade CI Xcode version to 13.4 (#104857) 2022-05-27 15:33:07 -07:00
Casey Hillers 93c8de41ff
[ci.yaml] Remove google testing postsubmit target (#104853) 2022-05-27 13:38:11 -07:00
yusuf-goog 053144b7d1
Revert "Removing minor ios version value for device_os property" (#104854) 2022-05-27 12:58:13 -07:00
yusuf-goog 562df08218
Removing minor ios version value for device_os property (#104835)
Bug:104770
2022-05-27 09:53:06 -07:00
Dan Field be7a4227c7
Add a macrobenchmark for laying out text in a list (#104736) 2022-05-26 15:25:10 -07:00
keyonghan b2eafd735d
Revert "Removing minor version from device_os value. (#104727)" (#104755)
This reverts commit 8461e573f8.

Co-authored-by: Jenn Magder <magder@google.com>
2022-05-26 14:26:49 -07:00
yusuf-goog 8461e573f8
Removing minor version from device_os value. (#104727) 2022-05-26 14:05:10 -07:00
Flutter GitHub Bot e8995736bf
Marks Mac_ios large_image_changer_perf_ios to be unflaky (#104627) 2022-05-25 14:33:14 -07:00
Flutter GitHub Bot 5d6c8b0983
Marks Linux_android new_gallery__crane_perf to be unflaky (#104624) 2022-05-25 14:28:10 -07:00
godofredoc 9cfac48e2e
Enable android_views. (#104474) 2022-05-24 08:58:08 -07:00
yusuf-goog 954c7472d9
Moving linux vm builds to Ubuntu. (#104294) 2022-05-23 16:23:08 -07:00
yusuf-goog 874b6c08f5
Add ignore_flakiness property to staging builds. (#104102)
* Add ignore_flakiness property to staging builds.

Bug:104100

* Update .ci.yaml
2022-05-20 09:45:58 -07:00
Flutter GitHub Bot c4644a6a2e
Marks Mac_arm64_android run_release_test to be unflaky (#104091) 2022-05-18 20:22:07 -07:00
Flutter GitHub Bot 23509ae9b7
Marks Linux_android cubic_bezier_perf_sksl_warmup__e2e_summary to be unflaky (#104089) 2022-05-18 20:17:07 -07:00
Zachary Anderson 80a51e4f97
Adds new_gallery_impeller__transition_perf benchmark for Android (#104126) 2022-05-18 20:07:12 -07:00
Jenn Magder 5ce07af9ca
Delete native_ui_tests_ios (#103727) 2022-05-16 15:59:52 -07:00
wangying b3d7a691f6
Add benchmark for clipper layers raster cache (#102495)
* Add clipper raster cache benchmarks

* fix ci test error

* Add PhysicalModel widget to test

* Set top margin adaptive screen height

* Remove PhysicalModel
2022-05-13 14:04:06 +08:00
keyonghan d647755ee3
Revert "Adding linux VM staging tests to .ci.yaml" (#103658) 2022-05-12 14:54:15 -07:00
yusuf-goog 041999ca1b
Adding linux VM staging tests to .ci.yaml (#103165) 2022-05-12 13:14:10 -07:00
Flutter GitHub Bot 7ad96dc345
Marks Linux_android cubic_bezier_perf_sksl_warmup__e2e_summary to be flaky (#103505) 2022-05-11 11:29:10 -07:00
Flutter GitHub Bot 97fc2ee4fc
Marks Linux_android animated_complex_opacity_perf__e2e_summary to be unflaky (#103501) 2022-05-11 11:14:07 -07:00
yusuf-goog 5e85d23740
Set presubmit false for staging targets in ci.yaml (#103509) 2022-05-11 10:29:09 -07:00
Casey Hillers eee051ac49
[ci.yaml] Remove explicit caches (#103175) 2022-05-06 10:44:07 -07:00
yusuf-goog 425aef22ac
Adding two staging tests to ci.yaml (#103003)
* Adding two staging tests to ci.yaml

Adding a properties block (linux_stating_build) and 2 builds
that use this to ci.yaml. This is to verify some failures on
these builds that are happening when running via entries
in devicelab_stating_config.star file.

Bug:102406

* Updating staging build entries to use new naming convention

Staging builds now use a name prefix of Staging_build_, which
allows us to filter these builds on the dashboard.

* Moving bringup:true to target level

We can't add bringup:true to properties block level, so
need to move this back to each target.
2022-05-05 14:00:22 -07:00
Flutter GitHub Bot 051f1b027f
Marks Mac_arm64_android run_release_test to be flaky (#103060) 2022-05-04 15:39:13 -07:00
Flutter GitHub Bot c3ab24e0b8
Marks Mac_ios external_ui_integration_test_ios to be flaky (#103058) 2022-05-04 13:04:12 -07:00
Casey Hillers baea888118
[ci.yaml] Revert devicelab targets back to LUCI scheduler (#103048) 2022-05-04 12:59:15 -07:00
Emmanuel Garcia b4f8d7c792
Clean up ci.yaml and add missing gradle caches (#102942) 2022-05-03 15:14:07 -07:00
keyonghan 35e35b6fcc
Deflake arm64 android tests (#102929) 2022-05-02 14:24:07 -07:00
godofredoc b1eed25bfc
Add mirroring from master to main. (#102843) 2022-04-29 19:14:04 -07:00
Gary Qian a622b6a536
Remove Linux android views (#102699) 2022-04-27 17:59:07 -07:00
Casey Hillers 29943e6595
[ci.yaml] Migrate 50 targets to Cocoon scheduler (#102676) 2022-04-27 13:44:07 -07:00
Flutter GitHub Bot d7cd8c1039
Marks Linux_android android_semantics_integration_test to be unflaky (#102658) 2022-04-27 13:24:07 -07:00
Flutter GitHub Bot 3f2cb2418d
Marks Mac tool_host_cross_arch_tests to be unflaky (#102659) 2022-04-27 11:19:08 -07:00
keyonghan 1bb9eed4d0
Update open sdk version to be version version:11 (#102610) 2022-04-26 18:09:04 -07:00
keyonghan d69816163e
Enable Mac/android arm64 tests as bringup: true (#102589) 2022-04-26 13:34:06 -07:00
Jonah Williams 63574cf76a
add benchmark for animated complex opacity (#102532) 2022-04-25 18:14:06 -07:00
keyonghan 0411a6f8a3
Enable M1 mac/ios tests in prod as bringup: false (#102530) 2022-04-25 16:14:03 -07:00
Emmanuel Garcia 4ca94ab2fc
Remove build_aar_module_test from devicelab tests (#102329) 2022-04-21 15:24:09 -07:00
keyonghan 242ad0f730
Enable DeviceLab arm64 ios tests as bringup: true (#102089) 2022-04-21 13:24:07 -07:00
Casey Hillers 4a72c5345e
[ci.yaml] Migrate bringup targets to cocoon scheduler (#102249) 2022-04-21 12:49:08 -07:00
drewroengoogle ec6481bed8
Change dependency from ios_signing to apple_signing (#102259)
* Change dependency name to apple_signing for a better understanding of it's use

* Updated Mac_ios test to run if .ci.yaml is updated
2022-04-21 14:12:38 -05:00
Flutter GitHub Bot d3ce6d6eb1
Marks Mac_ios cubic_bezier_perf_ios_sksl_warmup__timeline_summary to be flaky (#102231) 2022-04-21 11:09:10 -07:00
Flutter GitHub Bot 49e043a2c0
Marks Linux_android gradient_dynamic_perf__e2e_summary to be unflaky (#101832) 2022-04-21 10:49:09 -07:00
yusuf-goog a9eaee55ea
Switch ci.yaml Linux builders to Debian. (#102253)
In preparation for upgrading linux VMs to Ubuntu, specify builders
to use 'os: Debian' instead of 'os: Linux'.

There should be no functional changes to current builders with this change.

Bug:102252
2022-04-21 09:35:24 -07:00
Emmanuel Garcia 3fefb2d5eb
Add verbose flag to flutter run commands (#102257) 2022-04-20 22:34:07 -07:00
Flutter GitHub Bot f5cf963fa2
Marks Linux_android new_gallery__crane_perf to be flaky (#102233) 2022-04-20 21:54:07 -07:00
Flutter GitHub Bot 878880fa52
Marks Windows build_aar_module_test to be flaky (#102227) 2022-04-20 21:49:07 -07:00
Flutter GitHub Bot 2bc539a896
Marks Mac_ios native_ui_tests_ios to be unflaky (#102225) 2022-04-20 21:44:10 -07:00
Flutter GitHub Bot 208832e012
Marks Mac_ios flutter_view_ios__start_up to be unflaky (#102224)
* Marks Mac_ios flutter_view_ios__start_up to be unflaky

* update mode

Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-20 21:18:13 -07:00
Flutter GitHub Bot fbaf86788d
Marks Mac_android entrypoint_dart_registrant to be unflaky (#102223)
* Marks Mac_android entrypoint_dart_registrant to be unflaky

* update mode

Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-20 21:16:44 -07:00
Elsabe Ros 606e91ad63
Use the maven-publish plugin to publish AAR files. (#101891) 2022-04-19 16:34:07 -07:00
keyonghan 7d2d63c90d
Enforce cpu explicitly for Mac devicelab test beds (#101871) 2022-04-15 09:24:07 -07:00
Christopher Fujino 41b73894bc
Test framework for executable files (#101853) 2022-04-13 22:44:07 -07:00
Christopher Fujino fd5356ff60
[flutter_tools] shard out two integration tests we want to run on macOS arm64 (#101769) 2022-04-13 12:09:11 -07:00
Zachary Anderson 6190c5df09
Revert "Use the maven-publish plugin to publish AAR files. (#101276)" (#101827)
This reverts commit 2b0255f0d9.
2022-04-13 08:12:07 -07:00
Elsabe Ros 2b0255f0d9
Use the maven-publish plugin to publish AAR files. (#101276) 2022-04-12 22:19:08 -07:00
Emmanuel Garcia 9b6e4f01ab
Make hybrid_android_views_integration_test fail the build (#101066) 2022-04-11 14:19:10 -07:00
Flutter GitHub Bot 6b461de012
Marks Linux_android color_filter_cache_perf__e2e_summary to be unflaky (#100629)
* Marks Linux_android color_filter_cache_perf__e2e_summary to be unflaky

* deflake

Co-authored-by: keyonghan <54558023+keyonghan@users.noreply.github.com>
Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-11 14:01:04 -07:00
gaaclarke fb00617585
Added missing device requirement for "Mac entrypoint_dart_registrant" (#101599)
* Added missing device requirement for "Mac entrypoint_dart_registrant"

* renamed task

* removed caches and dependencies
2022-04-11 10:00:16 -07:00
Jim Graham 493323506f
add gradient benchmarks (#101549) 2022-04-08 17:20:22 -07:00
Zachary Anderson 221235c7ed
Delete deferred component test (#101553) 2022-04-08 03:01:08 -07:00
gaaclarke bb300b467e
updated the dependencies for the Mac entrypoint_dart_registrant (#101368) 2022-04-07 13:06:40 -07:00
Flutter GitHub Bot 2999e85315
Marks Linux_android android_choreographer_do_frame_test to be unflaky (#99835) 2022-04-06 16:16:10 -07:00
Flutter GitHub Bot bd4e844a0b
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be unflaky (#100227) 2022-04-06 16:15:17 -07:00
Flutter GitHub Bot db1074202f
Marks Windows gradle_plugin_fat_apk_test to be flaky (#101429) 2022-04-06 15:56:30 -07:00
Flutter GitHub Bot 17398fd828
Marks Mac_ios native_ui_tests_ios to be flaky (#101427) 2022-04-06 13:31:10 -07:00
Flutter GitHub Bot d08f7ab9c9
Marks Mac run_release_test_macos to be unflaky (#101055) 2022-04-06 12:57:01 -07:00
Flutter GitHub Bot 3201d590fd
Marks Linux_android shader_mask_cache_perf__e2e_summary to be unflaky (#101424) 2022-04-06 12:55:35 -07:00
Flutter GitHub Bot 49c978a59c
Marks Linux_android complex_layout__start_up to be unflaky (#101425) 2022-04-06 10:06:09 -07:00
Zachary Anderson f42f7d19aa
Remove redundant timeline_summary benchmarks from ci.yaml (#101372) 2022-04-05 14:01:08 -07:00
Casey Hillers 6bb36bbcc4
Revert roller back to LUCI scheduler (#101371) 2022-04-05 13:23:52 -07:00
Casey Hillers d6cc67d529
[ci.yaml] Revert every target except roller back to luci scheduler (#101323) 2022-04-05 09:24:45 -07:00
Jenn Magder 1429957aa4
Remove gems dependency from tests that do not use it (#101210) 2022-04-04 15:21:11 -07:00
Flutter GitHub Bot 4d50f51915
Marks Mac_ios native_ui_tests_ios to be unflaky (#97670) 2022-04-04 15:16:10 -07:00
Flutter GitHub Bot d60272a203
Marks Windows module_custom_host_app_name_test to be unflaky (#99407) 2022-04-04 11:58:05 -07:00
Flutter GitHub Bot 92877a648a
Marks Windows module_test to be unflaky (#99408) 2022-04-04 11:57:17 -07:00
Yegor 72ecaf7411
[web] reenable canvaskit benchmarks (#101155) 2022-04-01 12:48:34 -07:00
Casey Hillers e298c79032
[ci.yaml] Revert all devicelab tests back to LUCI scheduler (#101124) 2022-03-31 12:30:12 -07:00
Emmanuel Garcia 5c6918933e
Migrate AGP and Gradle versions to 7.1.2/7.4 (#99723) 2022-03-30 20:30:09 -07:00
Flutter GitHub Bot d9de75aa52
Marks Mac_ios large_image_changer_perf_ios to be flaky (#101060) 2022-03-30 11:20:18 -07:00
Flutter GitHub Bot a171f3069a
Marks Mac_ios post_backdrop_filter_perf_ios__timeline_summary to be unflaky (#101054) 2022-03-30 10:05:16 -07:00
Emmanuel Garcia 032205eaca
Reland: "Use texture layer when displaying an Android view" (#100990) 2022-03-29 19:40:17 -07:00
gaaclarke 912873baa7
Relands "Starts using the --source flag to compile the dart registrant. (#98046)" (#100572) 2022-03-28 18:15:10 -07:00
Casey Hillers 810784842a
Revert some targets back to LUCI scheduler (#100898) 2022-03-28 09:50:10 -07:00
wangying 712abb08e2
Add benchmark for ShaderMask RasterCache (#100127) 2022-03-28 00:15:07 -07:00
Zachary Anderson 8acbf54930
Adds an impeller variant of the new gallery transition perf benchmark (#100837) 2022-03-26 22:12:48 -07:00
Jenn Magder 46642320ce
Mark integration_ui_ios_textfield unflaky (#100661) 2022-03-25 18:00:08 -07:00
Casey Hillers b346a59337
[ci.yaml] Migrate bringup tasks to cocoon scheduler (#100766) 2022-03-25 12:29:15 -07:00
Flutter GitHub Bot 613f16c1e4
Marks Mac_ios route_test_ios to be unflaky (#100631) 2022-03-23 11:00:07 -07:00
Flutter GitHub Bot 59e4bf8bd3
Marks Mac dart_plugin_registry_test to be unflaky (#100630) 2022-03-23 10:55:09 -07:00
Chris Bracken 4b819782fb
[macOS] Add run release test in devicelab (#100526)
Adds a test that invokes flutter run in release mode on macOS desktop,
waits for successful launch and the flutter command list, then sends the
'q' command to quit the running app.

This adds an integration test for https://github.com/flutter/flutter/pull/100504.

Issue: https://github.com/flutter/flutter/issues/100348 (fix)
Issue: https://github.com/flutter/flutter/issues/97978 (partial fix)
Issue: https://github.com/flutter/flutter/issues/97977 (partial fix)
Umbrella issue: https://github.com/flutter/flutter/issues/60113
2022-03-22 14:12:59 -07:00
gaaclarke 97258979df
Revert "Starts using the --source flag to compile the dart registrant. (#98046) (#100493) 2022-03-21 13:40:23 -07:00
Casey Hillers 1ff5bff3e5
[ci.yaml] Migrate roller to cocoon scheduler (#100329) 2022-03-17 17:05:21 -07:00
Yegor 7f84c5500f
mark canvaskit benchmarks as bringup: true (#100331) 2022-03-17 14:01:10 -07:00
Yegor c2409797ff
Roll chrome 96 attempt 2 (#100073)
* [web] roll Chromium dep to 96.2

Roll Chromium 96.2.

This is the second attempt to roll it. The previous attempt
(https://github.com/flutter/flutter/pull/99725) failed due to a LUCI
cache issue.

* cache-bust CIPD dependency by changing its name
* specify chrome_and_driver version in canvaskit tests
* fix CRC corruption in kTransparentImage
2022-03-17 13:23:43 -07:00