Commit graph

899 commits

Author SHA1 Message Date
Jenn Magder c24904ddee
Run macOS benchmarks in prod pool to upload metrics (#119963) 2023-02-03 22:38:53 +00:00
Jenn Magder c52215e935
Run Mac hostonly tests on any available arch (#119884)
* Run Mac hostonly tests on any available arch

* Exception for framework tests
2023-02-03 22:37:48 +00:00
Jenn Magder 51b05ac7e1
Add mac_benchmark ci.yaml property (#119871)
* Add mac_benchmark ci.yaml property

* Remove presubmit

* Bringup

* Comma

* gems

* Test animated_complex_opacity_perf_macos__e2e_summary in presubmit

* Try top-level mac_model

* Move dependencies back into tasks

* Add signing dependency

* Revert animated_complex_opacity_perf_macos__e2e_summary test
2023-02-03 21:36:48 +00:00
Jenn Magder d875899a65
Bump test Chrome version for Mac arm support (#119773) 2023-02-03 00:14:42 +00:00
Ricardo Amador 22bbdf03e0
Android defines target update (#119766)
* Round 2 with dimensions

* Try with stringified keys

* Forgot a comma

* trying a list of maps.

* Try key value pairs

* Try with kvm only

* try with swarming_dimensions

* Updated with fix in swarming.star

* Attempting to remove the bring up property to verify test is running.

* Remove android from target tags to avoid adb command automatically running in test_utils call.

* Remove the duplicated dependencies in the defines target that exist in the platform
2023-02-02 20:56:05 +00:00
Flutter GitHub Bot e7d934a014
Marks Linux_android android_choreographer_do_frame_test to be flaky (#119721) 2023-02-02 18:12:56 +00:00
Jenn Magder 34730c79ca
Revert "Run Mac hostonly tests on any available arch (#119762)" (#119784)
This reverts commit 475fc4ac9d.
2023-02-02 03:42:17 +00:00
Jenn Magder 475fc4ac9d
Run Mac hostonly tests on any available arch (#119762)
* Run Mac hostonly presubmit tests on any available arch

* Force all Mac tests to run on arm64 to validate in presubmit

* Go back to web tests on x64

* Run plugin_test_ios on x64

* Try Chrome 110 on arm

* Revert chrome bump, remove forcing arm64

* Update issue number
2023-02-02 02:34:08 +00:00
Flutter GitHub Bot 1573c12963
Marks Mac_android microbenchmarks to be unflaky (#119727) 2023-02-01 18:53:20 +00:00
Chris Bracken d272a3ab80
Reland: [macos] add flavor options to tool commands (#119564)
* Reland: [macos] add flavor options to tool commands

Adds --flavor option to flutter run and flutter build. Running against
preexisting devicelab flavor tests for feature parity between macOS,
iOS, and Android.

This relands #118421 by alex-wallen which was reverted in #118858 due to
the following test failures:

The bail-out with "Host and target are the same. Nothing to install."
added in `packages/flutter_tools/lib/src/commands/install.dart`
triggered failures in the following tests, which unconditionally attempt
to install the built app, which is unsupported on desktop since the
host and target are the same:

* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791495589540422465/+/u/run_flutter_view_macos__start_up/test_stdout
* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791496218824259121/+/u/run_complex_layout_win_desktop__start_up/test_stdout
* https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8791496218165602641/+/u/run_flutter_gallery_win_desktop__start_up/test_stdout

Fixes #64088

* Partial revert: eliminate install check on desktop

The original flavour support patch included a check that triggered a
failure when flutter install is run on desktop OSes. This was
intentional, since the host and target devices are the same and
installation is unnecessary to launch the app on currently-supported
desktop OSes.

Note that Windows UWP apps *do* require installation to run, and we used
to have an install command for those apps, though UWP is no longer
supported.

Since that part of the change was orthogonal to flavour support itself,
I'm reverting that component of the change and we can deal with it
separately if so desired.
2023-01-31 17:37:46 +00:00
Flutter GitHub Bot 8898f4f198
Marks Mac_android run_debug_test_android to be unflaky (#117468) 2023-01-30 23:26:54 +00:00
Flutter GitHub Bot b2f2bf31c0
Marks Linux run_release_test_linux to be unflaky (#119156) 2023-01-27 19:19:45 +00:00
Flutter GitHub Bot 459c1b78b4
Marks Mac complex_layout_scroll_perf_macos__timeline_summary to be unflaky (#119157) 2023-01-26 18:59:40 +00:00
Flutter GitHub Bot fc02701818
Marks Mac run_debug_test_macos to be unflaky (#117470)
Co-authored-by: Chris Bracken <chris@bracken.jp>
2023-01-26 05:25:00 +00:00
stuartmorgan e3c51a2f2a
Add Windows unit tests to plugin template (#118638)
* Add Windows unit tests to plugin template

Adds an example native unit test to the plugin template for Windows,
matching the format we use for our 1P plugin example app unit tests.
Once these have been added for all platforms+languages, they will be
documented on a new plugin development page to explain their use.

Since we don't appear to be running our current plugin e2e tests for
Windows, this adds a new configuration to run them. I haven't
`led`-tested this, so it may not work, but this will give a starting
point for getting them running.

Part of https://github.com/flutter/flutter/issues/82458

* Minor fix

* Add test owner

* Fix typo

* Fix test feature flag
2023-01-24 18:23:57 +00:00
Jenn Magder 2e8dd9dd69
Run integration_ui_test_test_macos in prod (#118919) 2023-01-24 01:37:52 +00:00
Jenn Magder 65486163ac
Remove animated_complex_opacity_perf_macos__e2e_summary bringup (#118916) 2023-01-24 01:31:59 +00:00
Ricardo Amador 84071aa2aa
Add todo for linux defines test. (#119035)
* Add todo for linux defines test.

* Update the linux android defines test to make it bringup: true
2023-01-23 17:29:16 -08:00
Ricardo Amador 332aed9c88
Revert "Update the Linux Android defines test to use dimensions when selecting a build bot (#118930)" (#119023)
This reverts commit 392dffeb08.
2023-01-23 21:45:07 +00:00
Ricardo Amador 392dffeb08
Update the Linux Android defines test to use dimensions when selecting a build bot (#118930)
* Round 2 with dimensions

* Try with stringified keys

* Forgot a comma

* trying a list of maps.

* Try key value pairs

* Try with kvm only

* try with swarming_dimensions

* Updated with fix in swarming.star
2023-01-23 20:34:07 +00:00
Jenn Magder 25843bdb5a
Remove macOS impeller benchmarks (#118917)
* Remove macOS impeller benchmarks

* TESTOWNERS
2023-01-21 01:34:53 +00:00
Ricardo Amador bae4c1d243
Revert "Update android defines test to use emulator (#118808)" (#118928)
This reverts commit 49e025d8ac.
2023-01-21 01:06:14 +00:00
Ricardo Amador 49e025d8ac
Update android defines test to use emulator (#118808)
* Update android defines test to use emulator

* Need strings in dimensions.

* put dimensions in the wrong spot.

* Add bringup.

* See if the test runs with Linux_android

* Adjusting dimensions

* Dimension fields must be strings.

* Making dimensions a dict.

* Try with swarming.dimension

* The dimension set does not appear to do anything.

* Device type none

* Made target presubmit

* Dimensions again

* Fixed formatting.

* Update since flutter roller fails
2023-01-20 16:40:19 -08:00
Flutter GitHub Bot 15bc4e466c
Marks Mac_android microbenchmarks to be flaky (#118693) 2023-01-20 22:54:27 +00:00
Flutter GitHub Bot c0ad6add26
Marks Mac plugin_test_macos to be unflaky (#118706) 2023-01-20 21:48:10 +00:00
Jenn Magder 030288d33b
Revert "[macos] add flavor options to commands in the flutter_tool (#118421)" (#118858)
This reverts commit 73096fd96e.
2023-01-20 03:46:45 +00:00
Alex Wallen 73096fd96e
[macos] add flavor options to commands in the flutter_tool (#118421)
* Add new macos target configured for flavors

* Rename Free App copy-Info.plist to Free App Info.plist

* Remove bogus entitlements

* Remove Generated.xcconfig

* Audit project.pbxproj

* Remove unused configs

* share one info.plist

* Modify scheme so that paid app works

* Codesign automatic

* Pipe flavor as scheme into xcodebuild

* Ignore incoming flavor string

* pipe flavor for flutter run to work

* Add devicelab tests

* Error if host and target device are same for flutter install desktop

* Avoid bang (!) by promoting a local.

Co-authored-by: Jenn Magder <magder@google.com>

* Add supportsInstall property

* Override  in test classes

* Add install test on macOS

* Refactor application_package and add tests for package directory

Co-authored-by: a-wallen <stephenwallen@google.com>
Co-authored-by: Jenn Magder <magder@google.com>
2023-01-19 23:52:16 +00:00
Alex Wallen 22520f54df
[macOS] Add timeline summary benchmarks (#118748)
* Add new task runner for impeller enabled complex layout test

* Add new target in .ci.yaml

* Claim ownership of complex_layout_scroll_perf_impeller_macos__timeline_summary

* Task runner for non-impeller enabled scroll test

* Add test target for non impeller complex layout scroll

* claim ownership of the last target

* mark as bringup

Co-authored-by: a-wallen <stephenwallen@google.com>
2023-01-19 21:29:19 +00:00
Jenn Magder 2258590a82
Do not run Mac_arm64_ios run_debug_test_macos in presubmit during iPhone 11 migration (#118828) 2023-01-19 12:50:40 -08:00
yusuf-goog 9b5ea30a9c
Switching over from iOS-15 to iOS-16 in .ci.yaml. (#118807)
This will run tests on new iphone11 devicelab devices
which are running iOS-16.

Bug:https://github.com/flutter/flutter/issues/117237
2023-01-19 19:54:10 +00:00
Alex Wallen d53cc4a10f
[macOS] New e2e_summary benchmark fails without Cocoapods. (#118754)
* Add gems as a dep - fails without

* Add missing entitlements to run app on macos

Co-authored-by: a-wallen <stephenwallen@google.com>
2023-01-19 08:04:22 +00:00
Ricardo Amador e5c9d065fc
Forgot to remove emulator flag. (#118762) 2023-01-19 01:49:50 +00:00
Alex Wallen 666dccc85e
[macOS] bringup new e2e_summary devicelab test (#118717)
* Add new task runner for animated_complex_opacity_perf_impeller e2e_summary on macos

* Register new target for macos e2e_summary task

* Claim ownership in TESTOWNERS

* Add task runner for animated complex opacity without impeller

* Register new target in .ci.yaml for non-impeller test

* Claim ownership of non-impeller task

Co-authored-by: a-wallen <stephenwallen@google.com>
2023-01-18 22:33:49 +00:00
Ricardo Amador f989d551ce
Devicelab android emulator (#113472)
* Testing whether emulator is possible.

* Adding changes to see if emulator can be used from recipe.

* adding emulator support.

* Add the emulator flag for testing.

* Using string for boolean since it cannot be parsed in properties

* Checking to see if these changes are being used.

* Updated bool back to string

* Remove trailing whitespace from file.
2023-01-17 22:01:11 +00:00
Nehal Patel 0449030a96
Disable Xcode cache cleanup (#118641) 2023-01-17 22:01:08 +00:00
Jenn Magder 68dd63d66b
Mark Mac_arm64 tool_host_cross_arch_tests not flaky (#118484) 2023-01-13 23:34:33 +00:00
Loïc Sharma cea55d99d0
[Linux] Add a 'flutter run' console output test (#118279)
* Add Linux support for the UI integration test project

* Add Linux run console test
2023-01-13 19:17:12 +00:00
Flutter GitHub Bot a523f79233
Marks Mac_ios spell_check_test to be unflaky (#117743) 2023-01-13 16:05:19 +00:00
godofredoc 40c96f17bc
Enable xcode cache cleanup for a few days. (#118419)
This is to ensure the xcode caches get back to a normal state as they
seem to have gotten into a bad state after updating the xcode version.

Bug: https://github.com/flutter/flutter/issues/118324
Bug: https://github.com/flutter/flutter/issues/118327
Bug: https://github.com/flutter/flutter/issues/118328
2023-01-13 02:47:02 +00:00
Flutter GitHub Bot f8628b5cb1
Marks Mac_ios platform_views_scroll_perf_non_intersecting_impeller_ios__timeline_summary to be unflaky (#116668) 2023-01-12 02:48:03 +00:00
Flutter GitHub Bot 13ebde6ff1
Marks Mac channels_integration_test to be unflaky (#111571) 2023-01-11 18:20:31 -08:00
Flutter GitHub Bot 727e86079e
Marks Mac_ios complex_layout_scroll_perf_bad_ios__timeline_summary to be unflaky (#111570) 2023-01-11 18:02:30 -08:00
Flutter GitHub Bot 3cee38e80f
Marks Mac_arm64_ios run_debug_test_macos to be unflaky (#117990) 2023-01-10 18:07:09 +00:00
Flutter GitHub Bot 0cd8d8451c
Marks Mac_arm64_android run_debug_test_android to be unflaky (#117469) 2023-01-10 18:07:07 +00:00
Loïc Sharma cb62cfdd1f
Manually mark Windows run_debug_test_windows as unflaky (#118112) 2023-01-10 18:03:15 +00:00
Jenn Magder eaaacdcba9
Allow iOS and macOS plugins to share darwin directory (#115337) 2023-01-09 10:33:03 -08:00
Jenn Magder a02b9d2bff
Update to Xcode 14.2 (#117507)
* Update to Xcode 14.2

* Only bump for devicelab builders

* Restore presubmit: false
2023-01-09 18:29:26 +00:00
Camille Simon 9fb1ae839e
[iOS] Add task for spell check integration test (#116222)
* Add fix and test

* Add test owner

* Print error for testing

* Make sure locale is the problem

* Test capitalization fix

* Take out Android specific test

* Verify eng fix

* Test fix

* Empty-Commit

* Test all tests

* Up string size for testing

* Remove test

* Undo ci.yaml testing changes

* Test android variant:

* Change to testwidgets

* Add widget tester

* Remove android only attempt

* Revert ci.yaml changes
2022-12-22 02:47:11 +00:00
Siva b3c7fe32ed
enable test_ownership in presubmit (#117414) 2022-12-20 16:08:31 -08:00
godofredoc fa711f77e0
Run packaging on presubtmit. (#116943)
* Run packaging on presubtmit.

Test release package generation on presubmit.

Bug: https://github.com/flutter/flutter/issues/28618
Bug: https://github.com/flutter/flutter/issues/60706

* Run packaging_test on all branches.
2022-12-16 02:37:19 +00:00
godofredoc a41c447c8b
Pass dimension explicitly to mac x64 packaging. (#117172)
Without passing this dimension there is a chance that the build will
run on a arm64 machine.
2022-12-15 23:19:09 +00:00
godofredoc 0e0f29fc8c
Run packaging builders only on beta and stable. (#117037)
The packaging recipe is now checking the enabled branches property.

Bug: https://github.com/flutter/flutter/issues/115492
2022-12-14 18:05:03 +00:00
Flutter GitHub Bot 8e452be2f0
Marks Windows run_release_test_windows to be unflaky (#117071) 2022-12-14 18:04:59 +00:00
Loïc Sharma 41625b6620
Test flutter run does not have unexpected engine logs (#116798) 2022-12-12 22:39:49 +00:00
godofredoc bd0791be3f
Pass drone_dimensions as part of the main target. (#116812)
* Pass drone_dimensions as part of the main target.

Drone dimensions were passed as properties when the sharding utility is
expecting them in the target.

Bug: https://github.com/flutter/flutter/issues/116794

* Use dimensions instead of drone_dimensions.

* Use a map format.
2022-12-12 15:17:51 +00:00
godofredoc 1da8f4edc4
Several fixes to packaging builders. (#116800)
It includes the following changes:

* Adds main as the enabled branches.
* Adds docs_beta and docs_stable to pass the expected gcp project.
* Adds dimensions to packaging arm64 to ensure that it runs on arm64
  bot.

Bug: https://github.com/orgs/flutter/projects/43
2022-12-09 21:12:24 +00:00
Loïc Sharma bebea0cc6c
[Windows] Add a flutter run console output test (#116626)
Adds a test to verify the console output of `flutter run --release` on Windows.

Part of: https://github.com/flutter/flutter/issues/111577
2022-12-08 14:05:53 -08:00
sealesj e52449b641
Add Remaining Packaging Builders (#116683)
* add stable packaging builders

* update testowners

* consolidate and use enabled_branches

* update to reflect the consolidation
2022-12-08 17:19:05 +00:00
godofredoc e07240e684
Update docs_deploy builder with the real name. (#116631)
This is removing the temporary comments and simplifying the name.

Bug: https://github.com/flutter/flutter/issues/115489
2022-12-07 15:57:02 +00:00
sealesj 1b05653ab2
use deploy suffix (#116533) 2022-12-05 22:21:07 +00:00
sealesj 30fc993cae
Migrate Packaging Builders to .ci.yaml (#115569)
* packaging builder initial config

* add release scheduler parameter

* remove stables

* add taskname + test owner

* testowner test

* comment structure

* test naming convention

* test adding tags

* add timeout

* prune names

* Update testowners.

* Move packaging to shards section.

* Set packaging as shard.

* Use packaging V2

Co-authored-by: godofredoc <godofredoc@google.com>
2022-12-05 10:51:40 -05:00
Jonah Williams 08a2635e2b
[devicelab] add benchmark for complex non-intersecting widgets with platform views (#116436) 2022-12-02 21:37:45 +00:00
Flutter GitHub Bot a1b8dc9ea7
Marks Linux_android animated_complex_image_filtered_perf__e2e_summary to be unflaky (#116423) 2022-12-02 11:48:57 -08:00
Drew Roen 0d0febc94d
Add release_build parameter (#116307) 2022-11-30 14:49:07 -08:00
Jonah Williams dfa3d33328
[devicelab] track performance of animated image filter (#115850)
* [devicelab] track performance of animated image filter

* ++

* make animations repeat and add dispose

* make duration more consistently 10sec
2022-11-29 01:59:19 +00:00
Drew Roen 511c5341bd
Add test target for release scheduler (#115781)
* Add test scheduler

* Code review comments - added new line, update comment to include TODO

* Switch target to mimic Linux docs_deploy
2022-11-28 17:10:25 +00:00
Flutter GitHub Bot 7faacb5f74
Marks Windows_android channels_integration_test_win to be unflaky (#115939) 2022-11-28 16:38:24 +00:00
Christopher Fujino dfdec8984f
[flutter_tools] Remove package:image (#115848)
* remove ciyaml targets

* remove screenshot_test and package:image

* update-packages

* remove TESTOWNERS entries
2022-11-22 21:49:57 +00:00
keyonghan eed385132d
Support Host only bots apple signing (#115780)
* Mac host only codesigning

* consistent
2022-11-21 23:09:12 +00:00
Camille Simon 7045a8b570
Add Spell Check to Editable Text (iOS) (#110193)
* Add ios to integration test and comments

* Add licenses

* Fix integration test for ios

* Delete pngs

* Undo changes to integration test

* Undo error

* Add ios task

* Fix task for landing
2022-11-21 19:11:48 +00:00
Christopher Fujino 84357cbc4f
re-enable firebase release smoke test since infra outage is over (#115402) 2022-11-16 20:45:38 +00:00
Flutter GitHub Bot c940f31822
Marks Mac_ios flavors_test_ios to be unflaky (#115458) 2022-11-16 17:37:23 +00:00
godofredoc 10dc566436
Add drone_dimensions to devicelab_build_test. (#115183)
This is to allow a single drone to manage all the different subbuilds.

Bug: https://github.com/flutter/flutter/issues/114943
2022-11-12 00:30:07 +00:00
Christopher Fujino a6e3ec8fad
mark firebase test lab test flaky because of upstream infra issues (#115178) 2022-11-11 23:04:55 +00:00
Alex Wallen 7020f59ace
[tool] Support --flavor option for flutter install. (#114048)
* Alphabetize setup calls

* Add --flavor as an option for install

* Add verbose logging in install command

* Test that flavors build succeeds with proper flavor and fails with bogus one.

* Remove unused import

* The import was used...

* SQUASH

* Add flavor install test

* Rename test

* Add flavors install integration tests

* correct error message

* remove unused imports

* Delete copy test

* update test target

* Refactor mechanism to read buildInfo

* Remove unused import

* Set affected test targets to bringup: true

Co-authored-by: a-wallen <stephenwallen@google.com>
2022-11-08 22:53:23 +00:00
Chris Bracken cf0cd067a0
Mark new_gallery__transition_perf as non-flaky (#114694)
These were marked flaky due to a timeout switching between items in the
Studies list at the top of the screen, which had snap-to-item scroll
physics.

The same flake also affected new_gallery_impeller__transition_perf which
was failing with the same flake, though was separately marked flaky due
to a separate (engine crash) flake documented in:
* https://github.com/flutter/flutter/issues/112577
* https://github.com/flutter/flutter/issues/112438

Leaving the latter marked flaky for the time being while that separate
issue is investigated.

Issue: https://github.com/flutter/flutter/issues/114025
2022-11-05 17:02:38 -07:00
godofredoc 4fd0a92532
Remove auto_cleanup of xcode caches. (#114719)
After all the caches have been cleaned and the logic to cleanup runtimes
has landed we may not need to always delete the caches.

Bug: https://github.com/flutter/flutter/issues/114656
2022-11-05 00:08:15 +00:00
Flutter GitHub Bot 1f7bacff42
Marks Linux build_tests_2_3 to be unflaky (#114527) 2022-11-02 16:56:04 +00:00
keyonghan 70a95d57ce
Mark Linux_android new_gallery__transition_perf flaky (#114429) 2022-11-01 16:50:24 +00:00
keyonghan 0c7ee58696
Make Linux_android android_semantics_integration_test flaky (#114361) 2022-10-31 17:48:06 +00:00
Christopher Fujino a5d5cd7a7b
increase Linux build_test sharding (#114196) 2022-10-28 01:09:23 +00:00
Camille Simon 694b25355d
[Android] Fix spell check integration test guarded function conflict (#113541) 2022-10-24 22:54:18 +00:00
pdblasi-google 8d13c8966b
Followup 113705: Allow the slow tests to break the tree as all tests in that shard previously could (#113846) 2022-10-21 20:21:06 +00:00
pdblasi-google 782baecc50
Resolve 113705: Separated longer running tests from runMisc to prevent flakiness from timeouts (#113784) 2022-10-21 16:02:14 +00:00
godofredoc 3665dd8353
Start generating coverage. (#113587) 2022-10-20 23:02:13 +00:00
godofredoc 30161d4db9
Enable cache cleanup. (#113729) 2022-10-20 16:33:56 +00:00
Flutter GitHub Bot 83a9858fa0
Marks Windows_android channels_integration_test_win to be flaky (#113707) 2022-10-19 18:58:57 +00:00
Jenn Magder 6ad44434ad
Remove bringup from hot_mode_dev_cycle_ios_simulator (#113660) 2022-10-19 18:55:07 +00:00
Jenn Magder 4d28e6d064
Terminate simulator app on "q" (#113581) 2022-10-18 22:26:16 +00:00
godofredoc 10740484d2
Remove cross_arch_tests from recipes cq. (#113569) 2022-10-18 17:11:29 +00:00
Casey Hillers e23a68347e
[ci.yaml] Increase docs targets to use 32 cores (#113465) 2022-10-17 15:58:52 +00:00
Flutter GitHub Bot ea8e00e75a
Marks Windows web_tool_tests_1_2 to be unflaky (#112954) 2022-10-06 17:59:45 +00:00
Flutter GitHub Bot bee1775754
Marks Windows web_tool_tests_2_2 to be unflaky (#112955) 2022-10-06 17:59:43 +00:00
Flutter GitHub Bot 6f652863bb
Marks Mac_android microbenchmarks to be unflaky (#112953) 2022-10-06 17:55:51 +00:00
Flutter GitHub Bot 17514de663
Marks Mac plugin_lint_mac to be unflaky (#112951) 2022-10-06 17:55:48 +00:00
keyonghan be86a91654
Ignore flakiness for Mac_arm64 tool_host_cross_arch_tests (#112999) 2022-10-06 16:35:08 +00:00
Flutter GitHub Bot 61f61c44b4
Marks Windows plugin_test to be flaky (#112940) 2022-10-06 15:48:19 +00:00
godofredoc c99780dea8
Run docs publish on all branches. (#112909) 2022-10-05 04:41:27 +00:00
Camille Simon b94b584298
[Android] Fix spell_check integration test flakiness (#112109) 2022-10-04 19:05:39 +00:00
Jesús S Guerrero 45584b2528
Web subsharding (#112505) 2022-09-28 19:23:35 +00:00
Flutter GitHub Bot cd3beb4f0f
Marks Linux_android new_gallery_impeller__transition_perf to be flaky (#112578) 2022-09-28 19:01:09 +00:00
Flutter GitHub Bot 6e1438c9b5
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be flaky (#112574) 2022-09-28 18:51:57 +00:00
Flutter GitHub Bot 1a5bc32e00
Marks Mac complex_layout_macos__compile to be unflaky (#112556) 2022-09-28 18:16:10 +00:00
Flutter GitHub Bot 92815c9f10
Marks Mac flutter_gallery_macos__compile to be unflaky (#112557) 2022-09-28 18:13:26 +00:00
Jenn Magder 2f0f49f28f
Revert "Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558)" (#112579)
This reverts commit e0fcdabe7b.
2022-09-28 11:09:33 -07:00
Flutter GitHub Bot e0fcdabe7b
Marks Mac_arm64 tool_host_cross_arch_tests to be unflaky (#112558) 2022-09-28 17:26:24 +00:00
Flutter GitHub Bot c4dd441a12
Marks Windows_android channels_integration_test_win to be unflaky (#112559) 2022-09-28 17:20:03 +00:00
Flutter GitHub Bot 0941737d28
Marks Mac flutter_gallery_macos__start_up to be unflaky (#112088) 2022-09-28 15:34:08 +00:00
Alex Wallen 23d17e3021
Fix integration_ui_test_test_macos (#112507) 2022-09-28 00:37:25 +00:00
Sarang Pal 97b53bc90b
Fix for issue #104104 Add host tag to `tags in .ci.yaml targets (#112454) 2022-09-27 19:39:03 +00:00
Jenn Magder 216aefa140
Remove x64 "tool_host_cross_arch_tests" bringup (#112411) 2022-09-27 17:51:37 +00:00
Harry Terkelsen 9853d886ab
Revert "Remove tool_host_cross_arch_tests bringup" (#112406) 2022-09-26 20:33:45 +00:00
Jenn Magder 11f4d4fc02
Remove tool_host_cross_arch_tests bringup (#112311) 2022-09-26 18:01:16 +00:00
Flutter GitHub Bot ac823ccae6
Marks Mac flutter_view_macos__start_up to be unflaky (#112089) 2022-09-26 17:49:07 +00:00
Alex Wallen b22388ee68
Add a flutter app that can resize itself as integration test app. (#112297) 2022-09-26 17:45:19 +00:00
Flutter GitHub Bot d766269e6f
Marks Mac flutter_tool_startup__macos to be unflaky (#112094) 2022-09-22 17:13:06 +00:00
keyonghan 0eaa6dad9a
Mark Mac plugin_lint_mac as flaky (#112147) 2022-09-22 16:20:50 +00:00
Flutter GitHub Bot 32d944c093
Marks Windows flutter_tool_startup__windows to be unflaky (#112092) 2022-09-22 16:20:48 +00:00
Flutter GitHub Bot 6ddffadca6
Marks Linux flutter_tool_startup__linux to be unflaky (#112093) 2022-09-22 16:19:52 +00:00
Jenn Magder c9edacb172
Always run Mac hostonly builds on x64 by default (#112133) 2022-09-21 17:50:03 -07:00
Xilai Zhang d98c263e30
[codesign] remove beta, stable, dev references in ci.yaml (#112105) 2022-09-21 21:47:43 +00:00
Jenn Magder 442953268f
Run Mac hostonly tests on any available arch (#109889) 2022-09-21 21:38:09 +00:00
Xilai Zhang 99e491e30a
[codesign] bring up verify codesign test on release branches (#112096) 2022-09-21 18:29:23 +00:00
Flutter GitHub Bot 77377b46dd
Marks Mac hello_world_macos__compile to be unflaky (#112090) 2022-09-21 17:59:19 +00:00
Flutter GitHub Bot bdde878631
Marks Mac basic_material_app_macos__compile to be unflaky (#112087) 2022-09-21 17:52:39 +00:00
Flutter GitHub Bot c44407c820
Marks Mac platform_view_macos__start_up to be unflaky (#112091) 2022-09-21 17:52:37 +00:00
keyonghan ccd3d80074
Move android gallery_transition_perf targets to prod (#111584) 2022-09-19 16:03:24 +00:00
jensjoha b7b8b759bc
Add flutter startup benchmark (#111658)
Add flutter startup benchmark for Linux, Windows and MacOs.

Via guide on https://github.com/flutter/flutter/pull/111461#issuecomment-1247113905
2022-09-16 08:41:30 +02:00
Alex Wallen 29d508dd53
Add Xcode as dependency of flutter_view_macos__start_up in .ci.yaml (#111624) 2022-09-15 21:54:05 +00:00
Alex Wallen 96b49aae31
[macOS] Add flutter_view example. (#111326) 2022-09-14 23:44:14 +00:00
keyonghan e9d687bbf1
Remove customized runtime for framework targets (#111492) 2022-09-13 21:34:09 +00:00
keyonghan 26a76fe3a0
Mark Mac_android microbenchmarks flaky (#111486) 2022-09-13 16:57:10 +00:00
sealesj 0cbf67576a
Remove Linux_samsung_a02 openpay_benchmarks__scroll_perf (#111415) 2022-09-12 20:58:06 +00:00
Alex Wallen c6d44e25fb
[macOS] Add missing, required dependencies to run platform_view_macos__start_up (#111300) 2022-09-12 19:26:16 +00:00
godofredoc a1dbd0ccec
Revert "Temporarily disable docs tests." (#111278) 2022-09-09 17:59:10 +00:00
godofredoc 9bd751f27a
Temporarily disable docs tests. (#111237)
This is to reopen the tree while jazzy installation is fixed.

Bug: https://github.com/flutter/flutter/issues/111193
2022-09-08 20:27:27 -07:00
gaaclarke d2434a2b60
Added platform channel integration tests for macos (#110606) 2022-09-08 22:39:07 +00:00
Alex Wallen 652ff7a5e6
[macOS] Add platform_view_macos__start_up tests devicelab test suite. (#111041) 2022-09-08 19:35:20 +00:00
Alex Wallen eac2329ebf
Re-land [macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110379) 2022-09-08 16:49:17 +00:00
Alex Wallen 2b373903a8
Remove flutter_gallery_mac__start_up as target in .ci.yaml (#111117) 2022-09-07 22:19:21 +00:00
keyonghan ab77e43566
Migrate Linux android gallery e2e and hybrid tests to build+test (#110533) 2022-09-07 20:19:20 +00:00
Flutter GitHub Bot ad1e76a209
Marks Mac_ios native_platform_view_ui_tests_ios to be unflaky (#111107) 2022-09-07 17:22:07 +00:00
Flutter GitHub Bot de0dd063b4
Marks Mac_ios complex_layout_scroll_perf_bad_impeller_ios__timeline_summary to be unflaky (#111106) 2022-09-07 17:09:18 +00:00
keyonghan ad1ce00891
Switch Linux_build_test flutter_gallery__transition_perf to prod (#111047) 2022-09-07 00:27:09 +00:00
keyonghan 2719cd036e
Revert "Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup"" (#110804) 2022-09-01 20:59:37 +00:00
godofredoc 759d0e1b20
Revert "Set linux autoroller as bringup to reopen the tree." (#110748) 2022-09-01 06:07:20 +00:00
godofredoc d8d7b226ce
Set linux autoroller as bringup to reopen the tree. (#110739)
The build is failing to decrypt the key after it was moved to a
different GCP project. Disabling temporarily to reopen the tree while
the key is regenerated.
2022-08-31 20:13:34 -07:00
keyonghan 1f236a9b6f
Revert "Switch Linux_build_test flutter_gallery__transition_perf back to bringup" (#110734) 2022-09-01 00:29:05 +00:00
Jenn Magder 9f6b7dfefc
Do not run desktop benchmarks in presubmit (#110642) 2022-08-31 21:41:20 +00:00
Zachary Anderson c213fd9b9c
Switch Linux_build_test flutter_gallery__transition_perf back to bringup (#110702) 2022-08-31 13:35:52 -07:00
Jenn Magder 069f504297
Update CI to use Xcode 14 beta 5 (#110302) 2022-08-31 01:20:09 +00:00
keyonghan 226c63577b
Mark microbenchmarks_impeller_ios flaky (#110633) 2022-08-31 01:18:11 +00:00
keyonghan 171ddeb0e0
Manually deflake targets (#110621) 2022-08-30 22:18:20 +00:00
Stephen (Alex) Wallen f15f9aa293
Add required dependencies for benchmark target (#110510) 2022-08-30 16:27:05 +00:00
Stephen (Alex) Wallen b4c0a125b6
Add required dependencies for complex_layout_macos__start_up target. (#110515) 2022-08-29 21:13:08 +00:00
Stephen (Alex) Wallen 50004bdace
Revert "Add required dependencies for Mac flutter_gallery_macos__compile target." (#110382) 2022-08-26 23:40:09 +00:00
keyonghan 93d8be0e01
Switch to build+test model for flutter_gallery__transition_perf (#110377) 2022-08-26 22:30:23 +00:00
Zachary Anderson 056f11060f
Add several new iOS/Impeller benchmarks (#110358) 2022-08-26 14:06:26 -07:00
Jenn Magder d65d64d194
Revert "[macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110370)" (#110372)
This reverts commit 4770e34859.
2022-08-26 13:48:36 -07:00
Stephen (Alex) Wallen 4770e34859
[macOS] Bring up "flutter_gallery" devicelab, start up test for x86. (#110370) 2022-08-26 20:24:52 +00:00
Stephen (Alex) Wallen b3ae6ffc9f
Add required dependencies for Mac flutter_gallery_macos__compile target. (#110366) 2022-08-26 19:31:00 +00:00
Stephen (Alex) Wallen d420016587
[macOS] Bring up "complex_layout" devicelab, compilation test for x86. (#110360) 2022-08-26 19:27:31 +00:00
Jonah Williams f0ffc85698
Add bad scroller benchmark (#110362) 2022-08-26 18:50:07 +00:00
Stephen (Alex) Wallen 9a34a60c0c
[macOS] Bring up "flutter_gallery_macos__compile" devicelab, compilation test for x86. (#110356) 2022-08-26 17:29:39 +00:00
Stephen (Alex) Wallen 0d2776fd92
Add missing, required dependencies for complex_layout_macos__start_up (#110352) 2022-08-26 16:50:10 +00:00
Stephen (Alex) Wallen 80a635e4a9
[macOS] Bring up "basic_material_app" devicelab, compile tests for x64 macs. (#110296) 2022-08-26 15:29:14 +00:00
Loïc Sharma 4898f1f5c5
[Windows] Add app startup integration test (#110114)
Add a basic integration test for the Windows's app startup. In a subsequent change (https://github.com/flutter/flutter/pull/109816), this test will be updated to verify the app's window isn't visible until after the first frame has been drawn.

Part of https://github.com/flutter/flutter/issues/41980
2022-08-25 18:54:20 -07:00
Stephen (Alex) Wallen 27bfc511ba
[macOS] Bring up "complex_layout" devicelab, startup tests for x64 (#110100) 2022-08-25 23:35:00 +00:00
Stephen (Alex) Wallen 5705890971
Add Xcode dependencies to Mac hello_world_macos__compile (#110274) 2022-08-25 20:46:13 +00:00
Flutter GitHub Bot bac574ce6e
Marks Windows complex_layout_win_desktop__compile to be unflaky (#110191) 2022-08-24 18:14:04 +00:00
Flutter GitHub Bot 5a33eb520b
Marks Windows hello_world_win_desktop__compile to be unflaky (#110188) 2022-08-24 18:05:58 +00:00
Stephen (Alex) Wallen d71a8a7093
[macOS] Bring up "hello_world" devicelab, compilation test for x86. (#109891) 2022-08-24 18:04:42 +00:00
Flutter GitHub Bot 82f35976b8
Marks Windows flutter_gallery_win_desktop__compile to be unflaky (#110189) 2022-08-24 18:03:42 +00:00
Flutter GitHub Bot 51656e53e7
Marks Windows flutter_gallery_win_desktop__start_up to be unflaky (#110190) 2022-08-24 18:02:43 +00:00
Flutter GitHub Bot 22a59bc832
Marks Windows complex_layout_win_desktop__start_up to be unflaky (#110192) 2022-08-24 18:01:31 +00:00
Flutter GitHub Bot 27f32220c6
Marks Mac_ios flutter_gallery_ios__transition_perf to be unflaky (#110186) 2022-08-24 17:56:16 +00:00
Flutter GitHub Bot 0ae6ef8a3a
Marks Mac_ios flutter_gallery_ios_sksl_warmup__transition_perf to be unflaky (#110187) 2022-08-24 17:54:05 +00:00
Flutter GitHub Bot 5ac3596199
Marks Mac_ios flutter_gallery__transition_perf_e2e_ios to be unflaky (#110185) 2022-08-24 17:18:05 +00:00
Flutter GitHub Bot 3e2e3c9b7f
Marks Mac_arm64_ios build_ios_framework_module_test to be unflaky (#110183) 2022-08-24 17:03:18 +00:00
keyonghan 9ef5017b92
Update open_jdk version version:11 (#110110) 2022-08-23 22:24:21 +00:00
Ricardo Amador 129fa7699f
Moving ios benchmark tests to prod. (#110049)
* Moving io benchmark tests to prod.

* New tasks must be marked bringup: true
2022-08-22 17:10:15 -07:00
Zachary Anderson d79a3d7a19
Remove most benchmarks of SkSL warmup (#110040) 2022-08-22 22:31:54 +00:00
keyonghan 43822a1263
mark flaky (#109890) 2022-08-19 16:25:36 -07:00
Gary Qian 357755f968
Update ci.yaml tests to Android API 33 (#109820) 2022-08-19 17:46:22 +00:00
Camille Simon 5ca8c4d03e
Remove scheduler (#109714) 2022-08-17 21:42:52 +00:00
Flutter GitHub Bot 4cf3288898
Marks Windows_android channels_integration_test_win to be flaky (#109695) 2022-08-17 18:21:24 +00:00
Camille Simon 7db25c36ad
Re-land Add Spell Check to EditableText (#109643) 2022-08-17 16:16:02 +00:00
yaakovschectman 4e068a613e
Bring up new Windows start-up tests (#109618)
* Add Windows startup test

* Add new tests for Windows desktop

* Bring up complex layout tests for Win Desktop

* Bring up flutter_view startup test for Windows

* Add Platform View startup test for Windows

* Fix typo in .ci.yaml

* Make basename variable final

* Link to bug in .ci.yaml
2022-08-17 09:38:41 -04:00
Jonah Williams 0ba88d8b43
Revert "Add Spellcheck to EditableText (Android) (#109334)" (#109631)
This reverts commit ff9fe35682.
2022-08-16 14:30:03 -07:00
Camille Simon ff9fe35682
Add Spellcheck to EditableText (Android) (#109334) 2022-08-16 18:22:45 +00:00
yaakovschectman bba2ac83b1
Add Compilation DeviceLab test for Windows (#109540)
* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete asset from repo

* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete icon

* Use path.basename

Re triggering tests

* Update test owner to desktop team
2022-08-15 16:26:02 -04:00
yusuf-goog 5ac269937f
Making xcode version consistent across .ci.yaml. (#109009) 2022-08-05 02:26:06 +00:00
Jenn Magder 25b3788f4e
Remove android_sdk and open_jdk from some iOS-only tests (#108994) 2022-08-04 21:39:08 +00:00
Flutter GitHub Bot bfca3143c2
Marks Linux_android clipper_cache_perf__e2e_summary to be unflaky (#104088) 2022-08-02 23:24:07 +00:00
keyonghan c6bb9cc0b8
Mark Mac_ios microbenchmarks_ios_flaky flaky (#108820) 2022-08-02 18:58:06 +00:00
Kaushik Iska 611514886b
Reland Linux_samsung_a02 openpay_benchmarks__scroll_perf (#108466) (#108769) 2022-08-02 04:32:06 +00:00
hellohuanlin 176f7d7130
[platform_view]run platform view ui test to physical device (#108642) 2022-07-30 06:36:09 +00:00
Casey Hillers d4e10fd86d
[ci.yaml] Run flutter_plugins only on tip of tree (#108594) 2022-07-29 13:02:06 +00:00
yusuf-goog 4aa3d740af
Remove failing test Linux_android android_lifecycles_test. (#108587) 2022-07-29 00:10:05 +00:00
hellohuanlin b00bfef3c1
[platform_view]add android deps to platform view test (#108585) 2022-07-28 23:42:07 +00:00
Flutter GitHub Bot 4d5e4d4d94
Marks Linux_android new_gallery_impeller__transition_perf to be unflaky (#108458) 2022-07-27 20:13:05 +00:00
keyonghan 6eb602d6c2
Remove Linux_samsung_a02 openpay_benchmarks__scroll_perf (#108466) 2022-07-27 20:09:07 +00:00
Flutter GitHub Bot b7e08dd226
Marks Windows gradle_plugin_bundle_test to be unflaky (#108459) 2022-07-27 20:04:06 +00:00
Flutter GitHub Bot 2756f868b6
Marks Linux_android color_filter_with_unstable_child_perf__e2e_summary to be unflaky (#108457) 2022-07-27 17:04:05 +00:00
keyonghan c0f4475981
ignore flakiness (#108039) 2022-07-27 09:23:17 -07:00
Kaushik Iska 6a5cd3d825
Remove luci scheduling from openpay benchmarks (#108126) 2022-07-21 20:47:06 +00:00
Kaushik Iska f7504f0380
[openpay] Create an OpenPay benchmark (#107838) 2022-07-21 20:01:06 +00:00
Flutter GitHub Bot 94bb1bddf4
Marks Linux_samsung_s10 new_gallery_impeller__transition_perf to be unflaky (#108030) 2022-07-20 21:54:05 +00:00
Flutter GitHub Bot 08c0b92a1a
Marks Mac_ios cubic_bezier_perf_ios_sksl_warmup__timeline_summary to be unflaky (#108031) 2022-07-20 21:52:06 +00:00
Flutter GitHub Bot 5fb4d10fa1
Marks Windows gradle_plugin_bundle_test to be flaky (#108021) 2022-07-20 21:50:06 +00:00
Flutter GitHub Bot 981e85c14b
Marks Mac_ios new_gallery_impeller_ios__transition_perf to be unflaky (#108032) 2022-07-20 21:48:05 +00:00
ColdPaleLight 1919167540
Added benchmark for early removal of unused raster cache entris mecha… (#107918) 2022-07-20 19:13:06 +00:00
keyonghan 5b94f254f4
Migrate Mac_ios targets to cocoon scheduler (#107944) 2022-07-20 03:57:05 +00:00
keyonghan 6bd3e6e006
Migrate Linux android targets to cocoon scheduler (#107852) 2022-07-19 00:40:07 +00:00
keyonghan 6952408cdf
Migrate Mac/Windows+android targets to cocoon scheduler (#107737) 2022-07-16 00:12:06 +00:00
keyonghan bc097f4b2a
Mark Windows_android flavors_test_win flaky (#107749) 2022-07-16 00:08:06 +00:00
hellohuanlin da8070d6af
Fix native platform view integration test config (#107679) 2022-07-15 22:56:09 +00:00
keyonghan 9b15b4fa2c
Migrate host only targets to cocoon scheduler (#107673) 2022-07-15 00:08:14 +00:00
Flutter GitHub Bot f879bcf9b0
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be unflaky (#107557) 2022-07-14 15:38:07 +00:00
keyonghan 82b843b36f
Migrate bringup post-submit targets to cocoon scheduler (#107483) 2022-07-13 16:50:07 +00:00
Flutter GitHub Bot 78b38b77b9
Marks Linux_android raster_cache_use_memory_perf__e2e_summary to be unflaky (#107165) 2022-07-06 22:32:06 +00:00
stuartmorgan f3717d70d7
Enable Windows platform_channel test (#106973) 2022-07-06 14:21:07 +00:00
stuartmorgan 6c6ae06381
Add Windows to the platform_channels example (#106754) 2022-06-30 14:54:07 +00:00
JsouLiang f0200f0106
Add benchmark case for RasterCache (#103338) 2022-06-29 23:54:10 +00:00
Christopher Fujino f10138f0e6
[flutter_tools] don't run pub_autoroller on release branches (#106830) 2022-06-29 22:52:06 +00:00
Flutter GitHub Bot eb832a2b57
Marks Mac_ios external_ui_integration_test_ios to be flaky (#106807) 2022-06-29 17:30:07 +00:00
Flutter GitHub Bot 0df4885473
Marks Linux_android new_gallery__crane_perf to be unflaky (#106808) 2022-06-29 17:28:07 +00:00
Flutter GitHub Bot f59146ce29
Marks Windows_android channels_integration_test_win to be unflaky (#106812) 2022-06-29 17:26:07 +00:00
Flutter GitHub Bot 88b1e41f7c
Marks Linux_android gradient_static_perf__e2e_summary to be unflaky (#101834) 2022-06-29 10:03:21 -07:00
Christopher Fujino 2657eea5a3
move "Linux packages_autoroller" to prod pool (#106749) 2022-06-28 19:06:07 +00:00
keyonghan 99c195de17
Skip Mac_android run_release_test in presubmit (#106709) 2022-06-28 18:50:06 +00:00
Christopher Fujino 77ad5190e3
[flutter_tools] add packages_autoroller to .ci.yaml as bringup (#106711) 2022-06-28 17:48:07 +00:00
Jonah Williams 98f0c3694b
add old gallery page transition (#106701) 2022-06-27 23:36:06 +00:00
hellohuanlin 0dd0c2edca
[platform_view]Send platform message when platform view is focused (#105050) 2022-06-23 00:01:07 +00:00
Flutter GitHub Bot 1c6da0d653
Marks Mac_ios hot_mode_dev_cycle_ios__benchmark to be unflaky (#106427) 2022-06-22 18:23:08 +00:00
Flutter GitHub Bot 832eb37f71
Marks Windows_android channels_integration_test_win to be flaky (#106031) 2022-06-22 00:17:07 +00:00
Ricardo Amador f6f0d608ba
Update the platform properties for android bots (#106146) 2022-06-17 04:04:06 +00:00
Flutter GitHub Bot 261246b820
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be flaky (#102237) 2022-06-15 21:24:07 +00:00
Flutter GitHub Bot 873d343e09
Marks Mac_ios external_ui_integration_test_ios to be unflaky (#106041) 2022-06-15 17:52:06 +00:00
Flutter GitHub Bot 971f12b0ef
Marks Mac_arm64_ios build_ios_framework_module_test to be flaky (#105610) 2022-06-10 11:53:09 -07:00
keyonghan 7345b05cb6
Enable arm64 module_test_ios and plugin_lint_mac in prod (#105744) 2022-06-09 16:38:09 -07:00
keyonghan 23174b9b6b
Enable two new arm64 ios tests (#105636) 2022-06-09 11:18:11 -07:00
Flutter GitHub Bot f377f61f77
Marks Mac_ios new_gallery_ios__transition_perf to be unflaky (#105627) 2022-06-08 13:53:10 -07:00
Flutter GitHub Bot 71a0634e68
Marks Linux_android flutter_gallery_sksl_warmup__transition_perf to be unflaky (#105623) 2022-06-08 13:48:11 -07:00
Flutter GitHub Bot 08aecd40fe
Marks Linux_android flutter_gallery__transition_perf_with_semantics to be unflaky (#105622) 2022-06-08 13:43:11 -07:00
Flutter GitHub Bot 4c1736e757
Marks Linux_android flutter_gallery__transition_perf_hybrid to be unflaky (#105621) 2022-06-08 13:38:10 -07:00
Flutter GitHub Bot 5b7f94375f
Marks Linux_android flutter_gallery__transition_perf_e2e to be unflaky (#105620) 2022-06-08 13:28:12 -07:00
Flutter GitHub Bot e6d31b9d56
Marks Linux_android flutter_gallery_sksl_warmup__transition_perf_e2e to be unflaky (#105624) 2022-06-08 11:38:10 -07:00
Flutter GitHub Bot c41e7b244d
Marks Linux_android flutter_gallery__transition_perf to be unflaky (#105619) 2022-06-08 11:33:09 -07:00
Flutter GitHub Bot 856fa3ce8e
Marks Linux android views to be unflaky (#105618) 2022-06-08 11:28:11 -07:00
Flutter GitHub Bot 11ed474ef9
Marks Linux_android new_gallery__crane_perf to be flaky (#105612) 2022-06-08 11:18:09 -07:00
Flutter GitHub Bot 13fae53dc5
Marks Linux_android gradient_consistent_perf__e2e_summary to be unflaky (#101833) 2022-06-07 16:23:06 -07:00
Ricardo Amador 80bfc8f35a
Add targets for benchmark tests moved from staging to prod. (#105481)
* Add targets for benchmark tests moved from staging to prod.

* Add bringup:true to new targets.

* Missed a builder for bringup.

* Fix a presubmit that was inadvertently created as true.

* Removed some trailing whitespace causing format check to fail.
2022-06-07 14:11:57 -07:00
keyonghan 7df7e8abad
Use device_type dimension for samsung S10 builders (#105322) 2022-06-03 15:18:11 -07:00
Gary Qian 68d09d6e2a
Upgrade test shards to use android API 32 (#105259) 2022-06-02 18:38:12 -07:00
Ricardo Amador ff110fb958
Add versions to all the dependencies so they are pinned (#104867)
* Updated file to include version for dependencies.

* Updated clang version to use github revision.
2022-06-02 13:11:28 -07:00
godofredoc f4d15dfc0d
For linux builds use machines with 8 cores. (#105083) 2022-06-01 10:43:09 -07:00
yusuf-goog 588f1c93e5
Removing minor iOS version filter value from ci.yaml (#105059) 2022-05-31 15:38:08 -07:00
Jenn Magder 15308b339b
Upgrade CI Xcode version to 13.4 (#104857) 2022-05-27 15:33:07 -07:00
Casey Hillers 93c8de41ff
[ci.yaml] Remove google testing postsubmit target (#104853) 2022-05-27 13:38:11 -07:00
yusuf-goog 053144b7d1
Revert "Removing minor ios version value for device_os property" (#104854) 2022-05-27 12:58:13 -07:00
yusuf-goog 562df08218
Removing minor ios version value for device_os property (#104835)
Bug:104770
2022-05-27 09:53:06 -07:00
Dan Field be7a4227c7
Add a macrobenchmark for laying out text in a list (#104736) 2022-05-26 15:25:10 -07:00
keyonghan b2eafd735d
Revert "Removing minor version from device_os value. (#104727)" (#104755)
This reverts commit 8461e573f8.

Co-authored-by: Jenn Magder <magder@google.com>
2022-05-26 14:26:49 -07:00
yusuf-goog 8461e573f8
Removing minor version from device_os value. (#104727) 2022-05-26 14:05:10 -07:00
Flutter GitHub Bot e8995736bf
Marks Mac_ios large_image_changer_perf_ios to be unflaky (#104627) 2022-05-25 14:33:14 -07:00
Flutter GitHub Bot 5d6c8b0983
Marks Linux_android new_gallery__crane_perf to be unflaky (#104624) 2022-05-25 14:28:10 -07:00
godofredoc 9cfac48e2e
Enable android_views. (#104474) 2022-05-24 08:58:08 -07:00
yusuf-goog 954c7472d9
Moving linux vm builds to Ubuntu. (#104294) 2022-05-23 16:23:08 -07:00
yusuf-goog 874b6c08f5
Add ignore_flakiness property to staging builds. (#104102)
* Add ignore_flakiness property to staging builds.

Bug:104100

* Update .ci.yaml
2022-05-20 09:45:58 -07:00
Flutter GitHub Bot c4644a6a2e
Marks Mac_arm64_android run_release_test to be unflaky (#104091) 2022-05-18 20:22:07 -07:00
Flutter GitHub Bot 23509ae9b7
Marks Linux_android cubic_bezier_perf_sksl_warmup__e2e_summary to be unflaky (#104089) 2022-05-18 20:17:07 -07:00
Zachary Anderson 80a51e4f97
Adds new_gallery_impeller__transition_perf benchmark for Android (#104126) 2022-05-18 20:07:12 -07:00
Jenn Magder 5ce07af9ca
Delete native_ui_tests_ios (#103727) 2022-05-16 15:59:52 -07:00
wangying b3d7a691f6
Add benchmark for clipper layers raster cache (#102495)
* Add clipper raster cache benchmarks

* fix ci test error

* Add PhysicalModel widget to test

* Set top margin adaptive screen height

* Remove PhysicalModel
2022-05-13 14:04:06 +08:00
keyonghan d647755ee3
Revert "Adding linux VM staging tests to .ci.yaml" (#103658) 2022-05-12 14:54:15 -07:00
yusuf-goog 041999ca1b
Adding linux VM staging tests to .ci.yaml (#103165) 2022-05-12 13:14:10 -07:00
Flutter GitHub Bot 7ad96dc345
Marks Linux_android cubic_bezier_perf_sksl_warmup__e2e_summary to be flaky (#103505) 2022-05-11 11:29:10 -07:00
Flutter GitHub Bot 97fc2ee4fc
Marks Linux_android animated_complex_opacity_perf__e2e_summary to be unflaky (#103501) 2022-05-11 11:14:07 -07:00
yusuf-goog 5e85d23740
Set presubmit false for staging targets in ci.yaml (#103509) 2022-05-11 10:29:09 -07:00
Casey Hillers eee051ac49
[ci.yaml] Remove explicit caches (#103175) 2022-05-06 10:44:07 -07:00
yusuf-goog 425aef22ac
Adding two staging tests to ci.yaml (#103003)
* Adding two staging tests to ci.yaml

Adding a properties block (linux_stating_build) and 2 builds
that use this to ci.yaml. This is to verify some failures on
these builds that are happening when running via entries
in devicelab_stating_config.star file.

Bug:102406

* Updating staging build entries to use new naming convention

Staging builds now use a name prefix of Staging_build_, which
allows us to filter these builds on the dashboard.

* Moving bringup:true to target level

We can't add bringup:true to properties block level, so
need to move this back to each target.
2022-05-05 14:00:22 -07:00
Flutter GitHub Bot 051f1b027f
Marks Mac_arm64_android run_release_test to be flaky (#103060) 2022-05-04 15:39:13 -07:00
Flutter GitHub Bot c3ab24e0b8
Marks Mac_ios external_ui_integration_test_ios to be flaky (#103058) 2022-05-04 13:04:12 -07:00
Casey Hillers baea888118
[ci.yaml] Revert devicelab targets back to LUCI scheduler (#103048) 2022-05-04 12:59:15 -07:00
Emmanuel Garcia b4f8d7c792
Clean up ci.yaml and add missing gradle caches (#102942) 2022-05-03 15:14:07 -07:00
keyonghan 35e35b6fcc
Deflake arm64 android tests (#102929) 2022-05-02 14:24:07 -07:00
godofredoc b1eed25bfc
Add mirroring from master to main. (#102843) 2022-04-29 19:14:04 -07:00
Gary Qian a622b6a536
Remove Linux android views (#102699) 2022-04-27 17:59:07 -07:00
Casey Hillers 29943e6595
[ci.yaml] Migrate 50 targets to Cocoon scheduler (#102676) 2022-04-27 13:44:07 -07:00
Flutter GitHub Bot d7cd8c1039
Marks Linux_android android_semantics_integration_test to be unflaky (#102658) 2022-04-27 13:24:07 -07:00
Flutter GitHub Bot 3f2cb2418d
Marks Mac tool_host_cross_arch_tests to be unflaky (#102659) 2022-04-27 11:19:08 -07:00
keyonghan 1bb9eed4d0
Update open sdk version to be version version:11 (#102610) 2022-04-26 18:09:04 -07:00
keyonghan d69816163e
Enable Mac/android arm64 tests as bringup: true (#102589) 2022-04-26 13:34:06 -07:00
Jonah Williams 63574cf76a
add benchmark for animated complex opacity (#102532) 2022-04-25 18:14:06 -07:00
keyonghan 0411a6f8a3
Enable M1 mac/ios tests in prod as bringup: false (#102530) 2022-04-25 16:14:03 -07:00
Emmanuel Garcia 4ca94ab2fc
Remove build_aar_module_test from devicelab tests (#102329) 2022-04-21 15:24:09 -07:00
keyonghan 242ad0f730
Enable DeviceLab arm64 ios tests as bringup: true (#102089) 2022-04-21 13:24:07 -07:00
Casey Hillers 4a72c5345e
[ci.yaml] Migrate bringup targets to cocoon scheduler (#102249) 2022-04-21 12:49:08 -07:00
drewroengoogle ec6481bed8
Change dependency from ios_signing to apple_signing (#102259)
* Change dependency name to apple_signing for a better understanding of it's use

* Updated Mac_ios test to run if .ci.yaml is updated
2022-04-21 14:12:38 -05:00
Flutter GitHub Bot d3ce6d6eb1
Marks Mac_ios cubic_bezier_perf_ios_sksl_warmup__timeline_summary to be flaky (#102231) 2022-04-21 11:09:10 -07:00
Flutter GitHub Bot 49e043a2c0
Marks Linux_android gradient_dynamic_perf__e2e_summary to be unflaky (#101832) 2022-04-21 10:49:09 -07:00
yusuf-goog a9eaee55ea
Switch ci.yaml Linux builders to Debian. (#102253)
In preparation for upgrading linux VMs to Ubuntu, specify builders
to use 'os: Debian' instead of 'os: Linux'.

There should be no functional changes to current builders with this change.

Bug:102252
2022-04-21 09:35:24 -07:00
Emmanuel Garcia 3fefb2d5eb
Add verbose flag to flutter run commands (#102257) 2022-04-20 22:34:07 -07:00
Flutter GitHub Bot f5cf963fa2
Marks Linux_android new_gallery__crane_perf to be flaky (#102233) 2022-04-20 21:54:07 -07:00
Flutter GitHub Bot 878880fa52
Marks Windows build_aar_module_test to be flaky (#102227) 2022-04-20 21:49:07 -07:00
Flutter GitHub Bot 2bc539a896
Marks Mac_ios native_ui_tests_ios to be unflaky (#102225) 2022-04-20 21:44:10 -07:00
Flutter GitHub Bot 208832e012
Marks Mac_ios flutter_view_ios__start_up to be unflaky (#102224)
* Marks Mac_ios flutter_view_ios__start_up to be unflaky

* update mode

Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-20 21:18:13 -07:00
Flutter GitHub Bot fbaf86788d
Marks Mac_android entrypoint_dart_registrant to be unflaky (#102223)
* Marks Mac_android entrypoint_dart_registrant to be unflaky

* update mode

Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-20 21:16:44 -07:00
Elsabe Ros 606e91ad63
Use the maven-publish plugin to publish AAR files. (#101891) 2022-04-19 16:34:07 -07:00
keyonghan 7d2d63c90d
Enforce cpu explicitly for Mac devicelab test beds (#101871) 2022-04-15 09:24:07 -07:00
Christopher Fujino 41b73894bc
Test framework for executable files (#101853) 2022-04-13 22:44:07 -07:00
Christopher Fujino fd5356ff60
[flutter_tools] shard out two integration tests we want to run on macOS arm64 (#101769) 2022-04-13 12:09:11 -07:00
Zachary Anderson 6190c5df09
Revert "Use the maven-publish plugin to publish AAR files. (#101276)" (#101827)
This reverts commit 2b0255f0d9.
2022-04-13 08:12:07 -07:00
Elsabe Ros 2b0255f0d9
Use the maven-publish plugin to publish AAR files. (#101276) 2022-04-12 22:19:08 -07:00
Emmanuel Garcia 9b6e4f01ab
Make hybrid_android_views_integration_test fail the build (#101066) 2022-04-11 14:19:10 -07:00
Flutter GitHub Bot 6b461de012
Marks Linux_android color_filter_cache_perf__e2e_summary to be unflaky (#100629)
* Marks Linux_android color_filter_cache_perf__e2e_summary to be unflaky

* deflake

Co-authored-by: keyonghan <54558023+keyonghan@users.noreply.github.com>
Co-authored-by: Keyong Han <keyonghan@google.com>
2022-04-11 14:01:04 -07:00
gaaclarke fb00617585
Added missing device requirement for "Mac entrypoint_dart_registrant" (#101599)
* Added missing device requirement for "Mac entrypoint_dart_registrant"

* renamed task

* removed caches and dependencies
2022-04-11 10:00:16 -07:00
Jim Graham 493323506f
add gradient benchmarks (#101549) 2022-04-08 17:20:22 -07:00
Zachary Anderson 221235c7ed
Delete deferred component test (#101553) 2022-04-08 03:01:08 -07:00
gaaclarke bb300b467e
updated the dependencies for the Mac entrypoint_dart_registrant (#101368) 2022-04-07 13:06:40 -07:00
Flutter GitHub Bot 2999e85315
Marks Linux_android android_choreographer_do_frame_test to be unflaky (#99835) 2022-04-06 16:16:10 -07:00
Flutter GitHub Bot bd4e844a0b
Marks Mac_ios ios_picture_cache_complexity_scoring_perf__timeline_summary to be unflaky (#100227) 2022-04-06 16:15:17 -07:00
Flutter GitHub Bot db1074202f
Marks Windows gradle_plugin_fat_apk_test to be flaky (#101429) 2022-04-06 15:56:30 -07:00
Flutter GitHub Bot 17398fd828
Marks Mac_ios native_ui_tests_ios to be flaky (#101427) 2022-04-06 13:31:10 -07:00
Flutter GitHub Bot d08f7ab9c9
Marks Mac run_release_test_macos to be unflaky (#101055) 2022-04-06 12:57:01 -07:00
Flutter GitHub Bot 3201d590fd
Marks Linux_android shader_mask_cache_perf__e2e_summary to be unflaky (#101424) 2022-04-06 12:55:35 -07:00
Flutter GitHub Bot 49c978a59c
Marks Linux_android complex_layout__start_up to be unflaky (#101425) 2022-04-06 10:06:09 -07:00
Zachary Anderson f42f7d19aa
Remove redundant timeline_summary benchmarks from ci.yaml (#101372) 2022-04-05 14:01:08 -07:00
Casey Hillers 6bb36bbcc4
Revert roller back to LUCI scheduler (#101371) 2022-04-05 13:23:52 -07:00
Casey Hillers d6cc67d529
[ci.yaml] Revert every target except roller back to luci scheduler (#101323) 2022-04-05 09:24:45 -07:00
Jenn Magder 1429957aa4
Remove gems dependency from tests that do not use it (#101210) 2022-04-04 15:21:11 -07:00
Flutter GitHub Bot 4d50f51915
Marks Mac_ios native_ui_tests_ios to be unflaky (#97670) 2022-04-04 15:16:10 -07:00
Flutter GitHub Bot d60272a203
Marks Windows module_custom_host_app_name_test to be unflaky (#99407) 2022-04-04 11:58:05 -07:00
Flutter GitHub Bot 92877a648a
Marks Windows module_test to be unflaky (#99408) 2022-04-04 11:57:17 -07:00
Yegor 72ecaf7411
[web] reenable canvaskit benchmarks (#101155) 2022-04-01 12:48:34 -07:00
Casey Hillers e298c79032
[ci.yaml] Revert all devicelab tests back to LUCI scheduler (#101124) 2022-03-31 12:30:12 -07:00
Emmanuel Garcia 5c6918933e
Migrate AGP and Gradle versions to 7.1.2/7.4 (#99723) 2022-03-30 20:30:09 -07:00
Flutter GitHub Bot d9de75aa52
Marks Mac_ios large_image_changer_perf_ios to be flaky (#101060) 2022-03-30 11:20:18 -07:00
Flutter GitHub Bot a171f3069a
Marks Mac_ios post_backdrop_filter_perf_ios__timeline_summary to be unflaky (#101054) 2022-03-30 10:05:16 -07:00
Emmanuel Garcia 032205eaca
Reland: "Use texture layer when displaying an Android view" (#100990) 2022-03-29 19:40:17 -07:00
gaaclarke 912873baa7
Relands "Starts using the --source flag to compile the dart registrant. (#98046)" (#100572) 2022-03-28 18:15:10 -07:00
Casey Hillers 810784842a
Revert some targets back to LUCI scheduler (#100898) 2022-03-28 09:50:10 -07:00
wangying 712abb08e2
Add benchmark for ShaderMask RasterCache (#100127) 2022-03-28 00:15:07 -07:00
Zachary Anderson 8acbf54930
Adds an impeller variant of the new gallery transition perf benchmark (#100837) 2022-03-26 22:12:48 -07:00
Jenn Magder 46642320ce
Mark integration_ui_ios_textfield unflaky (#100661) 2022-03-25 18:00:08 -07:00
Casey Hillers b346a59337
[ci.yaml] Migrate bringup tasks to cocoon scheduler (#100766) 2022-03-25 12:29:15 -07:00
Flutter GitHub Bot 613f16c1e4
Marks Mac_ios route_test_ios to be unflaky (#100631) 2022-03-23 11:00:07 -07:00
Flutter GitHub Bot 59e4bf8bd3
Marks Mac dart_plugin_registry_test to be unflaky (#100630) 2022-03-23 10:55:09 -07:00
Chris Bracken 4b819782fb
[macOS] Add run release test in devicelab (#100526)
Adds a test that invokes flutter run in release mode on macOS desktop,
waits for successful launch and the flutter command list, then sends the
'q' command to quit the running app.

This adds an integration test for https://github.com/flutter/flutter/pull/100504.

Issue: https://github.com/flutter/flutter/issues/100348 (fix)
Issue: https://github.com/flutter/flutter/issues/97978 (partial fix)
Issue: https://github.com/flutter/flutter/issues/97977 (partial fix)
Umbrella issue: https://github.com/flutter/flutter/issues/60113
2022-03-22 14:12:59 -07:00