Commit graph

1285 commits

Author SHA1 Message Date
Jim Graham b8d21ad357
Remove the flaky flag from post-bdf benchmark (#69591) 2020-11-06 15:29:04 -08:00
Jonah Williams 75e8428b6b
mark flutter_gallery_sksl_warmup__transition_perf_e2e_ios32 as flaky (#69970) 2020-11-06 10:58:41 -08:00
Dan Field 76784651d4
Move package:integration_test to flutter/flutter (#69622) 2020-11-05 17:28:47 -08:00
Jonah Williams e8efde6a54
[versions] update more null safe versions (#69892) 2020-11-05 09:09:03 -08:00
Jenn Magder 3145c835ed
Deprecate build ios-framework --universal (#69720) 2020-11-04 19:44:04 -08:00
Jonah Williams 580cacf4bd
[versions] roll versions (#69810) 2020-11-04 15:38:58 -08:00
Jonah Williams c985fd35cd
[devicelab] re-land cocoon auto-restart (#69710)
Due to #69707 the SkSL tests need the process killing logic still.
2020-11-03 13:20:40 -08:00
Jenn Magder 91b82347af
Build App.framework directly to build directory (#69699) 2020-11-03 12:48:25 -08:00
Emmanuel Garcia 212967449b
Update plugins dependencies for the Gallery test (#69630) 2020-11-03 12:03:18 -08:00
Jonah Williams ea3551b058
Revert "[devicelab] reboot attached devices after 30 test runs (#69447)" (#69703)
This reverts commit 406ca0bc59.
2020-11-03 11:13:19 -08:00
Yegor 9e5d22d101
Say [APP] instead of [Gallery] in web benchmarks (#69624) 2020-11-03 10:13:07 -08:00
Jonah Williams 406ca0bc59
[devicelab] reboot attached devices after 30 test runs (#69447) 2020-11-03 10:10:55 -08:00
Jonah Williams 059cd3185c
mark flutter_gallery__transition_perf_e2e_ios32 flaky (#69696) 2020-11-03 10:08:32 -08:00
Greg Spencer c0ef94780c
Fix spelling errors (#69451)
My yearly pass to fix spelling errors in the API dartdocs.
2020-10-31 03:12:27 -07:00
Jenn Magder bb495ba90c
Do not fail if average_memory_usage is not recorded (#69339) 2020-10-29 16:09:50 -07:00
Jenn Magder 71c09484fd
Mark flutter_gallery_sksl_warmup__transition_perf_e2e_ios32 as unflaky (#69338) 2020-10-29 16:07:03 -07:00
Jonah Williams 31c96b5d83
[devicelab] do not fail test if CPU measurement is not recorded (#69268) 2020-10-29 09:32:34 -07:00
Jonah Williams 18341efa2f
[devicelab] retry startup of start up test (#69272) 2020-10-29 09:19:07 -07:00
Jonah Williams 83d4351e0c
[devicelab] work around occasional null values for devtools (#69273)
* [devicelab] work around occasional null values for devtools

* Update perf_tests.dart
2020-10-29 09:18:38 -07:00
Jenn Magder 13896b3bd1
Decrease device discovery timeout from 10 to 5 seconds (#69266) 2020-10-28 19:43:19 -07:00
Jenn Magder 135aab9cf5
Increase device run perf test timeout (#69260) 2020-10-28 18:29:04 -07:00
Jonah Williams d306c37bc4
[flutter_tools] fix --use-existing-app (#69237) 2020-10-28 13:55:29 -07:00
Jonah Williams 3b9ef2e8de
[devicelab] mark routing test as flaky (#69228) 2020-10-28 12:11:58 -07:00
Jonah Williams 18f0a2288e
[flutter_tools] update to vm_service 5.2.0, update to dwds 7.0.0 (#69067)
Rolls in several fixes to web tooling, including better handling of absolute file imports. Updates to latest vm service to unblock null safety mode query

Co-authored-by: Gary Roumanis <grouma@google.com>
Co-authored-by: Anna Gringauze <annagrin@google.com>
2020-10-27 13:55:32 -07:00
Jacob MacDonald 193fe3e980
Update null safe deps to prepare for the 2.12 sdk version (#69041)
* update pinned null safety deps

* run update-packages

* add http dep to devicelab package

* rerun update-packages
2020-10-26 14:31:13 -07:00
Jonah Williams 2c12a8d917
[devicelab] remove twc enabled test and uncaught image test (#68518) 2020-10-24 13:19:51 -07:00
Jonah Williams 9f6b575ef1
[devicelab] mark uncaught exceptions as flaky (#68906)
* [devicelab] mark uncaight exceptions as flaky

* add print error output

* try and fix test
2020-10-23 12:32:08 -07:00
Jonah Williams d75cda9d82
[devicelab] never run pub (#68900) 2020-10-23 11:13:25 -07:00
Jonah Williams f0ecfff3ca
[devicelab] mark twc as flaky and fix flutter test perf (#68895) 2020-10-23 10:39:33 -07:00
Casey Hillers ce3ce20b14
[devicelab] Upload git branch (#68541) 2020-10-23 08:02:02 -07:00
Casey Hillers d2314ecfa9
[Doc Fixit 2020] Move dashboard documentation to flutter/cocoon (#68822) 2020-10-23 06:37:03 -07:00
Jonah Williams 37042fdb08
[flutter_tools] remove iOS screenshot on failure functionality (#68650)
* [flutter_tools] remove iOS screenshot on failure functionality

* remove all screenshot code
2020-10-22 13:34:07 -07:00
Yuqian Li 8a25557619
Mark the test as flaky again (#68636)
It seems that I was lucky to see 10 consecutive successes. Now the test
seems to be quite flaky again.
2020-10-20 11:58:49 -07:00
Jonah Williams 0e1c3fc7c4
[devicelab] remove commands test (#68539) 2020-10-20 09:50:06 -07:00
Jonah Williams ab20ae782a
[devicelab] uinstall during memory test (#68548) 2020-10-20 09:49:50 -07:00
Jonah Williams 938fae9c99
remove --machine flag (#68538) 2020-10-19 17:06:28 -07:00
Jonah Williams a152c0f429
[devicelab] reland: reduce iterations of startup test, use application binary (#68532)
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.

The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5

Uninstall the app after each run so temp storage does not fill up.
2020-10-19 16:51:28 -07:00
Yuqian Li 91a5a1e7f9
Mark e2e ios32 warmup test as nonflaky (#68511) 2020-10-19 15:52:05 -07:00
Jonah Williams 4a3e2a1af5
Revert "[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests (#68516)" (#68531)
This reverts commit a4c2075a45.
2020-10-19 15:05:46 -07:00
Jonah Williams 8262f808ba
Revert "[devicelab] fix flutter gallery app name (#68528)" (#68530)
This reverts commit 0f69f8e53b.
2020-10-19 15:05:10 -07:00
Jonah Williams 0f69f8e53b
[devicelab] fix flutter gallery app name (#68528) 2020-10-19 14:48:05 -07:00
Jonah Williams a4c2075a45
[devicelab] reduce iterations, uninstall at end, and use --application-binary in all startup tests (#68516)
These devicelab tests are incredibly flaky. Currently they will build & install the same application 15 times. This causes the temp storage to fill up on android, and has a good chance of flaking on iOS due to install issues.

The change from 3 to 15 increased total test time for 2 -> 12 minutes on iOS, or roughly 5 more test equivalents for every single iOS test. Reduce the iteration count back to 5

Uninstall the app after each run so temp storage does not fill up.
2020-10-19 14:16:04 -07:00
Casey Hillers 1c35091a13
[devicelab] Cocoon client (#68333) 2020-10-19 13:12:04 -07:00
Jonah Williams e8dc7a2e17
[devicelab] update hostonly tests to use flutter directly or precache deps (#68487)
Fixes #67370

By running most of these executions through flutter, we get the benefit of the flutter error handling and precaching. IN the test where this is not feasible, call pre-cache directly.
2020-10-19 13:01:50 -07:00
Jonah Williams 03db9bf918
[devicelab] migrate defines test to DriverTest (#68407)
Removes one-off handling for defines test and forces it to run through the DriverTest interface
2020-10-19 12:28:43 -07:00
Jonah Williams 223df0c351
[devicelab] split end to end tests into driver targets (#68410)
Split the integration_ui target into individual driver tests. Remove disabled screenshot tests
2020-10-19 12:28:13 -07:00
Jonah Williams e422d5c724
[flutter_tools] reland: --no-android-gradle-daemon in devicelab (#68491)
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.

Example:

flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 10:27:58 -07:00
Jonah Williams ed5482de19
Revert "[flutter_tools] add --android-gradle-daemon option, use in devicelab (#68409)" (#68489)
This reverts commit ddab72e79f.
2020-10-19 09:33:52 -07:00
Jonah Williams ddab72e79f
[flutter_tools] add --android-gradle-daemon option, use in devicelab (#68409)
Remove devicelab specific code for shutting down gradle daemon, add --android-gradle-daemon option to build/run/drive`. Avoids need for un-tested devicelab specific handler. There are also some feature requests for this, so 2 birds one stone.

Example:

flutter build apk --no-android-gradle-daemon will pass --no-daemon on to gradle
2020-10-19 09:12:21 -07:00
Alexandre Ardhuin c0176c9ee5
use_is_even_rather_than_modulo (#68301) 2020-10-16 20:20:00 +02:00