Commit graph

1052 commits

Author SHA1 Message Date
Loïc Sharma 80d6c10596
[Tool] [Windows] Output app path on build completion (#122858)
[Tool] [Windows] Output app path on build completion
2023-03-17 20:53:40 +00:00
Jonah Williams 7ce6ddabab
[gallery] roll gallery to 6a8d738c94d0710e229d726729c09fdb5ccaf7ed (#122747)
[gallery] roll gallery to 6a8d738c94d0710e229d726729c09fdb5ccaf7ed
2023-03-15 21:22:03 +00:00
Jenn Magder e2e313ecf6
Take screenshot on devicelab failure (#122249)
Take screenshot on devicelab failure
2023-03-15 02:13:21 +00:00
Jonah Williams e98c53751e
Revert "[Impeller] Temporary flag flip for devicelab tests to use Impeller redux. (#122340)" (#122362)
Revert "[Impeller] Temporary flag flip for devicelab tests to use Impeller redux."
2023-03-10 16:16:30 +00:00
Jonah Williams de399511d6
[Impeller] Temporary flag flip for devicelab tests to use Impeller redux. (#122340) 2023-03-09 17:45:17 -08:00
stuartmorgan 449a5bc757
Enable plugin_test_linux (#120912)
Enable plugin_test_linux
2023-03-09 00:41:34 +00:00
Jonah Williams 4adb299566
Revert "[Impeller] Temporary flag flip for devicelab tests to use Impeller. (#122224)" (#122236)
This reverts commit 21b8b7297f.
2023-03-08 14:04:25 -08:00
Jonah Williams 21b8b7297f
[Impeller] Temporary flag flip for devicelab tests to use Impeller. (#122224)
[Impeller] Temporary flag flip for devicelab tests to use Impeller.
2023-03-08 21:41:51 +00:00
Jenn Magder a16e620ec2
Funnel devicelab tests through utils process methods (#122161)
Funnel devicelab tests through utils process methods
2023-03-08 19:44:40 +00:00
Ben Konyi ecd7518df5
Reland "Remove references to Observatory (#118577)" (#121606)
This reverts commit 275ab9c69b.
2023-02-28 11:57:04 -05:00
Michael Goderbauer 275ab9c69b
Revert "Reland "Remove references to Observatory (#118577)" (#121215)" (#121555)
Revert "Reland "Remove references to Observatory (#118577)""
2023-02-27 23:46:53 +00:00
Ben Konyi fbae472fc3
Reland "Remove references to Observatory (#118577)" (#121215)
This reverts commit 298d8c76ba.
2023-02-27 09:26:43 -05:00
Lioness100 26b6c1bedd
Fix typos (#121171)
* Fix typos

* lowercase animated & opacity

* Undo typo fix

---------

Co-authored-by: Michael Goderbauer <goderbauer@google.com>
2023-02-23 19:43:21 +00:00
Casey Hillers 298d8c76ba
Revert "Remove references to Observatory (#118577)" (#120929)
This reverts commit 2df140f40d.
2023-02-16 21:28:30 -08:00
stuartmorgan e00241a060
Enable Windows plugin tests (#119345)
* Fix binary path

* Enable in presubmit
2023-02-16 21:21:10 +00:00
Michael Goderbauer 34102ca3bb
Migrate channels to pkg:integration _test (#120833)
* migrate to integration_test framework

* Update embedding
2023-02-16 18:55:32 +00:00
stuartmorgan e65dfba8e1
Add Linux unit tests to plugin template (#120814)
* Add Linux unit tests to plugin template

Adds an example native unit test to the plugin template for Linux,
matching the structure we use for our 1P plugin unit tests. Once these
have been added for all platforms+languages, they will be documented on
a new plugin development page to explain their use.

While ideally we would adjust the engine APIs first to allow for testing
the method call handler directly, it's unclear when we will have time
for that work, and for a complex plugin most of the testing wouldn't be
at that layer anyway, so having the structure in place with the
limitations documented is still a significant improvement over having
nothing in the template.

Part of https://github.com/flutter/flutter/issues/82458

* Add creation test

* Add integration tests

* Missing newlines

* test owner

* Typo
2023-02-15 19:13:11 +00:00
stuartmorgan ef49f5661b
Add Android unit tests to plugin template (#120720)
* Add Java tests

* Add Kotlin

* Add integration testing

* Add cerate tests
2023-02-15 17:25:23 +00:00
gaaclarke ddebe833b0
Added integration test for wide gamut support. (#119657)
* Added integration test for wide gamut support.

* cleaned up

* deleted files that can be generated

* switched back to standard flutter in the shell script

* added devicelab task

* removed analysis options

* analyzer

* Fixed task

* made local_run.sh not executable

* analyzer

* removed the logo asset

* added task to ci

* updated pubspec

* analysis errors fixed

* updated pubspec
2023-02-13 22:33:19 +00:00
Ben Konyi 2df140f40d
Remove references to Observatory (#118577)
Observatory is being deprecated for Dart 3.0 so it should no longer be
referenced in tooling messaging / flags.

See https://github.com/dart-lang/sdk/issues/50233
2023-02-13 14:29:30 -05:00
Daco Harkes cd3806337c
Update gallery.dart (#120366)
Incorporating:

* https://github.com/flutter/flutter/issues/120260
2023-02-09 16:37:09 +00:00
Loïc Sharma ef854a3db0
[Tool] [Windows] Output build duration (#120311)
* [Tool][Windows] Output build duration

* Tweak

* Format
2023-02-08 23:24:42 +00:00
Andrew Kolos fd76ef0f26
Reland "Add API for discovering assets" (#119277)
* add asset manifest bin loading and asset manifest api

* use new api for image resolution

* remove upfront smc data casting

* fix typecasting issue

* remove unused import

* fix tests

* lints

* lints

* fix import

* revert image resolution changes

* Update image_resolution_test.dart

* Update decode_and_parse_asset_manifest.dart

* make targetDevicePixelRatio optional

* Update packages/flutter/lib/src/services/asset_manifest.dart

Co-authored-by: Jonah Williams <jonahwilliams@google.com>

* Update packages/flutter/lib/src/services/asset_manifest.dart

Co-authored-by: Jonah Williams <jonahwilliams@google.com>

* fix immutable not being imported

* return List in AssetManifest methods, fix annotation import

* simplify onError callback

* make AssetManifest methods abstract instead of throwing UnimplementedError

* simplify AssetVariant.key docstring

* tweak _AssetManifestBin docstring

* make AssetManifest and AssetVariant doc strings more specific

* use List.of instead of List.from for type-safety

* adjust import

* change _AssetManifestBin comment from doc comment to normal comment

* revert to callback function for onError in loadStructuredBinaryData

* add more to the docstring of AssetManifest.listAssets and AssetVariant.key

* add tests for CachingAssetBundle caching behavior

* add simple test to ensure loadStructuredBinaryData correctly calls load

* Update asset_manifest.dart

* update docstring for AssetManifest.getAssetVariants

* rename getAssetVariants, have it include main asset

* rename isMainAsset field of AssetMetadata to main

* (slightly) shorten name of describeAssetAndVariants

* rename describeAssetVariants back to getAssetVariants

* add tests for TestAssetBundle

* nits

* fix typo in docstring

* remove no longer necessary non-null asserts

* update gallery and google_fonts versions

---------

Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2023-02-02 15:17:15 +00:00
stuartmorgan e3c51a2f2a
Add Windows unit tests to plugin template (#118638)
* Add Windows unit tests to plugin template

Adds an example native unit test to the plugin template for Windows,
matching the format we use for our 1P plugin example app unit tests.
Once these have been added for all platforms+languages, they will be
documented on a new plugin development page to explain their use.

Since we don't appear to be running our current plugin e2e tests for
Windows, this adds a new configuration to run them. I haven't
`led`-tested this, so it may not work, but this will give a starting
point for getting them running.

Part of https://github.com/flutter/flutter/issues/82458

* Minor fix

* Add test owner

* Fix typo

* Fix test feature flag
2023-01-24 18:23:57 +00:00
Michael Goderbauer ab3c82244e
Remove unnecessary null checks in dev/devicelab (#118842) 2023-01-20 18:56:44 +00:00
Ricardo Amador f989d551ce
Devicelab android emulator (#113472)
* Testing whether emulator is possible.

* Adding changes to see if emulator can be used from recipe.

* adding emulator support.

* Add the emulator flag for testing.

* Using string for boolean since it cannot be parsed in properties

* Checking to see if these changes are being used.

* Updated bool back to string

* Remove trailing whitespace from file.
2023-01-17 22:01:11 +00:00
Loïc Sharma cea55d99d0
[Linux] Add a 'flutter run' console output test (#118279)
* Add Linux support for the UI integration test project

* Add Linux run console test
2023-01-13 19:17:12 +00:00
Jenn Magder eaaacdcba9
Allow iOS and macOS plugins to share darwin directory (#115337) 2023-01-09 10:33:03 -08:00
stuartmorgan 2a502363e1
Add native unit tests to iOS and macOS templates (#117147)
* Improve Swift plugin implementation

* Add iOS tests

* Review feedback on structure

* Remove duplicate scheme file

* Add macOS

* Add iOS

* swift test tweaks

* unit tests

* Whitespace

* Add e2e tests
2022-12-21 19:10:22 +00:00
Michael Goderbauer fdd2d7d64a
Sync analysis_options.yaml & cleanups (#117327) 2022-12-20 14:15:39 -08:00
Jason Simmons 7336312b0b
Do not filter the stderr output of "flutter run" in the devicelab run tests (#117188) 2022-12-16 01:57:14 +00:00
Loïc Sharma 028c6e29e0
[Android] Fix the run_debug_test_android device lab test (#117016)
* Fix

* Format

* DO NOT MERGE! Test in presubmit

* Revert "DO NOT MERGE! Test in presubmit"

This reverts commit 41c7186c72.
2022-12-14 05:18:21 +00:00
Loïc Sharma 41625b6620
Test flutter run does not have unexpected engine logs (#116798) 2022-12-12 22:39:49 +00:00
Siva 7c8e171320
Manual Roll of Flutter Engine from 67254d6e4b03 to 8d83b98c55b3 (#116635)
* Roll Flutter Engine from 67254d6e4b03 to 8d83b98c55b3

* Roll Dart SDK from 35a9facce191 to e517487c5679 (Dart 3.0) (#38105)

* Bump SDK versions.

* Bump Dart SDK version constraints

* Update shrine package to 2.0.1 (null safe version)

* Fix more tests.

* Include patches from Jason for min android sdk version

* Fix analyzer warning
2022-12-08 18:03:51 -08:00
Loïc Sharma bebea0cc6c
[Windows] Add a flutter run console output test (#116626)
Adds a test to verify the console output of `flutter run --release` on Windows.

Part of: https://github.com/flutter/flutter/issues/111577
2022-12-08 14:05:53 -08:00
Loïc Sharma 30c575140a
[Android] Refactor the flutter run Android console output test (#115023)
* [Android] Refactor the flutter run Android console output test

* CI bump
2022-12-06 21:57:25 +00:00
Jonah Williams 08a2635e2b
[devicelab] add benchmark for complex non-intersecting widgets with platform views (#116436) 2022-12-02 21:37:45 +00:00
Christopher Fujino e62b6e7997
Track entire web build directory size in web_size__compile_test (#115682)
* wip

* add track entire web build output dir size

* add more fields

* migrate metrics to use bytes rather than kb

* update keys

* use -9 on tar cz

* delete tempDir and tar first before measuring size
2022-11-30 22:06:58 +00:00
Jonah Williams dfa3d33328
[devicelab] track performance of animated image filter (#115850)
* [devicelab] track performance of animated image filter

* ++

* make animations repeat and add dispose

* make duration more consistently 10sec
2022-11-29 01:59:19 +00:00
Jonah Williams 9379c3233c
Revert "[devicelab] measure entire release folder size, zipped (#115612)" (#115617)
This reverts commit 0b33b85928.
2022-11-17 18:13:49 -08:00
Jonah Williams 0b33b85928
[devicelab] measure entire release folder size, zipped (#115612)
* [devicelab] measure entire release folder size, zipped

* [devicelab] tar with more settings

* super safe reland

* Update perf_tests.dart
2022-11-18 01:54:54 +00:00
Jonah Williams ec03f1c8c4
Revert "[devicelab] measure entire release folder size, zipped (#115597)" (#115609)
This reverts commit 75a0a72555.
2022-11-17 16:27:49 -08:00
Jonah Williams 75a0a72555
[devicelab] measure entire release folder size, zipped (#115597) 2022-11-18 00:03:49 +00:00
Loïc Sharma 9797d5f1cb
[macOS] Refactor the flutter run macOS console output test (#114645) 2022-11-08 23:00:04 +00:00
Chris Bracken 15867a612f
Roll gallery to b6728704a6441ac37a21e433a1e43c990780d47b (#114537) 2022-11-02 20:47:06 +00:00
Christopher Fujino 0211df9cfc
[flutter_tools] provide --timeout option to flutter drive (#114458) 2022-11-02 18:43:42 +00:00
Jenn Magder 4d28e6d064
Terminate simulator app on "q" (#113581) 2022-10-18 22:26:16 +00:00
Andrew Kolos eec8d9d9cc
Add asset manifest parsing benchmark (#112836) 2022-10-07 13:39:35 +00:00
Jenn Magder 35afe1bdac
Stop embedding bitcode for iOS in tool (#112831) 2022-10-04 01:41:23 +00:00
Jenn Magder 94b740ad6d
Roll gallery for devicelab tests (#112509) 2022-09-28 18:13:24 +00:00
Jason Simmons b31f41bd1a
Unlock the device before running a StartupTest benchmark (#112243) 2022-09-23 14:38:09 +00:00
jensjoha b7b8b759bc
Add flutter startup benchmark (#111658)
Add flutter startup benchmark for Linux, Windows and MacOs.

Via guide on https://github.com/flutter/flutter/pull/111461#issuecomment-1247113905
2022-09-16 08:41:30 +02:00
Gary Qian a8a6fe2fb1
Reland "Add initial compile tests #109177" (#111562) 2022-09-14 19:35:16 +00:00
Jenn Magder 489094ad98
Quiet iOS native test result zipping (#111434) 2022-09-13 23:08:41 +00:00
Sigurd Meldgaard d80e994a62
Reland: Show output from pub get in flutter pub get (#110851) 2022-09-08 15:13:23 +02:00
keyonghan ab77e43566
Migrate Linux android gallery e2e and hybrid tests to build+test (#110533) 2022-09-07 20:19:20 +00:00
Jenn Magder a4530b7c12
Make module tests pass on Xcode 14 (#110556) 2022-08-30 18:51:20 +00:00
Jenn Magder 99372ba1e4
Revert "Add initial compile tests (#109177)" (#110550)
This reverts commit 3437fd9c03.
2022-08-29 17:46:31 -07:00
Gary Qian 3437fd9c03
Add initial compile tests (#109177) 2022-08-29 23:12:22 +00:00
Stephen (Alex) Wallen 2f3ba1a313
Readability revisions for #109891 (#110348) 2022-08-29 18:23:16 +00:00
Zachary Anderson d0c8774508
Fix microbenchmarks_impeller_ios (#110392) 2022-08-27 04:21:12 +00:00
Zachary Anderson 056f11060f
Add several new iOS/Impeller benchmarks (#110358) 2022-08-26 14:06:26 -07:00
Jonah Williams f0ffc85698
Add bad scroller benchmark (#110362) 2022-08-26 18:50:07 +00:00
Loïc Sharma 4898f1f5c5
[Windows] Add app startup integration test (#110114)
Add a basic integration test for the Windows's app startup. In a subsequent change (https://github.com/flutter/flutter/pull/109816), this test will be updated to verify the app's window isn't visible until after the first frame has been drawn.

Part of https://github.com/flutter/flutter/issues/41980
2022-08-25 18:54:20 -07:00
Stephen (Alex) Wallen 27bfc511ba
[macOS] Bring up "complex_layout" devicelab, startup tests for x64 (#110100) 2022-08-25 23:35:00 +00:00
Stephen (Alex) Wallen d71a8a7093
[macOS] Bring up "hello_world" devicelab, compilation test for x86. (#109891) 2022-08-24 18:04:42 +00:00
keyonghan 8027842393
Copy artifacts to applicationBinaryPath when specified for build+test separation (#109879) 2022-08-23 16:32:39 +00:00
Zachary Anderson d79a3d7a19
Remove most benchmarks of SkSL warmup (#110040) 2022-08-22 22:31:54 +00:00
Camille Simon 7db25c36ad
Re-land Add Spell Check to EditableText (#109643) 2022-08-17 16:16:02 +00:00
yaakovschectman 4e068a613e
Bring up new Windows start-up tests (#109618)
* Add Windows startup test

* Add new tests for Windows desktop

* Bring up complex layout tests for Win Desktop

* Bring up flutter_view startup test for Windows

* Add Platform View startup test for Windows

* Fix typo in .ci.yaml

* Make basename variable final

* Link to bug in .ci.yaml
2022-08-17 09:38:41 -04:00
Jonah Williams 0ba88d8b43
Revert "Add Spellcheck to EditableText (Android) (#109334)" (#109631)
This reverts commit ff9fe35682.
2022-08-16 14:30:03 -07:00
Camille Simon ff9fe35682
Add Spellcheck to EditableText (Android) (#109334) 2022-08-16 18:22:45 +00:00
yaakovschectman bba2ac83b1
Add Compilation DeviceLab test for Windows (#109540)
* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete asset from repo

* Add Windows compilation test (hello_world_windows__compile)

* Add devicelab target to .ci.yaml

* Bringup on new target

* Add license to generated files

* Indicate test ownership

* Delete icon

* Use path.basename

Re triggering tests

* Update test owner to desktop team
2022-08-15 16:26:02 -04:00
Michael Goderbauer 10a7c9ba22
Unify analysis options (#108462) 2022-07-28 09:07:49 -07:00
gaaclarke d98297a2f9
Added benchmark for debugBuildProfileEnabledUserWidgets (#101444) 2022-07-27 02:42:06 +00:00
Kaushik Iska f7504f0380
[openpay] Create an OpenPay benchmark (#107838) 2022-07-21 20:01:06 +00:00
ColdPaleLight 1919167540
Added benchmark for early removal of unused raster cache entris mecha… (#107918) 2022-07-20 19:13:06 +00:00
Alexandre Ardhuin ccd33631e3
enable combinators_ordering (#107847) 2022-07-18 22:04:07 +00:00
Alexander Biggs 7db73c0a93
[fuchsia] Change format of ffx call to debug spam. (#105169) 2022-07-10 22:51:06 +00:00
Alexander Aprelev 9d00787791
Add build-after-edit benchmark (#107192)
* Add build-after-edit benchmark

* Clean up analyzer warnings

* Restore line break
2022-07-06 19:19:07 -07:00
stuartmorgan 6c6ae06381
Add Windows to the platform_channels example (#106754) 2022-06-30 14:54:07 +00:00
JsouLiang f0200f0106
Add benchmark case for RasterCache (#103338) 2022-06-29 23:54:10 +00:00
hellohuanlin 0dd0c2edca
[platform_view]Send platform message when platform view is focused (#105050) 2022-06-23 00:01:07 +00:00
gaaclarke d88212c89c
added microbenchmark for loading assets (#105982) 2022-06-16 18:16:07 +00:00
Jenn Magder 3f1f0a8170
Add flutter build macos-framework command (#105242) 2022-06-03 10:13:08 -07:00
Dan Field be7a4227c7
Add a macrobenchmark for laying out text in a list (#104736) 2022-05-26 15:25:10 -07:00
gaaclarke 64a0c19652
switched to a double variant of clamp to avoid boxing (#103559) 2022-05-18 13:26:08 -07:00
Pierre-Louis a5589dd828
Roll gallery for device lab tests (#103993) 2022-05-17 23:07:08 -07:00
Jenn Magder 036cae3669
Enforce minimum plugin version iOS 11 (#103545) 2022-05-13 10:04:10 -07:00
wangying b3d7a691f6
Add benchmark for clipper layers raster cache (#102495)
* Add clipper raster cache benchmarks

* fix ci test error

* Add PhysicalModel widget to test

* Set top margin adaptive screen height

* Remove PhysicalModel
2022-05-13 14:04:06 +08:00
keyonghan abebd8b7b7
Separate build and test for flutter_gallery__transition_perf task (#103550) 2022-05-12 09:54:10 -07:00
Zachary Anderson 7be261a1bb
Wait longer for the vmservice out file to appear (#103513)
An hour is likely longer than the CI timeout.

Fixes https://github.com/flutter/flutter/issues/103504
2022-05-11 12:37:35 -07:00
Jonah Williams c1b909e3fc
add image load benchmark (#103459) 2022-05-10 22:49:08 -07:00
Christopher Fujino 09686a04c9
[flutter_tools] add --uninstall-first flag and pipe it through to ios-deploy (#102948) 2022-05-07 11:49:07 -07:00
Jenn Magder c6ced845e3
Remove custom unawaited, prefer dart:async version (#103212) 2022-05-07 08:49:04 -07:00
Alexandre Ardhuin d40ee2149c
remove unnecessary .toString() (#103226) 2022-05-06 16:04:13 -07:00
Phil Quitslund 20f029e3bc
[devicelab, flutter_test, ...] rename local functions with _s (#102833) 2022-05-03 10:29:06 -07:00
Alexandre Ardhuin 07f1c20474
add missing trailing commas in list/set/map literals (#102585) 2022-04-27 09:15:35 +02:00
Jonah Williams 63574cf76a
add benchmark for animated complex opacity (#102532) 2022-04-25 18:14:06 -07:00
gaaclarke 1ac368280f
Increased StandardMethodCodec's WriteBuffer start capacity (#101860)
* Added standard method codec benchmark

* increased writebuffer start size

* added const
2022-04-20 14:35:34 -07:00
Jenn Magder 88eca6c1ce
Fail integration test if expected bitcode markers not found (#102016) 2022-04-19 13:29:06 -07:00
gaaclarke e6f3022890
Adds StandardMessageCodec benchmark (#101767) 2022-04-12 16:34:10 -07:00
Jim Graham 493323506f
add gradient benchmarks (#101549) 2022-04-08 17:20:22 -07:00
Casey Hillers 3109073fd9
[devicelab] Remove legacy devicelab manifest logic (#101554) 2022-04-08 09:46:08 -07:00
Jenn Magder 68471bbb74
Remove --enable-web and --enable-windows-desktop from tests (#101208) 2022-04-07 15:57:09 -07:00
keyonghan 647044c969
Use separate metric file names for same tests running on different platforms (#101317)
* use separate file names for same test

* use string buffer
2022-04-05 09:16:04 -07:00
Emmanuel Garcia 16ebbdf336
Remove unintended comment (#101130) 2022-03-31 12:35:05 -07:00
Emmanuel Garcia 5c6918933e
Migrate AGP and Gradle versions to 7.1.2/7.4 (#99723) 2022-03-30 20:30:09 -07:00
Michael Goderbauer 195a1cc413
Prepare dev (minus flutter_gallery) for use_super_parameters (#100516) 2022-03-29 12:52:42 -07:00
Michael Goderbauer 43029bebc4
Roll gallery to 03dedee4bc24878fec1c1d1338daffd5b792a29d (#100989) 2022-03-29 12:15:32 -07:00
Michael Goderbauer c4585ecc46
Roll gallery to d63bd9200b6a8ad69d47bdc5e4059fadb9c962c1 (#100979) 2022-03-29 11:02:09 -07:00
gaaclarke 912873baa7
Relands "Starts using the --source flag to compile the dart registrant. (#98046)" (#100572) 2022-03-28 18:15:10 -07:00
wangying 712abb08e2
Add benchmark for ShaderMask RasterCache (#100127) 2022-03-28 00:15:07 -07:00
Zachary Anderson 8acbf54930
Adds an impeller variant of the new gallery transition perf benchmark (#100837) 2022-03-26 22:12:48 -07:00
Chris Bracken 4b819782fb
[macOS] Add run release test in devicelab (#100526)
Adds a test that invokes flutter run in release mode on macOS desktop,
waits for successful launch and the flutter command list, then sends the
'q' command to quit the running app.

This adds an integration test for https://github.com/flutter/flutter/pull/100504.

Issue: https://github.com/flutter/flutter/issues/100348 (fix)
Issue: https://github.com/flutter/flutter/issues/97978 (partial fix)
Issue: https://github.com/flutter/flutter/issues/97977 (partial fix)
Umbrella issue: https://github.com/flutter/flutter/issues/60113
2022-03-22 14:12:59 -07:00
Jenn Magder a165da236d
Remove device unlock from hostonly compile test (#100571) 2022-03-22 13:55:17 -07:00
Chris Yang e6bd208196
Reland "Add the refresh rate fields to perf_test #99710" (#99854) 2022-03-21 15:55:13 -07:00
gaaclarke 97258979df
Revert "Starts using the --source flag to compile the dart registrant. (#98046) (#100493) 2022-03-21 13:40:23 -07:00
Emmanuel Garcia 5e6a653865
Flush and close stdin in dart_plugin_registry_test (#100338) 2022-03-17 19:25:14 -07:00
Emmanuel Garcia 9072a09958
Fix race condition in readJsonResults (#100243) 2022-03-17 13:40:15 -07:00
wangying b4040c867b
Add benchmark for ColorFilter raster cache (#99542) 2022-03-16 19:15:13 -07:00
Emmanuel Garcia cd725e3640
Ensure dart_plugin_registry shows stderr and exits when process exits (#99936) 2022-03-14 12:15:20 -07:00
Jeff Ward 0aab22807c
First pass at using platform abstraction for plugins (#92672) 2022-03-09 14:10:21 -08:00
Zachary Anderson 5f76ac35bc
Revert "Add the refresh rate fields to perf_test (#99710)" (#99801)
This reverts commit a7c85996b8.
2022-03-08 23:04:49 -08:00
Chris Yang a7c85996b8
Add the refresh rate fields to perf_test (#99710) 2022-03-08 17:25:15 -08:00
Jonah Williams 59859df126
Add Windows performance benchmark (#99564) 2022-03-04 15:41:14 -08:00
Emmanuel Garcia f320d14062
Fix lifecycle for API level 28 (#99433) 2022-03-02 18:30:54 -08:00
gaaclarke fdcd14464c
Starts using the --source flag to compile the dart registrant. (#98046)
* Starts using the `--source` flag to compile the dart registrant.

* updated general.shard tests

* Fixed the resident compiler flow

* added integration test

* made the integration test self contained

* renamed generated_main to dart_plugin_registrant

* cleaned up for review

* added task runner for ci

* added bringup and TESTOWNERS

* updated failure message
2022-03-01 16:24:47 -08:00
Emmanuel Garcia 6c818d772a
Add Android lifecycles test (#99319) 2022-03-01 15:26:21 -08:00
Emmanuel Garcia e27f714497
Add regression test for #98973 (#99187) 2022-02-28 10:16:21 -08:00
Tomasz Gucio e4351ff053
Enable use_if_null_to_convert_nulls_to_bools lint (#98753) 2022-02-22 14:39:20 -08:00
gaaclarke a7790d8e3a
Added a microbenchmark for Timeline events. (#98763) 2022-02-22 13:42:50 -08:00
Ben Konyi 729f8c83d2
Update regexp for Observatory/VM Service message parsing for device lab (#98935)
Should unblock https://github.com/flutter/flutter/issues/98930
2022-02-22 10:59:53 -08:00
David Iglesias 93c0c043cf
[devicelab] Web benchmarks now run on Chromium 89+ (#98629) 2022-02-16 19:04:14 -08:00
Ben Konyi 2a2f973120
Update flutter_tools to look for new VM service message (#97683)
* Update flutter_tools to look for new VM service message

The Dart SDK will soon move away from the current Observatory message:

"Observatory listening on ..."

To a new message that no longer references Observatory:

"Dart VM Service listening on ..."

This change updates all tests with mocks to check for the new message
and also adds support for the new message in ProtocolDiscovery.

See https://github.com/dart-lang/sdk/issues/46756

* Fix some parsing locations

* Fix analysis failures

* Update message

* Remove extra comment

* Update message

* Add globals prefix
2022-02-15 07:33:57 -08:00
keyonghan e8bc5c5ace
Support Samsung phone when getting device wakefulness status (#98146) 2022-02-11 12:05:18 -08:00
George Wright ff1e9b7b9e
Add a benchmark for simple DisplayLists to exercise the Raster Cache's cache admission algorithm (#97992) 2022-02-07 21:01:01 -08:00
Emmanuel Garcia 3facdb8717
Pin Gallery to version with updated settings.gradle (#97986) 2022-02-07 15:15:46 -08:00
Jenn Magder 57d5222876
Include -isysroot -arch and -miphoneos-version-min when creating dummy module App.framework (#97689) 2022-02-04 14:50:11 -08:00
Collin Jackson 10fbbafe09
[flutter_tools] Use proper project name in templates (#96373) 2022-02-02 06:50:14 -08:00
Jim Graham 9c934041bd
Add benchmarks to measure impact of alpha saveLayers in DisplayLists (#97336) 2022-01-27 13:25:17 -08:00
Daco Harkes 0e2f51dfd0
FFI plugins (#96225) 2022-01-26 23:44:45 +01:00
Michael Goderbauer 5684b9f69e
Enable no_leading_underscores_for_local_identifiers (#96422) 2022-01-21 14:43:59 -08:00
stuartmorgan 2df7dca858
Fully support Dart-only mobile and macOS plugins (#96183) 2022-01-13 08:30:22 -08:00
Ian Hickson 57f097b532
Refactor devicelab bin/run.dart and other cleanup (#96320) 2022-01-10 13:40:17 -08:00
Zachary Anderson 764c3c18d4
Revert "Add total_ui_gc_time to benchmarks captured (#96125)" (#96137) 2022-01-04 12:14:36 -08:00
Kaushik Iska da9e87021d
Add total_ui_gc_time to benchmarks captured (#96125) 2022-01-04 10:02:21 -08:00
Christopher Fujino 6054eda86b
fix lateinitialization error in devicelab-runner (#94957) 2021-12-28 18:19:16 -08:00
godofredoc e6971136e4
Adds a home method to device classes. (#95103) 2021-12-13 17:09:09 -08:00
Jim Graham ee204880a5
Opacity Peephole optimization benchmarks (#94447) 2021-12-01 01:39:02 -08:00
Jason Simmons 67a8200e24
Roll Gallery for compatibility with the latest Gradle dependencies (#93985)
See https://github.com/flutter/flutter/issues/93975
2021-11-20 17:42:56 -08:00
Core d8034538bd
feat: enable flavor option on test command (#89045) 2021-11-11 09:23:02 -08:00
Greg Spencer 52ae102f18
Adds tool warning log level and command line options to fail on warning/error output (#92031) 2021-11-10 16:13:04 -08:00
Zachary Anderson 3fba55a18d
Revert "Bump Gallery version (#93173)" (#93207)
This reverts commit 36a0bc5b96.
2021-11-06 23:40:10 -07:00
Emmanuel Garcia 36a0bc5b96
Bump Gallery version (#93173) 2021-11-05 17:33:31 -07:00
keyonghan 33be68d9bf
Stop sending metrics to builder name (#92989) 2021-11-05 16:28:02 -07:00
Jenn Magder dc20a6066f
Skip codesigning during native macOS integration tests (#92938) 2021-11-02 16:41:32 -07:00
Emmanuel Garcia 93b3810022
Roll Gallery with updated Gradle lockfiles (#92850) 2021-11-01 10:47:57 -07:00
Ian Hickson 7f7f487abc
Feature/cpu gpu memory gallery transition tests (#92626) 2021-10-28 16:03:03 -07:00
keyonghan 30d3866ab9
Add extra benchmark metrics to test name in addition to builder name (#92530) 2021-10-27 15:33:06 -07:00
keyonghan 7de92e2653
Add devicelab benchmark tags support (#92141) 2021-10-20 15:03:06 -07:00
Jason Simmons 0bf2c9b3b7
Add local engine flag support to the SkSL caching performance benchmark scripts (#91773) 2021-10-14 10:57:32 -07:00
Jia Hao e32201235f
Indicate that only physical iOS devices are supported (#79350) 2021-10-13 10:43:05 -07:00
Ian Hickson f90b019c68
Enable prefer_relative_imports and fix files. (#91573) 2021-10-11 10:28:07 -07:00
Ian Hickson 7b01346c5c
Enable no_default_cases lint (#91530) 2021-10-11 10:23:04 -07:00
Ian Hickson b3f63d38ac
Document why some lints aren't enabled and fix some minor issues. (#91527) 2021-10-09 04:03:03 -07:00
Ian Hickson 61a0add286
Enable avoid_redundant_argument_values lint (#91409) (#91462) 2021-10-08 09:25:14 -07:00
Zachary Anderson b9d2177da0
Revert "Enable avoid_redundant_argument_values lint (#91409)" (#91461)
This reverts commit 5fd259be24.
2021-10-07 21:11:07 -07:00
Ian Hickson 5fd259be24
Enable avoid_redundant_argument_values lint (#91409) 2021-10-07 20:13:02 -07:00
Jenn Magder 4ef6fc1833
Update number of IPHONEOS_DEPLOYMENT_TARGET in plugin_test_ios (#91324) 2021-10-07 10:13:04 -07:00
Dan Field 22c1ca769b
Add a startup test that delays runApp (#91346) 2021-10-06 09:43:02 -07:00
stuartmorgan 8231592d71
Update minimum iOS version in plugin_test (#91099) 2021-10-05 10:33:04 -07:00
Alexander Aprelev 98120d19d3
Add a microbenchmark that measures performance of flutter compute. (#91257)
* Add a microbenchmark that measures performance of flutter compute.

This benchmark should show performance improvements when compute is switched to Isolate.exit

* Fix analyzer warnings, increase warmup iterations

* Fix license header
2021-10-04 14:16:23 -07:00
Jenn Magder be8d29ffc6
Run native_ui_tests_macos in correct directory (#90829) 2021-09-27 17:38:03 -07:00
Jenn Magder 5c79a0c2f4
Run flutter_gallery macOS native tests on presubmit (#89620) 2021-09-22 13:18:07 -07:00
Jim Graham abfb889fff
Add raster cache metrics to timeline summaries (#89393) 2021-09-04 18:31:03 -07:00
Konstantin Scheglov cfd0743d10
Fix UNNECESSARY_TYPE_CHECK_TRUE violations. (#89186) 2021-08-31 15:46:05 -07:00
keyonghan e311e3b3ef
skip staging update (#89137) 2021-08-30 09:26:05 -07:00
keyonghan db4c104c8e
Use task name when uploading metrics to skia perf (#89004) 2021-08-26 22:31:02 -07:00
keyonghan b67e264203
Revert "Skip staging test update to cocoon in test runner (#88835)" (#88971)
This reverts commit 884dfc260d.
2021-08-26 09:41:22 -07:00
Casey Hillers b0950fd567
Revert "Use bucket to check staging test instead of builder name (#88908)" (#88969)
This reverts commit d36f246dcc.
2021-08-26 09:19:50 -07:00
keyonghan d36f246dcc
Use bucket to check staging test instead of builder name (#88908) 2021-08-25 20:36:02 -07:00
keyonghan 884dfc260d
Skip staging test update to cocoon in test runner (#88835) 2021-08-25 11:36:03 -07:00
Jenn Magder 413f88f209
Do not try to codesign during plugin_test_ios (#88834) 2021-08-24 21:36:36 -07:00
keyonghan b468be3030
Use default value for ResultData when uploading metrics from test runner (#88749) 2021-08-24 12:04:03 -07:00
keyonghan 208d312ff0
Upload devicelab test metrics from test runner (#88447) 2021-08-20 12:57:03 -07:00
Jonah Williams 060e4608b1
clean up stale or unnecessary TODOS (#88308) 2021-08-16 21:37:03 -07:00
yusufm fe52e56614
Adding a timeout and retry to upload results step. (#87306)
* Adding a timeout and retry to upload results step.

* Adding tests for retries and timeout.

* Adding async to call

* Fixing sleep to trigger the timeout, and adding addition timeout test.

* Fixing minor typo.

* Fixing some minor flutter style issues.

Co-authored-by: yusufm <mohsinally@google.com>
2021-08-03 13:40:28 -07:00
Casey Hillers 79f377dabe
[devicelab] Only upload results on master (#87125) 2021-07-27 12:49:05 -07:00
Jenn Magder f673c5c58f
Remove obsolete codegen_integration tests (#86962) 2021-07-23 14:56:04 -07:00
Jenn Magder 6881fca7b7
Respect plugin excluded iOS architectures (#86905) 2021-07-23 13:56:03 -07:00
Jenn Magder 81aeb33ce3
Increase Flutter framework minimum iOS version to 9.0 (#86840) 2021-07-22 13:21:05 -07:00
keyonghan a5b9b5774a
Fix the tree (#86691)
* fix type cast error

* update doc
2021-07-19 20:23:45 -07:00
keyonghan 3aeb794298
Extend test runner command to update test flaky status (#86513) 2021-07-19 09:46:03 -07:00
Kaushik Iska df3fe587e8
Validate that min frame number is numeric (#86498) 2021-07-15 17:11:09 -07:00
keyonghan 4d96a3fd50
Rerun devicelab task from test runner (#86394) 2021-07-14 15:23:10 -07:00
William Hesse e01d327239
Always write devicelab test results to a file if the resultsPath option is present (#86393)
Some runs of DeviceLab performance tests are run without a gitBranch option, but
still must save their results to a local file.
2021-07-13 22:00:26 -07:00
Darren Austin 4c96cb26d2
Fixed a cast issue with host_mode_tests.dart. (#86392) 2021-07-13 17:31:02 -07:00
Darren Austin ef5ffd08f6
Migrate devicelab framework code to null safety. (#86325)
(Attempt to reland #85993)
2021-07-13 12:14:50 -07:00
Darren Austin 08ef7752d5
Revert "Migrate core devicelab framework to null safety. (#85993)" (#86269)
This reverts commit 2175e64e4f.
2021-07-11 23:25:25 -07:00