Commit graph

5633 commits

Author SHA1 Message Date
Vyacheslav Egorov 1891636db0 [gardening] Final attempt to fix apply.sh.
Use git cache fetch correctly

TBR=kustermann@google.com

Change-Id: I9245ebc2bb36e4f80e815b0f4557a34f77cbbe84
Reviewed-on: https://dart-review.googlesource.com/c/85289
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-11-23 15:32:40 +00:00
Vyacheslav Egorov 6300b7e0a0 [gardening] Fix apply.sh syntax (no spaces between variable name and =)
TBR=kustermann@google.com

Change-Id: Ia268f69045d91447f5b84ee9a21926b03ecc2f58
Reviewed-on: https://dart-review.googlesource.com/c/85288
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-11-23 15:19:21 +00:00
Vyacheslav Egorov 2fbc6b9a2e [gardening] Make apply.sh script force update git cache used by bots
R=kustermann@google.com

Change-Id: Id03377dbe4a294032d41a612076b933b447fd2f6
Reviewed-on: https://dart-review.googlesource.com/c/85287
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-11-23 15:03:57 +00:00
Vyacheslav Egorov 1ed5f78e9c [gardening] Make apply.sh script fetch before trying to checkout.
TBR=kustermann@google.com

Change-Id: I195100218b7d83eee4647d5baf254c075e7492df
Reviewed-on: https://dart-review.googlesource.com/c/85286
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-11-23 13:48:08 +00:00
Vyacheslav Egorov c62af758ee [gardening] Switch apply.sh script to use bash instead of sh
R=sortie@google.com

Change-Id: I30d39d4edf864d0307d18c8fd095649cfe3ed17c
Reviewed-on: https://dart-review.googlesource.com/c/85284
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-11-23 13:31:15 +00:00
Vyacheslav Egorov 01380ede49 [gardening] Expand 3xHEAD Flutter patch mechanism to support DEPS file changes.
We don't rerun gclient sync after applying patches so changes to Dart
dependencies were not picked up.

Change-Id: I4360ddf7f906ab0552bd3ae8abbe9210a785845a
Reviewed-on: https://dart-review.googlesource.com/c/85282
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-11-23 13:10:25 +00:00
Vyacheslav Egorov ba0222df78 [flutter] Update flutter-engine-linux 3xHEAD patch.
dart2js_info dependency is upgraded to 0.5.15 from 0.5.13

Change-Id: I3077c7953af17c610864d309e9f17e350a560fba
Reviewed-on: https://dart-review.googlesource.com/c/85262
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-11-23 11:37:36 +00:00
Paul Berry e649ed1aa3 Merge commit 'c1daa3276566e48dac6f52742264578092c56a35' into analyzer 2018-11-21 08:47:55 -08:00
Martin Kustermann 8044e32fc5 [infra] Blacklist android device id in attempt to make buildbot builder more stable
This particular device sometimes fails with errors such as:

  * "protocol error"
  * "protocol error (no status)"
  * "device not found"

Change-Id: Iced97ae8f5e891c43436a3d745004517dc59b42c
Reviewed-on: https://dart-review.googlesource.com/c/84905
Reviewed-by: Alexander Thomas <athom@google.com>
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-11-20 21:25:04 +00:00
Alexander Aprelev c8372c00dc Patch hhh flutter flutter as follow-up to https://dart-review.googlesource.com/c/sdk/+/84688
Change-Id: I392ad11684eedee143cab9e90227c6b886e09c12
Reviewed-on: https://dart-review.googlesource.com/c/84960
Reviewed-by: Paul Berry <paulberry@google.com>
Commit-Queue: Alexander Aprelev <aam@google.com>
2018-11-20 20:15:51 +00:00
Alexander Aprelev 57a4f11b64 [gardening] Patch flutter engine post 0ca1c57
Change-Id: I92d9589850fa4b95c4be454a48e9e9782f90b908
Reviewed-on: https://dart-review.googlesource.com/c/84926
Commit-Queue: Alexander Aprelev <aam@google.com>
Reviewed-by: Alexander Aprelev <aam@google.com>
2018-11-20 18:50:06 +00:00
Paul Berry 6d8e14c9db Merge commit 'f56fea3e6389727df2cae5c6feebcdd49437b12a' into analyzer 2018-11-19 08:24:02 -08:00
Alexander Thomas 52d1a2b29b [release] Prepare changelog and version for 2.2.0-dev.0.0
TBR=whesse@google.com

Change-Id: I4e168ef4c48597d6a5eeabcfcece32044eccc3a8
Reviewed-on: https://dart-review.googlesource.com/c/84634
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-19 11:02:51 +00:00
Paul Berry 32a6032f03 Merge commit 'ddbe22190c41b1993a3c93b67f1bfa57287348f8' into analyzer 2018-11-16 12:01:38 -08:00
Martin Kustermann 79b85ae944 Add --write_logs to set of blacklisted objects, so they do not appear on reproduction commands
Change-Id: Id4031192d220ab82429cab895cf4121913231a54
Reviewed-on: https://dart-review.googlesource.com/c/84534
Reviewed-by: Alexander Thomas <athom@google.com>
Reviewed-by: William Hesse <whesse@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-11-16 09:33:52 +00:00
Paul Berry b14b19e13c Merge commit '9e3d3cf765ba3f761b2507950039bcdd2dd3ece8' into analyzer 2018-11-15 09:17:48 -08:00
Alexander Thomas bc2294c004 [infra] Shard reload builders
Change-Id: I6e1577ec7a8f0d7aec73bbee71d8d3a3a0febdd8
Reviewed-on: https://dart-review.googlesource.com/c/84520
Reviewed-by: Samir Jindel <sjindel@google.com>
2018-11-15 14:01:18 +00:00
Alexander Markov ed48cfeb47 [vm/bytecode] Support source positions when executing bytecode
This includes both interpreted and compiled bytecode.

Change-Id: I6309ec4f0687f68caf6260cc57dacf94f027177d
Reviewed-on: https://dart-review.googlesource.com/c/84481
Commit-Queue: Alexander Markov <alexmarkov@google.com>
Auto-Submit: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Régis Crelier <regis@google.com>
2018-11-15 00:48:04 +00:00
Paul Berry 1b5996ae67 Merge commit '30c5b39d4e0e7672d05df6aebba73254dd7ee770' into analyzer 2018-11-14 09:37:06 -08:00
Alexander Thomas 1ade3b624f [infra] Switch cross-arm64 builder to use a single shard
Triggering on arm64 fails because some kitchen CIPD packages
are unavailable on arm64.

TBR=whesse@google.com

Change-Id: I26b05d000dde712ab1b1d55a33be1e4a02f22247
Reviewed-on: https://dart-review.googlesource.com/c/84424
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-14 15:45:08 +00:00
Alexander Thomas eb4f9290de [infra] Add arm64 builders to the test matrix
TBR=whesse@google.com

Change-Id: If432f9fe2c12ed5a0d7a5af8b15e4daaa13e68f5
Reviewed-on: https://dart-review.googlesource.com/c/84420
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-14 11:08:00 +00:00
Paul Berry fc2888982c Merge commit 'c92f9dce2357d0da7909c0c5f630ad59882ccf29' into analyzer 2018-11-13 12:35:13 -08:00
Jonas Termansen 927f0937bd [infra] Add test.dart script for local testing.
test.dart locates where the current branch branched off master and compares
the local testing results with the appropriate mainline builder results,
letting you know how the current change compares without the need for status
files.

Bug: https://github.com/dart-lang/sdk/issues/35086
Change-Id: Ib79479b867c5ac131302fea1bdf7effd0422a83a
Reviewed-on: https://dart-review.googlesource.com/c/83281
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-12 21:51:48 +00:00
Konstantin Shcheglov 2079620a53 Issue 34733. Expand 'implicit-casts' controlled casts, and deprecate more of 'declaration-casts'.
R=brianwilkerson@google.com, paulberry@google.com

Bug: https://github.com/dart-lang/sdk/issues/34733
Change-Id: Ifda5cbd8cc8d81a7e3ad8133d68c056b869bb588
Reviewed-on: https://dart-review.googlesource.com/c/84122
Commit-Queue: Konstantin Shcheglov <scheglov@google.com>
Reviewed-by: Brian Wilkerson <brianwilkerson@google.com>
2018-11-12 21:04:59 +00:00
Aart Bik c60cff1d33 [dart/fuzzer] Introduce time-based test runs
Rationale:
To maximize CPU utilitization during fuzzing runs,
we now use a time-out on all the individual fuzz
testing runs (rather than repeat based). This way,
the "faster" tests will cover more ground, while
the "slower" straggler tests will not break the test
with unnecessary time-outs at cluster level.
Change-Id: I5f0f9646da3fbd8b361a7ea43444b1896a45b57f
Reviewed-on: https://dart-review.googlesource.com/c/84047
Commit-Queue: Aart Bik <ajcbik@google.com>
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-12 18:47:59 +00:00
Jonas Termansen 8043e9851c [infra] Fix test matrix path logic in approve_results.
Change-Id: Id84365b760d61e01e06f7c5c1377eae456c15441
Reviewed-on: https://dart-review.googlesource.com/c/83764
Reviewed-by: Alexander Thomas <athom@google.com>
2018-11-12 18:47:10 +00:00
Paul Berry 3ae0dcaa18 Merge commit '5ef1465c55be601f601e1f565c9b9d2f94d76aff' into analyzer
Conflicts:
	pkg/analysis_server/lib/src/analysis_server.dart
	pkg/analysis_server/lib/src/server/driver.dart
2018-11-12 06:39:27 -08:00
Aart Bik a20986b299 [dart/fuzzer] Reduce number of runs to avoid timeouts
Rationale:
Now that we are running on multiple shards, worker
timeouts are becoming a bit more frequent due to
(1) file copying overhead
(2) more stragglers due to law of larger numbers.
Change-Id: I36169c0b2033390b1c577f1dbafb1b34c3dd382d
Reviewed-on: https://dart-review.googlesource.com/c/84040
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Aart Bik <ajcbik@google.com>
2018-11-09 18:05:08 +00:00
William Hesse 0caf8dd8ed Add logs.json file to results from test.py, output of failing tests
Change-Id: I18287dd6a435074dd3ff88d17aa5757109b4e9a1
Reviewed-on: https://dart-review.googlesource.com/c/83280
Commit-Queue: William Hesse <whesse@google.com>
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-11-09 01:16:34 +00:00
Alexander Thomas fd5928e97e [dart/fuzzer] Reduce number of runs to avoid timeouts
Change-Id: I582dbe87a84511c63aeb6dc0cfa52156d33c015a
Reviewed-on: https://dart-review.googlesource.com/c/83660
Auto-Submit: Alexander Thomas <athom@google.com>
Reviewed-by: Aart Bik <ajcbik@google.com>
Commit-Queue: Aart Bik <ajcbik@google.com>
2018-11-08 19:24:11 +00:00
Jonas Termansen c52a38c4ad [infra] Use new approved results bucket in approve_results.dart
Change-Id: Ia20e682c542edba8b606276124e9f8fd78785680
Reviewed-on: https://dart-review.googlesource.com/c/83620
Reviewed-by: Alexander Thomas <athom@google.com>
Reviewed-by: William Hesse <whesse@google.com>
2018-11-08 18:53:19 +00:00
Paul Berry d076571cd9 Merge commit '35c6c79ebc052ab28efcaf045b38ff71c6ed5f3e' into analyzer 2018-11-08 09:32:18 -08:00
Sam Rawlins 1a5f5e4caf Fix doc comment in HttpRequest.getString and other tweaks
Bug: https://github.com/dart-lang/sdk/issues/21578
Change-Id: I9ec333319922f27a216c1804d889198baf7e579b
Reviewed-on: https://dart-review.googlesource.com/c/82789
Reviewed-by: Terry Lucas <terry@google.com>
Commit-Queue: Samuel Rawlins <srawlins@google.com>
2018-11-07 23:31:14 +00:00
Paul Berry be7983e148 Merge commit 'c24073f442e7c7b789894ad8210aff8accc36702' into analyzer 2018-11-07 07:37:12 -08:00
Vyacheslav Egorov 73a5809c19 [testing] Path absolute path to kernel service snapshot to run_vm_tests.
There are tests that change current working directory, while kernel
service is trying to start so we can't pass relative paths to --dfe.

Fixes https://github.com/dart-lang/sdk/issues/35093

R=kustermann@google.com

Change-Id: I40fc44243c3011d1d787523b8fc427ec1fde3fea
Reviewed-on: https://dart-review.googlesource.com/c/83404
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
2018-11-07 15:27:57 +00:00
Alexander Thomas e679101211 [infra] Update debian package metadata
Change-Id: I73696171a6d118c39ef485f0456898f789596876
Reviewed-on: https://dart-review.googlesource.com/c/82993
Reviewed-by: William Hesse <whesse@google.com>
2018-11-07 09:54:46 +00:00
Jonas Termansen c46202a387 [infra] Fix approve_results using wrong name.
Change-Id: I1b39d69ebd859b29aeb1b217097f0be69b55341b
Reviewed-on: https://dart-review.googlesource.com/c/83260
Reviewed-by: William Hesse <whesse@google.com>
2018-11-07 00:05:57 +00:00
Paul Berry 8b87e73428 Merge commit 'f7dab643ff254ead592d7bd038d858ebc9f2570c' into analyzer 2018-11-06 15:16:04 -08:00
Paul Berry 4b1870307d Merge commit '8d12600b16bcc9ae113c47fb6a3d5b68b1388c5c' into analyzer 2018-11-06 14:59:15 -08:00
Sam Rawlins f7dab643ff Remove discontinued webproject.org links. Fixes #21482
Bug: https://github.com/dart-lang/sdk/issues/21482
Change-Id: Ie3becfa7eb9f233186629cf97bfcabe51efc8794
Reviewed-on: https://dart-review.googlesource.com/c/82790
Reviewed-by: Terry Lucas <terry@google.com>
Commit-Queue: Samuel Rawlins <srawlins@google.com>
2018-11-06 22:20:51 +00:00
Alexander Thomas a6bb2e5fac [dart/fuzzer] Shard fuzzer
Change-Id: I75df5c9db920331a56b27c2e457bd3b4ce1efd64
Reviewed-on: https://dart-review.googlesource.com/c/78125
Commit-Queue: Alexander Thomas <athom@google.com>
Reviewed-by: Aart Bik <ajcbik@google.com>
2018-11-06 20:23:58 +00:00
Alexander Thomas 8d12600b16 [infra] Make IE work on Luci (closes #30505)
Change-Id: I0ebf9645247320104246d867ad87dc35542e74de
Reviewed-on: https://dart-review.googlesource.com/c/68364
Reviewed-by: William Hesse <whesse@google.com>
Reviewed-by: Sigmund Cherem <sigmund@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-11-06 20:07:13 +00:00
Jonas Termansen 51f815f7f3 [infra] Support configurations in compare_results and update_flakiness.
Change-Id: I640486957a40ebd178a0d7d06a7a81af758536c8
Reviewed-on: https://dart-review.googlesource.com/c/82980
Commit-Queue: Jonas Termansen <sortie@google.com>
Reviewed-by: William Hesse <whesse@google.com>
2018-11-06 19:57:08 +00:00
Alexander Thomas 54a3e11d5b [infra] Upload core dumps if BUILDBOT_BUILDERNAME is set
Recipes pass output_dir to local shards as well but it points to a temp
directory that isn't accessible to users.

Change-Id: I0618abf78cf03957dd5cb8c9a10150bc4964684e
Reviewed-on: https://dart-review.googlesource.com/c/82985
Commit-Queue: Alexander Thomas <athom@google.com>
Auto-Submit: Alexander Thomas <athom@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-11-06 11:56:11 +00:00
Jonas Termansen af63ea79a1 [infra] Add approve_results.dart script for approving test result changes.
The approve_results program downloads the current results, the approved
results, and flakiness information for the specified bots. It presents
tables of the tests that have been fixed and the ones that have broken since
the last approval. Finally, it provides the option to approve the new
changes.

The approve_results program is part of the new workflow and only affects the
greenness of bots enrolled in it.

You can list the available bots by running:

    dart tools/approve_results.dart -l

You can approve the results on a bot by running:

    dart tools/approve_results.dart -b vm-kernel-linux-release-x64

Globs are supported, e.g. to approve all vm linux bots on ia32 and x64:

    dart tools/approve_results.dart -b 'vm-*linux*{ia32,x64}*'

By default the tool is interactive and asks whether the changes should be
approved. Approving the results turns the bots green on the next commit.
It's assumed that bugs have been filed prior to approving the test changes.
The -y option approves the changes non-interactively while the -n option
does a try run and shows what needs to be approved.

This tool is meant to be used early and often to turn the bot green. Emails
are not set about additional failures until the regressions has been
approved.

Bug: https://github.com/dart-lang/sdk/issues/35000
Change-Id: I6479edaa76556aa5ef499509c04b92ae770d1727
Reviewed-on: https://dart-review.googlesource.com/c/82222
Reviewed-by: William Hesse <whesse@google.com>
2018-11-06 01:08:50 +00:00
Paul Berry 2e52420a56 Merge commit '4324bd1fd1ab52b4b74073fd9ca11cbdf0596454' into analyzer 2018-11-02 10:26:19 -07:00
William Hesse 5f0df32646 Dummy commit to analyzer branch, to trigger builders
Change-Id: If2f94e6572ff01ffb642cb2e4e9e056f25d27ed3
Reviewed-on: https://dart-review.googlesource.com/c/82503
Reviewed-by: Konstantin Shcheglov <scheglov@google.com>
2018-11-02 16:51:33 +00:00
Erik Ernst 33c321892c Cleaned up some terminology, whitespace, and added index.
Changed "compile-time warning" to "static warning"; eliminated spurious
space at the beginning of each normative paragraph; added index and
changed all `{\em ..}` containing defining occurrences of words and
phrases such that they are added to the index and marked with a
diamond in the margin (to make it easy to spot definitions).

Change-Id: I688561a24d2b9955f383d6c8db2c913353d41b4b
Reviewed-on: https://dart-review.googlesource.com/c/82501
Reviewed-by: Lasse R.H. Nielsen <lrn@google.com>
2018-11-02 12:11:41 +00:00
Paul Berry b3312238ac Merge commit '2bb05234a801ceea8a240c581ba55007c2337568' into analyzer 2018-11-01 06:01:05 -07:00
Ben Konyi 5d7eaaf2e0 [ VM / buildtools ] Allow for downloading of clang-format.exe on Windows
Change-Id: Id73479468ecff28b60545191d8cd655fbfe277db
Reviewed-on: https://dart-review.googlesource.com/c/82301
Commit-Queue: Zach Anderson <zra@google.com>
Auto-Submit: Ben Konyi <bkonyi@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
2018-11-01 04:09:20 +00:00
William Hesse 7a4e142d00 Add analyzer-linux-release-analyzer-new builder to test matrix on analyzer branch
Change-Id: I6f7476e8f299bac79684c670184f1d46970bb451
Reviewed-on: https://dart-review.googlesource.com/c/82440
Reviewed-by: Devon Carew <devoncarew@google.com>
2018-10-31 23:37:36 +00:00
Paul Berry 0b96b06ef9 Merge commit 'cf73e08b71ccbed85e2e6a14a7499341c0e15b0d' into analyzer 2018-10-31 07:25:10 -07:00
Paul Berry 5089649b15 Merge commit '98a0309fbd8a53ceb4f5520c530507e135930eab' into analyzer 2018-10-30 14:58:31 -07:00
Vyacheslav Egorov c413b61969 [testing] Improvements to crash dump archiving
* On Windows dump stacks from all collected dumps into the output so
that one would not need to download the dump to analyse it.
* Document crash dump archiving so that engineers know where to look
for dumps and how look at them.

Change-Id: Ibf53bb597c07702b3e051cf24bea8f6bfb1d5e8f
Reviewed-on: https://dart-review.googlesource.com/c/82066
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
2018-10-30 20:41:03 +00:00
Jens Johansen a1293f1591 test.py -c fasta: Enable asserts and verify
Change-Id: Ie7ff93cb552a0b2ae8e11078dd19358d199889d1
Reviewed-on: https://dart-review.googlesource.com/c/82040
Reviewed-by: Peter von der Ahé <ahe@google.com>
Commit-Queue: Jens Johansen <jensj@google.com>
2018-10-30 08:34:03 +00:00
Paul Berry 03df087c60 Merge commit '1215d9163af58229132e4776a89ea87d5302c9e3' into analyzer
Conflicts:
	pkg/analysis_server/lib/src/edit/edit_dartfix.dart
	pkg/analysis_server/lib/src/services/correction/assist_internal.dart
2018-10-29 08:48:27 -07:00
Jonas Termansen 1c5e7cf363 [infra] Stop using tests and exclude_tests fields in test matrix.
These fields complicate how test.py is called and could just have well have
been put in the arguments list for simplicity. They were already used
inconsistently. The support can be removed from the recipe in a follow up
changelist in the infra repository.

Change-Id: Ib5c39d61d730bfcb719c1884d910bbd2f73b4fce
Reviewed-on: https://dart-review.googlesource.com/c/81403
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Jonas Termansen <sortie@google.com>
2018-10-29 15:34:27 +00:00
Vyacheslav Egorov f185012d20 [gardening] Integrate Crashpad with run_vm_tests.
Change-Id: Ia18b5e22cefe1fb4dfa8d8ed9361789304eb8acc
Reviewed-on: https://dart-review.googlesource.com/c/81826
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-29 15:11:16 +00:00
Vyacheslav Egorov 64635263ff [testing] Fix code in utils.py to use Python not Dart
In Dart we do `x.containsKey(k)` in Python we do `k in x`.

Change-Id: I60d0e95d0c4402c42a914270dbb1828f714f9d08
Reviewed-on: https://dart-review.googlesource.com/c/81760
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
2018-10-29 10:34:24 +00:00
Paul Berry 80265bc7d1 Merge commit '7c788d0734f9aef95ccffc48212b79656b5b676e' into analyzer 2018-10-26 16:09:56 -07:00
Devon Carew 7c788d0734 Don't make a shallow clone of the flutter repo.
Change-Id: Iddeec5f709b086fac3ab331fcffbe8e77201cbf7
Reviewed-on: https://dart-review.googlesource.com/c/81720
Reviewed-by: Paul Berry <paulberry@google.com>
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Devon Carew <devoncarew@google.com>
2018-10-26 20:31:15 +00:00
Vyacheslav Egorov 040dd40ef3 [testing] Making core dump archiving more robust.
* Catch and suppress errors so that core dump archiving can succeed even
if it can't delete some files.
* On Windows also archive PDB files that contains debugging information.

Change-Id: If1d7caa7c793a71bf8c0852c38098933e88fadba
Reviewed-on: https://dart-review.googlesource.com/c/81680
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Commit-Queue: Samir Jindel <sjindel@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Samir Jindel <sjindel@google.com>
2018-10-26 18:17:18 +00:00
Paul Berry 1894056c71 Merge commit '4aaa9660148fabc25a259a602c49ae924c33e378' into analyzer 2018-10-26 05:58:56 -07:00
Vyacheslav Egorov 4aaa966014 [testing] Pass abolute path to Crashpad handler.
This fixes remaining tests that started failing after Crashpad integration
because they spawn Dart processes in different working directories and
those processes can't find Crashpad hanlder unless we use absolute path.

Revert "[gardening] Temporary mark two standalone_2 io tests as failing"

Change-Id: I2951396a02bbec56c30e7a40b0ba34722928f9a1
Reviewed-on: https://dart-review.googlesource.com/c/81600
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Commit-Queue: Samir Jindel <sjindel@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Samir Jindel <sjindel@google.com>
2018-10-26 09:51:09 +00:00
Vyacheslav Egorov 3e824d2ecd [testing] Fix test selector matching on Windows
Our display test names (and filters) are given using forward slashes
while filenames on Windows use backwards slashes.

This meant that reproduction commands like

    python tools/test.py -m release -n dartk-win-release-x64 standalone_2/io/regress_7679_test

did not work on Windows.

Change-Id: I707966b871d575ffc19911a27b0a7fc0eead2060
Reviewed-on: https://dart-review.googlesource.com/c/81415
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-25 15:46:24 +00:00
Vyacheslav Egorov 245ec25943 [testing] Make core dump archiving machinery more verbose
Change-Id: Ifadbc3e5d0740697aaea7336a738daa20223ad5e
Reviewed-on: https://dart-review.googlesource.com/c/81412
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Samir Jindel <sjindel@google.com>
2018-10-25 15:31:27 +00:00
Vyacheslav Egorov 523353d280 [build] Move to Jessie sysroots from Wheezy sysroots.
Wheezy is not supported anymore (EOL May 2018) and these sysroots are
really outdated, which introduces build problems whenever we try to
use recent enough features and header files.

We are already using Jessie to build Dart SDK distributions and in some cases we use
Jessie to build binaries for testing (e.g. when building on ARM64).

This CL makes it uniform.

Change-Id: Id4d165a41aa37118f5e49edb2122d905219cd377
Reviewed-on: https://dart-review.googlesource.com/c/81409
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-25 15:05:22 +00:00
Vyacheslav Egorov 39136b0f41 [testing] Recognize STATUS_FATAL_APP_EXIT as a Crash on Windows.
Exiting VM with abort() returns this exit code when building with Crashpad
integration.

Change-Id: I400e4436c358827f3bdb06cc78c489cc82e99b51
Reviewed-on: https://dart-review.googlesource.com/c/81410
Auto-Submit: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-10-25 13:49:07 +00:00
Alexander Thomas bf26f760b1 [infra] Ensure that core dump upload triggers on main builders
https://crrev.com/c/1296514 will add --output_directory to non-shards as
well. BUILDBOT_BUILDERNAME is not set on shards and a more reliable
indication that this is a main bot that should gsutil upload core dumps.

Change-Id: Ic6cddc4937b8e83d2e15da4acd90c193e412773b
Reviewed-on: https://dart-review.googlesource.com/c/81362
Reviewed-by: Jonas Termansen <sortie@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-10-25 07:36:06 +00:00
Paul Berry 98d9792ab3 Merge commit 'd8cb60d746e3d34f9ee5e6b0a08bf12104d3f8e3' into analyzer 2018-10-24 09:04:01 -07:00
Alexander Thomas d8cb60d746 [infra] Improve clone command in analyze-flutter.sh script (#34739)
TBR=whesse@google.com

Change-Id: I2e43da79dbb3dba85403ee0ae4dcde2e16cd3afd
Reviewed-on: https://dart-review.googlesource.com/c/81279
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-24 15:51:33 +00:00
Vyacheslav Egorov 2c83eb550e [vm] Integrate dart binary with Crashpad on Windows.
dart binary would instantiate CrashpadClient if DART_CRASHPAD_HANDLER
and DART_CRASHPAD_CRASHES_DIR environment variables are set.

- DART_CRASHPAD_HANDLER should contain the path to the crashpad_handler
binary that would handle the crash and write minidump;
- DART_CRASHPAD_CRASHES_DIR should contain the path to the crashpad database
which would be used to store minidumps.

Rewrite --copy-crash-dumps support on windows to use Crashpad integration
instead of editing Windows registry.

Embedding crashpad required to roll a new zlib version because Crashpad
depends on the zlib. This version of zlib is buildable with its own
BUILD.gn so our custom BUILD.gn is removed.

Change-Id: I048aad16b234e1d750f0a24782b04e3b6e19703d
Reviewed-on: https://dart-review.googlesource.com/c/81007
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-24 13:30:16 +00:00
Paul Berry 2e2c360371 Merge commit '0b15595913ff89d8486e6677af0254dd6feab350' into analyzer 2018-10-24 06:09:47 -07:00
Jonas Termansen b73f7ed3d4 [infra] Add tools/bots/find_base_commit.dart
The find_base_commit program locates the newest commit with a full set of
test results. This is a good base for local testing when comparing with the
results from the official bots, as all the needed results are there.

Change-Id: Ie06020ca98317b82f46589ad6dede37361acf744
Reviewed-on: https://dart-review.googlesource.com/c/81040
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-23 14:02:51 +00:00
Paul Berry 5665636983 Merge commit '7fd78ed5b606e64d30ec201de9adce6fdf8856ba' into analyzer 2018-10-22 13:07:24 -07:00
Alexander Thomas 7fd78ed5b6 [infra] Add analyzer branch alias for flutter-analyze builder (#34739)
* Channel detection only works for -dev, -stable and -try.
* This will allow adding flutter-analyze to the analyzer branch console.

TBR=whesse@google.com

Change-Id: I0a4036d290acdfba78ba138a0e87448f6da1e878
Reviewed-on: https://dart-review.googlesource.com/c/81101
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-10-22 18:22:16 +00:00
Alexander Aprelev dcb665fa6d [hhh] Apply patch to flutter engine to fix hhh buildbot build step.
Change-Id: I13cceb1a784092f8c66d151eb8afeac0162a9c7a
Reviewed-on: https://dart-review.googlesource.com/c/80900
Commit-Queue: Alexander Aprelev <aam@google.com>
Reviewed-by: Alexander Aprelev <aam@google.com>
2018-10-19 18:10:44 +00:00
Paul Berry fe5467092a Merge commit '7a3762d4a91aed0b3885259b297953d0c38ce849' into analyzer 2018-10-19 10:00:38 -07:00
Alexander Thomas 2a63500865 [infra] Add flutter-analyze builder to the test matrix (#34739)
Change-Id: I04d741753c89191ccb8706d02330c8404efc1eb8
Reviewed-on: https://dart-review.googlesource.com/c/80581
Commit-Queue: Alexander Thomas <athom@google.com>
Auto-Submit: Alexander Thomas <athom@google.com>
Reviewed-by: Devon Carew <devoncarew@google.com>
2018-10-18 17:31:09 +00:00
Jonas Termansen d04a36b4ab [infra] Fix third_party/pkg_tested step having slash in name.
The step names of test.py invocations are currently used as directory names
in cloud storage. This unintentionally creates an unexpected subdirectory
where the top third_party/ directory is malformed because it doesn't have
the right contents.

Change-Id: I57e32ed917ba863e9bccf611f496e520b9a97310
Reviewed-on: https://dart-review.googlesource.com/c/80620
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Jonas Termansen <sortie@google.com>
2018-10-18 12:38:39 +00:00
Sergey G. Grekhov fed5bc62b6 [co19] DEPS and .status files updated
Change-Id: If0747db4bd02d31814b407970b11d16519329625
Reviewed-on: https://dart-review.googlesource.com/c/79661
Commit-Queue: Alexander Thomas <athom@google.com>
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-18 11:45:54 +00:00
Paul Berry 9233c1e40e Merge commit '4506e1d179d4494e21be05a2940295b1673b579c' into analyzer
Conflicts:
	pkg/analyzer/lib/src/dart/analysis/driver.dart
2018-10-17 12:08:17 -07:00
Alexander Thomas 18f56e59cf [infra] Add configuration name to results.json
Change-Id: I8884227bde16c7d370135ba44336136834ef0bb0
Reviewed-on: https://dart-review.googlesource.com/c/80446
Auto-Submit: Alexander Thomas <athom@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
Commit-Queue: Jonas Termansen <sortie@google.com>
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-10-17 12:48:42 +00:00
Ben Konyi 445a43b58d [ VM / Testing ] Add build flags to enable code coverage
Change-Id: I37e945f842932b1ac1d87444e4fec2eb752f312f
Reviewed-on: https://dart-review.googlesource.com/c/79465
Commit-Queue: Ben Konyi <bkonyi@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
Auto-Submit: Ben Konyi <bkonyi@google.com>
2018-10-16 22:11:05 +00:00
Alexander Markov 009eabf892 [Test tool] Add VM options to compiler arguments in VMKernelCompilerConfiguration
This is needed to correctly define -Ddart.developer.causal_async_stacks in
56306b90ee/tools/testing/dart/compiler_configuration.dart (L1090-L1092)

Change-Id: I50301804a96d4cb562663371ff72cc7113eede0a
Reviewed-on: https://dart-review.googlesource.com/c/80320
Commit-Queue: Zach Anderson <zra@google.com>
Auto-Submit: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
2018-10-16 19:11:53 +00:00
Paul Berry b739b2e034 Merge remote-tracking branch 'origin/master' into analyzer 2018-10-16 08:18:52 -07:00
Martin Kustermann 349adc5b1f Reland "[VM] Use c++/kernel2kernel constant evaluator for const StaticInvocation in the kernel IR"
Fixes https://github.com/dart-lang/sdk/issues/34770

Change-Id: I55b02e6ce327f4a08d96612fea44f7b03bddcbb5
Reviewed-on: https://dart-review.googlesource.com/c/79680
Commit-Queue: Martin Kustermann <kustermann@google.com>
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-10-16 11:22:56 +00:00
Martin Kustermann ed73cc379d Increase file descriptor limit when running test.py on MacOS
This is an attempt to solve io test flakiness on MacOS. The symptoms
include "connection refused", "broken pipe" error messages.

Change-Id: If6759f4ef9cd2c1b9bd083db9a469db43f12c4e0
Reviewed-on: https://dart-review.googlesource.com/c/80120
Commit-Queue: Martin Kustermann <kustermann@google.com>
Reviewed-by: Vyacheslav Egorov <vegorov@google.com>
2018-10-16 09:25:10 +00:00
Alexander Thomas 5ce132a912 [infra] Copy core dumps to ISOLATED_OUTDIR on shards (#34746)
* Upload to Cloud Storage requires credentials not available to shards.
* Remove "SiteConfigBotoFile" buildbot hack.
* Remove obsolete Java utility method.

Change-Id: If03412a09644845d0f9467fa5fffc1cbec1cc216
Reviewed-on: https://dart-review.googlesource.com/c/79900
Auto-Submit: Alexander Thomas <athom@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-16 09:11:45 +00:00
Alexander Thomas 632f272e37 [infra] Add analyzer branch builders to the test matrix (#34780)
TBR=paulberry@google.com

Change-Id: I34d3422712ab9f27d0d5303391233f6b27d619a7
Reviewed-on: https://dart-review.googlesource.com/c/79686
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-15 15:53:41 +00:00
Terry Lucas 490421d166 Fixed Service Workers and any Promise/Future API with a Dictionary parameter.
APIs in dart:html (that take a Dictionary) will receive a Dart Map parameter.  The Map parameter
must be converted to a Dictionary before passing to the browser's API.  Before this change,
any Promise/Future API with a Map/Dictionary parameter never called the Promise and didn't
return a Dart Future - now it does.

This caused a number of breaks especially in Service Workers (register, etc.).  Here is a
complete list of the fixed APIs:

BackgroundFetchManager
    Future<BackgroundFetchRegistration> fetch(String id, Object requests, [Map options])

CacheStorage
    Future match(/*RequestInfo*/ request, [Map options])

CanMakePayment
    Future<List<Client>> matchAll([Map options])

CookieStore
    Future getAll([Map options])
    Future set(String name, String value, [Map options])

CredentialsContainer
    Future get([Map options])
    Future create([Map options])

DirectoryEntry
    Future<Entry> _getDirectory(String path, {Map options})
    Future<Entry> _getFile(String path, {Map options})

ImageCapture
    Future setOptions(Map photoSettings)

MediaCapabilities
    Future<MediaCapabilitiesInfo> decodingInfo(Map configuration)
    Future<MediaCapabilitiesInfo> encodingInfo(Map configuration)

MediaStreamTrack
    Future applyConstraints([Map constraints])

Navigator
    Future requestKeyboardLock([List<String> keyCodes])
    Future requestMidiAccess([Map options])
    Future share([Map data])

OffscreenCanvas
    Future<Blob> convertToBlob([Map options])

PaymentInstruments
    Future set(String instrumentKey, Map details)

Permissions
    Future<PermissionStatus> query(Map permission)
    Future<PermissionStatus> request(Map permissions)
    Future<PermissionStatus> revoke(Map permission)

PushManager
    Future permissionState([Map options])
    Future<PushSubscription> subscribe([Map options])

RtcPeerConnection
    REMOVED:  Future createAnswer([options_OR_successCallback,
                                   RtcPeerConnectionErrorCallback failureCallback,
                                   Map mediaConstraints])
    REMOVED:  Future createOffer([options_OR_successCallback,
                                  RtcPeerConnectionErrorCallback failureCallback,
                                  Map rtcOfferOptions])
    REMOVED:  Future setLocalDescription(Map description, VoidCallback successCallback,
                                         [RtcPeerConnectionErrorCallback failureCallback])
    REMOVED:  Future setLocalDescription(Map description, VoidCallback successCallback,
                                         [RtcPeerConnectionErrorCallback failureCallback])
    Future<RtcSessionDescription> createAnswer([Map options])
    Future<RtcSessionDescription> createOffer([Map options])
    Future setLocalDescription(Map description)
    Future setRemoteDescription(Map description)

ServiceWorkerContainer
    Future<ServiceWorkerRegistration> register(String url, [Map options])

ServiceWorkerRegistration
    Future<List<Notification>> getNotifications([Map filter])
    Future showNotification(String title, [Map options])

VRDevice
    Future requestSession([Map options])
    Future supportsSession([Map options])

VRSession
    Future requestFrameOfReference(String type, [Map options])

Window
    Future fetch(/*RequestInfo*/ input, [Map init])

WorkerGlobalScope
    Future fetch(/*RequestInfo*/ input, [Map init])


In addition, exposed Service Worker "self" as a static getter named "instance".  The
instance is exposed on four different Service Worker classes and can throw a InstanceTypeError
if the instance isn't of the class expected (WorkerGlobalScope.instance will always work
and not throw):

*   SharedWorkerGlobalScope.instance
*   DedicatedWorkerGlobalScope.instance
*   ServiceWorkerGlobalScope.instance
*   WorkerGlobalScope.instance

R=vsm@google.com

Bug: #34202
Change-Id: I641ccbff7cc771465dd32c73db20eba5d6667939
Reviewed-on: https://dart-review.googlesource.com/c/74482
Commit-Queue: Terry Lucas <terry@google.com>
Reviewed-by: Vijay Menon <vsm@google.com>
Reviewed-by: Jenny Messerly <jmesserly@google.com>
2018-10-14 22:48:33 +00:00
Martin Kustermann 99815c8d6d Do not print --output_directory in reproduction commands
Change-Id: I19229506a1f8eb3c13dff84794b9bba53cc5841e
Reviewed-on: https://dart-review.googlesource.com/c/79562
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-10-12 14:36:34 +00:00
Jonas Termansen 5b1fcb09df Remove d2fe ikg minimal benchmark from commit queue.
Change-Id: I343d37206f614ff5def567faea88c3eb5af7881b
Reviewed-on: https://dart-review.googlesource.com/c/79580
Reviewed-by: Peter von der Ahé <ahe@google.com>
2018-10-12 13:38:18 +00:00
Bob Nystrom f6ca2c1d8f Remove the Dart 1 tests.
This deletes:

tests/co19
tests/corelib
tests/html
tests/isolate
tests/language
tests/lib

It does not delete tests/standalone because apparently there are tests
in there that are not in standalone_2. (I assume they were added after
the test migration. I don't know why they were added there.)

I have tried to remove references to the old tests from various scripts
and tools but may have missed some. (As you can imagine, grepping for
"lib" does not have the best signal-to-noise ratio.)

"It was a pleasure to burn. It was a special pleasure to see things
eaten, to see things blackened and changed. With the brass nozzle in his
fists, with this great python spitting its venomous kerosene upon the
world, the blood pounded in his head, and his hands were the hands of
some amazing conductor playing all the symphonies of blazing and burning
to bring down the tatters and charcoal ruins of history."

- Ray Bradbury, Fahrenheit 451

Change-Id: If3db4a50e7a5ee25aff8058b1483e2ce8e68424e
Reviewed-on: https://dart-review.googlesource.com/c/75420
Commit-Queue: Bob Nystrom <rnystrom@google.com>
Auto-Submit: Bob Nystrom <rnystrom@google.com>
Reviewed-by: William Hesse <whesse@google.com>
Reviewed-by: Terry Lucas <terry@google.com>
Reviewed-by: Sigmund Cherem <sigmund@google.com>
2018-10-11 23:45:18 +00:00
Devon Carew 82f31cd250 Add types to method args to avoid analysis warnings.
Change-Id: Ib8aae3373e008998e08904b2e8e0b37e5a646295
Reviewed-on: https://dart-review.googlesource.com/c/79422
Reviewed-by: Konstantin Shcheglov <scheglov@google.com>
2018-10-11 22:08:05 +00:00
Vyacheslav Egorov 3fe3106489 [gardening] Fix leaks in run_vm_tests binary detected by ASAN.
Change-Id: I8a7f008ad7d25111b0c9da7a2e65f489edce7900
Reviewed-on: https://dart-review.googlesource.com/c/79260
Commit-Queue: Vyacheslav Egorov <vegorov@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-11 16:52:14 +00:00
Alexander Thomas 5e7ea5b672 [infra] Add .vpython spec to fix gsutil on the bots (#31065)
Change-Id: I931695878cdcd9f014b1b751bbe52cfc2d524bb8
Reviewed-on: https://dart-review.googlesource.com/c/79262
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-10-11 15:11:35 +00:00
Alexander Markov 3cf0008b13 [vm/bytecode] Remove dependencies on ASTs when running with bytecode
Also, enable dropping ASTs from kernel files when testing in dartkb mode.

Change-Id: Iec82f1b76e3b8a9eb692de325d7645d8f271e03e
Reviewed-on: https://dart-review.googlesource.com/c/79087
Auto-Submit: Alexander Markov <alexmarkov@google.com>
Commit-Queue: Zach Anderson <zra@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
2018-10-11 15:11:26 +00:00
William Hesse 1809bae318 Revert "Ignore JSON exceptions when reading (empty) test results file"
This reverts commit 0aa99cca99.
Also fixes issue writing newline-terminated json records to file.

Change-Id: I568442149f532c4164610b6694fa95bc4f6e97e4
Reviewed-on: https://dart-review.googlesource.com/c/79205
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-10-11 11:51:12 +00:00
Alexander Thomas 1c2ed4ac11 [infra] Include gsutil in vm-kernel fileset to enable coredumps on shards (#31065)
Change-Id: Ic583bae50c78b5b1cd6e3a0a9ec144178dc4be6b
Reviewed-on: https://dart-review.googlesource.com/c/79001
Commit-Queue: Alexander Thomas <athom@google.com>
Reviewed-by: Martin Kustermann <kustermann@google.com>
2018-10-11 09:02:38 +00:00
Alexander Markov 5deb1c6e81 [vm] Remove strong mode and sync-async flags from pkg/vm
Change-Id: Icd2920274ca4c402b38e5774bb408d6b5e529169
Reviewed-on: https://dart-review.googlesource.com/c/79082
Commit-Queue: Alexander Markov <alexmarkov@google.com>
Auto-Submit: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Siva Annamalai <asiva@google.com>
2018-10-10 20:11:35 +00:00
G?nter Z?chbauer 2da0b9f4f1 fix some typos
Closes #34738
https://github.com/dart-lang/sdk/pull/34738

GitOrigin-RevId: d211bbacfe65355cf7304c990ffb6c79d7a229cf
Change-Id: If690e6d378e543b300e1f6a353ceae73e39c29db
Reviewed-on: https://dart-review.googlesource.com/c/78900
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-10 19:15:30 +00:00
William Hesse 0aa99cca99 Ignore JSON exceptions when reading (empty) test results file
Change-Id: I65557ca82acb0ec51d5f3f49ff2799ca77204dc3
Reviewed-on: https://dart-review.googlesource.com/c/79049
Reviewed-by: William Hesse <whesse@google.com>
2018-10-10 16:35:44 +00:00
Vyacheslav Egorov 051108c004 [tools] Re-enable core-dump archiving on Linux.
Make core_pattern checks non-fatal for now because underlying issues with
bots are not yet fixed.

We need core-dumps from debug kernel bots to look into some pthread flakes.

Bug: https://github.com/dart-lang/sdk/issues/31979

Change-Id: I38c79013cb2ed5a82ce10c909ff729f73cc34536
Reviewed-on: https://dart-review.googlesource.com/c/37320
Commit-Queue: Alexander Thomas <athom@google.com>
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-10 13:47:17 +00:00
William Hesse aa5b1b1f2f Make test results in json format end with a newline
Change-Id: I88e0672dc8ee7ddf0020c33fae689f85669a0954
Reviewed-on: https://dart-review.googlesource.com/c/79044
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-10-10 13:43:58 +00:00
Peter von der Ahé 4db2bbe94d Pass SharedOptions to Fasta
Change-Id: Idf85bf49e0ddd47640719eb65044f0b6527f9d9c
Reviewed-on: https://dart-review.googlesource.com/c/78525
Commit-Queue: Peter von der Ahé <ahe@google.com>
Reviewed-by: William Hesse <whesse@google.com>
2018-10-10 13:38:57 +00:00
Martin Kustermann 17ac151f44 [Gardening] Increase timeout on release-hotreload configuration as well (not just debug), skip streamed_conversion_json_utf8_decode in hot-reload-simdbc64
Change-Id: Ifde8ae03b0f4da57c9c2f7ea445c0626630bcbce
Reviewed-on: https://dart-review.googlesource.com/c/79026
Reviewed-by: Martin Kustermann <kustermann@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
Auto-Submit: Martin Kustermann <kustermann@google.com>
2018-10-10 12:14:16 +00:00
Peter von der Ahé 8c872e0e3a Remove TargetFlags.strongMode
Change-Id: Ibf8661e5444d16666c54f1d81c626893b000521a
Reviewed-on: https://dart-review.googlesource.com/c/78986
Commit-Queue: Jens Johansen <jensj@google.com>
Auto-Submit: Peter von der Ahé <ahe@google.com>
Reviewed-by: Jens Johansen <jensj@google.com>
2018-10-10 12:11:41 +00:00
Peter von der Ahé ee97806084 Replace strongMode with legacyMode in CompilerOptions
Also, remove --strong and --strong-mode flags (use --legacy-mode
flag to enable legacy mode).

Change-Id: I577ab5f755a2bee88f0f4d63915a6e852e792f06
Reviewed-on: https://dart-review.googlesource.com/c/79000
Commit-Queue: Jens Johansen <jensj@google.com>
Auto-Submit: Peter von der Ahé <ahe@google.com>
Reviewed-by: Jens Johansen <jensj@google.com>
2018-10-10 12:04:26 +00:00
Jonas Termansen 8247fb7eec Stop stripping d8 for benchmarking.
Change-Id: I7eb304671fd891e9a02c40442b766b6ee1c23bed
Reviewed-on: https://dart-review.googlesource.com/c/79021
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-10 11:51:27 +00:00
Aart Bik 751cf1974a [dart/fuzzer] Add DBC as execution mode.
Rationale:
More coverage is better!
Change-Id: Ic04f4caf7d02e1db9398f3d51ae44f6b51d6542d
Reviewed-on: https://dart-review.googlesource.com/c/78862
Reviewed-by: Alexander Thomas <athom@google.com>
Reviewed-by: Alexander Markov <alexmarkov@google.com>
Commit-Queue: Aart Bik <ajcbik@google.com>
2018-10-09 18:56:28 +00:00
Martin Kustermann a50dfd6698 Make --write-results not appear in reproduction commands
Change-Id: Ibb492283c2b53762cb4f74da52c3f005cc282d85
Reviewed-on: https://dart-review.googlesource.com/c/78745
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Martin Kustermann <kustermann@google.com>
2018-10-09 13:47:11 +00:00
Peter von der Ahé f4ebebb37b Ignore runtime arguments in Fasta compiler configuration
Change-Id: I48817c4e6de58b418bd47188e878fd7f468ade61
Reviewed-on: https://dart-review.googlesource.com/c/78480
Commit-Queue: Peter von der Ahé <ahe@google.com>
Auto-Submit: Peter von der Ahé <ahe@google.com>
Reviewed-by: William Hesse <whesse@google.com>
2018-10-09 12:20:07 +00:00
Aart Bik 69550e2837 [dart/fuzzer] Increase #tests to 125
Rationale:
With 8 isolates per machine, this gives an even
8 x 125 = 1000 tests per machine on the cluster
Change-Id: I06e21f271ec5452c1d5559666b3f0f1eaea439dd
Reviewed-on: https://dart-review.googlesource.com/c/78620
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Aart Bik <ajcbik@google.com>
2018-10-08 18:16:44 +00:00
Jonas Termansen c8b72ae028 [infra] Replace deflake limit with overall limit.
Change-Id: I13057e5f3731c31b3b21da9eebe94ea90bb5c91a
Reviewed-on: https://dart-review.googlesource.com/c/78207
Reviewed-by: William Hesse <whesse@google.com>
2018-10-05 09:40:20 +00:00
Jonas Termansen 91f5ff9123 [infra] Limit how many tests are deflaked.
Change-Id: Ied9c03466ac265f804141f0611fa6c09959f8aa7
Reviewed-on: https://dart-review.googlesource.com/c/78205
Reviewed-by: William Hesse <whesse@google.com>
Commit-Queue: William Hesse <whesse@google.com>
Auto-Submit: Jonas Termansen <sortie@google.com>
2018-10-05 07:53:19 +00:00
Sergey G. Grekhov e8e9677fad [co19] co19_2 roll.
* co19_2 tests enabled for vm-kernel CQ builders.

Change-Id: I5ccc27d1110c22960e550b060a7e140bc1ac68b1
Reviewed-on: https://dart-review.googlesource.com/c/76820
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-10-05 06:35:43 +00:00
Alexander Thomas ced7ee6f4b [dart/fuzzer] Use multiple isolates
Change-Id: I8e3882d3a45a3ac8111d2a18c619c7bc20fc4b3d
Reviewed-on: https://dart-review.googlesource.com/c/78161
Reviewed-by: Aart Bik <ajcbik@google.com>
2018-10-04 21:56:33 +00:00
Alexander Thomas cf007d1f40 [infra] Add missing entries to the test matrix
TBR=whesse@google.com

Change-Id: I159e1a784a88eb1c040046edfdb881b6962be672
Reviewed-on: https://dart-review.googlesource.com/c/78160
Reviewed-by: Alexander Thomas <athom@google.com>
2018-10-04 19:59:54 +00:00
Alexander Thomas 1af136987b [infra] Prepare test matrix for the Dart 1 removal
* Remove all obsolete builders (only the try jobs used the test matrix).
* Add all missing Dart 2 builders.

Change-Id: I5c97e34928beb9023d87aaa638f759af16a7ccc4
Reviewed-on: https://dart-review.googlesource.com/c/77881
Commit-Queue: Alexander Thomas <athom@google.com>
Reviewed-by: Siva Annamalai <asiva@google.com>
2018-10-04 15:50:14 +00:00
Jonas Termansen ec4663ee5c Don't build runtime_kernel in benchmarks.
runtime_kernel is now the same as just runtime.

Confirm the gen_snapshot build target continues to work.

Change-Id: Ia282d7ba63c53ae8b35dad947d3dbbb671309e26
Reviewed-on: https://dart-review.googlesource.com/c/77801
Reviewed-by: Siva Annamalai <asiva@google.com>
2018-10-04 07:37:53 +00:00
Alexander Markov ff3992b9ea [test tool] Pass --packages to gen_kernel
Fixes: https://github.com/dart-lang/sdk/issues/32085
Change-Id: Ic18b7c39238994cf750824606e24671fffecc0d8
Reviewed-on: https://dart-review.googlesource.com/c/77983
Commit-Queue: Alexander Markov <alexmarkov@google.com>
Auto-Submit: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
2018-10-03 22:37:55 +00:00
asiva 30aa464f77 [VM] Remove 'corelib' and 'dart-io' sources generation into C++ arrays
- Remove all code that generates the corelib and dart:io library sources into C++ arrays and link them into dart_bootstrap
- Remove the executable dart_bootstrap and all uses of it
- Remove bootstrap_nolib.cc and builtin_nocore.cc
- Remove the Dart 1 code in core lib bootstrap path

Change-Id: Ifd33496204285a08b42fe09e39428e7a92b416b6
Reviewed-on: https://dart-review.googlesource.com/c/77241
Commit-Queue: Siva Annamalai <asiva@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
2018-10-02 23:27:05 +00:00
Alexander Thomas 93c5dcd00a [infra] Add fuzz testing builder to the test matrix
Change-Id: I8a9af496eea3b2c82ff30d158971227df78b9dab
Reviewed-on: https://dart-review.googlesource.com/c/77620
Reviewed-by: Aart Bik <ajcbik@google.com>
2018-10-02 20:02:21 +00:00
Ryan Macnak 49e521c55b [build] Forward load limit from build.py to Ninja.
Change-Id: I8d217147aa8273e8434ee5c4eefbd6266f5a3fec
Reviewed-on: https://dart-review.googlesource.com/77487
Reviewed-by: Zach Anderson <zra@google.com>
2018-10-02 00:40:03 +00:00
Zach Anderson 3c40b5670d [test] Shard the dartkb tests.
Change-Id: I3a97e340e83ddf1df4438262f176392540ecbbc2
Reviewed-on: https://dart-review.googlesource.com/76745
Commit-Queue: Zach Anderson <zra@google.com>
Reviewed-by: William Hesse <whesse@google.com>
Reviewed-by: Alexander Thomas <athom@google.com>
2018-09-28 19:45:28 +00:00
Zach Anderson defd68e431 [infra] Don't run generate_buildfiles.py during gclient hooks
There is a race with downloading the prebuilt Dart SDK from CIPD
introduced by:

647e1e79eb

If the prebuilt Dart SDK isn't there, then generate_buildfiles.py will
fail. Instead check whether generate_buildfiles.py should be run
right before we try to build.

Change-Id: I1e25e5280075f9d1c7d96877602617ddfb40291e
Reviewed-on: https://dart-review.googlesource.com/77160
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-09-28 18:11:07 +00:00
William Hesse bb78aa6356 Remove unneeded type on object read from JSON in a testing script
Change-Id: I9948230132854e5ebe7ae176a49cb085586924d6
Reviewed-on: https://dart-review.googlesource.com/77064
Reviewed-by: William Hesse <whesse@google.com>
2018-09-28 11:55:33 +00:00
Ryan Macnak 2f25dcda16 [vm] Remove script snapshots.
Change-Id: I5bc692b754c0909de4aa5f05af81b074578b16f4
Reviewed-on: https://dart-review.googlesource.com/76706
Reviewed-by: Siva Annamalai <asiva@google.com>
Commit-Queue: Ryan Macnak <rmacnak@google.com>
2018-09-26 22:49:27 +00:00
Jenny Messerly d673847bd8 [dartdevc] add --kernel option, deprecate bin/dartdevk
`dartdevc --kernel` is now equivalent to the old `dartdevk` command.
This will make migration easier, as it's now just a flag to enable
CFE/Kernel. `dartdevk` is now deprecated, but it can be supported for
a while as it just calls `dartdevc --kernel`.

Change-Id: Ib8d09f74556740a3af11c753f80cd87bd4a09044
Reviewed-on: https://dart-review.googlesource.com/76566
Reviewed-by: Vijay Menon <vsm@google.com>
Commit-Queue: Jenny Messerly <jmesserly@google.com>
2018-09-26 21:18:06 +00:00
Zach Anderson 5940ba21d2 [benchmark] Add gen_kernel_bytecode.dill to try_benchmarks.sh
Change-Id: Iaf0a52324fdef082df14f9affb2a316757e4a0ea
Reviewed-on: https://dart-review.googlesource.com/76702
Reviewed-by: Jonas Termansen <sortie@google.com>
Commit-Queue: Zach Anderson <zra@google.com>
2018-09-26 17:01:34 +00:00
William Hesse b01f461280 Add product mode macos dart executable to fileset for running tests
Change-Id: I0c4d70271c1949e642329371706740ea448a3a59
Reviewed-on: https://dart-review.googlesource.com/76670
Reviewed-by: William Hesse <whesse@google.com>
2018-09-26 14:09:09 +00:00
Alexander Thomas c38eab4fa9 [infra] Remove Dart 1 builders from the CQ (Part II)
TBR=whesse@google.com

Change-Id: Ia3529510b7c4c3b17ba07d76e2da9dd8d6e9ccff
Reviewed-on: https://dart-review.googlesource.com/76541
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-09-26 07:11:21 +00:00
Alexander Thomas 8ff692acf4 [infra] Remove Dart 1 builders from the CQ (Part I)
* Remove obsolete vm-kernel-legacy and analyzer-cfe builders.

Change-Id: I6b316359b1a2c5ce2adcf276578a9b9be5db5c15
Reviewed-on: https://dart-review.googlesource.com/76480
Reviewed-by: William Hesse <whesse@google.com>
Commit-Queue: Alexander Thomas <athom@google.com>
2018-09-25 19:03:54 +00:00
Alexander Thomas fc04f56430 [infra] Remove deleted Dart 1 builders (app/precomp) from the test matrix
Change-Id: I5f7d4e2755db531e9a62e611e51f7c62d6fdd521
Reviewed-on: https://dart-review.googlesource.com/69681
Reviewed-by: William Hesse <whesse@google.com>
2018-09-25 11:51:21 +00:00
asiva 355c73d4ee [VM] Remove support for option --no-preview-dart-2
- option --no-preview-dart-2 will now result in an error
- change aot-assembly build rule to generate AOT snapshot using Dart 2
- generate coresnapshot using Dart 2 (this snapshot is not used yet, next CL which switch the isolate create code to use this snapshot)
- by pass all Dart1 test runs in the status file
- change the default compiler setting in test.py to use dartk
- have test.py not pick up any configuration for --no-preview-dart-2

Change-Id: Ia136943ebfd0fed0c52683b330745b3e2c7a7ce6
Reviewed-on: https://dart-review.googlesource.com/75820
Reviewed-by: Zach Anderson <zra@google.com>
Commit-Queue: Siva Annamalai <asiva@google.com>
2018-09-24 20:38:08 +00:00
Alexander Markov 654c4babc8 [vm/bytecode] Fix a couple of assertions when running with bytecode
Also, add more tests to dartkb bots.

Change-Id: I6fbcbe73d6b9065ec03e64bf150b4ebd742e4d28
Reviewed-on: https://dart-review.googlesource.com/75981
Commit-Queue: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Régis Crelier <regis@google.com>
2018-09-21 22:54:39 +00:00
Jonas Termansen 69cd7cb43f [infra] Add compare_results.dart and update_flakiness.dart.
tools/bots/compare_results.dart compares the previous and current test
results in the results.json format and lists the differences, taking the
flakiness data into account.

tools/bots/update_flakiness.dart reads new result.json files and updates the
flakiness data in the flaky.json format file. The updated flakiness data
contains the list of tests that were already known to be flaky, plus any
new tests with multiple different outcomes in the provided results.json
files.

For instance, after running the tests, to find the list of tests that
changed result and needs to be deflaked, excluding tests that are already
known to be flaky:

  compare_results.dart \
    --flakiness-data flaky.json
    --changed \
    --passing \
    --failing \
    previous.json results.json

After the tests needing deflakinghas been run again, the flakiness data can
be updated:

  update_flakiness.dart -i flaky.json -o flaky.json results.json more.json

Finally a human readable report can explain what happened, exiting 1 if any
tests started failing in a non-flaky manner:

  compare_results.dart \
    --flakiness-data flaky.json \
    --judgement \
    --human \
    --verbose \
    --changed \
    --failing \
    --flaky \
    previous.json results.json

Bug: https://github.com/dart-lang/sdk/issues/34517
Bug: https://github.com/dart-lang/sdk/issues/34518
Change-Id: I156a8a49b8df09c0aebcb77376b69d365d0aa2ac
Reviewed-on: https://dart-review.googlesource.com/75540
Reviewed-by: William Hesse <whesse@google.com>
2018-09-20 12:22:11 +00:00
William Hesse 00f2054242 Add --repeat flag to test.py, so tests can be run multiple times
Change-Id: I827774a829c1a9d97bd1eb82b9ef52640a1ae6d5
Reviewed-on: https://dart-review.googlesource.com/75521
Reviewed-by: William Hesse <whesse@google.com>
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-09-20 09:35:12 +00:00
asiva f0974aee20 Remove entry_points option from the test harness
(should fix the precompiler bot failure).

Change-Id: I0120808f180d4f106597c39219e4f8ba1393de41
Reviewed-on: https://dart-review.googlesource.com/75627
Commit-Queue: Siva Annamalai <asiva@google.com>
Reviewed-by: Alexander Markov <alexmarkov@google.com>
2018-09-20 01:05:24 +00:00
asiva a0776096b9 Cleanup some of the build rules to not use Dart 1 mode.
Change-Id: I799ae7e910b90047a76151e47fc4c46d20f46ff7
Reviewed-on: https://dart-review.googlesource.com/74493
Commit-Queue: Siva Annamalai <asiva@google.com>
Reviewed-by: Zach Anderson <zra@google.com>
Reviewed-by: Samir Jindel <sjindel@google.com>
2018-09-19 22:23:33 +00:00
William Hesse 62ce86e20c Add --test-list and --repeat options to test.py, for deflaking
Change-Id: I88ae0a32ba5e28974cb22d75f56febb23f29edd9
Reviewed-on: https://dart-review.googlesource.com/75080
Commit-Queue: William Hesse <whesse@google.com>
Reviewed-by: Bob Nystrom <rnystrom@google.com>
2018-09-19 10:52:09 +00:00
Peter von der Ahé 6fe272314d Tweak parameters of ProcessedOptions
Change-Id: Id7aa47d9119da3ab21a1130253b4735c160a2459
Reviewed-on: https://dart-review.googlesource.com/74740
Reviewed-by: Aske Simon Christensen <askesc@google.com>
2018-09-19 08:13:45 +00:00
Zach Anderson bfeb270b21 [tests] Try dartkb with different vm flags
This change modifies the test matrix to run with --compiler=dartkb with
--enable_interpreter and --use_bytecode_compiler in sequence.

Change-Id: Ie1be3ffdd97e65ceafb8838fd1b159746ba4c2cb
Reviewed-on: https://dart-review.googlesource.com/75206
Commit-Queue: Zach Anderson <zra@google.com>
Reviewed-by: Régis Crelier <regis@google.com>
Reviewed-by: Alexander Markov <alexmarkov@google.com>
2018-09-18 15:30:15 +00:00
William Hesse ba5a4bd8c4 Add periodic output to test.py so test infrastructure doesn't time out.
Every 5 minutes, test.py prints a status update.

Change-Id: Id11d9e4a01a94dc8515a7e2d1df4f3d417998cc1
Reviewed-on: https://dart-review.googlesource.com/75262
Reviewed-by: Alexander Thomas <athom@google.com>
Commit-Queue: William Hesse <whesse@google.com>
2018-09-18 15:19:55 +00:00
Paul Berry a48120aabd Wire up placeholder executable in pkg/analyzer_fe_comparison.
The placeholder executable is replaced by a shell script that invokes
pkg/analyzer_fe_comparison (in a similar way to how
sdk/bin/dartanalyzer invokes pkg/analyzer_cli).  This required some
rewriting of pkg/analyzer_fe_comparison to support analysis of a
single test case (as opposed to analysis of a package, which is what
it did before).

It's now possible to run the comparison tool over the test suite in
language_2.  There are many failures, which I'll begin addressing in
follow-up CLs.

Change-Id: I52d8f3b53064e8e29028571d416f2573c6cba35d
Reviewed-on: https://dart-review.googlesource.com/74820
Reviewed-by: Brian Wilkerson <brianwilkerson@google.com>
Reviewed-by: Konstantin Shcheglov <scheglov@google.com>
Commit-Queue: Paul Berry <paulberry@google.com>
2018-09-13 16:41:20 +00:00
Zach Anderson 568b13905f [vm] Fixes for dartkb testing
The "vm" test suite is cauing the kernel bytecode compiler to
OOM on the bot, so this CL removes it from the test matrix for
dartkb. This CL also protects against non-utf8 data coming in
on the error message pipe during process spawning.

Change-Id: Iab110a49a49ea12d21037719716a228776343602
Reviewed-on: https://dart-review.googlesource.com/74490
Reviewed-by: Alexander Markov <alexmarkov@google.com>
Reviewed-by: Régis Crelier <regis@google.com>
Commit-Queue: Zach Anderson <zra@google.com>
2018-09-12 20:02:10 +00:00
William Hesse 9b7b0d4631 Add commit hash to results upload on builders
Change-Id: I395ea68d7c6f7f45d665279e3dbc0b4f60d3ac1c
Reviewed-on: https://dart-review.googlesource.com/74624
Reviewed-by: Martin Kustermann <kustermann@google.com>
Reviewed-by: Jonas Termansen <sortie@google.com>
2018-09-12 17:15:39 +00:00
Kevin Moore 0f1fa9eeae Remove pkg/dart_messages
Not used

Fixes https://github.com/dart-lang/sdk/issues/27832

Change-Id: Ia1e00fc8be2c904f21a95e89640099fa900a15a5
Reviewed-on: https://dart-review.googlesource.com/74461
Reviewed-by: Peter von der Ahé <ahe@google.com>
2018-09-11 16:20:06 +00:00
Jenny Messerly 24493c2f54 Add support for dartdevk to read Analyzer summaries into Kernel format
This allows dartdevk to be used in the context of an existing build
system based on Analyzer summary files. This will ease migration of
existing dartdevc users over to dartdevk.

Change-Id: I8413f906e384f3f33c98e450adc0860f6fa7bc53
Reviewed-on: https://dart-review.googlesource.com/65641
Reviewed-by: Kevin Millikin <kmillikin@google.com>
Reviewed-by: Vijay Menon <vsm@google.com>
Commit-Queue: Jenny Messerly <jmesserly@google.com>
2018-09-10 22:51:04 +00:00