Commit graph

955 commits

Author SHA1 Message Date
Benjamin Pasero 7d78913dff
smoke - remove only usage 2022-02-12 07:47:54 +01:00
Benjamin Pasero 5911ead4c6
smoke - open a different file for #142745 2022-02-12 07:38:04 +01:00
Robo 01df559c18
chore: update to electron 16 (#137241)
* chore: bump electron@15.3.0

* chore: bump node@16.x

* chore: enable render process reuse

* Revert "watcher - use `type` property for crash reporter location"

This reverts commit bfa488dd8f.

* Revert "watcher - enable crash reports on linux (#136264)"

This reverts commit af261488f8.

* chore: enable crashpad on linux

* chore: bump electron@15.3.1

* chore: update api changes

* chore: bump @vscode/sqlite3@5.0.3

* spec: skip non-context aware module unittests

* chore: fix perf hook integration with node environment

* fix: adopt fs api changes

* chore: fix integration tests

* chore: bump electron@15.3.2

* chore: bump electron@16.0.0

* temp(macOS): kill test instances in OSS

* Revert "temp(macOS): kill test instances in OSS"

This reverts commit b0d796c8d64227a5ec012c060bbbee7d9da27568.

* chore: update chromium version for clang downloader

* some 💄 changes

* align with changes

* adopt more fs.rm

* 💄

* chore: bump @vscode/sqlite3@5.0.4

* fix layers check to account for duplicated types from node.js

* update todo for type casts

* smoke - fix compile issue

* chore: update module cache

* watcher - fix unhandled rejection (fix #137416)

* ci: update node version

* enable stack dumping

* update electron types to 16.x

* chore: bump @vscode/sqlite3@5.0.5

Refs https://github.com/microsoft/vscode/issues/137496

* fix layer issue

* add `AbortSignal` to core types

* chore: update linux compile flags

Refs 797723ec83

* ci: fix linux build

* ci: update github ci cache

* ci: fix remote build in github ci

* ci: better fix for remote build

* chore: bump azure cache

* chore: fix merge conflict

* :chore: update to electron@16.0.2

* chore: bump @vscode/sqlite3@5.0.7

* ci: update to gcc-4.9 for remote

Refs https://github.com/microsoft/vscode/issues/137659

* ci: switch to buster for linux arm

Refs https://github.com/microsoft/vscode/issues/137927

* ci: fix build on linux arm64

* ci: fix arm client compiler toolchain

Refs #137927

* chore: bump electron@16.0.3

* ci: fix compile flags for the c toolchain

* chore: bump electron@16.0.4

* Add experimental dark mode flag (#139109)

* Add experimental dark mode flag

* Apply PR feedback

* chore: bump electron@16.0.6

* chore: bump electron@16.0.7

Fixes https://github.com/microsoft/vscode/issues/138792
Fixes https://github.com/microsoft/vscode/issues/139300

* chore: experimental highlight API

* smoke - fix compile issue

* FIXME: custom ELECTRON_RUN_AS_NODE with node worker

* Revert "chore: bump electron@16.0.7"

This reverts commit 5fd01cf37c.

* Revert "Revert "chore: bump electron@16.0.7""

This reverts commit a7f1b73951.

* chore: fix github linux workflow

* chore: address review feedback

* chore: bump electron@16.0.8

* ci: revert to stretch distro for linux arm

Refs https://github.com/microsoft/vscode/issues/137927

* ci: force build

* chore: update yarn.lock

* address feedback

* Revert "FIXME: custom ELECTRON_RUN_AS_NODE with node worker"

This reverts commit 7b48fa3732.

* ci: fix remote folder build

* chore: fix github linux ci

* 🆙 `versionSpec`

Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
Co-authored-by: Raymond Zhao <raymondzhao@microsoft.com>
2022-02-08 20:09:00 +01:00
Benjamin Pasero b6c093a888
💄 todos 2022-02-08 18:04:54 +01:00
Sandeep Somavarapu 3b1da68d60
#142027 enable preferences smoke test 2022-02-08 08:30:27 +01:00
Benjamin Pasero 0d741957d9
smoke - bring back keybindings test 2022-02-05 07:06:54 +01:00
Benjamin Pasero b667613ff8
smoke - retry fetch to update service (fix #142188) 2022-02-04 19:10:21 +01:00
Megan Rogge 921264bfe3
add splitCwd smoke test for linux/mac (NaiveCwdDetection) (#141974) 2022-02-03 19:57:26 -06:00
Rob Lourens b46986a65f Remove .only 2022-02-03 09:37:56 -08:00
Benjamin Pasero ee3556530f
smoke - skip test (#142020) 2022-02-02 18:16:10 +01:00
Benjamin Pasero 77a93b43e9
smoke - skip #141054 2022-02-02 16:51:55 +01:00
Johannes Rieken 4a130c40ed
enable @typescript-eslint/member-delimiter-style, https://github.com/microsoft/vscode/issues/140391 2022-02-02 14:35:33 +01:00
SteVen Batten a48c94c91f
bump node-fetch version in smoke tests 2022-02-01 11:40:45 -08:00
Benjamin Pasero 12c5c57e46
smoke - simplify line number test (#141054) 2022-02-01 10:08:15 +01:00
Sandeep Somavarapu fb8316c8f4
#141054 check line numbers in settigns file 2022-02-01 09:35:54 +01:00
Sandeep Somavarapu d4e08c85a9
#141054 enable the tests and keep debugging 2022-01-28 13:50:09 +01:00
Benjamin Pasero c9960f9cee
Cleanup package.json test scripts (#141210)
* tests - remove `yarn test`

* fix smoke test

* readme

* 💄

* ci - do not install playwright
2022-01-22 13:07:14 +01:00
Benjamin Pasero b7cdfce7e5
Smoke test runner fails or hangs without error (fix #141148) 2022-01-22 08:43:21 +01:00
Benjamin Pasero 01a976f80c
smoke - properly skip tests (#141054) 2022-01-21 08:55:59 +01:00
Benjamin Pasero 5993199079
smoke - skip flaky one (#141054) 2022-01-21 07:26:59 +01:00
Connor Peet 904c63debd
smoketests: use new extractSync option 2022-01-20 11:04:36 -08:00
Benjamin Pasero e07713a8a9
smoke - log fatal errors 2022-01-20 14:18:06 +01:00
Benjamin Pasero 365fea1d61
fix #141060 2022-01-20 13:59:47 +01:00
Benjamin Pasero 96206bb5a8
smoke - 🆙 timeouts 2022-01-19 19:45:03 +01:00
Connor Peet bdc81fc0a9
tests: log progress as stable code downloads 2022-01-19 09:16:39 -08:00
Benjamin Pasero 158cd6da42
smoke - log code download (#140769)
* smoke - log progress/errors of vscode download

//cc @connor4312

* reduce spam
2022-01-15 11:31:13 +01:00
Benjamin Pasero 9be2757019
🆙 playwright@1.18 (#140767)
* tests - use `@playwright/test@1.18.0-rc1`

* fix bad dependency

* clear more weird ts dependencies
2022-01-15 09:35:39 +01:00
Daniel Imms f2c755a878 Skip smoke test
Part of #139076
2022-01-14 09:47:56 -08:00
Daniel Imms 0b7bc6d73c Re-enable auto replies tests with retries on Windows only
Fixes #139076
2022-01-14 08:56:11 -08:00
Daniel Imms 860e935d1a Skip notebooks smoke test suite
Part of #140575
2022-01-12 07:35:56 -08:00
Benjamin Pasero 18a7108073
smoke - select tab over quick pick (#139944)
* smoke - further try to reduce usages of quick pick

* poke
2021-12-30 22:38:59 +01:00
Benjamin Pasero b2e9e87c2e
smoke - skip flaky notebook test (#139672) 2021-12-23 17:12:29 +01:00
Benjamin Pasero b2e79a699f
smoke - improve app lifecycle (#139693)
* smoke - make sure app is closed when `app.start` fails

* smoke - `capturePage` to fallback to active window

* smoke - more logging around remote resolving
2021-12-23 16:38:54 +01:00
Benjamin Pasero bb39ae82cf
smoke - improve runCommand and disable more tests 2021-12-20 08:25:08 +01:00
Benjamin Pasero 2d77c9e23a
smoke - more robust usage of quick input / access (#139367)
* smoke - more robust `openQuickAccessAndWait`

* tweaks

* 💄

* trigger

* fix fluke

* poke

* fix terminal weirdness

* poke

* address feedback
2021-12-17 18:49:17 +01:00
Daniel Imms 88fcbd84e0 Fix auto replies smoke tests
This was flaky because the shell's wrapping character may have come after the
input (eg. 'foo> bar'), the fix is to allow characters between the matching
string and reply via regex.

Fixes #139083
2021-12-17 09:42:50 -08:00
Benjamin Pasero 7141436baa
smoke - skip failing terminal test (#139353) 2021-12-17 08:21:58 +01:00
Benjamin Pasero 1a4a2714bf
smoke - skip failing terminal test (#139349) 2021-12-17 07:34:20 +01:00
Daniel Imms d33e3d2fbc Re-enable flaky auto replies tests
Need a new playwright trace from a failure to be able to diagnose

Part of #139083
2021-12-16 11:36:53 -08:00
Benjamin Pasero ae8aeb653d
smoke - use absolute paths for opening files (#139322) 2021-12-16 20:14:12 +01:00
Benjamin Pasero 9e22f1ccac
smoke - disable flaky notebook tests (#139270) 2021-12-16 15:55:15 +01:00
Daniel Imms dfc4077fb0 Use dom renderer for terminal smoke tests
Part of #139083
2021-12-16 06:38:11 -08:00
Sandeep Somavarapu 995d40b12d
#139183 enable the test and add a log statement 2021-12-16 14:34:47 +01:00
Benjamin Pasero 51eda13af4
smoke - move editor test into language test 2021-12-16 10:29:46 +01:00
Rob Lourens 86bdc567e9 Remove obsolete comment 2021-12-15 16:41:20 -08:00
Johannes Rieken 1b2c610ffe
skip bad test, https://github.com/microsoft/vscode/issues/139183 2021-12-15 10:51:01 +01:00
Matt Bierner 8cf4dcdade
Re-enable notebook smoke tests (#139127)
Fixes #126371
2021-12-14 16:50:22 -08:00
Daniel Imms 2eb4cec44b Wait for terminal to be ready before changing color
Fixes #139081
2021-12-14 10:14:06 -08:00
Daniel Imms 9c99eaa0b2 Also log exception in itSkipOnFail 2021-12-14 08:15:54 -08:00
Daniel Imms c29df4c2d5 Add itSkipOnFail util
Part of #139076
2021-12-14 08:05:43 -08:00
Benjamin Pasero 5526cd558f
smoke - remove only 2021-12-14 07:38:08 +01:00
Daniel Imms 50f96a3c6b Clean up terminal creation in smoke tests 2021-12-13 16:54:42 -08:00
Daniel Imms 73a19337ac Merge remote-tracking branch 'origin/main' into tyriar/133524 2021-12-13 16:28:23 -08:00
Daniel Imms 9566e299dd Add auto replies test 2021-12-13 16:20:34 -08:00
Megan Rogge a2f5ec29b2
Revert "Revert "be sure that terminal target gets set for the instance (#138875)""
This reverts commit 8605d7aeff.
2021-12-13 17:08:29 -06:00
Megan Rogge 0602587ff2
re-enable smoke tests, keep editor fix (#139012) 2021-12-13 12:50:58 -06:00
Rob Lourens 7e4942dcb7 Revert "Re-enable additional notebook smoke tests"
This reverts commit b3b9d4e2e7.
2021-12-13 09:18:17 -08:00
Daniel Imms 8605d7aeff Revert "be sure that terminal target gets set for the instance (#138875)"
This reverts commit 578eb0d4ae.
2021-12-13 08:15:32 -08:00
Matt Bierner b3b9d4e2e7
Re-enable additional notebook smoke tests
For #126371

These pass for me locally
2021-12-10 17:08:02 -08:00
Matt Bierner 02c3551a59
Re-enable notebook smoke suite
For #126371

This single test passes for me. Will look at re-enabling individual tests next
2021-12-10 17:01:02 -08:00
Megan Rogge 86ee106054
skip failing tests 2021-12-10 16:06:13 -08:00
Megan Rogge 578eb0d4ae
be sure that terminal target gets set for the instance (#138875) 2021-12-10 14:51:45 -08:00
Daniel Imms 69dcf8b0f6 Revert "Re-enable tests now that runCommandWithValue is more reliable"
This reverts commit 4554eac76d.
2021-12-10 13:05:53 -08:00
Daniel Imms 4554eac76d Re-enable tests now that runCommandWithValue is more reliable
Part of #138658
2021-12-10 10:59:40 -08:00
Benjamin Pasero c5ea0fa337
fix some recent test failures 2021-12-10 14:34:14 +01:00
Benjamin Pasero 05de5834b0
smoke - add test to verify an editor can be saved 2021-12-10 13:45:08 +01:00
Benjamin Pasero 4667cac14b
smoke - more obvious tests setup 2021-12-10 13:32:08 +01:00
Rob Lourens e5637ce9af Fix #138748 2021-12-09 10:00:25 -08:00
Johannes Rieken ee3e404b71
disable failing smoketest, https://github.com/microsoft/vscode/issues/138748 2021-12-09 12:53:27 +01:00
Benjamin Pasero c04c29d496
smoke - mention playwright trace website 2021-12-09 12:36:41 +01:00
Benjamin Pasero 9c7387bb5a
smoke - bring back stable smoke tests 2021-12-09 11:05:41 +01:00
Benjamin Pasero 27e38a8e27
smoke - always create screenshot on failure on desktop 2021-12-09 09:51:55 +01:00
Benjamin Pasero ae0ee547ba
smoke - reimplement test handlers 2021-12-09 09:33:51 +01:00
Benjamin Pasero 158bd2507e
smoke - always have a logger 2021-12-09 08:48:42 +01:00
Benjamin Pasero acc0803f38
cleanup automation 2021-12-09 07:03:29 +01:00
Rob Lourens 1341ca3d7f Remove timeouts in search smoketest.
Improvements came from waiting for search to complete before clicking buttons, clearing previous results before starting the search, and adding a retry around the clicking.
2021-12-08 15:34:35 -08:00
Benjamin Pasero 18cba4882d
smoke - more logging 2021-12-08 15:23:27 +01:00
Benjamin Pasero 64562e2a0e
smoke - reimplement logging 2021-12-08 14:13:41 +01:00
Benjamin Pasero 2c68d4de7e
smoke - always log with trace 2021-12-08 10:50:27 +01:00
Benjamin Pasero fbad065eea
Playwright: record a trace per failing test, not suite (#138600)
* smoke - record traces per test and not entire suite

* smoke - only persist failing tests

* smoke - cleanup

* smoke - more logging

* smoke - push a test failure to proof the point

* smoke - switch back to chrome for smoke tests

* smoke - warn when exit takes 10s

* Revert "smoke - push a test failure to proof the point"

This reverts commit e572a0c40d.
2021-12-08 10:09:30 +01:00
Benjamin Pasero 13c0ed811e
🆙 playwright & set trace names (#138539) 2021-12-06 19:42:05 +01:00
Benjamin Pasero 2085b19a51
smoke - allow 30s max for deleting test path (#137725) 2021-12-06 14:09:02 +01:00
Benjamin Pasero e8e0fb874d
smoke - disable test that is flaky still 2021-12-06 13:44:01 +01:00
Benjamin Pasero fe227dacb7
lifecycle - introduce and adopt finalVeto for backups (#138055) 2021-12-06 11:16:57 +01:00
Benjamin Pasero e1caacebce
backup - cancel pending operations on shutdown and handle cancellation better (#138055) 2021-12-06 10:55:33 +01:00
Benjamin Pasero 9d427e4df4
smoke test tweaks
- remove timeout on shutdown
- log exactly where time is spend on shutdown (web)
- stop spawning code when terminated
2021-12-02 07:34:13 +01:00
Megan Rogge 4a21019476
fix #138238, skip failing test 2021-12-01 08:50:26 -08:00
Megan Rogge c0f21fa378
fix #138239, skip test 2021-12-01 08:38:28 -08:00
Megan Rogge 7b3078d931
fix #137795 2021-11-30 12:48:58 -08:00
Megan Rogge 7f7fad2f9e
fix #137798 2021-11-30 12:38:52 -08:00
Daniel Imms faf6f0e1fd Setup terminal tests for 3 retries to minimize impact on build
This isn't a great long term solution but it should help reduce failures
for now.

Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge 005947e3b8
fix #137722
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge e89889fe54
fix #137799 2021-11-30 11:21:01 -08:00
Megan Rogge 18725fc147
set default profile to pwsh for only windows for #137225 2021-11-30 10:57:59 -08:00
Megan Rogge 4be98a3bce
set default to pwsh instead of bash for #137725 2021-11-30 10:21:15 -08:00
Benjamin Pasero 7b6c1065c7
smoke - temporary bring back timeout 2021-11-30 11:04:39 +01:00
Benjamin Pasero 1af6cb0edc
smoke test tweaks 2021-11-29 17:53:11 +01:00
Benjamin Pasero e241749320
smoke - print more backup info 2021-11-29 14:05:40 +01:00
Benjamin Pasero 5bb653374f
smoke - diagnose failing backup test 2021-11-29 09:56:19 +01:00
Benjamin Pasero cbbba8e69a
smoke - unique user data dir for stable tests too 2021-11-29 09:11:23 +01:00