Commit graph

857 commits

Author SHA1 Message Date
Megan Rogge 5357dcfc04
fine tune shell integration messaging (#148856) 2022-05-06 09:26:12 -07:00
Daniel Imms de7062f173
Re-enable retries 2022-05-06 08:13:19 -07:00
Daniel Imms a5f0a29527
Fix, re-enable or disable skipped terminal smoke tests
Fixes #146700
2022-05-06 08:11:50 -07:00
Megan Rogge bbf3142a89
use describe.skip for windows (#148580) 2022-05-02 14:23:55 -07:00
Benjamin Pasero f90dd46fc3
smoke - fail early if cloning fails 2022-05-02 08:38:03 +02:00
Megan Rogge 032d8ce4c6
shell integration smoke tests (#148056) 2022-04-25 14:53:55 -07:00
Benjamin Pasero fb8dc11d58
Failed IPC communication with playwright smoke tests from preload script (for #146785) 2022-04-21 18:58:44 +02:00
Benjamin Pasero a9010d094a
smoke - support retryWithRestart in web too 2022-04-19 09:03:17 +02:00
Benjamin Pasero ac6b490b2d
retr (#147442) 2022-04-14 11:34:22 +02:00
Benjamin Pasero 55759234d7
preload - revert retry logic which does not seem to help 2022-04-14 08:14:40 +02:00
Benjamin Pasero c4cdb552a5
Remove legacy smoke test driver (#147393)
* wip

* fix imports

* more lipstick

* fix?

* fix
2022-04-13 19:19:58 +02:00
Benjamin Pasero d215bada5e
smoke - more logging for shared process 2022-04-12 11:13:19 +02:00
Benjamin Pasero 84d6b4a12a
smoke - enable more logging for #146800 2022-04-11 10:34:47 +02:00
Benjamin Pasero 497a035770
smoke - properly pick suite name 2022-04-10 10:13:07 +02:00
Benjamin Pasero d9db5d10ec
smoke - try to fix terminal tests and partition logs path per suite 2022-04-09 13:38:59 +02:00
Benjamin Pasero 9a8fa5f014
revert 2022-04-08 19:12:34 +02:00
Benjamin Pasero af6bfd1352
smoke - bring back ext tests with retry for now to have coverage (#146800) 2022-04-08 12:33:52 +02:00
Benjamin Pasero b6fc6eae3b
skip terminal tests (#147063) 2022-04-08 10:32:00 +02:00
Benjamin Pasero acc4c50ffa
smoke - skip flaky tests (#146800) 2022-04-06 19:36:17 +02:00
Benjamin Pasero 8e8b3026fc
tests - reduce spam and work 2022-04-06 19:34:41 +02:00
Benjamin Pasero 66c9155d93
smoke - skip install and enable vscode-smoketest-check extension in remote (#146800) 2022-04-05 17:31:10 +02:00
Benjamin Pasero 690a9c0f8d
smoke - adopt repo changes 2022-04-05 17:19:53 +02:00
Benjamin Pasero e58cad64a9
smoke - add refs to #146811 2022-04-05 11:49:52 +02:00
Benjamin Pasero a90f57b4a9
smoke - skip terminal tests in desktop 2022-04-05 11:47:29 +02:00
Benjamin Pasero a99a8711af
skip flaky terminal smoke test (#146796) 2022-04-05 08:40:07 +02:00
Jackson Kearl ee8535e777
Fix #124335 2022-04-04 12:48:12 -07:00
Benjamin Pasero f707fd3b09
smoke - run legacy tests again, do not fail new playwright tests for a while to figure out flakiness 2022-04-04 15:03:17 +02:00
Benjamin Pasero 65bfe1ef11
smoke - enable multi root tests in web 2022-04-04 13:47:43 +02:00
Benjamin Pasero 2ada17080c
Use playwright for desktop smoke tests (#146692)
* Use `playwright` for desktop smoke tests

* fix distro issues

* tests - enable prefs tests for web
2022-04-04 10:13:08 +02:00
SteVen Batten 6b74534212
rename side panel (#144862)
* rename side panel

* tweaks based on feedback
2022-03-10 16:20:23 -08:00
Benjamin Pasero 5a17b1bb76
smoke - retry stable code download (fix #143386) (#143592) 2022-02-22 09:04:56 +01:00
Benjamin Pasero 7d78913dff
smoke - remove only usage 2022-02-12 07:47:54 +01:00
Benjamin Pasero 5911ead4c6
smoke - open a different file for #142745 2022-02-12 07:38:04 +01:00
Benjamin Pasero b6c093a888
💄 todos 2022-02-08 18:04:54 +01:00
Sandeep Somavarapu 3b1da68d60
#142027 enable preferences smoke test 2022-02-08 08:30:27 +01:00
Benjamin Pasero 0d741957d9
smoke - bring back keybindings test 2022-02-05 07:06:54 +01:00
Benjamin Pasero b667613ff8
smoke - retry fetch to update service (fix #142188) 2022-02-04 19:10:21 +01:00
Megan Rogge 921264bfe3
add splitCwd smoke test for linux/mac (NaiveCwdDetection) (#141974) 2022-02-03 19:57:26 -06:00
Rob Lourens b46986a65f Remove .only 2022-02-03 09:37:56 -08:00
Benjamin Pasero ee3556530f
smoke - skip test (#142020) 2022-02-02 18:16:10 +01:00
Benjamin Pasero 77a93b43e9
smoke - skip #141054 2022-02-02 16:51:55 +01:00
Johannes Rieken 4a130c40ed
enable @typescript-eslint/member-delimiter-style, https://github.com/microsoft/vscode/issues/140391 2022-02-02 14:35:33 +01:00
Benjamin Pasero 12c5c57e46
smoke - simplify line number test (#141054) 2022-02-01 10:08:15 +01:00
Sandeep Somavarapu fb8316c8f4
#141054 check line numbers in settigns file 2022-02-01 09:35:54 +01:00
Sandeep Somavarapu d4e08c85a9
#141054 enable the tests and keep debugging 2022-01-28 13:50:09 +01:00
Benjamin Pasero b7cdfce7e5
Smoke test runner fails or hangs without error (fix #141148) 2022-01-22 08:43:21 +01:00
Benjamin Pasero 01a976f80c
smoke - properly skip tests (#141054) 2022-01-21 08:55:59 +01:00
Benjamin Pasero 5993199079
smoke - skip flaky one (#141054) 2022-01-21 07:26:59 +01:00
Connor Peet 904c63debd
smoketests: use new extractSync option 2022-01-20 11:04:36 -08:00
Benjamin Pasero e07713a8a9
smoke - log fatal errors 2022-01-20 14:18:06 +01:00
Benjamin Pasero 96206bb5a8
smoke - 🆙 timeouts 2022-01-19 19:45:03 +01:00
Connor Peet bdc81fc0a9
tests: log progress as stable code downloads 2022-01-19 09:16:39 -08:00
Benjamin Pasero 158cd6da42
smoke - log code download (#140769)
* smoke - log progress/errors of vscode download

//cc @connor4312

* reduce spam
2022-01-15 11:31:13 +01:00
Daniel Imms f2c755a878 Skip smoke test
Part of #139076
2022-01-14 09:47:56 -08:00
Daniel Imms 0b7bc6d73c Re-enable auto replies tests with retries on Windows only
Fixes #139076
2022-01-14 08:56:11 -08:00
Daniel Imms 860e935d1a Skip notebooks smoke test suite
Part of #140575
2022-01-12 07:35:56 -08:00
Benjamin Pasero 18a7108073
smoke - select tab over quick pick (#139944)
* smoke - further try to reduce usages of quick pick

* poke
2021-12-30 22:38:59 +01:00
Benjamin Pasero b2e9e87c2e
smoke - skip flaky notebook test (#139672) 2021-12-23 17:12:29 +01:00
Benjamin Pasero b2e79a699f
smoke - improve app lifecycle (#139693)
* smoke - make sure app is closed when `app.start` fails

* smoke - `capturePage` to fallback to active window

* smoke - more logging around remote resolving
2021-12-23 16:38:54 +01:00
Benjamin Pasero bb39ae82cf
smoke - improve runCommand and disable more tests 2021-12-20 08:25:08 +01:00
Benjamin Pasero 2d77c9e23a
smoke - more robust usage of quick input / access (#139367)
* smoke - more robust `openQuickAccessAndWait`

* tweaks

* 💄

* trigger

* fix fluke

* poke

* fix terminal weirdness

* poke

* address feedback
2021-12-17 18:49:17 +01:00
Daniel Imms 88fcbd84e0 Fix auto replies smoke tests
This was flaky because the shell's wrapping character may have come after the
input (eg. 'foo> bar'), the fix is to allow characters between the matching
string and reply via regex.

Fixes #139083
2021-12-17 09:42:50 -08:00
Benjamin Pasero 7141436baa
smoke - skip failing terminal test (#139353) 2021-12-17 08:21:58 +01:00
Benjamin Pasero 1a4a2714bf
smoke - skip failing terminal test (#139349) 2021-12-17 07:34:20 +01:00
Daniel Imms d33e3d2fbc Re-enable flaky auto replies tests
Need a new playwright trace from a failure to be able to diagnose

Part of #139083
2021-12-16 11:36:53 -08:00
Benjamin Pasero ae8aeb653d
smoke - use absolute paths for opening files (#139322) 2021-12-16 20:14:12 +01:00
Benjamin Pasero 9e22f1ccac
smoke - disable flaky notebook tests (#139270) 2021-12-16 15:55:15 +01:00
Daniel Imms dfc4077fb0 Use dom renderer for terminal smoke tests
Part of #139083
2021-12-16 06:38:11 -08:00
Sandeep Somavarapu 995d40b12d
#139183 enable the test and add a log statement 2021-12-16 14:34:47 +01:00
Benjamin Pasero 51eda13af4
smoke - move editor test into language test 2021-12-16 10:29:46 +01:00
Rob Lourens 86bdc567e9 Remove obsolete comment 2021-12-15 16:41:20 -08:00
Johannes Rieken 1b2c610ffe
skip bad test, https://github.com/microsoft/vscode/issues/139183 2021-12-15 10:51:01 +01:00
Matt Bierner 8cf4dcdade
Re-enable notebook smoke tests (#139127)
Fixes #126371
2021-12-14 16:50:22 -08:00
Daniel Imms 2eb4cec44b Wait for terminal to be ready before changing color
Fixes #139081
2021-12-14 10:14:06 -08:00
Daniel Imms 9c99eaa0b2 Also log exception in itSkipOnFail 2021-12-14 08:15:54 -08:00
Daniel Imms c29df4c2d5 Add itSkipOnFail util
Part of #139076
2021-12-14 08:05:43 -08:00
Benjamin Pasero 5526cd558f
smoke - remove only 2021-12-14 07:38:08 +01:00
Daniel Imms 50f96a3c6b Clean up terminal creation in smoke tests 2021-12-13 16:54:42 -08:00
Daniel Imms 73a19337ac Merge remote-tracking branch 'origin/main' into tyriar/133524 2021-12-13 16:28:23 -08:00
Daniel Imms 9566e299dd Add auto replies test 2021-12-13 16:20:34 -08:00
Megan Rogge a2f5ec29b2
Revert "Revert "be sure that terminal target gets set for the instance (#138875)""
This reverts commit 8605d7aeff.
2021-12-13 17:08:29 -06:00
Megan Rogge 0602587ff2
re-enable smoke tests, keep editor fix (#139012) 2021-12-13 12:50:58 -06:00
Rob Lourens 7e4942dcb7 Revert "Re-enable additional notebook smoke tests"
This reverts commit b3b9d4e2e7.
2021-12-13 09:18:17 -08:00
Daniel Imms 8605d7aeff Revert "be sure that terminal target gets set for the instance (#138875)"
This reverts commit 578eb0d4ae.
2021-12-13 08:15:32 -08:00
Matt Bierner b3b9d4e2e7
Re-enable additional notebook smoke tests
For #126371

These pass for me locally
2021-12-10 17:08:02 -08:00
Matt Bierner 02c3551a59
Re-enable notebook smoke suite
For #126371

This single test passes for me. Will look at re-enabling individual tests next
2021-12-10 17:01:02 -08:00
Megan Rogge 86ee106054
skip failing tests 2021-12-10 16:06:13 -08:00
Megan Rogge 578eb0d4ae
be sure that terminal target gets set for the instance (#138875) 2021-12-10 14:51:45 -08:00
Daniel Imms 69dcf8b0f6 Revert "Re-enable tests now that runCommandWithValue is more reliable"
This reverts commit 4554eac76d.
2021-12-10 13:05:53 -08:00
Daniel Imms 4554eac76d Re-enable tests now that runCommandWithValue is more reliable
Part of #138658
2021-12-10 10:59:40 -08:00
Benjamin Pasero c5ea0fa337
fix some recent test failures 2021-12-10 14:34:14 +01:00
Benjamin Pasero 05de5834b0
smoke - add test to verify an editor can be saved 2021-12-10 13:45:08 +01:00
Benjamin Pasero 4667cac14b
smoke - more obvious tests setup 2021-12-10 13:32:08 +01:00
Rob Lourens e5637ce9af Fix #138748 2021-12-09 10:00:25 -08:00
Johannes Rieken ee3e404b71
disable failing smoketest, https://github.com/microsoft/vscode/issues/138748 2021-12-09 12:53:27 +01:00
Benjamin Pasero 9c7387bb5a
smoke - bring back stable smoke tests 2021-12-09 11:05:41 +01:00
Benjamin Pasero 27e38a8e27
smoke - always create screenshot on failure on desktop 2021-12-09 09:51:55 +01:00
Benjamin Pasero ae0ee547ba
smoke - reimplement test handlers 2021-12-09 09:33:51 +01:00
Benjamin Pasero 158bd2507e
smoke - always have a logger 2021-12-09 08:48:42 +01:00
Benjamin Pasero acc0803f38
cleanup automation 2021-12-09 07:03:29 +01:00