Commit Graph

896 Commits

Author SHA1 Message Date
Megan Rogge
4a21019476
fix #138238, skip failing test 2021-12-01 08:50:26 -08:00
Megan Rogge
c0f21fa378
fix #138239, skip test 2021-12-01 08:38:28 -08:00
Megan Rogge
7b3078d931
fix #137795 2021-11-30 12:48:58 -08:00
Megan Rogge
7f7fad2f9e
fix #137798 2021-11-30 12:38:52 -08:00
Daniel Imms
faf6f0e1fd Setup terminal tests for 3 retries to minimize impact on build
This isn't a great long term solution but it should help reduce failures
for now.

Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge
005947e3b8
fix #137722
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge
e89889fe54
fix #137799 2021-11-30 11:21:01 -08:00
Megan Rogge
18725fc147
set default profile to pwsh for only windows for #137225 2021-11-30 10:57:59 -08:00
Megan Rogge
4be98a3bce
set default to pwsh instead of bash for #137725 2021-11-30 10:21:15 -08:00
Benjamin Pasero
7b6c1065c7
smoke - temporary bring back timeout 2021-11-30 11:04:39 +01:00
Benjamin Pasero
1af6cb0edc
smoke test tweaks 2021-11-29 17:53:11 +01:00
Benjamin Pasero
e241749320
smoke - print more backup info 2021-11-29 14:05:40 +01:00
Benjamin Pasero
5bb653374f
smoke - diagnose failing backup test 2021-11-29 09:56:19 +01:00
Benjamin Pasero
cbbba8e69a
smoke - unique user data dir for stable tests too 2021-11-29 09:11:23 +01:00
Benjamin Pasero
c42793d035
smoke - do not fail build when unable to delete workspace folder (workaround #137725) 2021-11-29 08:49:37 +01:00
Benjamin Pasero
a5efd80ee0
Revert "smoke - print task list when deleting workspace path fails"
This reverts commit 368154bd0b.
2021-11-29 08:46:35 +01:00
Benjamin Pasero
368154bd0b
smoke - print task list when deleting workspace path fails 2021-11-29 08:04:30 +01:00
Benjamin Pasero
e71b28a444
Smoke test lifecycle changes (#137969)
* rewrite teardown

* 💄

* avoid spam errors

* 💄

* split spawning browser from electron

* await copyExtension

* cleanup

* refactor methods

* cleanup

* cleanup

* cleanup

* 🆙 deps
2021-11-28 10:30:52 +01:00
Benjamin Pasero
13ff6baa3f
fix smoke tests 2021-11-26 14:45:35 +01:00
Benjamin Pasero
8d250e99e7
smoke - wait for tab becoming dirty before exit 2021-11-26 11:00:15 +01:00
Benjamin Pasero
a11814c57a
smoke - switch away from potentially flaky editors.selectTab method 2021-11-26 09:22:19 +01:00
Benjamin Pasero
6f2239307b
Smoke test tweaks (#137809)
* smoke - move data migration tests into one and align

* fix app starting

* `createWorkspaceFile` is not async

* 💄

* support screenshot on failure even for stable app

* smoke - try to remove timeout (#137847)

* improve exit call
2021-11-25 14:37:22 +01:00
Daniel Imms
eeae10e56c Skip flaky test
Part of #137795
2021-11-24 10:04:38 -08:00
Daniel Imms
653e5cdaee Skip flaky test
Part of #137808
2021-11-24 09:59:22 -08:00
Daniel Imms
f880669743
Merge pull request #137763 from microsoft/tyriar/cleanup_smoke
Move terminal smoke tests into a single suite and reduce boilterplate
2021-11-24 09:54:50 -08:00
Daniel Imms
07d986443d
Skipping flaky test
Part of #137799
2021-11-24 09:50:26 -08:00
Daniel Imms
42bd3e884b More clean up of terminal smoke test init 2021-11-23 15:46:51 -08:00
Rob Lourens
2932ec095d Add retry to quickaccess tests
Fix #137733
2021-11-23 15:35:48 -08:00
Daniel Imms
d7f10626b8 Clean up terminal smoke test setup
Part of #136064
2021-11-23 15:18:38 -08:00
Daniel Imms
68e491f99f Re-enable other smoke tests 2021-11-23 14:50:52 -08:00
Daniel Imms
78d7ece7aa Add basic detach/attach terminal tests
Part of #136064
2021-11-23 13:23:54 -08:00
Daniel Imms
ef440e563d Merge remote-tracking branch 'origin/main' into tyriar/persist_tests 2021-11-23 12:47:36 -08:00
Benjamin Pasero
1b40be3377
smoke - enable graceful-fs (#137734) 2021-11-23 17:29:08 +01:00
Rob Lourens
3bac53642b Disable flaky search smoke test #137195 2021-11-22 14:25:23 -08:00
Megan Rogge
4e303fcc52
fix #137590 2021-11-21 10:04:21 -08:00
Daniel Imms
2f7ab5c0e0 Disable should update color of the tab
Flake in CI
2021-11-19 13:58:01 -08:00
Daniel Imms
5dec5256d7 Add some detach/attach tests 2021-11-19 10:33:43 -08:00
Megan Rogge
f66bc86da8
add terminal editor and tab smoke tests (#137393)
* Add a bunch of tests

* tweak tests

* add profile tests, now breaking (no profiles showing up)

* uncomment tests

* update expected

* fix test

* merge

* all passing

* bunch of improvements

* improve readability

* all should be passing and cleaned up

* all passing

* fix #137243 and clean-up

* remove .only

* fix #137247

* get rid of enum

* see if this fixes timing issue

* use keybinding for show terminal instead

* remove delay, implement better accept function

* get rid of unneeded index

* try something else

* wait for empty editor to be active

* remove .only

* decrease redundancy in names

* re-add xterm selector

* try something else

* undo change that broke things worse

* add terminal-tabs test

* all tabs tests passing locally

* kill all

* await before running each

* fix tests

* remove .only

* try waiting for focused xterm

* remove .only

* clean up

* 🧹

* fix profiles tests by using this.app.props

* revert to use default shell

* re-add conditional

* Get tests passing on WebKit

On WebKit the smoke tests were failing because the quick pick was
triggering a focus event on the terminal after the blur event had
already happened, this caused the view service to think the terminal
was still focused when it wasn't. The fix was to reset the context key
also in IViewsService.closeView.

* Safari -> WebKit

* Prefer arrow functions

* remove beforeEach timeout

* add timeouts to contributed profile tests

* add terminal editor tests, fix #137377

* add a bunch of tests

* refactor

* get rid of profile specific command

* more polish

* refactor getTabs -> assertTerminalGroups

* fix failing test

* more polish

* remove .only

* add assertSingleTab

* remove unused import

* fix error

* fix more failures

* more changes

* fix almost all except for plus button

* fix failing plus button test

* all passing

* modify error that gets thrown

* modify error message again

* remove unused wildcard/ ANY_NAME, fix icon code

* fix icon code

* large refactor, improvements

* finish polish

* 1 failing

* get test to pass

Co-authored-by: Daniel Imms <2193314+Tyriar@users.noreply.github.com>
2021-11-18 15:11:40 -08:00
Megan Rogge
00fa317c43
Add terminal profile smoke tests (#137079) 2021-11-17 14:00:01 -08:00
Benjamin Pasero
bacf6ed2c1
smoke - properly create screenshots and stop instances (#137220) 2021-11-15 12:15:25 +01:00
Daniel Imms
3c9b18e135 Remove test only 2021-11-12 06:16:17 -08:00
Daniel Imms
634dae736e Merge remote-tracking branch 'origin/main' into tyriar/smoke_test_improvements 2021-11-12 05:45:20 -08:00
Daniel Imms
e6caf0da49 Pass terminal profiles test 2021-11-10 12:27:38 -08:00
Daniel Imms
5bfaf29f2b Fix layering problem 2021-11-10 08:38:02 -08:00
Benjamin Pasero
bef4dba21f
Parcel update and CI improvements (#136830)
* 🆙 product

* 🆙 parcel/watcher

* 🆙 parcel/watcher

* tests - separate remote logs from others

* store server logs too

* more tweaks

* fix name

* error when 10s passed
2021-11-10 08:13:56 +01:00
Daniel Imms
bd98431baf Write basic terminal default profile test
Co-authored-by: Megan Rogge <merogge@microsoft.com>
2021-11-09 10:10:54 -08:00
Daniel Imms
28da3051b3 Tidy up smoke test imports 2021-11-09 08:26:39 -08:00
Daniel Imms
281bacb074 Stub out some terminal smoke tests
Part of #136064
2021-11-09 08:25:15 -08:00
Benjamin Pasero
f9e8dc2095
🆙 playwright 2021-11-04 09:27:22 +01:00
Benjamin Pasero
7ca8b0f613
Statusbar - checks if 'Go to Line' works if called from the status bar: (fix #135962) 2021-10-28 07:22:45 +02:00
Rob Lourens
83fec0220c Add retry logic for flaky git operations
Fix #132218
2021-10-12 17:08:20 -07:00
Benjamin Pasero
769d5fb521
smoke - disable search smoke tests on windows (#132218) 2021-09-06 18:07:58 +02:00
Sandeep Somavarapu
77b1fb79f5
Fix #132233 2021-09-06 14:32:19 +02:00
Johannes Rieken
70e30bc64e
disable flaky/failing smoketest, https://github.com/microsoft/vscode/issues/132233 2021-09-03 11:38:14 +02:00
Benjamin Pasero
a3acef919f
smoke - ignore any failure from capturing screenshot 2021-09-03 09:31:01 +02:00
Benjamin Pasero
90443f7a8a
tests - try to make some tests more robust 2021-08-12 07:48:02 +02:00
Benjamin Pasero
6957e52e4b
smoke - always create test folder 2021-08-05 10:31:07 +02:00
Benjamin Pasero
b96644b15f
smoke tests - drop 'tmp' and try to deal with tmp path ourself (#130102) 2021-08-05 10:04:00 +02:00
Benjamin Pasero
70e6d3f85d
smoke tests - try to fix data migration test (#129279) 2021-08-05 07:56:55 +02:00
Benjamin Pasero
bf4a4a6b05
smoke tests - retry data migration tests on windows (#129279) 2021-08-04 18:10:00 +02:00
Benjamin Pasero
2f58131321
smoke tests - fix compile issue 2021-08-04 15:46:10 +02:00
Benjamin Pasero
c28ea165cd
smoke tests - try other ways of ensuring the editor is open for data migration (#129279) 2021-08-04 15:32:21 +02:00
João Moreno
132e3783d0
smoke: fix vscode-test cache location 2021-07-16 15:23:48 +02:00
João Moreno
a9e4cb0874
oops 2021-07-16 12:50:07 +02:00
João Moreno
3c4fdb58a1
fix screenshots in smoketests
related to #122685
2021-07-16 11:58:52 +02:00
Rob Lourens
50b3811fdc Revert "Fix running smoketest multiple times"
See https://github.com/microsoft/vscode/pull/124666/files#r662070269

This reverts commit 4d694d7dc8.
2021-07-14 21:32:51 -07:00
Rob Lourens
4d694d7dc8 Fix running smoketest multiple times 2021-07-14 21:21:27 -07:00
Robo
9520f0a515
chore: update to electron 13 (#124666)
* chore: bump electron@13.0.1

* chore: update cache for native modules

* chore: bump electron@13.1.2

* chore: bump electron@13.1.4

* chore: fix user data dir length for validateIPCHandleLength check

* chore: always disable uploadToServer on OSS

* chore: use process.contextIsolated property

* chore: bump electron@13.1.6

* fix: getUserDataPath helper
2021-07-13 20:01:10 -07:00
Benjamin Pasero
d85bc647ef
smoke tests - automatically test against stable build (#127799)
* smoke tests - automatically test against stable build

* fix path on Linux/Windows

* 💄

* retry migration tests

* smoke: always download latest previous stable

* hm

Co-authored-by: João Moreno <joao.moreno@microsoft.com>
2021-07-12 05:44:50 -07:00
João Moreno
d737dc4db3
smoke: simplify localization test 2021-07-12 12:20:34 +02:00
João Moreno
a28d028d2d
Enable automated smoketests on Windows (#128224) 2021-07-08 19:10:25 +02:00
Dirk Baeumer
c9aea49a87
Re-enable enhanced localization tests 2021-07-07 10:49:52 +02:00
João Moreno
2c7fc24d63
smoke: ctrl-c should kill all processes 2021-07-06 20:30:20 +02:00
Dirk Baeumer
1a3fd783fe
Disable locale info check. 2021-07-06 15:38:21 +02:00
Dirk Baeumer
ae52915f0c
Improve localization tests 2021-07-06 13:15:43 +02:00
Benjamin Pasero
7a0714a6e5
smoke - harden data migration test 2021-07-06 12:10:08 +02:00
Sandeep Somavarapu
062e6519f8
use vscode smoke test check extension 2021-07-02 10:46:31 +02:00
Dirk Baeumer
a63e0a0a21
Reenable German translation test based on new API 2021-06-29 09:23:52 +02:00
Dirk Baeumer
9cfc4bcb5c
Improve wording for failing test case 2021-06-22 13:30:29 +02:00
Dirk Baeumer
1f2a6cc331
Improve localization smoke test 2021-06-21 13:54:16 +02:00
João Moreno
9d4274bf64
skip the entire notebook test suite so Code isn't even launched 2021-06-15 14:07:35 +02:00
Benjamin Pasero
81317867a3
web - disable welcome in smoke tests (fix #126221)
//cc @JacksonKearl
2021-06-15 10:57:29 +02:00
João Moreno
85a36ae074 enable smoketest on linux 2021-06-11 12:19:17 +02:00
Ladislau Szomoru
291ec03bc3
Smoke tests - run each suite in its own user-data-dir (#125670)
* Initial commit for isolated smoke tests

* Do not wait for the explorer view when restarting

* Debug failed localization test

* User data path suffix length

* Kill server when application exits

* Do not run yarn install

* Refactor application start/stop

* Reverted some changes

* Missed one

* One more change to revert

* Restored one more file

* Pull request feedback
2021-06-10 06:40:57 -07:00
Ladislau Szomoru
e2d0e05038
Do not run yarn install as part of the smoke tests 2021-06-06 21:14:37 +02:00
Benjamin Pasero
5eec3c86e3 smoke test - disable experiments 2021-05-27 07:30:23 +02:00
Benjamin Pasero
4cda850edf disable welcome editor in smoke tests (fix #124674) 2021-05-26 14:22:13 +02:00
Jackson Kearl
5ac4f5f5be
Fix didn't work 2021-05-21 11:21:27 -07:00
Jackson Kearl
852b70eafe
Try fix (#124384) 2021-05-21 17:36:20 +00:00
Benjamin Pasero
4b5db9098c
smoke test - disable failing search test
//cc @JacksonKearl
2021-05-21 09:12:01 +02:00
Jackson Kearl
e66c62f38a
Generalize smoke text 2021-05-20 22:21:19 -07:00
Jackson Kearl
89c8f91988
Add smoke test for #124146 2021-05-20 22:20:48 -07:00
Ladislau Szomoru
a13da59f95
Fix #123621 2021-05-12 10:04:46 +02:00
Rob Lourens
5c22e55a74 Disable broken smoke test #123621 2021-05-11 19:26:30 -07:00
Dirk Baeumer
2fc3214ba4
Fixes #123083: Localization: starts with 'DE' locale and verifies title and viewlets text is in German 2021-05-10 13:57:43 +02:00
Dirk Baeumer
08c4cd87e3 Reenable localization tests. 2021-03-25 10:42:35 +01:00
rebornix
2b66dfe021
skip flaky tests. 2021-03-23 21:49:48 -07:00
Rob Lourens
cca8a48b17 Restore notebook smoketests, Fix #113882 2021-03-23 08:49:57 -07:00
Johannes Rieken
b353f06339
comment out failing notebook smoke tests, https://github.com/microsoft/vscode/issues/119164 2021-03-17 09:22:44 +01:00
Jackson Kearl
556e6d8310
Fixup search smoke tests 2021-03-09 12:50:36 -08:00
Jackson Kearl
9eceb50498
Move label about for #115244 after more tests are failing 2021-03-09 11:25:45 -08:00
Jackson Kearl
e5a10ca55d
Skip search tests while diagnosing flakeyness 2021-03-09 11:16:09 -08:00
Sandeep Somavarapu
edfbf27e3a #118443 - change name 2021-03-09 09:34:19 +01:00
Sandeep Somavarapu
9d3a1d9f59 Fix #118443 2021-03-09 09:30:56 +01:00
Jackson Kearl
ac229ced07
Revert "Reenable smoke test to see if still flakey" #115244
This reverts commit 5d80c30e5b.
2021-03-08 19:31:58 -08:00
Benjamin Pasero
9c78fa40ca
skip failing test (#118443) 2021-03-08 15:22:24 +01:00
Jackson Kearl
5d80c30e5b
Reenable smoke test to see if still flakey
Ref #115244
2021-03-05 22:05:32 -08:00
Benjamin Pasero
041e4d9b1f fix smoke tests with stable build (fix #117420) 2021-02-23 19:04:51 +01:00
João Moreno
2ca2792a65
fix smoketest 2021-02-19 16:03:01 +01:00
Rob Lourens
a699ffaee6 Reenable notebook smoke test
Fix #116535
2021-02-13 15:48:37 -08:00
Johannes Rieken
fc31a6a558 skip failing test, https://github.com/microsoft/vscode/issues/116535 2021-02-12 11:15:56 +01:00
Jackson Kearl
8a3a5d9b74 Fix search smoke test 2021-02-09 15:44:07 -08:00
Sandeep Somavarapu
cd97629c44 #116152 enable smoke tests 2021-02-09 08:58:39 +01:00
Rob Lourens
be5126d37c Also skip 'before', #116156 2021-02-08 22:08:17 -08:00
Rob Lourens
0829608afb Change disabled tests to .skip 2021-02-08 21:37:02 -08:00
Megan Rogge
29844a0baf disable smoke tests that time out 2021-02-08 18:21:39 -08:00
Sandeep Somavarapu
a9ccd48a1f enable extension tests in web 2021-02-04 08:44:06 +01:00
Sandeep Somavarapu
4e6d9ce2b7 add server cli test 2021-02-03 21:42:12 +01:00
Sandeep Somavarapu
066c584405 enable remote smoke tests 2021-02-03 19:20:44 +01:00
Sandeep Somavarapu
abb05eb058 Fix #115586 2021-02-02 10:25:50 +01:00
Benjamin Pasero
04d4310a8a fix smoketest (#115586) 2021-02-02 08:20:07 +01:00
Rob Lourens
662a698ef9 Skip failing test #115244 2021-01-28 12:00:17 -08:00
Sandeep Somavarapu
4b9b2ab9a6 Fix #114707 2021-01-21 17:46:40 +01:00
João Moreno
f745a912ae
fixes #114420 2021-01-15 15:19:19 +01:00
Alexandru Dima
00f8540d79
Fixes #114332
`yarn` no longer compiles the smoke test as a postinstall script. This breaks the flow of running `yarn && yarn smoketest` to execute the smoketest.

So change `yarn smoketest` to also do the compiling of the smoke test. But that generates too much extra work on the build machine, which needs to invoke `yarn smoketest` twice, once for Electron and once for web.

To workaround that, `yarn smoketest-no-compile` is added, which can be used by the build machine to avoid needlessly compiling.

While here, the nodejs version is already checked in the `yarn` preinstall script, so remove the check from the smoke test.
2021-01-14 10:35:42 +01:00
Benjamin Pasero
96e2981c91 skip failing test (#113882) 2021-01-08 08:16:28 +01:00
Rob Lourens
d29388d255 Reenable test, fix #113768 2021-01-05 12:21:50 -08:00
Alexandru Dima
f74ad9692f
Align @types/* dev dependencies (#112718) 2020-12-18 13:28:39 +01:00
Sandeep Somavarapu
0ac5e95251 Fix #109644 2020-12-02 17:50:49 +01:00
Martin Aeschlimann
3472159cb1
Merge pull request #111408 from microsoft/aeschli/notebookIcons
externalize notebook items
2020-12-01 09:29:13 +01:00
Sandeep Somavarapu
47ce2a8d6d #111845 fix localization tests 2020-11-30 20:26:00 +01:00
Martin Aeschlimann
4e45d27a72 fix stopIcon name 2020-11-27 12:12:54 +01:00
Sandeep Somavarapu
6a2535e0ab Fix #107965 2020-10-28 19:49:42 +01:00
Benjamin Pasero
781e0e3192 windows - remove not needed and confusing disable-restore-windows CLI arg 2020-10-01 11:36:45 +02:00
Rob Lourens
b47a60c67f Fix notebook smoketest
Fix #107219
2020-09-22 17:14:15 -05:00
ChaseKnowlden
e8760a5d6c Fix capitalization of GitHub org 2020-09-17 11:43:03 +02:00
Rob Lourens
1893b55c25 Skip smoketest #105330 2020-09-16 17:06:40 -05:00
Rob Lourens
7a92c462c8 Reenable notebook smoke test #105330 2020-09-08 10:46:04 -05:00
Rob Lourens
a1724a23df Disable smoke test for #105330 2020-09-02 09:56:32 -07:00
Sandeep Somavarapu
2277c8e2a3 Fix #104230 2020-08-07 12:31:03 +02:00
Dirk Baeumer
0b79a0e708 Reenable localization tests 2020-08-07 11:30:30 +02:00
isidor
f3e4ff9196 skip failing tests 2020-07-30 14:39:52 +02:00
Matt Bierner
42761b9db2 Fix smoke test function call 2020-07-28 14:57:08 -07:00
rebornix
5e96337121 re #93070. test for command arguments. 2020-07-13 10:52:57 -07:00
Dirk Baeumer
09531cdf10 Fixes #101005: Localization - starts with 'DE' locale and verifies title and viewlets text is in German 2020-06-25 09:38:42 +02:00
Rob Lourens
4d6da3154c Get notebook smoketest working in web
Fix #98364
2020-06-07 17:27:47 -05:00
Rob Lourens
3eb6c1704b Disable notebook smoketests in web 2020-05-26 12:12:34 -05:00
Rob Lourens
8253b52191 Remove .only 2020-05-20 12:04:28 -05:00
Rob Lourens
9bc11824c3 Add notebook smoketests 2020-05-20 12:01:52 -05:00
Benjamin Pasero
869929e8c6 tests - log the actual build used for tests 2020-05-14 17:00:51 +02:00
Benjamin Pasero
0ac3b1114a smoke 💄 2020-04-30 13:32:27 +02:00
Benjamin Pasero
30bba102b3 smoke - only start automatically after data migration tests 2020-04-30 09:50:55 +02:00
Daniel Imms
b7e0abbdcc
Merge branch 'master' into tyriar/90539 2020-04-10 05:56:39 -07:00
Dirk Baeumer
e694b041e3 Label for extension viewlet changed. Disable smoke test 2020-04-02 11:20:42 +02:00
Rob Lourens
64c157244e Wait for cleared settings to be applied before continuing
Fix #93292
2020-03-28 10:43:24 -07:00
Benjamin Pasero
e80f8a5da9 quick access - more cleanup 2020-03-26 13:51:05 +01:00
Benjamin Pasero
85d2077f19 smoke - quickopen => quickaccess 2020-03-26 12:28:49 +01:00
Dirk Baeumer
b418b9cd59 Comment out debugger tests 2020-03-26 10:02:17 +01:00
Benjamin Pasero
21431f6117 quick access - cleanup API for quick input 2020-03-24 10:13:45 +01:00
Martin Aeschlimann
bf6c93062b Rename CSS smoke test to language features: For #90538 2020-03-02 11:39:43 +01:00
Pine Wu
a68bfa3846 Add back languages/css test. Fix #90538 2020-02-28 11:56:25 -08:00
Rob Lourens
db380eaad0 Fix build 2020-02-26 17:29:55 -08:00
Pine Wu
e63119f785 Fix #90538 2020-02-26 16:24:46 -08:00
Benjamin Pasero
29c2c6079e smoke - do not restore windows 2020-02-26 12:03:05 +01:00
Dirk Baeumer
2cb430b396 Fixes #91433: Smoke Test: Localization Test Failure 2020-02-26 11:55:17 +01:00
Daniel Imms
06f2731c7f Remove terminal smoke test
Fixes #90539
2020-02-14 07:24:44 -08:00
Benjamin Pasero
35379aba75 smoke - headless option is troublesome 2020-02-11 17:35:53 +01:00
Benjamin Pasero
06b06ca10a smoke - move quick open tests into search 2020-02-11 17:28:03 +01:00
Benjamin Pasero
bb3edc40e6 smoke - exclude a few more tests for web 2020-02-07 07:10:59 +01:00
Benjamin Pasero
ec41f20c40
Web - run smoke tests using playwright (#89918)
* playwright - initial version

* browser - use existing page and not create new context

* macOS: document how to remove the security flag

* smoke test - allow to run against server build with --build option

* do not rely on args

* fix path for windows

* smoke test - smoke 💄 and -ci option
2020-02-04 17:23:27 +01:00
Joao Moreno
16c7551f36
move git smoke tests to integration tests 2020-02-04 17:06:49 +01:00
isidor
8f90e851c5 remode debug smoke tests 2020-02-04 16:14:02 +01:00
Benjamin Pasero
a15803b9e7 smoke test - add attribute for tabs to simplify lookup 2020-02-04 14:50:53 +01:00
Sandeep Somavarapu
4fac3e22c5 remove the timeout 2020-02-03 11:49:10 +01:00
Daniel Imms
547cf4e81f
Run smoke tests against actual build (#83799)
* Run web against actual server

Part of #80308

* Fix strict null check errors

* Fix folder arg

* Disable unit tests and integration tests temporarily

* Allow running on node 12

* Fix smoke test condition

* Disable continue on error

* Add web to server dir

* fix smoke test to use build for web

* enable in product build

Co-authored-by: Benjamin Pasero <benjamin.pasero@gmail.com>
2020-02-03 11:26:55 +01:00
Benjamin Pasero
d6eb50caa4
Smoke-Test: Hot-exit / dataloss tests broken (#89905)
* smoke test - carefuly select untitled content based on file name to find it properly

* Fileservice: mkdirp() logic is prone to errors from race conditions (fixes #89834)
2020-02-03 09:38:03 +01:00
Joao Moreno
9bec0160f6
fixes #86474 2020-01-23 11:41:00 +01:00
isidor
0fae04b8a2 fixes #78384 2019-12-05 14:21:50 +01:00
Johannes Rieken
266f78096e remove smoke test for find ref, rename, goto, and peek, #85377 2019-11-22 11:36:13 +01:00
Benjamin Pasero
ea89eb903f fix #83805 2019-11-01 09:15:35 +01:00
Joao Moreno
925f3ab1a0 fixes #81871 2019-10-03 08:51:05 +02:00
Daniel Imms
615e262789 Fix git smoke tests 2019-10-02 14:46:35 -07:00
Dmitry Gozman
367a5a0c59 Improve LinkDetector
- recognizes web urls;
- checks that file path exists;
- supports relative to workspace root paths (./foo);
- supports relative to home dir paths (~/foo);
- optional line/column;
- smoke test.
2019-09-24 13:19:52 -07:00
Daniel Imms
a5b58dc5b8 Link directly to automation from smoke 2019-09-12 21:32:41 -07:00
Jason Ginchereau
4f2c387de1 Refactor smoke UI automation into separate package 2019-09-05 09:16:29 -07:00
Rob Lourens
7edc8f786e Fix #80304 - wait for remote window to actually connect before running tests 2019-09-04 17:29:07 -07:00
Rob Lourens
58c740aa48 Remove workaround for #74875 2019-09-04 14:52:53 -07:00
Johannes Rieken
dedf0de944 change type of _serviceBrand from any to undefined, #79918 2019-08-30 15:40:46 +02:00
Joao Moreno
4994c7be4e fixes #79867 2019-08-28 14:34:54 +02:00
Daniel Imms
68660775ab Teardown server on SIGTERM 2019-08-20 10:17:54 -07:00
Daniel Imms
64716dd3b0 Fix smoke test driver types 2019-08-20 10:17:54 -07:00
Martin Aeschlimann
815f7b05dd Localization test fails on remote smoketest. Fixes #78412 2019-08-19 13:01:26 +02:00
Daniel Imms
329f2fe76b Fix smoke tests 2019-08-16 06:39:38 -07:00
Daniel Imms
d8cb87bd21 Reduce diff 2019-08-15 08:45:30 -07:00
Daniel Imms
6e8d4cf70f Fix dispatch keybinding when called multiple times 2019-08-15 07:58:24 -07:00
Daniel Imms
173b8c5cc6 Reduce diff 2019-08-15 07:52:23 -07:00
Daniel Imms
520fac5336 Remove click code from puppeteer driver, move interfaces to common 2019-08-15 07:49:06 -07:00
Daniel Imms
221a6ca43c Fix strict error 2019-08-15 07:15:59 -07:00
Daniel Imms
414a35dcf7 Use new browser none arg 2019-08-14 15:04:35 -07:00
Daniel Imms
57c13dc0c4 Base web user data dir off normal one 2019-08-14 14:50:45 -07:00
Daniel Imms
1f8d0fced3 Teardown on sigint 2019-08-14 11:38:48 -07:00
Daniel Imms
37d8f1fd26 Register driver 2019-08-14 11:37:16 -07:00
Daniel Imms
4af418a01f Use bat on Windows 2019-08-13 12:35:22 -07:00
Daniel Imms
d5840463a3 Improve logging name 2019-08-13 11:37:26 -07:00
Daniel Imms
3db202b430 Clean up teardown code 2019-08-13 11:35:44 -07:00
Daniel Imms
27f5a327c9 Kill process when process exits 2019-08-13 11:34:02 -07:00
Daniel Imms
68f94dd8b4 Use temp user data dir 2019-08-13 11:28:29 -07:00
Daniel Imms
f4deaa16c1 Remove unused import 2019-08-13 11:19:55 -07:00
Daniel Imms
064e134c6c Launch server from tests 2019-08-13 11:19:14 -07:00
Daniel Imms
8f1c14f737 Fix naming of puppeteer driver 2019-08-13 09:48:58 -07:00
Daniel Imms
7721d6e373 Support launching web smoketests in headless mode 2019-08-09 11:21:40 -07:00
Daniel Imms
b7bc156319 Remove resolved TODOs 2019-08-09 11:15:45 -07:00
Daniel Imms
d224d533c8 Add all passing web tests 2019-08-09 11:06:01 -07:00
Daniel Imms
0d740b9913 Enable passing tests 2019-08-09 10:41:07 -07:00
Daniel Imms
3d64c7ef94 Allow web tests to pass electron path exists check 2019-08-09 10:03:08 -07:00
Daniel Imms
16a19e4452 Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-08-09 09:47:02 -07:00
Tony Xia
8443b97473 Fixed minor typos (#78042) 2019-08-05 11:14:08 +02:00
Joao Moreno
709a07d519 comment out i18n smoke test assertion 2019-08-02 15:33:17 +02:00
Joao Moreno
d7f957bdec fix statusbar smoketests 2019-08-02 15:27:42 +02:00
Daniel Imms
e723f810ec Add more tests 2019-07-31 10:24:42 -07:00
Christian Oliff
42cdcbb1bd
Fix 'Untitled' typo 2019-07-31 22:16:42 +09:00
Daniel Imms
65cd41503b Share code between electron and browser drivers 2019-07-27 13:39:35 -07:00
Daniel Imms
e0d2e537f0 Pass web opt through 2019-07-19 17:21:11 -07:00
Daniel Imms
88c8745851 Bring more non-web smoke test code back 2019-07-19 17:16:04 -07:00
Daniel Imms
8d20c171fc Bring back non-web smoke tests 2019-07-19 17:12:11 -07:00
Daniel Imms
2eb4b1aebd Improve types 2019-07-16 14:09:12 -07:00
Daniel Imms
f7b8079f21 Add puppeteer types and use TS in driver 2019-07-15 11:50:15 -07:00
Daniel Imms
f784f5fd7f Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-07-15 10:34:58 -07:00
Martin Aeschlimann
e6295eae65 Remote smoke test fails for 1.36.1. fixes #76987 2019-07-12 21:55:45 +02:00
Daniel Imms
76641f06d3 Get terminal smoke tests working under puppeteer 2019-07-12 12:39:53 -07:00
Martin Aeschlimann
112ca40eb1 remove unused import 2019-07-12 21:04:44 +02:00
Martin Aeschlimann
39e688381c smoke: support --test-repo on windows 2019-07-12 20:49:23 +02:00
Daniel Imms
f9549e2347 Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-07-12 10:53:44 -07:00
Dirk Baeumer
39292af2b5 Fixes #76298: Smoke test failure: starts with 'DE' locale and verifies title and viewlets text is in German 2019-07-01 09:53:26 +02:00
Benjamin Pasero
9da43bcfb3 smoke - fix waitForStatusbarText 2019-06-28 15:35:36 +02:00
Benjamin Pasero
ab9812e1af fix smoketest 2019-06-28 08:53:10 +02:00
Benjamin Pasero
84bfa21566 fix #75909 2019-06-27 11:51:00 +02:00
Martin Aeschlimann
f14e091212 fix smoke test after problems view css change 2019-06-17 12:08:26 +02:00
Daniel Imms
c41ad18414 Puppeteer exploration 2019-06-12 14:37:12 -07:00
Benjamin Pasero
3ae69da3a5 status - incremental updates 2019-06-11 09:59:01 +02:00
Waldir Pimenta
f3e4e47164 Fix spelling of the example abbreviation (e.g.) 2019-06-05 16:00:26 +02:00
Martin Aeschlimann
66280104a9 [smoke] workaround for #74875 2019-06-05 12:31:50 +02:00
Martin Aeschlimann
be547e26fc fixes for remote smoke tests against a build 2019-06-05 09:38:02 +02:00
Johannes Rieken
c9344059ca fix #74702 2019-06-03 11:08:33 +02:00
Benjamin Pasero
959246744b status - simplify by not needing element ID 2019-05-28 18:20:56 +02:00
Benjamin Pasero
8c35807271 status bar - adopt octicons for problems (#74285) 2019-05-28 17:54:01 +02:00
Martin Aeschlimann
90cfe12a63 Add vscode-test-resolver 2019-05-22 16:41:26 +02:00
Sandeep Somavarapu
c77ec582b0 - Remove undefined in the aria label
- Search extension by id
2019-04-30 11:42:32 +02:00
Daniel Imms
0b3bfd9598 More arguments for test 2019-04-10 22:32:45 +02:00
Sandeep Somavarapu
01470fbca3 Fix #71319 2019-03-28 12:52:25 +01:00