Commit graph

1044 commits

Author SHA1 Message Date
Daniel Imms 07d986443d
Skipping flaky test
Part of #137799
2021-11-24 09:50:26 -08:00
Daniel Imms 42bd3e884b More clean up of terminal smoke test init 2021-11-23 15:46:51 -08:00
Rob Lourens 2932ec095d Add retry to quickaccess tests
Fix #137733
2021-11-23 15:35:48 -08:00
Daniel Imms d7f10626b8 Clean up terminal smoke test setup
Part of #136064
2021-11-23 15:18:38 -08:00
Daniel Imms 68e491f99f Re-enable other smoke tests 2021-11-23 14:50:52 -08:00
Daniel Imms 78d7ece7aa Add basic detach/attach terminal tests
Part of #136064
2021-11-23 13:23:54 -08:00
Daniel Imms ef440e563d Merge remote-tracking branch 'origin/main' into tyriar/persist_tests 2021-11-23 12:47:36 -08:00
Benjamin Pasero 1b40be3377
smoke - enable graceful-fs (#137734) 2021-11-23 17:29:08 +01:00
Rob Lourens 3bac53642b Disable flaky search smoke test #137195 2021-11-22 14:25:23 -08:00
Megan Rogge 4e303fcc52
fix #137590 2021-11-21 10:04:21 -08:00
Daniel Imms 2f7ab5c0e0 Disable should update color of the tab
Flake in CI
2021-11-19 13:58:01 -08:00
Daniel Imms 5dec5256d7 Add some detach/attach tests 2021-11-19 10:33:43 -08:00
Megan Rogge f66bc86da8
add terminal editor and tab smoke tests (#137393)
* Add a bunch of tests

* tweak tests

* add profile tests, now breaking (no profiles showing up)

* uncomment tests

* update expected

* fix test

* merge

* all passing

* bunch of improvements

* improve readability

* all should be passing and cleaned up

* all passing

* fix #137243 and clean-up

* remove .only

* fix #137247

* get rid of enum

* see if this fixes timing issue

* use keybinding for show terminal instead

* remove delay, implement better accept function

* get rid of unneeded index

* try something else

* wait for empty editor to be active

* remove .only

* decrease redundancy in names

* re-add xterm selector

* try something else

* undo change that broke things worse

* add terminal-tabs test

* all tabs tests passing locally

* kill all

* await before running each

* fix tests

* remove .only

* try waiting for focused xterm

* remove .only

* clean up

* 🧹

* fix profiles tests by using this.app.props

* revert to use default shell

* re-add conditional

* Get tests passing on WebKit

On WebKit the smoke tests were failing because the quick pick was
triggering a focus event on the terminal after the blur event had
already happened, this caused the view service to think the terminal
was still focused when it wasn't. The fix was to reset the context key
also in IViewsService.closeView.

* Safari -> WebKit

* Prefer arrow functions

* remove beforeEach timeout

* add timeouts to contributed profile tests

* add terminal editor tests, fix #137377

* add a bunch of tests

* refactor

* get rid of profile specific command

* more polish

* refactor getTabs -> assertTerminalGroups

* fix failing test

* more polish

* remove .only

* add assertSingleTab

* remove unused import

* fix error

* fix more failures

* more changes

* fix almost all except for plus button

* fix failing plus button test

* all passing

* modify error that gets thrown

* modify error message again

* remove unused wildcard/ ANY_NAME, fix icon code

* fix icon code

* large refactor, improvements

* finish polish

* 1 failing

* get test to pass

Co-authored-by: Daniel Imms <2193314+Tyriar@users.noreply.github.com>
2021-11-18 15:11:40 -08:00
Megan Rogge 00fa317c43
Add terminal profile smoke tests (#137079) 2021-11-17 14:00:01 -08:00
Benjamin Pasero bacf6ed2c1
smoke - properly create screenshots and stop instances (#137220) 2021-11-15 12:15:25 +01:00
Daniel Imms 3c9b18e135 Remove test only 2021-11-12 06:16:17 -08:00
Daniel Imms 634dae736e Merge remote-tracking branch 'origin/main' into tyriar/smoke_test_improvements 2021-11-12 05:45:20 -08:00
Daniel Imms e6caf0da49 Pass terminal profiles test 2021-11-10 12:27:38 -08:00
Daniel Imms 5bfaf29f2b Fix layering problem 2021-11-10 08:38:02 -08:00
Benjamin Pasero bef4dba21f
Parcel update and CI improvements (#136830)
* 🆙 product

* 🆙 parcel/watcher

* 🆙 parcel/watcher

* tests - separate remote logs from others

* store server logs too

* more tweaks

* fix name

* error when 10s passed
2021-11-10 08:13:56 +01:00
Daniel Imms bd98431baf Write basic terminal default profile test
Co-authored-by: Megan Rogge <merogge@microsoft.com>
2021-11-09 10:10:54 -08:00
Daniel Imms 28da3051b3 Tidy up smoke test imports 2021-11-09 08:26:39 -08:00
Daniel Imms 281bacb074 Stub out some terminal smoke tests
Part of #136064
2021-11-09 08:25:15 -08:00
Daniel Imms 1cbf69d996 Document --headless in smoke tests 2021-11-09 08:24:38 -08:00
João Moreno 1788b8afd8
chore: 🔧 clean smoketest dependencies 2021-11-08 14:58:17 +01:00
Benjamin Pasero f9e8dc2095
🆙 playwright 2021-11-04 09:27:22 +01:00
Benjamin Pasero 7ca8b0f613
Statusbar - checks if 'Go to Line' works if called from the status bar: (fix #135962) 2021-10-28 07:22:45 +02:00
Rob Lourens 83fec0220c Add retry logic for flaky git operations
Fix #132218
2021-10-12 17:08:20 -07:00
Benjamin Pasero 769d5fb521
smoke - disable search smoke tests on windows (#132218) 2021-09-06 18:07:58 +02:00
Sandeep Somavarapu 77b1fb79f5
Fix #132233 2021-09-06 14:32:19 +02:00
Johannes Rieken 70e30bc64e
disable flaky/failing smoketest, https://github.com/microsoft/vscode/issues/132233 2021-09-03 11:38:14 +02:00
Benjamin Pasero a3acef919f
smoke - ignore any failure from capturing screenshot 2021-09-03 09:31:01 +02:00
Raymond Zhao 86d81f35fe
Clarify running remote tests 2021-09-01 19:17:58 -07:00
Benjamin Pasero cdde5bedbf
web tests - mention how to enable playwright logging 2021-08-26 10:34:17 +02:00
Benjamin Pasero 90443f7a8a
tests - try to make some tests more robust 2021-08-12 07:48:02 +02:00
dependabot[bot] 0344ecd462
Bump path-parse from 1.0.6 to 1.0.7 in /test/smoke (#130540) 2021-08-11 08:21:05 -07:00
Benjamin Pasero 6957e52e4b
smoke - always create test folder 2021-08-05 10:31:07 +02:00
Benjamin Pasero b96644b15f
smoke tests - drop 'tmp' and try to deal with tmp path ourself (#130102) 2021-08-05 10:04:00 +02:00
Benjamin Pasero 70e6d3f85d
smoke tests - try to fix data migration test (#129279) 2021-08-05 07:56:55 +02:00
Benjamin Pasero bf4a4a6b05
smoke tests - retry data migration tests on windows (#129279) 2021-08-04 18:10:00 +02:00
Benjamin Pasero 2f58131321
smoke tests - fix compile issue 2021-08-04 15:46:10 +02:00
Benjamin Pasero c28ea165cd
smoke tests - try other ways of ensuring the editor is open for data migration (#129279) 2021-08-04 15:32:21 +02:00
Raymond Zhao d163eabed0
Add troubleshooting step for tmp module 2021-07-26 14:39:44 -07:00
João Moreno 132e3783d0
smoke: fix vscode-test cache location 2021-07-16 15:23:48 +02:00
João Moreno a9e4cb0874
oops 2021-07-16 12:50:07 +02:00
João Moreno 3c4fdb58a1
fix screenshots in smoketests
related to #122685
2021-07-16 11:58:52 +02:00
Rob Lourens 50b3811fdc Revert "Fix running smoketest multiple times"
See https://github.com/microsoft/vscode/pull/124666/files#r662070269

This reverts commit 4d694d7dc8.
2021-07-14 21:32:51 -07:00
Rob Lourens 4d694d7dc8 Fix running smoketest multiple times 2021-07-14 21:21:27 -07:00
Robo 9520f0a515
chore: update to electron 13 (#124666)
* chore: bump electron@13.0.1

* chore: update cache for native modules

* chore: bump electron@13.1.2

* chore: bump electron@13.1.4

* chore: fix user data dir length for validateIPCHandleLength check

* chore: always disable uploadToServer on OSS

* chore: use process.contextIsolated property

* chore: bump electron@13.1.6

* fix: getUserDataPath helper
2021-07-13 20:01:10 -07:00
João Moreno 05fd05dc00
remove --stable-build 2021-07-12 05:56:27 -07:00
Benjamin Pasero d85bc647ef
smoke tests - automatically test against stable build (#127799)
* smoke tests - automatically test against stable build

* fix path on Linux/Windows

* 💄

* retry migration tests

* smoke: always download latest previous stable

* hm

Co-authored-by: João Moreno <joao.moreno@microsoft.com>
2021-07-12 05:44:50 -07:00
João Moreno d737dc4db3
smoke: simplify localization test 2021-07-12 12:20:34 +02:00
João Moreno a28d028d2d
Enable automated smoketests on Windows (#128224) 2021-07-08 19:10:25 +02:00
Dirk Baeumer c9aea49a87
Re-enable enhanced localization tests 2021-07-07 10:49:52 +02:00
João Moreno 2c7fc24d63
smoke: ctrl-c should kill all processes 2021-07-06 20:30:20 +02:00
Dirk Baeumer 1a3fd783fe
Disable locale info check. 2021-07-06 15:38:21 +02:00
Dirk Baeumer ae52915f0c
Improve localization tests 2021-07-06 13:15:43 +02:00
Benjamin Pasero 7a0714a6e5
smoke - harden data migration test 2021-07-06 12:10:08 +02:00
Sandeep Somavarapu 062e6519f8
use vscode smoke test check extension 2021-07-02 10:46:31 +02:00
Dirk Baeumer a63e0a0a21
Reenable German translation test based on new API 2021-06-29 09:23:52 +02:00
Dirk Baeumer 9cfc4bcb5c
Improve wording for failing test case 2021-06-22 13:30:29 +02:00
Dirk Baeumer 1f2a6cc331
Improve localization smoke test 2021-06-21 13:54:16 +02:00
João Moreno 9d4274bf64
skip the entire notebook test suite so Code isn't even launched 2021-06-15 14:07:35 +02:00
Benjamin Pasero 81317867a3
web - disable welcome in smoke tests (fix #126221)
//cc @JacksonKearl
2021-06-15 10:57:29 +02:00
João Moreno 85a36ae074 enable smoketest on linux 2021-06-11 12:19:17 +02:00
Ladislau Szomoru 291ec03bc3
Smoke tests - run each suite in its own user-data-dir (#125670)
* Initial commit for isolated smoke tests

* Do not wait for the explorer view when restarting

* Debug failed localization test

* User data path suffix length

* Kill server when application exits

* Do not run yarn install

* Refactor application start/stop

* Reverted some changes

* Missed one

* One more change to revert

* Restored one more file

* Pull request feedback
2021-06-10 06:40:57 -07:00
Ladislau Szomoru e2d0e05038
Do not run yarn install as part of the smoke tests 2021-06-06 21:14:37 +02:00
Benjamin Pasero 5eec3c86e3 smoke test - disable experiments 2021-05-27 07:30:23 +02:00
Benjamin Pasero 4cda850edf disable welcome editor in smoke tests (fix #124674) 2021-05-26 14:22:13 +02:00
Jackson Kearl 5ac4f5f5be
Fix didn't work 2021-05-21 11:21:27 -07:00
Jackson Kearl 852b70eafe
Try fix (#124384) 2021-05-21 17:36:20 +00:00
Benjamin Pasero 4b5db9098c
smoke test - disable failing search test
//cc @JacksonKearl
2021-05-21 09:12:01 +02:00
Jackson Kearl e66c62f38a
Generalize smoke text 2021-05-20 22:21:19 -07:00
Jackson Kearl 89c8f91988
Add smoke test for #124146 2021-05-20 22:20:48 -07:00
Ladislau Szomoru a13da59f95
Fix #123621 2021-05-12 10:04:46 +02:00
Rob Lourens 5c22e55a74 Disable broken smoke test #123621 2021-05-11 19:26:30 -07:00
dependabot[bot] 000e064e61
Bump hosted-git-info from 2.8.8 to 2.8.9 in /test/smoke (#123481)
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info) from 2.8.8 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases)
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md)
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.8.8...v2.8.9)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-11 07:57:52 -07:00
Dirk Baeumer 2fc3214ba4
Fixes #123083: Localization: starts with 'DE' locale and verifies title and viewlets text is in German 2021-05-10 13:57:43 +02:00
Robo bce4d71f64
chore: bump node@14.x in devDependencies (#122905) 2021-05-04 10:04:13 +02:00
Ladislau Szomoru 335bc0196c
Remove unused dependency 2021-03-31 10:11:35 +02:00
Ladislau Szomoru 7c498ec3a8
Update tests to use consistent version of mkdirp 2021-03-30 14:00:37 +02:00
Dirk Baeumer 08c4cd87e3 Reenable localization tests. 2021-03-25 10:42:35 +01:00
Megan Rogge 2c232fed6a
Update README.md 2021-03-24 12:40:21 -07:00
rebornix 2b66dfe021
skip flaky tests. 2021-03-23 21:49:48 -07:00
Rob Lourens cca8a48b17 Restore notebook smoketests, Fix #113882 2021-03-23 08:49:57 -07:00
Erich Gamma 73b9e6679d
Update README.md 2021-03-23 14:54:30 +01:00
Johannes Rieken b353f06339
comment out failing notebook smoke tests, https://github.com/microsoft/vscode/issues/119164 2021-03-17 09:22:44 +01:00
Jackson Kearl 556e6d8310
Fixup search smoke tests 2021-03-09 12:50:36 -08:00
Jackson Kearl 9eceb50498
Move label about for #115244 after more tests are failing 2021-03-09 11:25:45 -08:00
Jackson Kearl e5a10ca55d
Skip search tests while diagnosing flakeyness 2021-03-09 11:16:09 -08:00
Sandeep Somavarapu edfbf27e3a #118443 - change name 2021-03-09 09:34:19 +01:00
Sandeep Somavarapu 9d3a1d9f59 Fix #118443 2021-03-09 09:30:56 +01:00
Jackson Kearl ac229ced07
Revert "Reenable smoke test to see if still flakey" #115244
This reverts commit 5d80c30e5b.
2021-03-08 19:31:58 -08:00
Benjamin Pasero 9c78fa40ca
skip failing test (#118443) 2021-03-08 15:22:24 +01:00
Jackson Kearl 5d80c30e5b
Reenable smoke test to see if still flakey
Ref #115244
2021-03-05 22:05:32 -08:00
Benjamin Pasero 041e4d9b1f fix smoke tests with stable build (fix #117420) 2021-02-23 19:04:51 +01:00
Raymond Zhao ee820dffbf
Update smoke test README (#115582) 2021-02-19 09:05:11 -08:00
João Moreno 2ca2792a65
fix smoketest 2021-02-19 16:03:01 +01:00
Rob Lourens a699ffaee6 Reenable notebook smoke test
Fix #116535
2021-02-13 15:48:37 -08:00
Johannes Rieken fc31a6a558 skip failing test, https://github.com/microsoft/vscode/issues/116535 2021-02-12 11:15:56 +01:00
Jackson Kearl 8a3a5d9b74 Fix search smoke test 2021-02-09 15:44:07 -08:00
Sandeep Somavarapu cd97629c44 #116152 enable smoke tests 2021-02-09 08:58:39 +01:00
Rob Lourens be5126d37c Also skip 'before', #116156 2021-02-08 22:08:17 -08:00
Rob Lourens 0829608afb Change disabled tests to .skip 2021-02-08 21:37:02 -08:00
Megan Rogge 29844a0baf disable smoke tests that time out 2021-02-08 18:21:39 -08:00
Sandeep Somavarapu a9ccd48a1f enable extension tests in web 2021-02-04 08:44:06 +01:00
Sandeep Somavarapu 4e6d9ce2b7 add server cli test 2021-02-03 21:42:12 +01:00
Sandeep Somavarapu 066c584405 enable remote smoke tests 2021-02-03 19:20:44 +01:00
Sandeep Somavarapu abb05eb058 Fix #115586 2021-02-02 10:25:50 +01:00
Benjamin Pasero 04d4310a8a fix smoketest (#115586) 2021-02-02 08:20:07 +01:00
Rob Lourens 662a698ef9 Skip failing test #115244 2021-01-28 12:00:17 -08:00
Sandeep Somavarapu 4b9b2ab9a6 Fix #114707 2021-01-21 17:46:40 +01:00
João Moreno f745a912ae
fixes #114420 2021-01-15 15:19:19 +01:00
Alexandru Dima 00f8540d79
Fixes #114332
`yarn` no longer compiles the smoke test as a postinstall script. This breaks the flow of running `yarn && yarn smoketest` to execute the smoketest.

So change `yarn smoketest` to also do the compiling of the smoke test. But that generates too much extra work on the build machine, which needs to invoke `yarn smoketest` twice, once for Electron and once for web.

To workaround that, `yarn smoketest-no-compile` is added, which can be used by the build machine to avoid needlessly compiling.

While here, the nodejs version is already checked in the `yarn` preinstall script, so remove the check from the smoke test.
2021-01-14 10:35:42 +01:00
Benjamin Pasero 96e2981c91 skip failing test (#113882) 2021-01-08 08:16:28 +01:00
Alexandru Dima 8ad08b04f5
Do not compile /test/ and /build/ scripts during postinstall, the scripts get compiled explicitly during CI 2021-01-07 16:47:11 +01:00
Rob Lourens d29388d255 Reenable test, fix #113768 2021-01-05 12:21:50 -08:00
Alexandru Dima f74ad9692f
Align @types/* dev dependencies (#112718) 2020-12-18 13:28:39 +01:00
Alexandru Dima aa2864d53f
Remove most of the yarn license warnings 2020-12-18 10:26:14 +01:00
Alexandru Dima ed19f6082f
Share mocha related node modules (#112718) 2020-12-17 11:03:49 +01:00
Alexandru Dima bb157721fb
/build/ and /test/ should only have devDependencies 2020-12-17 10:27:39 +01:00
João Moreno 7743d971b1
concurrently -> run-run-all 2020-12-15 15:21:24 +01:00
Sandeep Somavarapu 0ac5e95251 Fix #109644 2020-12-02 17:50:49 +01:00
Martin Aeschlimann 3472159cb1
Merge pull request #111408 from microsoft/aeschli/notebookIcons
externalize notebook items
2020-12-01 09:29:13 +01:00
Sandeep Somavarapu 47ce2a8d6d #111845 fix localization tests 2020-11-30 20:26:00 +01:00
Martin Aeschlimann 4e45d27a72 fix stopIcon name 2020-11-27 12:12:54 +01:00
Sandeep Somavarapu 6a2535e0ab Fix #107965 2020-10-28 19:49:42 +01:00
Benjamin Pasero 781e0e3192 windows - remove not needed and confusing disable-restore-windows CLI arg 2020-10-01 11:36:45 +02:00
Christof Marti f48da22bdf
Update README.md 2020-09-30 09:16:06 +02:00
Rob Lourens 20b9010c39
Update README.md 2020-09-29 16:20:51 -07:00
Rob Lourens b47a60c67f Fix notebook smoketest
Fix #107219
2020-09-22 17:14:15 -05:00
ChaseKnowlden e8760a5d6c Fix capitalization of GitHub org 2020-09-17 11:43:03 +02:00
Rob Lourens 1893b55c25 Skip smoketest #105330 2020-09-16 17:06:40 -05:00
Rob Lourens 7a92c462c8 Reenable notebook smoke test #105330 2020-09-08 10:46:04 -05:00
Rob Lourens a1724a23df Disable smoke test for #105330 2020-09-02 09:56:32 -07:00
Ladislau Szomoru b2efcbf687
Add process.arch into the test results file name (#104946) 2020-08-19 07:48:37 +02:00
Ladislau Szomoru 652a432f59
Set suite name based on the --web parameter (#104798) 2020-08-17 11:51:59 +02:00
Sandeep Somavarapu 2277c8e2a3 Fix #104230 2020-08-07 12:31:03 +02:00
Dirk Baeumer 0b79a0e708 Reenable localization tests 2020-08-07 11:30:30 +02:00
isidor f3e4ff9196 skip failing tests 2020-07-30 14:39:52 +02:00
Matt Bierner 42761b9db2 Fix smoke test function call 2020-07-28 14:57:08 -07:00
dependabot[bot] 7fb5a9385b
Bump lodash from 4.17.15 to 4.17.19 in /test/smoke
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.19.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.19)

Signed-off-by: dependabot[bot] <support@github.com>
2020-07-17 11:09:45 +00:00
rebornix 5e96337121 re #93070. test for command arguments. 2020-07-13 10:52:57 -07:00
Dirk Baeumer 09531cdf10 Fixes #101005: Localization - starts with 'DE' locale and verifies title and viewlets text is in German 2020-06-25 09:38:42 +02:00
Rob Lourens 4d6da3154c Get notebook smoketest working in web
Fix #98364
2020-06-07 17:27:47 -05:00
Rob Lourens 3eb6c1704b Disable notebook smoketests in web 2020-05-26 12:12:34 -05:00
Rob Lourens 8253b52191 Remove .only 2020-05-20 12:04:28 -05:00
Rob Lourens 9bc11824c3 Add notebook smoketests 2020-05-20 12:01:52 -05:00
Benjamin Pasero 869929e8c6 tests - log the actual build used for tests 2020-05-14 17:00:51 +02:00
Benjamin Pasero 0ac3b1114a smoke 💄 2020-04-30 13:32:27 +02:00
Benjamin Pasero 30bba102b3 smoke - only start automatically after data migration tests 2020-04-30 09:50:55 +02:00
Daniel Imms b7e0abbdcc
Merge branch 'master' into tyriar/90539 2020-04-10 05:56:39 -07:00
Alex Dima 283545de57
check in missing yarn.lock 2020-04-03 13:05:10 +02:00
João Moreno 8f566065fc upgrade dependencies in smoke test 2020-04-03 07:47:44 +02:00
Dirk Baeumer e694b041e3 Label for extension viewlet changed. Disable smoke test 2020-04-02 11:20:42 +02:00
João Moreno 05f9b99541
Update README.md 2020-03-31 13:18:35 +02:00
Rob Lourens 64c157244e Wait for cleared settings to be applied before continuing
Fix #93292
2020-03-28 10:43:24 -07:00
Benjamin Pasero e80f8a5da9 quick access - more cleanup 2020-03-26 13:51:05 +01:00
Benjamin Pasero 85d2077f19 smoke - quickopen => quickaccess 2020-03-26 12:28:49 +01:00
Dirk Baeumer b418b9cd59 Comment out debugger tests 2020-03-26 10:02:17 +01:00
Benjamin Pasero 21431f6117 quick access - cleanup API for quick input 2020-03-24 10:13:45 +01:00
Martin Aeschlimann bf6c93062b Rename CSS smoke test to language features: For #90538 2020-03-02 11:39:43 +01:00
Pine Wu a68bfa3846 Add back languages/css test. Fix #90538 2020-02-28 11:56:25 -08:00
Benjamin Pasero 0bab257fe5 smoke - remove firefox from docs 2020-02-27 14:22:23 +01:00
Rob Lourens db380eaad0 Fix build 2020-02-26 17:29:55 -08:00
Pine Wu e63119f785 Fix #90538 2020-02-26 16:24:46 -08:00
Benjamin Pasero 65976ac711 Revert "docs for #91532"
This reverts commit ebcd432491.
2020-02-26 16:30:06 +01:00
Benjamin Pasero 29c2c6079e smoke - do not restore windows 2020-02-26 12:03:05 +01:00
Dirk Baeumer 2cb430b396 Fixes #91433: Smoke Test: Localization Test Failure 2020-02-26 11:55:17 +01:00
Benjamin Pasero ebcd432491 docs for #91532 2020-02-26 11:39:05 +01:00
Daniel Imms 06f2731c7f Remove terminal smoke test
Fixes #90539
2020-02-14 07:24:44 -08:00
Benjamin Pasero 35379aba75 smoke - headless option is troublesome 2020-02-11 17:35:53 +01:00
Benjamin Pasero 06b06ca10a smoke - move quick open tests into search 2020-02-11 17:28:03 +01:00
Benjamin Pasero 9d9d729655 Web: run integration tests as part of our product builds (fix #83923) 2020-02-10 11:23:00 +01:00
Benjamin Pasero 4be3cc8846 test - convert web integration to TS 2020-02-07 12:41:12 +01:00
Benjamin Pasero bb3edc40e6 smoke - exclude a few more tests for web 2020-02-07 07:10:59 +01:00
Benjamin Pasero ec41f20c40
Web - run smoke tests using playwright (#89918)
* playwright - initial version

* browser - use existing page and not create new context

* macOS: document how to remove the security flag

* smoke test - allow to run against server build with --build option

* do not rely on args

* fix path for windows

* smoke test - smoke 💄 and -ci option
2020-02-04 17:23:27 +01:00
Joao Moreno 16c7551f36
move git smoke tests to integration tests 2020-02-04 17:06:49 +01:00
isidor 8f90e851c5 remode debug smoke tests 2020-02-04 16:14:02 +01:00
Benjamin Pasero a15803b9e7 smoke test - add attribute for tabs to simplify lookup 2020-02-04 14:50:53 +01:00
Sandeep Somavarapu 4fac3e22c5 remove the timeout 2020-02-03 11:49:10 +01:00
Daniel Imms 547cf4e81f
Run smoke tests against actual build (#83799)
* Run web against actual server

Part of #80308

* Fix strict null check errors

* Fix folder arg

* Disable unit tests and integration tests temporarily

* Allow running on node 12

* Fix smoke test condition

* Disable continue on error

* Add web to server dir

* fix smoke test to use build for web

* enable in product build

Co-authored-by: Benjamin Pasero <benjamin.pasero@gmail.com>
2020-02-03 11:26:55 +01:00
Benjamin Pasero d6eb50caa4
Smoke-Test: Hot-exit / dataloss tests broken (#89905)
* smoke test - carefuly select untitled content based on file name to find it properly

* Fileservice: mkdirp() logic is prone to errors from race conditions (fixes #89834)
2020-02-03 09:38:03 +01:00
Joao Moreno 9bec0160f6
fixes #86474 2020-01-23 11:41:00 +01:00
isidor 0fae04b8a2 fixes #78384 2019-12-05 14:21:50 +01:00
ryenus d75f90976b fix typo: consecutive-word duplications
This fixes unintentional duplications of words, such as `the the`, and
`can can` etc. I also take the chance to make a few wording tweaks to
avoid suspicious duplications.
2019-11-27 11:07:06 +08:00
Johannes Rieken 266f78096e remove smoke test for find ref, rename, goto, and peek, #85377 2019-11-22 11:36:13 +01:00
Jason Ginchereau 5c2e24f6ad Remove extra step from readme 2019-11-06 16:26:55 -08:00
Benjamin Pasero ea89eb903f fix #83805 2019-11-01 09:15:35 +01:00
Benjamin Pasero ca22de4b17 debt - bump node.d.ts dependency in extensions to 12.x (part of #82514) 2019-10-28 08:11:47 +01:00
João Moreno 229df29bc9
Update README.md 2019-10-03 09:03:13 +02:00
Joao Moreno 925f3ab1a0 fixes #81871 2019-10-03 08:51:05 +02:00
Daniel Imms 615e262789 Fix git smoke tests 2019-10-02 14:46:35 -07:00
Martin Aeschlimann 74ac7b8520 smoke: update mocha 2019-09-30 22:58:57 +02:00
Dmitry Gozman 367a5a0c59 Improve LinkDetector
- recognizes web urls;
- checks that file path exists;
- supports relative to workspace root paths (./foo);
- supports relative to home dir paths (~/foo);
- optional line/column;
- smoke test.
2019-09-24 13:19:52 -07:00
Daniel Imms a5b58dc5b8 Link directly to automation from smoke 2019-09-12 21:32:41 -07:00
Daniel Imms c3459acf6d Remove vscode-automation from pckage.json 2019-09-11 14:44:35 -07:00
Daniel Imms a0fc3ba877 Relink automation dep before compile
Just always relink to avoid issues with the build cache not restoring
links.

Fixes #80729
2019-09-11 11:20:11 -07:00
Jason Ginchereau 3d08742789 Add automation to root postinstall script 2019-09-09 09:30:34 -07:00
Daniel Imms 883bf518a9 Use --preserveWatchOutput in tsc watch, update yarn deps 2019-09-06 09:10:53 -07:00
Jason Ginchereau 8b8ef3e2ee Fix some package dependencies 2019-09-05 09:30:38 -07:00
Jason Ginchereau 4f2c387de1 Refactor smoke UI automation into separate package 2019-09-05 09:16:29 -07:00
Rob Lourens 7edc8f786e Fix #80304 - wait for remote window to actually connect before running tests 2019-09-04 17:29:07 -07:00
Rob Lourens 58c740aa48 Remove workaround for #74875 2019-09-04 14:52:53 -07:00
Daniel Imms 052ffefc24 Move puppeteer dep into smoke test project
Fixes #80329
2019-09-04 10:32:32 -07:00
Robo f5d7606821
Merge branch 'master' into update_electron 2019-08-30 09:05:41 -07:00
Benjamin Pasero d32c857d1b tsconfig 💄 2019-08-30 17:56:56 +02:00
deepak1556 5e0b028701 chore: Bump electron@4.2.10 2019-08-30 08:07:53 -07:00
Johannes Rieken dedf0de944 change type of _serviceBrand from any to undefined, #79918 2019-08-30 15:40:46 +02:00
Joao Moreno 4994c7be4e fixes #79867 2019-08-28 14:34:54 +02:00
Daniel Imms 68660775ab Teardown server on SIGTERM 2019-08-20 10:17:54 -07:00
Daniel Imms 64716dd3b0 Fix smoke test driver types 2019-08-20 10:17:54 -07:00
Martin Aeschlimann 815f7b05dd Localization test fails on remote smoketest. Fixes #78412 2019-08-19 13:01:26 +02:00
Daniel Imms 329f2fe76b Fix smoke tests 2019-08-16 06:39:38 -07:00
Daniel Imms d8cb87bd21 Reduce diff 2019-08-15 08:45:30 -07:00
Daniel Imms 6e8d4cf70f Fix dispatch keybinding when called multiple times 2019-08-15 07:58:24 -07:00
Daniel Imms 173b8c5cc6 Reduce diff 2019-08-15 07:52:23 -07:00
Daniel Imms 520fac5336 Remove click code from puppeteer driver, move interfaces to common 2019-08-15 07:49:06 -07:00
Daniel Imms 221a6ca43c Fix strict error 2019-08-15 07:15:59 -07:00
Daniel Imms 414a35dcf7 Use new browser none arg 2019-08-14 15:04:35 -07:00
Daniel Imms 57c13dc0c4 Base web user data dir off normal one 2019-08-14 14:50:45 -07:00
Daniel Imms 1f8d0fced3 Teardown on sigint 2019-08-14 11:38:48 -07:00
Daniel Imms 37d8f1fd26 Register driver 2019-08-14 11:37:16 -07:00
Daniel Imms 4af418a01f Use bat on Windows 2019-08-13 12:35:22 -07:00
Daniel Imms d5840463a3 Improve logging name 2019-08-13 11:37:26 -07:00
Daniel Imms 3db202b430 Clean up teardown code 2019-08-13 11:35:44 -07:00
Daniel Imms 27f5a327c9 Kill process when process exits 2019-08-13 11:34:02 -07:00
Daniel Imms 68f94dd8b4 Use temp user data dir 2019-08-13 11:28:29 -07:00
Daniel Imms f4deaa16c1 Remove unused import 2019-08-13 11:19:55 -07:00
Daniel Imms 064e134c6c Launch server from tests 2019-08-13 11:19:14 -07:00
Daniel Imms 8f1c14f737 Fix naming of puppeteer driver 2019-08-13 09:48:58 -07:00
Daniel Imms e3cc50361d Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-08-13 08:58:21 -07:00
Robo c327c4fcb7 chore: Bump electron@4.2.9 (#78836) 2019-08-12 08:14:18 +02:00
Daniel Imms 7721d6e373 Support launching web smoketests in headless mode 2019-08-09 11:21:40 -07:00
Daniel Imms b7bc156319 Remove resolved TODOs 2019-08-09 11:15:45 -07:00
Daniel Imms d224d533c8 Add all passing web tests 2019-08-09 11:06:01 -07:00
Daniel Imms 0d740b9913 Enable passing tests 2019-08-09 10:41:07 -07:00
Daniel Imms 3d64c7ef94 Allow web tests to pass electron path exists check 2019-08-09 10:03:08 -07:00
Daniel Imms 16a19e4452 Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-08-09 09:47:02 -07:00
Tony Xia 8443b97473 Fixed minor typos (#78042) 2019-08-05 11:14:08 +02:00
Joao Moreno 709a07d519 comment out i18n smoke test assertion 2019-08-02 15:33:17 +02:00
Joao Moreno d7f957bdec fix statusbar smoketests 2019-08-02 15:27:42 +02:00
Daniel Imms e723f810ec Add more tests 2019-07-31 10:24:42 -07:00
Christian Oliff 42cdcbb1bd
Fix 'Untitled' typo 2019-07-31 22:16:42 +09:00
Daniel Imms 65cd41503b Share code between electron and browser drivers 2019-07-27 13:39:35 -07:00
Daniel Imms 2e9593d064 Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-07-24 17:46:46 -07:00
deepak1556 0899c8ca90 chore: Bump electron@4.2.7 2019-07-24 14:25:15 -07:00
Daniel Imms e0d2e537f0 Pass web opt through 2019-07-19 17:21:11 -07:00
Daniel Imms 88c8745851 Bring more non-web smoke test code back 2019-07-19 17:16:04 -07:00
Daniel Imms 8d20c171fc Bring back non-web smoke tests 2019-07-19 17:12:11 -07:00
Daniel Imms 2eb4b1aebd Improve types 2019-07-16 14:09:12 -07:00
Daniel Imms f7b8079f21 Add puppeteer types and use TS in driver 2019-07-15 11:50:15 -07:00
Daniel Imms f784f5fd7f Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-07-15 10:34:58 -07:00
Martin Aeschlimann e6295eae65 Remote smoke test fails for 1.36.1. fixes #76987 2019-07-12 21:55:45 +02:00
Daniel Imms 76641f06d3 Get terminal smoke tests working under puppeteer 2019-07-12 12:39:53 -07:00
Martin Aeschlimann 112ca40eb1 remove unused import 2019-07-12 21:04:44 +02:00
Martin Aeschlimann 39e688381c smoke: support --test-repo on windows 2019-07-12 20:49:23 +02:00
Daniel Imms f9549e2347 Merge remote-tracking branch 'origin/master' into tyriar/puppeteer 2019-07-12 10:53:44 -07:00
Benjamin Pasero f7ff421b11 🆙 chokidar@2.1.7 2019-07-03 15:16:21 +02:00
Dirk Baeumer 39292af2b5 Fixes #76298: Smoke test failure: starts with 'DE' locale and verifies title and viewlets text is in German 2019-07-01 09:53:26 +02:00
Benjamin Pasero 9da43bcfb3 smoke - fix waitForStatusbarText 2019-06-28 15:35:36 +02:00
Benjamin Pasero ab9812e1af fix smoketest 2019-06-28 08:53:10 +02:00
Benjamin Pasero 84bfa21566 fix #75909 2019-06-27 11:51:00 +02:00
Benjamin Pasero 28a51a3f45
electron@4.2.5 (#76020) 2019-06-24 17:05:19 +02:00
Martin Aeschlimann f14e091212 fix smoke test after problems view css change 2019-06-17 12:08:26 +02:00
Benjamin Pasero 7b80b25ddf bump electron@3.2.4 2019-06-13 08:03:41 +02:00
Daniel Imms c41ad18414 Puppeteer exploration 2019-06-12 14:37:12 -07:00
Benjamin Pasero 3ae69da3a5 status - incremental updates 2019-06-11 09:59:01 +02:00
Waldir Pimenta f3e4e47164 Fix spelling of the example abbreviation (e.g.) 2019-06-05 16:00:26 +02:00
Martin Aeschlimann 66280104a9 [smoke] workaround for #74875 2019-06-05 12:31:50 +02:00
Benjamin Pasero d78a75973c
update @types/node (#74881) 2019-06-05 10:20:01 +02:00
Martin Aeschlimann be547e26fc fixes for remote smoke tests against a build 2019-06-05 09:38:02 +02:00
Benjamin Pasero d7977c880f debt - use @types/node: 10 for all extensions 2019-06-05 09:32:36 +02:00
Benjamin Pasero 73643c60a6
Update to Electron 4.0.x (#73119)
* Bump electron@4.0.0-beta.9

* electron 4 - temporarily warn about exploration change

* update to Electron 4.0.0 stable

* remove electron 4 notification

* bump to electron@4.0.1

* electron 4: adopt format change of "version" file

* build - set to use exploration image

* Revert "build - set to use exploration image"

This reverts commit 1bb280fc5e.

* electron@4.0.2

* fix electron.d.ts

* update distro

* bump electron@4.0.4

* debt - adopt new process.getProcessMemoryInfo()

* update electron@4.0.5

* electron@4.0.6

* electron 4.0.x - remove Linux 32bit build

* electron@4.0.7

* electron - update to 4.1.2

* bump electron@4.1.4

* update build (remove Linux32)

* electron@4.1.5

* electron 4 - remove linux 32bit warning

* Remove more 32-bit Linux build stuff

Fixes #66271

* electron@4.2.0

* electron@4.2.1

* electron@4.2.2

* electron@4.2.3

* Revert "electron@4.2.3"

This reverts commit ae375ef764.

* Revert "Revert "electron@4.2.3""

This reverts commit 513581ebc5.
2019-06-04 10:50:10 +02:00
Johannes Rieken c9344059ca fix #74702 2019-06-03 11:08:33 +02:00
Rachel Macfarlane fcf2ce32df
Update README.md 2019-05-31 14:17:33 -07:00
Benjamin Pasero 959246744b status - simplify by not needing element ID 2019-05-28 18:20:56 +02:00
Benjamin Pasero 8c35807271 status bar - adopt octicons for problems (#74285) 2019-05-28 17:54:01 +02:00
Martin Aeschlimann 90cfe12a63 Add vscode-test-resolver 2019-05-22 16:41:26 +02:00
Alex Dima 21d523e3ea Remove trailing spaces 2019-05-22 13:01:41 +02:00
Daniel Imms 0a878e8a3e Git ignore temp server downloads 2019-05-22 10:59:02 +02:00
Sandeep Somavarapu c77ec582b0 - Remove undefined in the aria label
- Search extension by id
2019-04-30 11:42:32 +02:00
Andre Weinand 3d83fcf5be
improve doc about the two build versions required for the smoketest 2019-04-11 13:15:25 +02:00
Daniel Imms 0b3bfd9598 More arguments for test 2019-04-10 22:32:45 +02:00
Sandeep Somavarapu 2681e564e7
move back to vscode folder 2019-04-01 11:11:35 +02:00
Sandeep Somavarapu f5391c163f
Compile sources before running 2019-04-01 11:10:13 +02:00
Benjamin Pasero 978a41a6bb electron@3.1.8 2019-04-01 09:36:55 +02:00
Sandeep Somavarapu 01470fbca3 Fix #71319 2019-03-28 12:52:25 +01:00
Rob Lourens 47d76f154d Fix search smoke test 2019-03-22 18:36:50 +00:00
Rob Lourens fa1c88a4e1 Disable extensions in smoketest 2019-03-22 18:10:39 +00:00
isidor 5595925f93 fixes #70423 2019-03-22 17:09:08 +01:00
Daniel Imms e0c0e08569 Add extra timeout to squash flakiness 2019-03-22 08:53:33 -07:00
isidor 37b76b0889 debug: transform actions to commands and contribute them properly 2019-03-19 15:46:24 +01:00
Dirk Baeumer 4eb16c20fc Reenable localization smoke tests. 2019-03-18 21:19:10 +01:00
Benjamin Pasero 4412367554 fix #70017 2019-03-15 18:54:22 +01:00
Rob Lourens cceda8e2f2 Fix #70389 - fix search smoke test 2019-03-13 18:55:30 +00:00
Joao Moreno 7b8af7a5ab adopt latest smoketest changes 2019-03-13 11:56:07 +01:00
Benjamin Pasero 22fdb8e2c3 bump electron@3.1.6 2019-03-10 12:40:50 +01:00
Pine Wu 485b2c924a Notice for Node v10.x requirement for smoketest 2019-03-01 12:47:37 -08:00
Dirk Baeumer 406f066218 Disable localization tests due to refactorings 2019-02-27 12:34:01 +01:00