Commit graph

1483 commits

Author SHA1 Message Date
Megan Rogge 7b3078d931
fix #137795 2021-11-30 12:48:58 -08:00
Megan Rogge 7f7fad2f9e
fix #137798 2021-11-30 12:38:52 -08:00
Daniel Imms faf6f0e1fd Setup terminal tests for 3 retries to minimize impact on build
This isn't a great long term solution but it should help reduce failures
for now.

Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge 005947e3b8
fix #137722
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge e89889fe54
fix #137799 2021-11-30 11:21:01 -08:00
Megan Rogge 18725fc147
set default profile to pwsh for only windows for #137225 2021-11-30 10:57:59 -08:00
Megan Rogge 4be98a3bce
set default to pwsh instead of bash for #137725 2021-11-30 10:21:15 -08:00
Benjamin Pasero 7b6c1065c7
smoke - temporary bring back timeout 2021-11-30 11:04:39 +01:00
Daniel Imms d5bfd6d31c Remove unneeded logs in test 2021-11-29 11:48:14 -08:00
Daniel Imms e208c8604e Remove timeout from automation terminal util
I don't believe this was ever required, awaiting writeInTerminal should make sure the
data event is triggered in xterm, the following enter should just trigger another data
event. This doesn't guarantee it was accepted by the process yet, just that xterm.js
emitted the event.

Part of #137847
2021-11-29 11:46:57 -08:00
Benjamin Pasero 1af6cb0edc
smoke test tweaks 2021-11-29 17:53:11 +01:00
Benjamin Pasero e241749320
smoke - print more backup info 2021-11-29 14:05:40 +01:00
Benjamin Pasero 18c6692316
tests - print main process pid when killing fails 2021-11-29 13:48:27 +01:00
Matt Bierner f00c4da8b8
Update default webview commit 2021-11-29 12:27:23 +01:00
MalikIdreesHasanKhan 595d893fdc
Fixed typos. (#135729) 2021-11-29 11:32:14 +01:00
Benjamin Pasero 687521092d
smoke - print running tasks after smoke test run 2021-11-29 10:12:42 +01:00
Benjamin Pasero 12178a4cf7
unit - exclude more tests for node.js runs (#137853) 2021-11-29 10:02:03 +01:00
Benjamin Pasero 5bb653374f
smoke - diagnose failing backup test 2021-11-29 09:56:19 +01:00
Benjamin Pasero cbbba8e69a
smoke - unique user data dir for stable tests too 2021-11-29 09:11:23 +01:00
Benjamin Pasero c42793d035
smoke - do not fail build when unable to delete workspace folder (workaround #137725) 2021-11-29 08:49:37 +01:00
Benjamin Pasero a5efd80ee0
Revert "smoke - print task list when deleting workspace path fails"
This reverts commit 368154bd0b.
2021-11-29 08:46:35 +01:00
Benjamin Pasero 368154bd0b
smoke - print task list when deleting workspace path fails 2021-11-29 08:04:30 +01:00
Benjamin Pasero e71b28a444
Smoke test lifecycle changes (#137969)
* rewrite teardown

* 💄

* avoid spam errors

* 💄

* split spawning browser from electron

* await copyExtension

* cleanup

* refactor methods

* cleanup

* cleanup

* cleanup

* 🆙 deps
2021-11-28 10:30:52 +01:00
Benjamin Pasero df4b5d6d04
smoke - strengthen shutdown path 2021-11-26 18:08:27 +01:00
Benjamin Pasero 13ff6baa3f
fix smoke tests 2021-11-26 14:45:35 +01:00
Benjamin Pasero 8d250e99e7
smoke - wait for tab becoming dirty before exit 2021-11-26 11:00:15 +01:00
Benjamin Pasero a11814c57a
smoke - switch away from potentially flaky editors.selectTab method 2021-11-26 09:22:19 +01:00
Benjamin Pasero 6f2239307b
Smoke test tweaks (#137809)
* smoke - move data migration tests into one and align

* fix app starting

* `createWorkspaceFile` is not async

* 💄

* support screenshot on failure even for stable app

* smoke - try to remove timeout (#137847)

* improve exit call
2021-11-25 14:37:22 +01:00
Daniel Imms eeae10e56c Skip flaky test
Part of #137795
2021-11-24 10:04:38 -08:00
Daniel Imms 653e5cdaee Skip flaky test
Part of #137808
2021-11-24 09:59:22 -08:00
Daniel Imms f880669743
Merge pull request #137763 from microsoft/tyriar/cleanup_smoke
Move terminal smoke tests into a single suite and reduce boilterplate
2021-11-24 09:54:50 -08:00
Daniel Imms 07d986443d
Skipping flaky test
Part of #137799
2021-11-24 09:50:26 -08:00
Benjamin Pasero 754190f326
Run unit tests against node.js too (#137790)
* tests - run unit tests also against node.js

* fixes

* fail if major node.js version mismatch

* -tfs is unsupported

* Add `@ts-check` and remove `jsdom`

* tests - process.env layer breaker

* Improve loader config

* skip one test

* address todos

* try to force color output

* Use a file: URI as baseUrl

Co-authored-by: Alex Dima <alexdima@microsoft.com>
2021-11-24 13:45:17 +01:00
Daniel Imms 42bd3e884b More clean up of terminal smoke test init 2021-11-23 15:46:51 -08:00
Rob Lourens 2932ec095d Add retry to quickaccess tests
Fix #137733
2021-11-23 15:35:48 -08:00
Daniel Imms d7f10626b8 Clean up terminal smoke test setup
Part of #136064
2021-11-23 15:18:38 -08:00
Daniel Imms 68e491f99f Re-enable other smoke tests 2021-11-23 14:50:52 -08:00
Daniel Imms 78d7ece7aa Add basic detach/attach terminal tests
Part of #136064
2021-11-23 13:23:54 -08:00
Daniel Imms ef440e563d Merge remote-tracking branch 'origin/main' into tyriar/persist_tests 2021-11-23 12:47:36 -08:00
Benjamin Pasero 1b40be3377
smoke - enable graceful-fs (#137734) 2021-11-23 17:29:08 +01:00
Alex Dima 689467c841
Try to restore yarn mocha and move browser tests to /browser/ 2021-11-23 16:07:15 +01:00
Alexandru Dima 465b806ed2
Merge pull request #137650 from microsoft/issue-133173
Avoid using `setImmediate`
2021-11-23 11:38:52 +01:00
Benjamin Pasero 954ce2c3f4
proper await exit 2021-11-23 10:31:46 +01:00
Rob Lourens 3bac53642b Disable flaky search smoke test #137195 2021-11-22 14:25:23 -08:00
Megan Rogge 4e303fcc52
fix #137590 2021-11-21 10:04:21 -08:00
Daniel Imms 2f7ab5c0e0 Disable should update color of the tab
Flake in CI
2021-11-19 13:58:01 -08:00
Daniel Imms 5dec5256d7 Add some detach/attach tests 2021-11-19 10:33:43 -08:00
Benjamin Pasero ddbda4c196
tests - enable crash reporter for electron based unit tests
//cc @deepak1556
2021-11-19 11:12:53 +01:00
Megan Rogge f66bc86da8
add terminal editor and tab smoke tests (#137393)
* Add a bunch of tests

* tweak tests

* add profile tests, now breaking (no profiles showing up)

* uncomment tests

* update expected

* fix test

* merge

* all passing

* bunch of improvements

* improve readability

* all should be passing and cleaned up

* all passing

* fix #137243 and clean-up

* remove .only

* fix #137247

* get rid of enum

* see if this fixes timing issue

* use keybinding for show terminal instead

* remove delay, implement better accept function

* get rid of unneeded index

* try something else

* wait for empty editor to be active

* remove .only

* decrease redundancy in names

* re-add xterm selector

* try something else

* undo change that broke things worse

* add terminal-tabs test

* all tabs tests passing locally

* kill all

* await before running each

* fix tests

* remove .only

* try waiting for focused xterm

* remove .only

* clean up

* 🧹

* fix profiles tests by using this.app.props

* revert to use default shell

* re-add conditional

* Get tests passing on WebKit

On WebKit the smoke tests were failing because the quick pick was
triggering a focus event on the terminal after the blur event had
already happened, this caused the view service to think the terminal
was still focused when it wasn't. The fix was to reset the context key
also in IViewsService.closeView.

* Safari -> WebKit

* Prefer arrow functions

* remove beforeEach timeout

* add timeouts to contributed profile tests

* add terminal editor tests, fix #137377

* add a bunch of tests

* refactor

* get rid of profile specific command

* more polish

* refactor getTabs -> assertTerminalGroups

* fix failing test

* more polish

* remove .only

* add assertSingleTab

* remove unused import

* fix error

* fix more failures

* more changes

* fix almost all except for plus button

* fix failing plus button test

* all passing

* modify error that gets thrown

* modify error message again

* remove unused wildcard/ ANY_NAME, fix icon code

* fix icon code

* large refactor, improvements

* finish polish

* 1 failing

* get test to pass

Co-authored-by: Daniel Imms <2193314+Tyriar@users.noreply.github.com>
2021-11-18 15:11:40 -08:00
Megan Rogge 239a94cee8
remove debug log 2021-11-17 14:01:31 -08:00
Megan Rogge 00fa317c43
Add terminal profile smoke tests (#137079) 2021-11-17 14:00:01 -08:00
Benjamin Pasero bacf6ed2c1
smoke - properly create screenshots and stop instances (#137220) 2021-11-15 12:15:25 +01:00
Benjamin Pasero 6f28593438
smoke - retry quick open search (fix #136499) 2021-11-15 07:52:12 +01:00
Daniel Imms 3c9b18e135 Remove test only 2021-11-12 06:16:17 -08:00
Daniel Imms c65c8738f9 Copy and use IWindowDriver in PlaywrightDriver 2021-11-12 06:11:18 -08:00
Daniel Imms 634dae736e Merge remote-tracking branch 'origin/main' into tyriar/smoke_test_improvements 2021-11-12 05:45:20 -08:00
Daniel Imms e6caf0da49 Pass terminal profiles test 2021-11-10 12:27:38 -08:00
Daniel Imms 5bfaf29f2b Fix layering problem 2021-11-10 08:38:02 -08:00
Daniel Imms 6a6a1b65df Use handles in playwright driver 2021-11-10 08:03:22 -08:00
Benjamin Pasero bef4dba21f
Parcel update and CI improvements (#136830)
* 🆙 product

* 🆙 parcel/watcher

* 🆙 parcel/watcher

* tests - separate remote logs from others

* store server logs too

* more tweaks

* fix name

* error when 10s passed
2021-11-10 08:13:56 +01:00
Daniel Imms bd98431baf Write basic terminal default profile test
Co-authored-by: Megan Rogge <merogge@microsoft.com>
2021-11-09 10:10:54 -08:00
Daniel Imms 628f486b1d Move playwright driver impl to class
Part of #136064
2021-11-09 08:45:08 -08:00
Daniel Imms 28da3051b3 Tidy up smoke test imports 2021-11-09 08:26:39 -08:00
Daniel Imms 281bacb074 Stub out some terminal smoke tests
Part of #136064
2021-11-09 08:25:15 -08:00
Daniel Imms 1cbf69d996 Document --headless in smoke tests 2021-11-09 08:24:38 -08:00
João Moreno 1788b8afd8
chore: 🔧 clean smoketest dependencies 2021-11-08 14:58:17 +01:00
Benjamin Pasero f9e8dc2095
🆙 playwright 2021-11-04 09:27:22 +01:00
Alex Dima 3247c31f6a
Replace Right Single Quotation Mark with Single Quote 2021-11-03 23:34:40 +01:00
Benjamin Pasero 7ca8b0f613
Statusbar - checks if 'Go to Line' works if called from the status bar: (fix #135962) 2021-10-28 07:22:45 +02:00
Matt Bierner bc566d42a1
Try bumping webEndpointUrlTemplate again
Reverts dc1a669906

Also bumps distro to pick up new product.json changes
2021-10-26 15:38:11 -07:00
Alexandru Dima 7dfe2e33ea
Fix test running around loading assertCleanState 2021-10-19 11:09:47 +02:00
Alex Dima 11862795ea
Remove LanguageIdentifier and ensure tests dispose instantiated LanguagesRegistry objects 2021-10-18 10:29:16 +02:00
Rob Lourens 83fec0220c Add retry logic for flaky git operations
Fix #132218
2021-10-12 17:08:20 -07:00
Alex Dima 898c759f85
Fail the build when webpack has bundling warnings (early prevention of issues like microsoft/monaco-editor#2691) 2021-10-11 18:14:10 +02:00
Benjamin Pasero be2f951fde debt - introduce Promises.withAsyncBody and adopt in a few places 2021-10-11 13:27:43 +02:00
Matt Bierner 5fc835305a
Re-enable webview tests on web (#134300)
* Enable webview tests on web

These tests pass fine on Chrome and webkit. On Firefox, the two about loading resources currently fail

I spent a while trying to debug what is going on with these tests. It seems like the service workers is registered properly but `fetch` is never called on it. Skipping these for now

* Remove only

* Fix test
2021-10-01 12:32:29 -07:00
Henning Dieterichs 98c1725c7d
Encode actual and expected value as JSON to enable https://github.com/microsoft/vscode-selfhost-test-provider/pull/2.
Only a proof of concept yet.
2021-09-13 18:44:06 +02:00
Benjamin Pasero 769d5fb521
smoke - disable search smoke tests on windows (#132218) 2021-09-06 18:07:58 +02:00
Sandeep Somavarapu 77b1fb79f5
Fix #132233 2021-09-06 14:32:19 +02:00
Johannes Rieken 70e30bc64e
disable flaky/failing smoketest, https://github.com/microsoft/vscode/issues/132233 2021-09-03 11:38:14 +02:00
Benjamin Pasero a3acef919f
smoke - ignore any failure from capturing screenshot 2021-09-03 09:31:01 +02:00
Raymond Zhao 86d81f35fe
Clarify running remote tests 2021-09-01 19:17:58 -07:00
Benjamin Pasero cdde5bedbf
web tests - mention how to enable playwright logging 2021-08-26 10:34:17 +02:00
Matt Bierner 4cd3ec8281
Update commit 2021-08-24 14:15:43 -07:00
Matt Bierner a70fd2fbf6
Bump default webview commit 2021-08-23 18:46:43 -07:00
Benjamin Pasero 90443f7a8a
tests - try to make some tests more robust 2021-08-12 07:48:02 +02:00
Connor Peet fa8ccff4d8
testing: initial output correlation 2021-08-11 13:08:58 -07:00
Logan Ramos 8bf9cfa21b
Fix spacing 2021-08-11 15:26:20 -04:00
Logan Ramos 2ee9010437
Disable telemetry in tests (#130591)
* Disable telemetry in tests

* Remove the console log check
2021-08-11 11:49:23 -04:00
dependabot[bot] 0344ecd462
Bump path-parse from 1.0.6 to 1.0.7 in /test/smoke (#130540) 2021-08-11 08:21:05 -07:00
Benjamin Pasero ec9a8fe5b7
web smoke - guard against failing tracing 2021-08-07 15:10:50 +02:00
Rob Lourens 42a8653e39 Mention building browser integration test code 2021-08-06 18:22:41 -07:00
Benjamin Pasero 5e99049e66
smoke - fix web smoke tests 2021-08-05 11:31:04 +02:00
Benjamin Pasero 6957e52e4b
smoke - always create test folder 2021-08-05 10:31:07 +02:00
Benjamin Pasero b96644b15f
smoke tests - drop 'tmp' and try to deal with tmp path ourself (#130102) 2021-08-05 10:04:00 +02:00
Benjamin Pasero 6c3bb99c63
smoke - better exit application handling 2021-08-05 09:05:17 +02:00
Benjamin Pasero 70e6d3f85d
smoke tests - try to fix data migration test (#129279) 2021-08-05 07:56:55 +02:00
Benjamin Pasero bf4a4a6b05
smoke tests - retry data migration tests on windows (#129279) 2021-08-04 18:10:00 +02:00
Benjamin Pasero 2f58131321
smoke tests - fix compile issue 2021-08-04 15:46:10 +02:00
Benjamin Pasero c28ea165cd
smoke tests - try other ways of ensuring the editor is open for data migration (#129279) 2021-08-04 15:32:21 +02:00
Benjamin Pasero db4cda10a8
web - guard against error from stopping tracing on tear down of tests 2021-08-03 14:15:55 +02:00
Benjamin Pasero 0390d98a4e
web tests - print page errors to console
//cc @lramos15 this would have detected the missing module
2021-08-03 09:10:47 +02:00
Raymond Zhao ffceebb909
Revert "Update webviewExternalEndpointCommit"
This reverts commit dbe3a22a53.
2021-07-26 16:38:03 -07:00
Raymond Zhao d163eabed0
Add troubleshooting step for tmp module 2021-07-26 14:39:44 -07:00
Matt Bierner dbe3a22a53
Update webviewExternalEndpointCommit 2021-07-26 13:00:08 -07:00
João Moreno 132e3783d0
smoke: fix vscode-test cache location 2021-07-16 15:23:48 +02:00
João Moreno a9e4cb0874
oops 2021-07-16 12:50:07 +02:00
João Moreno 3c4fdb58a1
fix screenshots in smoketests
related to #122685
2021-07-16 11:58:52 +02:00
Rob Lourens 50b3811fdc Revert "Fix running smoketest multiple times"
See https://github.com/microsoft/vscode/pull/124666/files#r662070269

This reverts commit 4d694d7dc8.
2021-07-14 21:32:51 -07:00
Rob Lourens 4d694d7dc8 Fix running smoketest multiple times 2021-07-14 21:21:27 -07:00
Robo 9520f0a515
chore: update to electron 13 (#124666)
* chore: bump electron@13.0.1

* chore: update cache for native modules

* chore: bump electron@13.1.2

* chore: bump electron@13.1.4

* chore: fix user data dir length for validateIPCHandleLength check

* chore: always disable uploadToServer on OSS

* chore: use process.contextIsolated property

* chore: bump electron@13.1.6

* fix: getUserDataPath helper
2021-07-13 20:01:10 -07:00
Connor Peet fa9255c0de
almost complete update for run configurations 2021-07-12 17:28:01 -07:00
João Moreno 05fd05dc00
remove --stable-build 2021-07-12 05:56:27 -07:00
Benjamin Pasero d85bc647ef
smoke tests - automatically test against stable build (#127799)
* smoke tests - automatically test against stable build

* fix path on Linux/Windows

* 💄

* retry migration tests

* smoke: always download latest previous stable

* hm

Co-authored-by: João Moreno <joao.moreno@microsoft.com>
2021-07-12 05:44:50 -07:00
João Moreno d737dc4db3
smoke: simplify localization test 2021-07-12 12:20:34 +02:00
Connor Peet 20790ec994
testing: increase debugger wait timeout 2021-07-09 15:28:35 -07:00
João Moreno a28d028d2d
Enable automated smoketests on Windows (#128224) 2021-07-08 19:10:25 +02:00
Connor Peet c6d7cfed8a
testing: fix undefined not being reported correctly in results
Fixes #125669
2021-07-07 15:28:55 -07:00
Connor Peet 583f6d1418
open the devtools for browser tests when debug is passed 2021-07-07 12:58:19 -07:00
Benjamin Pasero d0df79be50
webview - remove more traces (#128128)
* webview - remove more traces

* more removal
2021-07-07 18:28:53 +02:00
Benjamin Pasero fa032d752d
Update playwright to 1.12.x and enable tracing for smoke tests (#128061)
* 🆙 playwright

* create trace
2021-07-07 13:23:11 +02:00
Dirk Baeumer c9aea49a87
Re-enable enhanced localization tests 2021-07-07 10:49:52 +02:00
João Moreno 2c7fc24d63
smoke: ctrl-c should kill all processes 2021-07-06 20:30:20 +02:00
Dirk Baeumer 1a3fd783fe
Disable locale info check. 2021-07-06 15:38:21 +02:00
Dirk Baeumer ae52915f0c
Improve localization tests 2021-07-06 13:15:43 +02:00
Benjamin Pasero 7a0714a6e5
smoke - harden data migration test 2021-07-06 12:10:08 +02:00
Sandeep Somavarapu 062e6519f8
use vscode smoke test check extension 2021-07-02 10:46:31 +02:00
Benjamin Pasero 99a831f6e8
web - allow integration tests to open a workspace 2021-07-01 15:38:30 +02:00
João Moreno ca61a42383
web smoke test: bump up port number 2021-06-30 12:01:31 +02:00
João Moreno a44611d4c6
tests: hide output 2021-06-30 11:07:35 +02:00
Dirk Baeumer a63e0a0a21
Reenable German translation test based on new API 2021-06-29 09:23:52 +02:00
Robo 92999c339e
fix: setuid helper permission (#126798)
* ci: fix setuid helper binary permission

* ci: allow privilege for CLONE_NEWPID | CLONE_NEWNET

* ci: fix chrome-sandbox permission with rpm

* ci: fix permissions on snap

* ci: download electron earlier for arm builds
2021-06-22 08:42:30 -07:00
Dirk Baeumer 9cfc4bcb5c
Improve wording for failing test case 2021-06-22 13:30:29 +02:00
Dirk Baeumer 1f2a6cc331
Improve localization smoke test 2021-06-21 13:54:16 +02:00
João Moreno 3d2dea7a9f
fix integration browser tests 2021-06-15 15:15:41 +02:00
João Moreno 9d4274bf64
skip the entire notebook test suite so Code isn't even launched 2021-06-15 14:07:35 +02:00
Benjamin Pasero 81317867a3
web - disable welcome in smoke tests (fix #126221)
//cc @JacksonKearl
2021-06-15 10:57:29 +02:00
Benjamin Pasero 2ddc1e4fc5
Produce logs during test runs (integration, smoke) and publish as artefacts (#126065)
* first cut upload log files from integration test runs

* always publish log files

* move logs into integration-tests folder

* also produce logs for smoke tests

* store remote log files

* wire in logspath arg properly

* always publish logs

* enable logs for browser based smoke tests

* log only in verbose
2021-06-15 08:33:26 +02:00
João Moreno 85a36ae074 enable smoketest on linux 2021-06-11 12:19:17 +02:00
Alexandru Dima 0c87771e7b
Merge pull request #125754 from microsoft/alex/update-playwright
Update to `playwright@1.11.1`
2021-06-10 23:00:14 +02:00
Ladislau Szomoru 291ec03bc3
Smoke tests - run each suite in its own user-data-dir (#125670)
* Initial commit for isolated smoke tests

* Do not wait for the explorer view when restarting

* Debug failed localization test

* User data path suffix length

* Kill server when application exits

* Do not run yarn install

* Refactor application start/stop

* Reverted some changes

* Missed one

* One more change to revert

* Restored one more file

* Pull request feedback
2021-06-10 06:40:57 -07:00
Alexandru Dima 911ef74bbb
Merge remote-tracking branch 'origin/main' into alex/update-playwright 2021-06-10 09:27:13 +02:00
Alexandru Dima b1bc7be9d1
Do not rely on console.log for exiting tests 2021-06-09 21:47:18 +02:00
Benjamin Pasero 33f84b36fd
tests - disable getting started in integration tests and smoke tests (#125808)
* tests - disable getting started in integration tests and smoke tests

* --skip-getting-started => --skip-welcome

Co-authored-by: Jackson Kearl <jakearl@microsoft.com>
2021-06-09 18:36:42 +00:00
Henning Dieterichs 00123b32a7
Updates sinon from 1.17 to 11.1. 2021-06-09 10:03:46 +02:00
Henning Dieterichs 294b3bdf16
Revert "Include sinon-test in renderer.html / index.html"
This reverts commit e4e0f8be89.
2021-06-08 17:18:34 +02:00
Henning Dieterichs e4e0f8be89
Include sinon-test in renderer.html / index.html 2021-06-08 17:16:54 +02:00
Ladislau Szomoru 4e0cf885d4
Don't wait for the explorer when restarting 2021-06-07 15:34:37 +02:00
Ladislau Szomoru b003560579
Use --disable-workspace-trust for the test runs 2021-06-07 09:59:26 +02:00
Ladislau Szomoru e2d0e05038
Do not run yarn install as part of the smoke tests 2021-06-06 21:14:37 +02:00
Benjamin Pasero 802648f2a1 electron - adopt some newer APIs and 💄 main code 2021-06-04 09:22:38 +02:00
Ladislau Szomoru b0509196f6
Disable workspace trust during tests 2021-06-03 10:21:19 +02:00
João Moreno 541a5d4fa7
smoke: trust dialog should appear in 5 seconds, and we can ignore if it doesn't 2021-05-28 11:38:10 +02:00
SteVen Batten e5f70e8e2a
fix smoke tests (#124814) 2021-05-28 09:30:47 +02:00
Benjamin Pasero 5eec3c86e3 smoke test - disable experiments 2021-05-27 07:30:23 +02:00
Benjamin Pasero 4cda850edf disable welcome editor in smoke tests (fix #124674) 2021-05-26 14:22:13 +02:00
Matt Bierner b1823157d5
Fall back to existing published webview commit (#119295) 2021-05-24 22:36:22 -07:00
Jackson Kearl 5ac4f5f5be
Fix didn't work 2021-05-21 11:21:27 -07:00
Jackson Kearl 852b70eafe
Try fix (#124384) 2021-05-21 17:36:20 +00:00
Benjamin Pasero 4b5db9098c
smoke test - disable failing search test
//cc @JacksonKearl
2021-05-21 09:12:01 +02:00
Jackson Kearl e66c62f38a
Generalize smoke text 2021-05-20 22:21:19 -07:00
Jackson Kearl 89c8f91988
Add smoke test for #124146 2021-05-20 22:20:48 -07:00
Ladislau Szomoru a13da59f95
Fix #123621 2021-05-12 10:04:46 +02:00
Rob Lourens 5c22e55a74 Disable broken smoke test #123621 2021-05-11 19:26:30 -07:00
dependabot[bot] 000e064e61
Bump hosted-git-info from 2.8.8 to 2.8.9 in /test/smoke (#123481)
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info) from 2.8.8 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases)
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md)
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.8.8...v2.8.9)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-11 07:57:52 -07:00
Dirk Baeumer 2fc3214ba4
Fixes #123083: Localization: starts with 'DE' locale and verifies title and viewlets text is in German 2021-05-10 13:57:43 +02:00
João Moreno 9a3bfc1ea1
add leak test scaffolding 2021-05-06 14:45:12 +02:00
Benjamin Pasero e2954beb4b
Remove --no-sandbox (#122909)
* linux - remove `--no-sandbox` flag

We should not disable sandbox on Linux.
We only added this to support running on Kernel <= 3.8 where setuid sandbox is used.

* fix ci

* add some docs
2021-05-04 11:18:19 +02:00
Robo bce4d71f64
chore: bump node@14.x in devDependencies (#122905) 2021-05-04 10:04:13 +02:00
Connor Peet 24ea8408c3
testing: propoagate timeout option for unit tests 2021-04-29 12:19:56 -07:00
Connor Peet b1569995f9
testing: allow waiting for server before running unit tests
Fixes https://github.com/microsoft/vscode/issues/121751
2021-04-26 16:31:36 -07:00
Benjamin Pasero 7095f4706c
unit tests (electron) - avoid sending circular structures over 2021-04-21 08:13:08 +02:00
Benjamin Pasero f8c7dd64a4 tests - ensure preload promises are all resolved 2021-04-09 08:28:21 +02:00
Benjamin Pasero ff0f7f3cf2
Make product configuration available to non node.js environments (fix #120243) 2021-04-06 08:55:31 +02:00
Benjamin Pasero 1db94dbb10
sandbox - add additional arguments also to test runner 2021-04-01 08:10:40 +02:00
Ladislau Szomoru 335bc0196c
Remove unused dependency 2021-03-31 10:11:35 +02:00
Ladislau Szomoru 45f061b9c8
Swap cpx for cpx2 2021-03-31 09:24:44 +02:00
Logan Ramos d5a670eaeb
Switch to deepStrictEqual part of #118667 2021-03-30 12:05:06 -04:00
Ladislau Szomoru 7c498ec3a8
Update tests to use consistent version of mkdirp 2021-03-30 14:00:37 +02:00
Connor Peet 48e8463a89
testing: tear down app if renderer crashes
Fixes https://github.com/microsoft/vscode/issues/117068
2021-03-29 16:41:03 -07:00
Logan Ramos 31fd94b660
First round of getting rid of deprecated asserts (#120125) 2021-03-29 15:48:46 -04:00
Dirk Baeumer 08c4cd87e3 Reenable localization tests. 2021-03-25 10:42:35 +01:00
Megan Rogge 2c232fed6a
Update README.md 2021-03-24 12:40:21 -07:00
rebornix 2b66dfe021
skip flaky tests. 2021-03-23 21:49:48 -07:00
Rob Lourens cca8a48b17 Restore notebook smoketests, Fix #113882 2021-03-23 08:49:57 -07:00
Erich Gamma 73b9e6679d
Update README.md 2021-03-23 14:54:30 +01:00
Connor Peet 808266d4de
Allow tests to be loaded asynchronously (#119537)
* initial wip in the extension host

* wip

* wip

* wip

* continued progress

* update api from discussion

* update for new proposal

* wip

* update to lastest testing api, almost everything working

Refs https://github.com/microsoft/vscode/issues/115089
Design https://gist.github.com/connor4312/73f1883d720654834b7fd40550d3b6e0

* re-wire retirement state

* update actions to new async test structure

* minor cleanup

* remove unused es2018 that failed build
2021-03-22 18:08:13 -07:00
Alexandru Dima 242ddc4bdf
Merge pull request #118400 from thebinarysearchtree/main
Fix transformToSnakecase
2021-03-18 22:02:49 +01:00
Johannes Rieken b353f06339
comment out failing notebook smoke tests, https://github.com/microsoft/vscode/issues/119164 2021-03-17 09:22:44 +01:00
Jackson Kearl ac0008a25b
Remove waiting for welcome page while we are experimenting with what the welcome page will be
Fixes #118748
2021-03-11 09:23:38 -08:00
Jackson Kearl 556e6d8310
Fixup search smoke tests 2021-03-09 12:50:36 -08:00
Jackson Kearl 9eceb50498
Move label about for #115244 after more tests are failing 2021-03-09 11:25:45 -08:00
Jackson Kearl e5a10ca55d
Skip search tests while diagnosing flakeyness 2021-03-09 11:16:09 -08:00
Sandeep Somavarapu edfbf27e3a #118443 - change name 2021-03-09 09:34:19 +01:00
Sandeep Somavarapu 9d3a1d9f59 Fix #118443 2021-03-09 09:30:56 +01:00
Jackson Kearl ac229ced07
Revert "Reenable smoke test to see if still flakey" #115244
This reverts commit 5d80c30e5b.
2021-03-08 19:31:58 -08:00
Benjamin Pasero 9c78fa40ca
skip failing test (#118443) 2021-03-08 15:22:24 +01:00
Andrew Jones 2a0f9aa8dc Reminder to compile between tests 2021-03-08 19:52:39 +10:00
Andrew Jones 3f46e7f7b5 add ui flag to mocha tests 2021-03-08 15:04:26 +10:00
Jackson Kearl 5d80c30e5b
Reenable smoke test to see if still flakey
Ref #115244
2021-03-05 22:05:32 -08:00
Sandeep Somavarapu 1a9df6127c fix smoke tests 2021-03-05 15:27:03 +01:00
Sandeep Somavarapu c6202bb3cc Adopt to use new table widget 2021-03-04 19:51:03 +01:00
Benjamin Pasero e916637528 tests - enable color output for integration tests 2021-03-01 15:10:15 +01:00
Benjamin Pasero 5fabc0d9dc smoke test - remove code only needed for stable january release 2021-02-25 09:31:55 +01:00
Benjamin Pasero 041e4d9b1f fix smoke tests with stable build (fix #117420) 2021-02-23 19:04:51 +01:00
Connor Peet a0e24147e0
testing: remove duplicate extension and internal IDs
Fixes #117084
2021-02-19 16:57:29 -08:00
Raymond Zhao ee820dffbf
Update smoke test README (#115582) 2021-02-19 09:05:11 -08:00
João Moreno 2ca2792a65
fix smoketest 2021-02-19 16:03:01 +01:00
Jackson Kearl 096e5555b6 Allow welcome page to not be active on account of focus potentially going to a getting started item. 2021-02-18 18:57:24 -08:00
Benjamin Pasero 9de38fc9a8
Disable keytar in our integration tests (#116852)
* tests - extract and use ALL_PLATFORMS_API_TESTS_EXTRA_ARGS

* tests - throw when accessing keytar from API tests
2021-02-17 15:09:40 +01:00
João Moreno 38ae92f4b1
remove unused ui tests 2021-02-16 11:59:30 +01:00
João Moreno 980becda8d main rename
fixes #116341
2021-02-14 20:10:24 +01:00
Rob Lourens a699ffaee6 Reenable notebook smoke test
Fix #116535
2021-02-13 15:48:37 -08:00
Johannes Rieken fc31a6a558 skip failing test, https://github.com/microsoft/vscode/issues/116535 2021-02-12 11:15:56 +01:00
Jackson Kearl d10f2e6032 Fix #116412: Use getting started page as default startupEditor. 2021-02-11 12:34:14 -08:00
Jackson Kearl 8a3a5d9b74 Fix search smoke test 2021-02-09 15:44:07 -08:00
Sandeep Somavarapu cd97629c44 #116152 enable smoke tests 2021-02-09 08:58:39 +01:00
Rob Lourens be5126d37c Also skip 'before', #116156 2021-02-08 22:08:17 -08:00
Rob Lourens 0829608afb Change disabled tests to .skip 2021-02-08 21:37:02 -08:00
Megan Rogge 29844a0baf disable smoke tests that time out 2021-02-08 18:21:39 -08:00
Jackson Kearl 4623a50995 Fix #116154 2021-02-08 17:46:12 -08:00
Sandeep Somavarapu 63310d91d3 remove install extension 2021-02-04 20:48:25 +01:00
Sandeep Somavarapu a9ccd48a1f enable extension tests in web 2021-02-04 08:44:06 +01:00
Sandeep Somavarapu 4e6d9ce2b7 add server cli test 2021-02-03 21:42:12 +01:00
Sandeep Somavarapu 066c584405 enable remote smoke tests 2021-02-03 19:20:44 +01:00
Benjamin Pasero 7a6a45fb2c browser tests - fix regression from updating playwright 2021-02-02 16:53:30 +01:00
Sandeep Somavarapu abb05eb058 Fix #115586 2021-02-02 10:25:50 +01:00
Benjamin Pasero 04d4310a8a fix smoketest (#115586) 2021-02-02 08:20:07 +01:00
Rob Lourens 662a698ef9 Skip failing test #115244 2021-01-28 12:00:17 -08:00
Alexandru Dima 0a943766a5
Fix monaco checks 2021-01-28 14:48:41 +01:00
Martin Aeschlimann 4bd2d367e7 Remote smoketest timeout (fixes #115159) 2021-01-27 15:52:25 +01:00
Sandeep Somavarapu 4b9b2ab9a6 Fix #114707 2021-01-21 17:46:40 +01:00
João Moreno f745a912ae
fixes #114420 2021-01-15 15:19:19 +01:00
Alexandru Dima 00f8540d79
Fixes #114332
`yarn` no longer compiles the smoke test as a postinstall script. This breaks the flow of running `yarn && yarn smoketest` to execute the smoketest.

So change `yarn smoketest` to also do the compiling of the smoke test. But that generates too much extra work on the build machine, which needs to invoke `yarn smoketest` twice, once for Electron and once for web.

To workaround that, `yarn smoketest-no-compile` is added, which can be used by the build machine to avoid needlessly compiling.

While here, the nodejs version is already checked in the `yarn` preinstall script, so remove the check from the smoke test.
2021-01-14 10:35:42 +01:00
Connor Peet 2b5ae783bf
testing: add full json reporter to show more complete output 2021-01-13 15:30:11 -08:00
Johannes Rieken b90166177b reuse stats collector for EchoRunner, fix missing titlePath-property, fixes https://github.com/microsoft/vscode/issues/114190 2021-01-12 11:21:32 +01:00
Alexandru Dima 533d094020
Allow logging FS access with stacks 2021-01-11 15:32:39 +01:00
Alexandru Dima 2fd00ba9fe
Add a way to troubleshoot fs calls 2021-01-11 09:11:33 +01:00
Benjamin Pasero eb40962288 tests (unit, electron) - set forbidOnly when running on build machine 2021-01-08 09:09:23 +01:00
Benjamin Pasero 96e2981c91 skip failing test (#113882) 2021-01-08 08:16:28 +01:00
Alexandru Dima 8ad08b04f5
Do not compile /test/ and /build/ scripts during postinstall, the scripts get compiled explicitly during CI 2021-01-07 16:47:11 +01:00
Rob Lourens d29388d255 Reenable test, fix #113768 2021-01-05 12:21:50 -08:00
Alexandru Dima 689fbbd960
Increase timeouts 2020-12-30 14:15:14 +01:00
Alexandru Dima 4b6280aa8c
Skip webkit 2020-12-28 21:53:35 +01:00
Alexandru Dima 9945754a62
Add editor smoke test (ported from monaco-editor) 2020-12-28 21:44:42 +01:00
Alexandru Dima f74ad9692f
Align @types/* dev dependencies (#112718) 2020-12-18 13:28:39 +01:00
Alexandru Dima aa2864d53f
Remove most of the yarn license warnings 2020-12-18 10:26:14 +01:00
Alexandru Dima fee6dbf4e0
Merge remote-tracking branch 'origin/master' into alex/node-modules-vscode 2020-12-17 22:02:47 +01:00
Alexandru Dima 7ca71e763d
Move away from deprecated 'vscode' node module (#112718) 2020-12-17 21:40:14 +01:00
Connor Peet 88f32df1d7
Merge branch 'mocha-update' 2020-12-17 12:08:24 -08:00