Commit graph

1696 commits

Author SHA1 Message Date
Matt Bierner c2f4daf348
Update webview bits version for tests 2021-12-07 16:16:54 -08:00
Tyler James Leonhardt 224701f74d
try remove timeouts in smoke tests for quickaccess (#138615) 2021-12-07 12:25:35 -08:00
Benjamin Pasero 13c0ed811e
🆙 playwright & set trace names (#138539) 2021-12-06 19:42:05 +01:00
Daniel Imms 110345a97b Try removing timeout in checkWindowReady
Part of #137847
2021-12-06 06:35:57 -08:00
Benjamin Pasero 2085b19a51
smoke - allow 30s max for deleting test path (#137725) 2021-12-06 14:09:02 +01:00
Benjamin Pasero e8e0fb874d
smoke - disable test that is flaky still 2021-12-06 13:44:01 +01:00
Benjamin Pasero fe227dacb7
lifecycle - introduce and adopt finalVeto for backups (#138055) 2021-12-06 11:16:57 +01:00
Benjamin Pasero e1caacebce
backup - cancel pending operations on shutdown and handle cancellation better (#138055) 2021-12-06 10:55:33 +01:00
Benjamin Pasero ff970e88e5
Revert "smoke - 🆙 retry timeout"
This reverts commit d60b844aa3.
2021-12-02 07:38:04 +01:00
Benjamin Pasero 9d427e4df4
smoke test tweaks
- remove timeout on shutdown
- log exactly where time is spend on shutdown (web)
- stop spawning code when terminated
2021-12-02 07:34:13 +01:00
Megan Rogge 4a21019476
fix #138238, skip failing test 2021-12-01 08:50:26 -08:00
Megan Rogge c0f21fa378
fix #138239, skip test 2021-12-01 08:38:28 -08:00
Benjamin Pasero d60b844aa3
smoke - 🆙 retry timeout 2021-12-01 11:34:25 +01:00
Megan Rogge 7b3078d931
fix #137795 2021-11-30 12:48:58 -08:00
Megan Rogge 7f7fad2f9e
fix #137798 2021-11-30 12:38:52 -08:00
Daniel Imms faf6f0e1fd Setup terminal tests for 3 retries to minimize impact on build
This isn't a great long term solution but it should help reduce failures
for now.

Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge 005947e3b8
fix #137722
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge e89889fe54
fix #137799 2021-11-30 11:21:01 -08:00
Megan Rogge 18725fc147
set default profile to pwsh for only windows for #137225 2021-11-30 10:57:59 -08:00
Megan Rogge 4be98a3bce
set default to pwsh instead of bash for #137725 2021-11-30 10:21:15 -08:00
Benjamin Pasero 7b6c1065c7
smoke - temporary bring back timeout 2021-11-30 11:04:39 +01:00
Daniel Imms d5bfd6d31c Remove unneeded logs in test 2021-11-29 11:48:14 -08:00
Daniel Imms e208c8604e Remove timeout from automation terminal util
I don't believe this was ever required, awaiting writeInTerminal should make sure the
data event is triggered in xterm, the following enter should just trigger another data
event. This doesn't guarantee it was accepted by the process yet, just that xterm.js
emitted the event.

Part of #137847
2021-11-29 11:46:57 -08:00
Benjamin Pasero 1af6cb0edc
smoke test tweaks 2021-11-29 17:53:11 +01:00
Benjamin Pasero e241749320
smoke - print more backup info 2021-11-29 14:05:40 +01:00
Benjamin Pasero 18c6692316
tests - print main process pid when killing fails 2021-11-29 13:48:27 +01:00
Matt Bierner f00c4da8b8
Update default webview commit 2021-11-29 12:27:23 +01:00
MalikIdreesHasanKhan 595d893fdc
Fixed typos. (#135729) 2021-11-29 11:32:14 +01:00
Benjamin Pasero 687521092d
smoke - print running tasks after smoke test run 2021-11-29 10:12:42 +01:00
Benjamin Pasero 12178a4cf7
unit - exclude more tests for node.js runs (#137853) 2021-11-29 10:02:03 +01:00
Benjamin Pasero 5bb653374f
smoke - diagnose failing backup test 2021-11-29 09:56:19 +01:00
Benjamin Pasero cbbba8e69a
smoke - unique user data dir for stable tests too 2021-11-29 09:11:23 +01:00
Benjamin Pasero c42793d035
smoke - do not fail build when unable to delete workspace folder (workaround #137725) 2021-11-29 08:49:37 +01:00
Benjamin Pasero a5efd80ee0
Revert "smoke - print task list when deleting workspace path fails"
This reverts commit 368154bd0b.
2021-11-29 08:46:35 +01:00
Benjamin Pasero 368154bd0b
smoke - print task list when deleting workspace path fails 2021-11-29 08:04:30 +01:00
Benjamin Pasero e71b28a444
Smoke test lifecycle changes (#137969)
* rewrite teardown

* 💄

* avoid spam errors

* 💄

* split spawning browser from electron

* await copyExtension

* cleanup

* refactor methods

* cleanup

* cleanup

* cleanup

* 🆙 deps
2021-11-28 10:30:52 +01:00
Benjamin Pasero df4b5d6d04
smoke - strengthen shutdown path 2021-11-26 18:08:27 +01:00
Benjamin Pasero 13ff6baa3f
fix smoke tests 2021-11-26 14:45:35 +01:00
Benjamin Pasero 8d250e99e7
smoke - wait for tab becoming dirty before exit 2021-11-26 11:00:15 +01:00
Benjamin Pasero a11814c57a
smoke - switch away from potentially flaky editors.selectTab method 2021-11-26 09:22:19 +01:00
Benjamin Pasero 6f2239307b
Smoke test tweaks (#137809)
* smoke - move data migration tests into one and align

* fix app starting

* `createWorkspaceFile` is not async

* 💄

* support screenshot on failure even for stable app

* smoke - try to remove timeout (#137847)

* improve exit call
2021-11-25 14:37:22 +01:00
Daniel Imms eeae10e56c Skip flaky test
Part of #137795
2021-11-24 10:04:38 -08:00
Daniel Imms 653e5cdaee Skip flaky test
Part of #137808
2021-11-24 09:59:22 -08:00
Daniel Imms f880669743
Merge pull request #137763 from microsoft/tyriar/cleanup_smoke
Move terminal smoke tests into a single suite and reduce boilterplate
2021-11-24 09:54:50 -08:00
Daniel Imms 07d986443d
Skipping flaky test
Part of #137799
2021-11-24 09:50:26 -08:00
Benjamin Pasero 754190f326
Run unit tests against node.js too (#137790)
* tests - run unit tests also against node.js

* fixes

* fail if major node.js version mismatch

* -tfs is unsupported

* Add `@ts-check` and remove `jsdom`

* tests - process.env layer breaker

* Improve loader config

* skip one test

* address todos

* try to force color output

* Use a file: URI as baseUrl

Co-authored-by: Alex Dima <alexdima@microsoft.com>
2021-11-24 13:45:17 +01:00
Daniel Imms 42bd3e884b More clean up of terminal smoke test init 2021-11-23 15:46:51 -08:00
Rob Lourens 2932ec095d Add retry to quickaccess tests
Fix #137733
2021-11-23 15:35:48 -08:00
Daniel Imms d7f10626b8 Clean up terminal smoke test setup
Part of #136064
2021-11-23 15:18:38 -08:00
Daniel Imms 68e491f99f Re-enable other smoke tests 2021-11-23 14:50:52 -08:00
Daniel Imms 78d7ece7aa Add basic detach/attach terminal tests
Part of #136064
2021-11-23 13:23:54 -08:00
Daniel Imms ef440e563d Merge remote-tracking branch 'origin/main' into tyriar/persist_tests 2021-11-23 12:47:36 -08:00
Benjamin Pasero 1b40be3377
smoke - enable graceful-fs (#137734) 2021-11-23 17:29:08 +01:00
Alex Dima 689467c841
Try to restore yarn mocha and move browser tests to /browser/ 2021-11-23 16:07:15 +01:00
Alexandru Dima 465b806ed2
Merge pull request #137650 from microsoft/issue-133173
Avoid using `setImmediate`
2021-11-23 11:38:52 +01:00
Benjamin Pasero 954ce2c3f4
proper await exit 2021-11-23 10:31:46 +01:00
Rob Lourens 3bac53642b Disable flaky search smoke test #137195 2021-11-22 14:25:23 -08:00
Megan Rogge 4e303fcc52
fix #137590 2021-11-21 10:04:21 -08:00
Daniel Imms 2f7ab5c0e0 Disable should update color of the tab
Flake in CI
2021-11-19 13:58:01 -08:00
Daniel Imms 5dec5256d7 Add some detach/attach tests 2021-11-19 10:33:43 -08:00
Benjamin Pasero ddbda4c196
tests - enable crash reporter for electron based unit tests
//cc @deepak1556
2021-11-19 11:12:53 +01:00
Megan Rogge f66bc86da8
add terminal editor and tab smoke tests (#137393)
* Add a bunch of tests

* tweak tests

* add profile tests, now breaking (no profiles showing up)

* uncomment tests

* update expected

* fix test

* merge

* all passing

* bunch of improvements

* improve readability

* all should be passing and cleaned up

* all passing

* fix #137243 and clean-up

* remove .only

* fix #137247

* get rid of enum

* see if this fixes timing issue

* use keybinding for show terminal instead

* remove delay, implement better accept function

* get rid of unneeded index

* try something else

* wait for empty editor to be active

* remove .only

* decrease redundancy in names

* re-add xterm selector

* try something else

* undo change that broke things worse

* add terminal-tabs test

* all tabs tests passing locally

* kill all

* await before running each

* fix tests

* remove .only

* try waiting for focused xterm

* remove .only

* clean up

* 🧹

* fix profiles tests by using this.app.props

* revert to use default shell

* re-add conditional

* Get tests passing on WebKit

On WebKit the smoke tests were failing because the quick pick was
triggering a focus event on the terminal after the blur event had
already happened, this caused the view service to think the terminal
was still focused when it wasn't. The fix was to reset the context key
also in IViewsService.closeView.

* Safari -> WebKit

* Prefer arrow functions

* remove beforeEach timeout

* add timeouts to contributed profile tests

* add terminal editor tests, fix #137377

* add a bunch of tests

* refactor

* get rid of profile specific command

* more polish

* refactor getTabs -> assertTerminalGroups

* fix failing test

* more polish

* remove .only

* add assertSingleTab

* remove unused import

* fix error

* fix more failures

* more changes

* fix almost all except for plus button

* fix failing plus button test

* all passing

* modify error that gets thrown

* modify error message again

* remove unused wildcard/ ANY_NAME, fix icon code

* fix icon code

* large refactor, improvements

* finish polish

* 1 failing

* get test to pass

Co-authored-by: Daniel Imms <2193314+Tyriar@users.noreply.github.com>
2021-11-18 15:11:40 -08:00
Megan Rogge 239a94cee8
remove debug log 2021-11-17 14:01:31 -08:00
Megan Rogge 00fa317c43
Add terminal profile smoke tests (#137079) 2021-11-17 14:00:01 -08:00
Benjamin Pasero bacf6ed2c1
smoke - properly create screenshots and stop instances (#137220) 2021-11-15 12:15:25 +01:00
Benjamin Pasero 6f28593438
smoke - retry quick open search (fix #136499) 2021-11-15 07:52:12 +01:00
Daniel Imms 3c9b18e135 Remove test only 2021-11-12 06:16:17 -08:00
Daniel Imms c65c8738f9 Copy and use IWindowDriver in PlaywrightDriver 2021-11-12 06:11:18 -08:00
Daniel Imms 634dae736e Merge remote-tracking branch 'origin/main' into tyriar/smoke_test_improvements 2021-11-12 05:45:20 -08:00
Daniel Imms e6caf0da49 Pass terminal profiles test 2021-11-10 12:27:38 -08:00
Daniel Imms 5bfaf29f2b Fix layering problem 2021-11-10 08:38:02 -08:00
Daniel Imms 6a6a1b65df Use handles in playwright driver 2021-11-10 08:03:22 -08:00
Benjamin Pasero bef4dba21f
Parcel update and CI improvements (#136830)
* 🆙 product

* 🆙 parcel/watcher

* 🆙 parcel/watcher

* tests - separate remote logs from others

* store server logs too

* more tweaks

* fix name

* error when 10s passed
2021-11-10 08:13:56 +01:00
Daniel Imms bd98431baf Write basic terminal default profile test
Co-authored-by: Megan Rogge <merogge@microsoft.com>
2021-11-09 10:10:54 -08:00
Daniel Imms 628f486b1d Move playwright driver impl to class
Part of #136064
2021-11-09 08:45:08 -08:00
Daniel Imms 28da3051b3 Tidy up smoke test imports 2021-11-09 08:26:39 -08:00
Daniel Imms 281bacb074 Stub out some terminal smoke tests
Part of #136064
2021-11-09 08:25:15 -08:00
Daniel Imms 1cbf69d996 Document --headless in smoke tests 2021-11-09 08:24:38 -08:00
João Moreno 1788b8afd8
chore: 🔧 clean smoketest dependencies 2021-11-08 14:58:17 +01:00
Benjamin Pasero f9e8dc2095
🆙 playwright 2021-11-04 09:27:22 +01:00
Alex Dima 3247c31f6a
Replace Right Single Quotation Mark with Single Quote 2021-11-03 23:34:40 +01:00
Benjamin Pasero 7ca8b0f613
Statusbar - checks if 'Go to Line' works if called from the status bar: (fix #135962) 2021-10-28 07:22:45 +02:00
Matt Bierner bc566d42a1
Try bumping webEndpointUrlTemplate again
Reverts dc1a669906

Also bumps distro to pick up new product.json changes
2021-10-26 15:38:11 -07:00
Alexandru Dima 7dfe2e33ea
Fix test running around loading assertCleanState 2021-10-19 11:09:47 +02:00
Alex Dima 11862795ea
Remove LanguageIdentifier and ensure tests dispose instantiated LanguagesRegistry objects 2021-10-18 10:29:16 +02:00
Rob Lourens 83fec0220c Add retry logic for flaky git operations
Fix #132218
2021-10-12 17:08:20 -07:00
Alex Dima 898c759f85
Fail the build when webpack has bundling warnings (early prevention of issues like microsoft/monaco-editor#2691) 2021-10-11 18:14:10 +02:00
Benjamin Pasero be2f951fde debt - introduce Promises.withAsyncBody and adopt in a few places 2021-10-11 13:27:43 +02:00
Matt Bierner 5fc835305a
Re-enable webview tests on web (#134300)
* Enable webview tests on web

These tests pass fine on Chrome and webkit. On Firefox, the two about loading resources currently fail

I spent a while trying to debug what is going on with these tests. It seems like the service workers is registered properly but `fetch` is never called on it. Skipping these for now

* Remove only

* Fix test
2021-10-01 12:32:29 -07:00
Henning Dieterichs 98c1725c7d
Encode actual and expected value as JSON to enable https://github.com/microsoft/vscode-selfhost-test-provider/pull/2.
Only a proof of concept yet.
2021-09-13 18:44:06 +02:00
Benjamin Pasero 769d5fb521
smoke - disable search smoke tests on windows (#132218) 2021-09-06 18:07:58 +02:00
Sandeep Somavarapu 77b1fb79f5
Fix #132233 2021-09-06 14:32:19 +02:00
Johannes Rieken 70e30bc64e
disable flaky/failing smoketest, https://github.com/microsoft/vscode/issues/132233 2021-09-03 11:38:14 +02:00
Benjamin Pasero a3acef919f
smoke - ignore any failure from capturing screenshot 2021-09-03 09:31:01 +02:00
Raymond Zhao 86d81f35fe
Clarify running remote tests 2021-09-01 19:17:58 -07:00
Benjamin Pasero cdde5bedbf
web tests - mention how to enable playwright logging 2021-08-26 10:34:17 +02:00
Matt Bierner 4cd3ec8281
Update commit 2021-08-24 14:15:43 -07:00
Matt Bierner a70fd2fbf6
Bump default webview commit 2021-08-23 18:46:43 -07:00
Benjamin Pasero 90443f7a8a
tests - try to make some tests more robust 2021-08-12 07:48:02 +02:00
Connor Peet fa8ccff4d8
testing: initial output correlation 2021-08-11 13:08:58 -07:00
Logan Ramos 8bf9cfa21b
Fix spacing 2021-08-11 15:26:20 -04:00
Logan Ramos 2ee9010437
Disable telemetry in tests (#130591)
* Disable telemetry in tests

* Remove the console log check
2021-08-11 11:49:23 -04:00
dependabot[bot] 0344ecd462
Bump path-parse from 1.0.6 to 1.0.7 in /test/smoke (#130540) 2021-08-11 08:21:05 -07:00
Benjamin Pasero ec9a8fe5b7
web smoke - guard against failing tracing 2021-08-07 15:10:50 +02:00
Rob Lourens 42a8653e39 Mention building browser integration test code 2021-08-06 18:22:41 -07:00
Benjamin Pasero 5e99049e66
smoke - fix web smoke tests 2021-08-05 11:31:04 +02:00
Benjamin Pasero 6957e52e4b
smoke - always create test folder 2021-08-05 10:31:07 +02:00
Benjamin Pasero b96644b15f
smoke tests - drop 'tmp' and try to deal with tmp path ourself (#130102) 2021-08-05 10:04:00 +02:00
Benjamin Pasero 6c3bb99c63
smoke - better exit application handling 2021-08-05 09:05:17 +02:00
Benjamin Pasero 70e6d3f85d
smoke tests - try to fix data migration test (#129279) 2021-08-05 07:56:55 +02:00
Benjamin Pasero bf4a4a6b05
smoke tests - retry data migration tests on windows (#129279) 2021-08-04 18:10:00 +02:00
Benjamin Pasero 2f58131321
smoke tests - fix compile issue 2021-08-04 15:46:10 +02:00
Benjamin Pasero c28ea165cd
smoke tests - try other ways of ensuring the editor is open for data migration (#129279) 2021-08-04 15:32:21 +02:00
Benjamin Pasero db4cda10a8
web - guard against error from stopping tracing on tear down of tests 2021-08-03 14:15:55 +02:00
Benjamin Pasero 0390d98a4e
web tests - print page errors to console
//cc @lramos15 this would have detected the missing module
2021-08-03 09:10:47 +02:00
Raymond Zhao ffceebb909
Revert "Update webviewExternalEndpointCommit"
This reverts commit dbe3a22a53.
2021-07-26 16:38:03 -07:00
Raymond Zhao d163eabed0
Add troubleshooting step for tmp module 2021-07-26 14:39:44 -07:00
Matt Bierner dbe3a22a53
Update webviewExternalEndpointCommit 2021-07-26 13:00:08 -07:00
João Moreno 132e3783d0
smoke: fix vscode-test cache location 2021-07-16 15:23:48 +02:00
João Moreno a9e4cb0874
oops 2021-07-16 12:50:07 +02:00
João Moreno 3c4fdb58a1
fix screenshots in smoketests
related to #122685
2021-07-16 11:58:52 +02:00
Rob Lourens 50b3811fdc Revert "Fix running smoketest multiple times"
See https://github.com/microsoft/vscode/pull/124666/files#r662070269

This reverts commit 4d694d7dc8.
2021-07-14 21:32:51 -07:00
Rob Lourens 4d694d7dc8 Fix running smoketest multiple times 2021-07-14 21:21:27 -07:00
Robo 9520f0a515
chore: update to electron 13 (#124666)
* chore: bump electron@13.0.1

* chore: update cache for native modules

* chore: bump electron@13.1.2

* chore: bump electron@13.1.4

* chore: fix user data dir length for validateIPCHandleLength check

* chore: always disable uploadToServer on OSS

* chore: use process.contextIsolated property

* chore: bump electron@13.1.6

* fix: getUserDataPath helper
2021-07-13 20:01:10 -07:00
Connor Peet fa9255c0de
almost complete update for run configurations 2021-07-12 17:28:01 -07:00
João Moreno 05fd05dc00
remove --stable-build 2021-07-12 05:56:27 -07:00
Benjamin Pasero d85bc647ef
smoke tests - automatically test against stable build (#127799)
* smoke tests - automatically test against stable build

* fix path on Linux/Windows

* 💄

* retry migration tests

* smoke: always download latest previous stable

* hm

Co-authored-by: João Moreno <joao.moreno@microsoft.com>
2021-07-12 05:44:50 -07:00
João Moreno d737dc4db3
smoke: simplify localization test 2021-07-12 12:20:34 +02:00
Connor Peet 20790ec994
testing: increase debugger wait timeout 2021-07-09 15:28:35 -07:00
João Moreno a28d028d2d
Enable automated smoketests on Windows (#128224) 2021-07-08 19:10:25 +02:00
Connor Peet c6d7cfed8a
testing: fix undefined not being reported correctly in results
Fixes #125669
2021-07-07 15:28:55 -07:00
Connor Peet 583f6d1418
open the devtools for browser tests when debug is passed 2021-07-07 12:58:19 -07:00
Benjamin Pasero d0df79be50
webview - remove more traces (#128128)
* webview - remove more traces

* more removal
2021-07-07 18:28:53 +02:00
Benjamin Pasero fa032d752d
Update playwright to 1.12.x and enable tracing for smoke tests (#128061)
* 🆙 playwright

* create trace
2021-07-07 13:23:11 +02:00
Dirk Baeumer c9aea49a87
Re-enable enhanced localization tests 2021-07-07 10:49:52 +02:00
João Moreno 2c7fc24d63
smoke: ctrl-c should kill all processes 2021-07-06 20:30:20 +02:00
Dirk Baeumer 1a3fd783fe
Disable locale info check. 2021-07-06 15:38:21 +02:00
Dirk Baeumer ae52915f0c
Improve localization tests 2021-07-06 13:15:43 +02:00
Benjamin Pasero 7a0714a6e5
smoke - harden data migration test 2021-07-06 12:10:08 +02:00
Sandeep Somavarapu 062e6519f8
use vscode smoke test check extension 2021-07-02 10:46:31 +02:00
Benjamin Pasero 99a831f6e8
web - allow integration tests to open a workspace 2021-07-01 15:38:30 +02:00
João Moreno ca61a42383
web smoke test: bump up port number 2021-06-30 12:01:31 +02:00
João Moreno a44611d4c6
tests: hide output 2021-06-30 11:07:35 +02:00
Dirk Baeumer a63e0a0a21
Reenable German translation test based on new API 2021-06-29 09:23:52 +02:00
Robo 92999c339e
fix: setuid helper permission (#126798)
* ci: fix setuid helper binary permission

* ci: allow privilege for CLONE_NEWPID | CLONE_NEWNET

* ci: fix chrome-sandbox permission with rpm

* ci: fix permissions on snap

* ci: download electron earlier for arm builds
2021-06-22 08:42:30 -07:00
Dirk Baeumer 9cfc4bcb5c
Improve wording for failing test case 2021-06-22 13:30:29 +02:00
Dirk Baeumer 1f2a6cc331
Improve localization smoke test 2021-06-21 13:54:16 +02:00
João Moreno 3d2dea7a9f
fix integration browser tests 2021-06-15 15:15:41 +02:00
João Moreno 9d4274bf64
skip the entire notebook test suite so Code isn't even launched 2021-06-15 14:07:35 +02:00
Benjamin Pasero 81317867a3
web - disable welcome in smoke tests (fix #126221)
//cc @JacksonKearl
2021-06-15 10:57:29 +02:00
Benjamin Pasero 2ddc1e4fc5
Produce logs during test runs (integration, smoke) and publish as artefacts (#126065)
* first cut upload log files from integration test runs

* always publish log files

* move logs into integration-tests folder

* also produce logs for smoke tests

* store remote log files

* wire in logspath arg properly

* always publish logs

* enable logs for browser based smoke tests

* log only in verbose
2021-06-15 08:33:26 +02:00
João Moreno 85a36ae074 enable smoketest on linux 2021-06-11 12:19:17 +02:00
Alexandru Dima 0c87771e7b
Merge pull request #125754 from microsoft/alex/update-playwright
Update to `playwright@1.11.1`
2021-06-10 23:00:14 +02:00
Ladislau Szomoru 291ec03bc3
Smoke tests - run each suite in its own user-data-dir (#125670)
* Initial commit for isolated smoke tests

* Do not wait for the explorer view when restarting

* Debug failed localization test

* User data path suffix length

* Kill server when application exits

* Do not run yarn install

* Refactor application start/stop

* Reverted some changes

* Missed one

* One more change to revert

* Restored one more file

* Pull request feedback
2021-06-10 06:40:57 -07:00
Alexandru Dima 911ef74bbb
Merge remote-tracking branch 'origin/main' into alex/update-playwright 2021-06-10 09:27:13 +02:00
Alexandru Dima b1bc7be9d1
Do not rely on console.log for exiting tests 2021-06-09 21:47:18 +02:00
Benjamin Pasero 33f84b36fd
tests - disable getting started in integration tests and smoke tests (#125808)
* tests - disable getting started in integration tests and smoke tests

* --skip-getting-started => --skip-welcome

Co-authored-by: Jackson Kearl <jakearl@microsoft.com>
2021-06-09 18:36:42 +00:00
Henning Dieterichs 00123b32a7
Updates sinon from 1.17 to 11.1. 2021-06-09 10:03:46 +02:00
Henning Dieterichs 294b3bdf16
Revert "Include sinon-test in renderer.html / index.html"
This reverts commit e4e0f8be89.
2021-06-08 17:18:34 +02:00
Henning Dieterichs e4e0f8be89
Include sinon-test in renderer.html / index.html 2021-06-08 17:16:54 +02:00
Ladislau Szomoru 4e0cf885d4
Don't wait for the explorer when restarting 2021-06-07 15:34:37 +02:00
Ladislau Szomoru b003560579
Use --disable-workspace-trust for the test runs 2021-06-07 09:59:26 +02:00
Ladislau Szomoru e2d0e05038
Do not run yarn install as part of the smoke tests 2021-06-06 21:14:37 +02:00
Benjamin Pasero 802648f2a1 electron - adopt some newer APIs and 💄 main code 2021-06-04 09:22:38 +02:00
Ladislau Szomoru b0509196f6
Disable workspace trust during tests 2021-06-03 10:21:19 +02:00
João Moreno 541a5d4fa7
smoke: trust dialog should appear in 5 seconds, and we can ignore if it doesn't 2021-05-28 11:38:10 +02:00
SteVen Batten e5f70e8e2a
fix smoke tests (#124814) 2021-05-28 09:30:47 +02:00
Benjamin Pasero 5eec3c86e3 smoke test - disable experiments 2021-05-27 07:30:23 +02:00
Benjamin Pasero 4cda850edf disable welcome editor in smoke tests (fix #124674) 2021-05-26 14:22:13 +02:00
Matt Bierner b1823157d5
Fall back to existing published webview commit (#119295) 2021-05-24 22:36:22 -07:00
Jackson Kearl 5ac4f5f5be
Fix didn't work 2021-05-21 11:21:27 -07:00
Jackson Kearl 852b70eafe
Try fix (#124384) 2021-05-21 17:36:20 +00:00
Benjamin Pasero 4b5db9098c
smoke test - disable failing search test
//cc @JacksonKearl
2021-05-21 09:12:01 +02:00
Jackson Kearl e66c62f38a
Generalize smoke text 2021-05-20 22:21:19 -07:00
Jackson Kearl 89c8f91988
Add smoke test for #124146 2021-05-20 22:20:48 -07:00
Ladislau Szomoru a13da59f95
Fix #123621 2021-05-12 10:04:46 +02:00
Rob Lourens 5c22e55a74 Disable broken smoke test #123621 2021-05-11 19:26:30 -07:00
dependabot[bot] 000e064e61
Bump hosted-git-info from 2.8.8 to 2.8.9 in /test/smoke (#123481)
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info) from 2.8.8 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases)
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md)
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.8.8...v2.8.9)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-11 07:57:52 -07:00
Dirk Baeumer 2fc3214ba4
Fixes #123083: Localization: starts with 'DE' locale and verifies title and viewlets text is in German 2021-05-10 13:57:43 +02:00
João Moreno 9a3bfc1ea1
add leak test scaffolding 2021-05-06 14:45:12 +02:00
Benjamin Pasero e2954beb4b
Remove --no-sandbox (#122909)
* linux - remove `--no-sandbox` flag

We should not disable sandbox on Linux.
We only added this to support running on Kernel <= 3.8 where setuid sandbox is used.

* fix ci

* add some docs
2021-05-04 11:18:19 +02:00
Robo bce4d71f64
chore: bump node@14.x in devDependencies (#122905) 2021-05-04 10:04:13 +02:00
Connor Peet 24ea8408c3
testing: propoagate timeout option for unit tests 2021-04-29 12:19:56 -07:00
Connor Peet b1569995f9
testing: allow waiting for server before running unit tests
Fixes https://github.com/microsoft/vscode/issues/121751
2021-04-26 16:31:36 -07:00
Benjamin Pasero 7095f4706c
unit tests (electron) - avoid sending circular structures over 2021-04-21 08:13:08 +02:00
Benjamin Pasero f8c7dd64a4 tests - ensure preload promises are all resolved 2021-04-09 08:28:21 +02:00
Benjamin Pasero ff0f7f3cf2
Make product configuration available to non node.js environments (fix #120243) 2021-04-06 08:55:31 +02:00
Benjamin Pasero 1db94dbb10
sandbox - add additional arguments also to test runner 2021-04-01 08:10:40 +02:00
Ladislau Szomoru 335bc0196c
Remove unused dependency 2021-03-31 10:11:35 +02:00
Ladislau Szomoru 45f061b9c8
Swap cpx for cpx2 2021-03-31 09:24:44 +02:00
Logan Ramos d5a670eaeb
Switch to deepStrictEqual part of #118667 2021-03-30 12:05:06 -04:00
Ladislau Szomoru 7c498ec3a8
Update tests to use consistent version of mkdirp 2021-03-30 14:00:37 +02:00
Connor Peet 48e8463a89
testing: tear down app if renderer crashes
Fixes https://github.com/microsoft/vscode/issues/117068
2021-03-29 16:41:03 -07:00
Logan Ramos 31fd94b660
First round of getting rid of deprecated asserts (#120125) 2021-03-29 15:48:46 -04:00
Dirk Baeumer 08c4cd87e3 Reenable localization tests. 2021-03-25 10:42:35 +01:00
Megan Rogge 2c232fed6a
Update README.md 2021-03-24 12:40:21 -07:00
rebornix 2b66dfe021
skip flaky tests. 2021-03-23 21:49:48 -07:00
Rob Lourens cca8a48b17 Restore notebook smoketests, Fix #113882 2021-03-23 08:49:57 -07:00
Erich Gamma 73b9e6679d
Update README.md 2021-03-23 14:54:30 +01:00
Connor Peet 808266d4de
Allow tests to be loaded asynchronously (#119537)
* initial wip in the extension host

* wip

* wip

* wip

* continued progress

* update api from discussion

* update for new proposal

* wip

* update to lastest testing api, almost everything working

Refs https://github.com/microsoft/vscode/issues/115089
Design https://gist.github.com/connor4312/73f1883d720654834b7fd40550d3b6e0

* re-wire retirement state

* update actions to new async test structure

* minor cleanup

* remove unused es2018 that failed build
2021-03-22 18:08:13 -07:00
Alexandru Dima 242ddc4bdf
Merge pull request #118400 from thebinarysearchtree/main
Fix transformToSnakecase
2021-03-18 22:02:49 +01:00
Johannes Rieken b353f06339
comment out failing notebook smoke tests, https://github.com/microsoft/vscode/issues/119164 2021-03-17 09:22:44 +01:00
Jackson Kearl ac0008a25b
Remove waiting for welcome page while we are experimenting with what the welcome page will be
Fixes #118748
2021-03-11 09:23:38 -08:00
Jackson Kearl 556e6d8310
Fixup search smoke tests 2021-03-09 12:50:36 -08:00
Jackson Kearl 9eceb50498
Move label about for #115244 after more tests are failing 2021-03-09 11:25:45 -08:00
Jackson Kearl e5a10ca55d
Skip search tests while diagnosing flakeyness 2021-03-09 11:16:09 -08:00
Sandeep Somavarapu edfbf27e3a #118443 - change name 2021-03-09 09:34:19 +01:00
Sandeep Somavarapu 9d3a1d9f59 Fix #118443 2021-03-09 09:30:56 +01:00
Jackson Kearl ac229ced07
Revert "Reenable smoke test to see if still flakey" #115244
This reverts commit 5d80c30e5b.
2021-03-08 19:31:58 -08:00
Benjamin Pasero 9c78fa40ca
skip failing test (#118443) 2021-03-08 15:22:24 +01:00
Andrew Jones 2a0f9aa8dc Reminder to compile between tests 2021-03-08 19:52:39 +10:00
Andrew Jones 3f46e7f7b5 add ui flag to mocha tests 2021-03-08 15:04:26 +10:00
Jackson Kearl 5d80c30e5b
Reenable smoke test to see if still flakey
Ref #115244
2021-03-05 22:05:32 -08:00
Sandeep Somavarapu 1a9df6127c fix smoke tests 2021-03-05 15:27:03 +01:00
Sandeep Somavarapu c6202bb3cc Adopt to use new table widget 2021-03-04 19:51:03 +01:00
Benjamin Pasero e916637528 tests - enable color output for integration tests 2021-03-01 15:10:15 +01:00
Benjamin Pasero 5fabc0d9dc smoke test - remove code only needed for stable january release 2021-02-25 09:31:55 +01:00
Benjamin Pasero 041e4d9b1f fix smoke tests with stable build (fix #117420) 2021-02-23 19:04:51 +01:00
Connor Peet a0e24147e0
testing: remove duplicate extension and internal IDs
Fixes #117084
2021-02-19 16:57:29 -08:00
Raymond Zhao ee820dffbf
Update smoke test README (#115582) 2021-02-19 09:05:11 -08:00
João Moreno 2ca2792a65
fix smoketest 2021-02-19 16:03:01 +01:00
Jackson Kearl 096e5555b6 Allow welcome page to not be active on account of focus potentially going to a getting started item. 2021-02-18 18:57:24 -08:00
Benjamin Pasero 9de38fc9a8
Disable keytar in our integration tests (#116852)
* tests - extract and use ALL_PLATFORMS_API_TESTS_EXTRA_ARGS

* tests - throw when accessing keytar from API tests
2021-02-17 15:09:40 +01:00
João Moreno 38ae92f4b1
remove unused ui tests 2021-02-16 11:59:30 +01:00
João Moreno 980becda8d main rename
fixes #116341
2021-02-14 20:10:24 +01:00
Rob Lourens a699ffaee6 Reenable notebook smoke test
Fix #116535
2021-02-13 15:48:37 -08:00
Johannes Rieken fc31a6a558 skip failing test, https://github.com/microsoft/vscode/issues/116535 2021-02-12 11:15:56 +01:00
Jackson Kearl d10f2e6032 Fix #116412: Use getting started page as default startupEditor. 2021-02-11 12:34:14 -08:00
Jackson Kearl 8a3a5d9b74 Fix search smoke test 2021-02-09 15:44:07 -08:00
Sandeep Somavarapu cd97629c44 #116152 enable smoke tests 2021-02-09 08:58:39 +01:00
Rob Lourens be5126d37c Also skip 'before', #116156 2021-02-08 22:08:17 -08:00
Rob Lourens 0829608afb Change disabled tests to .skip 2021-02-08 21:37:02 -08:00
Megan Rogge 29844a0baf disable smoke tests that time out 2021-02-08 18:21:39 -08:00
Jackson Kearl 4623a50995 Fix #116154 2021-02-08 17:46:12 -08:00
Sandeep Somavarapu 63310d91d3 remove install extension 2021-02-04 20:48:25 +01:00
Sandeep Somavarapu a9ccd48a1f enable extension tests in web 2021-02-04 08:44:06 +01:00
Sandeep Somavarapu 4e6d9ce2b7 add server cli test 2021-02-03 21:42:12 +01:00
Sandeep Somavarapu 066c584405 enable remote smoke tests 2021-02-03 19:20:44 +01:00
Benjamin Pasero 7a6a45fb2c browser tests - fix regression from updating playwright 2021-02-02 16:53:30 +01:00
Sandeep Somavarapu abb05eb058 Fix #115586 2021-02-02 10:25:50 +01:00
Benjamin Pasero 04d4310a8a fix smoketest (#115586) 2021-02-02 08:20:07 +01:00
Rob Lourens 662a698ef9 Skip failing test #115244 2021-01-28 12:00:17 -08:00
Alexandru Dima 0a943766a5
Fix monaco checks 2021-01-28 14:48:41 +01:00
Martin Aeschlimann 4bd2d367e7 Remote smoketest timeout (fixes #115159) 2021-01-27 15:52:25 +01:00
Sandeep Somavarapu 4b9b2ab9a6 Fix #114707 2021-01-21 17:46:40 +01:00
João Moreno f745a912ae
fixes #114420 2021-01-15 15:19:19 +01:00
Alexandru Dima 00f8540d79
Fixes #114332
`yarn` no longer compiles the smoke test as a postinstall script. This breaks the flow of running `yarn && yarn smoketest` to execute the smoketest.

So change `yarn smoketest` to also do the compiling of the smoke test. But that generates too much extra work on the build machine, which needs to invoke `yarn smoketest` twice, once for Electron and once for web.

To workaround that, `yarn smoketest-no-compile` is added, which can be used by the build machine to avoid needlessly compiling.

While here, the nodejs version is already checked in the `yarn` preinstall script, so remove the check from the smoke test.
2021-01-14 10:35:42 +01:00
Connor Peet 2b5ae783bf
testing: add full json reporter to show more complete output 2021-01-13 15:30:11 -08:00
Johannes Rieken b90166177b reuse stats collector for EchoRunner, fix missing titlePath-property, fixes https://github.com/microsoft/vscode/issues/114190 2021-01-12 11:21:32 +01:00
Alexandru Dima 533d094020
Allow logging FS access with stacks 2021-01-11 15:32:39 +01:00
Alexandru Dima 2fd00ba9fe
Add a way to troubleshoot fs calls 2021-01-11 09:11:33 +01:00
Benjamin Pasero eb40962288 tests (unit, electron) - set forbidOnly when running on build machine 2021-01-08 09:09:23 +01:00
Benjamin Pasero 96e2981c91 skip failing test (#113882) 2021-01-08 08:16:28 +01:00
Alexandru Dima 8ad08b04f5
Do not compile /test/ and /build/ scripts during postinstall, the scripts get compiled explicitly during CI 2021-01-07 16:47:11 +01:00
Rob Lourens d29388d255 Reenable test, fix #113768 2021-01-05 12:21:50 -08:00
Alexandru Dima 689fbbd960
Increase timeouts 2020-12-30 14:15:14 +01:00
Alexandru Dima 4b6280aa8c
Skip webkit 2020-12-28 21:53:35 +01:00
Alexandru Dima 9945754a62
Add editor smoke test (ported from monaco-editor) 2020-12-28 21:44:42 +01:00
Alexandru Dima f74ad9692f
Align @types/* dev dependencies (#112718) 2020-12-18 13:28:39 +01:00
Alexandru Dima aa2864d53f
Remove most of the yarn license warnings 2020-12-18 10:26:14 +01:00
Alexandru Dima fee6dbf4e0
Merge remote-tracking branch 'origin/master' into alex/node-modules-vscode 2020-12-17 22:02:47 +01:00
Alexandru Dima 7ca71e763d
Move away from deprecated 'vscode' node module (#112718) 2020-12-17 21:40:14 +01:00
Connor Peet 88f32df1d7
Merge branch 'mocha-update' 2020-12-17 12:08:24 -08:00
Connor Peet 04d7411785
eng: update mocha 2 -> 8 2020-12-17 11:24:15 -08:00
Alexandru Dima ed19f6082f
Share mocha related node modules (#112718) 2020-12-17 11:03:49 +01:00
Alexandru Dima bb157721fb
/build/ and /test/ should only have devDependencies 2020-12-17 10:27:39 +01:00
João Moreno 1100f27681
fix build 2020-12-16 11:18:28 +01:00
João Moreno 7743d971b1
concurrently -> run-run-all 2020-12-15 15:21:24 +01:00
Sandeep Somavarapu 0ac5e95251 Fix #109644 2020-12-02 17:50:49 +01:00
Martin Aeschlimann 3472159cb1
Merge pull request #111408 from microsoft/aeschli/notebookIcons
externalize notebook items
2020-12-01 09:29:13 +01:00
Sandeep Somavarapu 47ce2a8d6d #111845 fix localization tests 2020-11-30 20:26:00 +01:00
Sandeep Somavarapu 2890fd321f Fix #111485 2020-11-30 11:58:43 +01:00
Martin Aeschlimann 6c8f62432f Merge branch 'master' into aeschli/notebookIcons 2020-11-27 12:19:23 +01:00
Martin Aeschlimann 8012c255e5 fix keybinding smoke test after icon name changes 2020-11-27 12:19:03 +01:00
Martin Aeschlimann 4e45d27a72 fix stopIcon name 2020-11-27 12:12:54 +01:00
Sandeep Somavarapu 6a2535e0ab Fix #107965 2020-10-28 19:49:42 +01:00
Sandeep Somavarapu 758240249a Fix #109210 2020-10-23 09:20:36 +02:00
Benjamin Pasero 781e0e3192 windows - remove not needed and confusing disable-restore-windows CLI arg 2020-10-01 11:36:45 +02:00
Christof Marti f48da22bdf
Update README.md 2020-09-30 09:16:06 +02:00
Rob Lourens 20b9010c39
Update README.md 2020-09-29 16:20:51 -07:00
Benjamin Pasero 7f035b4be7 debt - introduce and adopt FileAccess
deprecate amd.ts and require.toUrl methods
2020-09-25 14:11:05 +02:00
Rob Lourens b47a60c67f Fix notebook smoketest
Fix #107219
2020-09-22 17:14:15 -05:00
Benjamin Pasero 5497e60ed2 sandbox - consolidate fileUriFromPath into one 2020-09-22 08:14:45 +02:00
ChaseKnowlden e8760a5d6c Fix capitalization of GitHub org 2020-09-17 11:43:03 +02:00
Rob Lourens 1893b55c25 Skip smoketest #105330 2020-09-16 17:06:40 -05:00
Benjamin Pasero 87847325a6 electron - set spellcheck: false again for windows 2020-09-11 09:49:18 +02:00
Rob Lourens 7a92c462c8 Reenable notebook smoke test #105330 2020-09-08 10:46:04 -05:00
Rob Lourens a1724a23df Disable smoke test for #105330 2020-09-02 09:56:32 -07:00
Ladislau Szomoru 06730e3e29
Azure DevOps pipeline - generate unique test result names (#105148)
* Set suite name based on environment variable
2020-08-21 15:05:15 +02:00
Ladislau Szomoru b2efcbf687
Add process.arch into the test results file name (#104946) 2020-08-19 07:48:37 +02:00
Ladislau Szomoru 41b661eb3d Add process.arch into unit test results file names 2020-08-18 18:08:37 +02:00
Ladislau Szomoru 652a432f59
Set suite name based on the --web parameter (#104798) 2020-08-17 11:51:59 +02:00
Robo e4296330de chore: update to electron 9-x-y (#102011)
Co-authored-by: Benjamin Pasero <benjpas@microsoft.com>
2020-08-11 11:30:23 -07:00
Ladislau Szomoru cf4e4c1754
Add JUnit reporter for unit tests (#104354) 2020-08-10 11:20:34 +02:00
Sandeep Somavarapu 2277c8e2a3 Fix #104230 2020-08-07 12:31:03 +02:00
Dirk Baeumer 0b79a0e708 Reenable localization tests 2020-08-07 11:30:30 +02:00
Robo 227d533937
Revert "chore: update to electron 9-x-y (#102011)" (#103599)
This reverts commit 3d0d50caf8.
2020-07-30 08:35:43 -07:00
isidor f3e4ff9196 skip failing tests 2020-07-30 14:39:52 +02:00
João Moreno c1f44f4e3e
Merge pull request #103436 from codebytere/fix-json-reporter
fix: add missing property to deserializeRunnable
2020-07-30 10:06:18 +02:00
Matt Bierner 42761b9db2 Fix smoke test function call 2020-07-28 14:57:08 -07:00
isidor 55e09d6bf8 update extensions aria label to contain version and publisher display name
fixes #102224
2020-07-28 19:16:02 +02:00
Shelley Vohr 3770547cc1
fix: add missing property to deserializeRunnable 2020-07-27 20:13:27 -07:00
Robo 3d0d50caf8
chore: update to electron 9-x-y (#102011)
* chore: bump electron@9.0.5

* remove exploration config

* fix compile error

* fix compile error

* crashReporter has to be called only once before app ready

* chore: bump electron@9.1.0

* enable LayoutNG

* fix cron schedule

* allow disabling appcenter crash reporting

* set additional crash reporting parameters

* start crashreporter for child process on linux

* setup crash parameters only once

* remove unused crashReporter.guid

* address review feedback

* reuse argv.json for storing crash reporter id

* remove trailing commas

* update localized name

* update argv based on telemetry optout

* update initial config based on setting

* fix conditional errors

* remove telemetry.enableCrashReporter

* move default crash reporter config to electron-main

* update comment for ext host crash reporting

* set default value for configuration

* some 💄 changes

* address review feedback

* do not use ES7 features in JS yet

* add app.focus({ steal: true }) usage

Co-authored-by: Benjamin Pasero <benjpas@microsoft.com>
2020-07-21 09:39:34 +02:00
Benjamin Pasero a006879172 electron - explicitly disable spellchecker
It will be enabled by default starting with Electron 9
2020-07-21 07:50:25 +02:00
Benjamin Pasero 4aab95966b unit tests - run them in same environment as our main code 2020-07-20 10:57:10 +02:00
Benjamin Pasero e5b3ff76ba
Enable sandbox and contextIsolation for process explorer when running with --__sandbox (#102924)
* sandbox - allow to enable sandbox and contextIsolation for process explorer

* fix asar lookup
2020-07-20 10:30:20 +02:00
dependabot[bot] 7fb5a9385b
Bump lodash from 4.17.15 to 4.17.19 in /test/smoke
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.19.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.19)

Signed-off-by: dependabot[bot] <support@github.com>
2020-07-17 11:09:45 +00:00
rebornix 5e96337121 re #93070. test for command arguments. 2020-07-13 10:52:57 -07:00
Fedor Nezhivoi 05613d7a1c
Move read and write logic from nativeTextFileService to textFileService for #79275 (#100804)
* move encoding logic from NativeTextFileService to AbstractTextFileService for #79275

* some cleanup things - just cosmetic

* fix tests

* review

* use correct comparison

Co-authored-by: Benjamin Pasero <benjpas@microsoft.com>
2020-07-03 15:55:44 +02:00
Benjamin Pasero 4f65b91444
electron - disable remote module in all windows (#101224) 2020-06-28 12:12:38 +02:00
Dirk Baeumer 09531cdf10 Fixes #101005: Localization - starts with 'DE' locale and verifies title and viewlets text is in German 2020-06-25 09:38:42 +02:00
Benjamin Pasero 7f49ef52e3 sandbox - configure nativeWindowOpen:true
This matches the behaviour of sandboxed Electron renderers.
2020-06-16 18:52:34 +02:00
Rob Lourens 8b5e6ff8c5 Fix notebook smoketest
Esc doesn't do the right thing because a notification showed up
Fix #99941
2020-06-12 07:56:18 -05:00
Sandeep Somavarapu 6876a0de40 Fix #99840 2020-06-11 10:13:21 +02:00
Benjamin Pasero d41ca1ce5f tests - also use --no-cached-data for normal integration tests 2020-06-09 10:29:01 +02:00
Rob Lourens 4d6da3154c Get notebook smoketest working in web
Fix #98364
2020-06-07 17:27:47 -05:00
deepak1556 113fd1b7bc chore: bump electron@7.3.0 2020-05-27 12:47:39 -07:00
Benjamin Pasero d637255b17 Merge branch 'master' into ben/electron-sandbox 2020-05-27 06:51:08 +02:00
deepak1556 876f2e70f9 Revert "chore: bump electron@8.3.0 (#98266)"
This reverts commit 820fd4048f.
2020-05-26 21:46:03 -07:00
Rob Lourens 3eb6c1704b Disable notebook smoketests in web 2020-05-26 12:12:34 -05:00
Benjamin Pasero 45552c0a2d sandbox - reduce clipboard dependencies in renderer 2020-05-26 08:12:09 +02:00
Rob Lourens b877c4d411 Fix notebooks and notebook smoketest in web 2020-05-21 08:56:22 -05:00
Robo 820fd4048f
chore: bump electron@8.3.0 (#98266) 2020-05-20 13:32:02 -07:00
Rob Lourens 8253b52191 Remove .only 2020-05-20 12:04:28 -05:00
Rob Lourens 9bc11824c3 Add notebook smoketests 2020-05-20 12:01:52 -05:00
Benjamin Pasero 869929e8c6 tests - log the actual build used for tests 2020-05-14 17:00:51 +02:00
Rob Lourens 7a5baba094 Fix replace smoketest
Fix #97120
2020-05-07 09:54:43 -05:00
Benjamin Pasero 0ac3b1114a smoke 💄 2020-04-30 13:32:27 +02:00
Benjamin Pasero 30bba102b3 smoke - only start automatically after data migration tests 2020-04-30 09:50:55 +02:00
Benjamin Pasero 6a8b201c8a smoke - restore skip-release-notes CLI arg (#96459) 2020-04-29 12:40:04 +02:00
Benjamin Pasero 9f45c20088
🆙 playwright@0.15.0 (#96218)
* playwright@0.15.0

* close to dumpio: true

* reduce logging
2020-04-27 08:50:50 +02:00
Martin Aeschlimann 2561955280 fix smoketest 2020-04-21 08:57:53 +02:00
Martin Aeschlimann be256b54a1 use Codicon.close / Codicon.closeDirty / Codicon.removeClose 2020-04-20 17:53:35 +02:00
NickDebug a656a723a8
added missing word in the readme (#95043) 2020-04-12 08:43:50 -07:00
Daniel Imms b7e0abbdcc
Merge branch 'master' into tyriar/90539 2020-04-10 05:56:39 -07:00
Sandeep Somavarapu 393aaa408b Fix #94665 2020-04-08 17:44:57 +02:00
Johannes Rieken 0549900aa5 run web-unit-tests in chromium, webkit, and firefox
@bpasero fyi that I have disabled the "editor observer copy group" test for web
2020-04-07 10:47:23 +02:00
Benjamin Pasero 9f1aa3c9fe debt - remove node pieces from environment (#82598) 2020-04-06 09:12:41 +02:00
Alex Dima 283545de57
check in missing yarn.lock 2020-04-03 13:05:10 +02:00
João Moreno 8f566065fc upgrade dependencies in smoke test 2020-04-03 07:47:44 +02:00
Dirk Baeumer e694b041e3 Label for extension viewlet changed. Disable smoke test 2020-04-02 11:20:42 +02:00
João Moreno 05f9b99541
Update README.md 2020-03-31 13:18:35 +02:00
Matt Bierner 273a4a389d
Convert most ts-ignore-calls to ts-expect-error (#93617)
Changes over to use ts-expect-error: https://devblogs.microsoft.com/typescript/announcing-typescript-3-9-beta/#ts-expect-error-comments

This revealed a number of places where we no longer need to supress errors
2020-03-30 17:31:37 -07:00
Sandeep Somavarapu 13b38d2a49 fix smoke tests 2020-03-30 08:56:20 +02:00
Benjamin Pasero 9bd87e3852 extensions - wire in proposed API enablement (for #92908) 2020-03-30 08:51:48 +02:00
Rob Lourens 64c157244e Wait for cleared settings to be applied before continuing
Fix #93292
2020-03-28 10:43:24 -07:00
Benjamin Pasero 537a2e783a tests - pass on enable-proposed-api to server 2020-03-27 14:33:47 +01:00
Benjamin Pasero e80f8a5da9 quick access - more cleanup 2020-03-26 13:51:05 +01:00
Benjamin Pasero 88d189b479 quick access - more renames towards less quick open usage 2020-03-26 13:38:59 +01:00
Benjamin Pasero 85d2077f19 smoke - quickopen => quickaccess 2020-03-26 12:28:49 +01:00
Dirk Baeumer b418b9cd59 Comment out debugger tests 2020-03-26 10:02:17 +01:00
Hyun Sick Moon 3b155031dc
fix typo (#93291) 2020-03-24 09:03:01 -07:00
Benjamin Pasero 21431f6117 quick access - cleanup API for quick input 2020-03-24 10:13:45 +01:00
Benjamin Pasero 4f0b2b0689 tests - fix smoketests for new quick open impl 2020-03-24 08:39:53 +01:00
Martin Aeschlimann bf6c93062b Rename CSS smoke test to language features: For #90538 2020-03-02 11:39:43 +01:00
Pine Wu a68bfa3846 Add back languages/css test. Fix #90538 2020-02-28 11:56:25 -08:00
Benjamin Pasero 0bab257fe5 smoke - remove firefox from docs 2020-02-27 14:22:23 +01:00
Johannes Rieken 2d313c9aef consolidate debug test instructions 2020-02-27 12:45:19 +01:00
Rob Lourens db380eaad0 Fix build 2020-02-26 17:29:55 -08:00
Pine Wu e63119f785 Fix #90538 2020-02-26 16:24:46 -08:00
Benjamin Pasero 65976ac711 Revert "docs for #91532"
This reverts commit ebcd432491.
2020-02-26 16:30:06 +01:00
Benjamin Pasero 29c2c6079e smoke - do not restore windows 2020-02-26 12:03:05 +01:00
Dirk Baeumer 2cb430b396 Fixes #91433: Smoke Test: Localization Test Failure 2020-02-26 11:55:17 +01:00
Joao Moreno f0066fe680
automation: refactor web tests not to use outPath 2020-02-26 11:55:48 +01:00
Benjamin Pasero ebcd432491 docs for #91532 2020-02-26 11:39:05 +01:00
Benjamin Pasero afcaaa6131 smoke - use tree kill also here 2020-02-26 09:04:03 +01:00
Daniel Imms 06f2731c7f Remove terminal smoke test
Fixes #90539
2020-02-14 07:24:44 -08:00
Benjamin Pasero a7ed9c9572
🆙 playwright@0.11.0 (#90663) 2020-02-14 09:56:08 +01:00
Benjamin Pasero f7884f5698 integration - mention how to debug 2020-02-13 15:32:02 +01:00
Benjamin Pasero 4b359a57a5 build - address some issues
- run local and remote integration tests separately
- enable playwright on Linux with -no-sandbox trick
2020-02-12 12:07:44 +01:00
Benjamin Pasero 35379aba75 smoke - headless option is troublesome 2020-02-11 17:35:53 +01:00
Benjamin Pasero 06b06ca10a smoke - move quick open tests into search 2020-02-11 17:28:03 +01:00
Benjamin Pasero b7a29c77ef tests - document and enable debug mode for integration tests 2020-02-11 17:18:43 +01:00
Daniel Imms 5cfae257fd
Merge pull request #90245 from microsoft/tyriar/browser_tests
Move terminal unit tests to browser and common
2020-02-10 04:58:40 -08:00
Benjamin Pasero cdf4026fb6
Add browser unit tests to product build (#90353)
* wip - add browser unit tests to product build

* run with more output

* load loader via script tag
2020-02-10 12:44:28 +01:00
Benjamin Pasero 9d9d729655 Web: run integration tests as part of our product builds (fix #83923) 2020-02-10 11:23:00 +01:00
Daniel Imms 8a4cd00f8f Move terminal tests to common and browser 2020-02-07 08:52:37 -08:00
Johannes Rieken 7b8552a711 also add a note about electron unit test runner 2020-02-07 16:49:49 +01:00
Johannes Rieken d288521f32 update test readme 2020-02-07 16:49:49 +01:00
Benjamin Pasero 6a91ae6eb0 test - fix help output for integration too 2020-02-07 16:48:46 +01:00
Benjamin Pasero 3f4e6a4854 test - make integration tests arguments 2020-02-07 16:35:32 +01:00
Benjamin Pasero 5e0189c8bf tests - browser tests to go through new log service 2020-02-07 16:22:10 +01:00
Johannes Rieken f9c5a5511e add help printing 2020-02-07 16:20:09 +01:00
Johannes Rieken 4f875f8d25
Merge branch 'master' into joh/continous-browser-tests 2020-02-07 15:06:46 +01:00
Johannes Rieken 3e19c9765e test - remove unsupported options, fix bad file warning 2020-02-07 15:06:29 +01:00
Johannes Rieken 37ef5e45af
Merge branch 'master' into joh/continous-browser-tests 2020-02-07 14:48:21 +01:00
Johannes Rieken 03fb0b117f support --run argument as before, #90063 2020-02-07 14:07:39 +01:00
Benjamin Pasero 4be3cc8846 test - convert web integration to TS 2020-02-07 12:41:12 +01:00
Alex Dima ca5144362b
Move coverage.js into test/unit 2020-02-07 12:37:26 +01:00
Alex Dima 97f826b007
Move assert.js into test/unit 2020-02-07 12:32:06 +01:00
Alex Dima 3ce3886428
Move css.mock to unit/node 2020-02-07 12:22:51 +01:00
Alex Dima 2e7c169024
Move more files to test/unit 2020-02-07 12:21:30 +01:00
Alex Dima 4afd61c29f
Replace usage of express 2020-02-07 12:15:14 +01:00
Alex Dima 1a86c1ec67
Modernize test/browser.js 2020-02-07 12:15:09 +01:00
Johannes Rieken 0332fbfc4b
Merge branch 'master' into joh/continous-browser-tests 2020-02-07 11:31:38 +01:00
Benjamin Pasero 085f0b09e5 tests - add wip integration test runner for browser 2020-02-07 11:00:41 +01:00
Johannes Rieken 562193e0d6
Merge branch 'master' into joh/continous-browser-tests 2020-02-07 10:30:35 +01:00
Alex Dima 5e8dabc1f4
Move test/all.js to test/unit/node/all.js 2020-02-07 10:20:08 +01:00
Benjamin Pasero e48debc94e tests - add a UI folder for manual UI tests 2020-02-07 10:17:49 +01:00
Benjamin Pasero a9c4a4397c tests - move readme around 2020-02-07 10:09:22 +01:00
Benjamin Pasero 0c94b3ade0 test - share playwright for tests 2020-02-07 10:07:21 +01:00
Johannes Rieken 8a1ca2b6c0 Merge branch 'master' into joh/continous-browser-tests 2020-02-07 10:02:38 +01:00
Johannes Rieken 0f60e831d6 fail when browser fails 2020-02-07 09:56:51 +01:00
Benjamin Pasero 310c969fce tests - run browser unit tests in default window 2020-02-07 09:53:24 +01:00
Benjamin Pasero 5393954877 tests - have a test/unit folder 2020-02-07 09:51:28 +01:00
Benjamin Pasero bb3edc40e6 smoke - exclude a few more tests for web 2020-02-07 07:10:59 +01:00
Johannes Rieken 21b671d921 browser-test: exit(1) when test failed 2020-02-06 16:39:45 +01:00
Johannes Rieken 93379d00b1 print manual debug instructions when test fail 2020-02-05 15:44:43 +01:00
Johannes Rieken f96a99a577 add "manual" test mode 2020-02-05 15:23:02 +01:00
Johannes Rieken d01c4cd10e remove unused file 2020-02-05 15:09:31 +01:00
Johannes Rieken 632939e159 update assert.js-copy 2020-02-05 12:10:02 +01:00
Johannes Rieken e584763f2a browser tests support reporter-options 2020-02-05 11:59:25 +01:00
Johannes Rieken 2ce6f5115e add --debug option to run not headless 2020-02-05 11:11:51 +01:00
Johannes Rieken 3b66dc7307 better glob to catch all tests for browser and common 2020-02-05 11:06:21 +01:00
Johannes Rieken 1355463c76 print browser when printing fails 2020-02-05 09:48:15 +01:00
Johannes Rieken 850206d0fb support --browser flag 2020-02-05 09:16:52 +01:00
Johannes Rieken ce1bb2220a improper deepStrictEqual implementation 2020-02-05 09:16:01 +01:00
Johannes Rieken 1908fdc68b
Merge branch 'master' into joh/browser-tests 2020-02-04 19:53:20 +01:00
Benjamin Pasero ec41f20c40
Web - run smoke tests using playwright (#89918)
* playwright - initial version

* browser - use existing page and not create new context

* macOS: document how to remove the security flag

* smoke test - allow to run against server build with --build option

* do not rely on args

* fix path for windows

* smoke test - smoke 💄 and -ci option
2020-02-04 17:23:27 +01:00
Joao Moreno 16c7551f36
move git smoke tests to integration tests 2020-02-04 17:06:49 +01:00
isidor 8f90e851c5 remode debug smoke tests 2020-02-04 16:14:02 +01:00
Johannes Rieken 890b357e94 run tests in parallel, tweak presentation 2020-02-04 15:33:57 +01:00
Johannes Rieken 874f759bbe better (disabled) one-by-one loading of files 2020-02-04 15:25:14 +01:00
Johannes Rieken b5252d32f7 use playwright for unit tests 2020-02-04 15:02:52 +01:00
Benjamin Pasero a15803b9e7 smoke test - add attribute for tabs to simplify lookup 2020-02-04 14:50:53 +01:00
Benjamin Pasero cfc452e466 smoketest - use element ID for status item selectors 2020-02-04 14:50:53 +01:00
Alex Ross 0b312b08f2 CSS smoketest fix for high DPI on Windows
@sandy081 and @joaomoreno
2020-02-03 12:50:27 +01:00
Sandeep Somavarapu 4fac3e22c5 remove the timeout 2020-02-03 11:49:10 +01:00
Daniel Imms 547cf4e81f
Run smoke tests against actual build (#83799)
* Run web against actual server

Part of #80308

* Fix strict null check errors

* Fix folder arg

* Disable unit tests and integration tests temporarily

* Allow running on node 12

* Fix smoke test condition

* Disable continue on error

* Add web to server dir

* fix smoke test to use build for web

* enable in product build

Co-authored-by: Benjamin Pasero <benjamin.pasero@gmail.com>
2020-02-03 11:26:55 +01:00
Benjamin Pasero d6eb50caa4
Smoke-Test: Hot-exit / dataloss tests broken (#89905)
* smoke test - carefuly select untitled content based on file name to find it properly

* Fileservice: mkdirp() logic is prone to errors from race conditions (fixes #89834)
2020-02-03 09:38:03 +01:00
Sandeep Somavarapu 39e290dbbc Fix #89796 2020-02-03 09:36:08 +01:00
Rob Lourens f550dcc7ba Fix search smoketest - use span for all searchview messages and fix selector
Fix #89795
2020-01-31 09:32:52 -08:00
Joao Moreno 9bec0160f6
fixes #86474 2020-01-23 11:41:00 +01:00
Alexandru Dima 4e5a05c3fd
Don't instrument any test code for coverage (#86608)
Don't instrument any test code for coverage
2020-01-14 11:10:51 +01:00
Alexandru Dima 31ef68ff7c
Adopt latest istanbul libraries 2020-01-14 11:09:29 +01:00
Charles Gagnon 34c591eeb3
Don't instrument any test code for coverage 2019-12-09 09:37:52 -08:00
isidor 0fae04b8a2 fixes #78384 2019-12-05 14:21:50 +01:00
Sandeep Somavarapu 121a3425a4
Merge branch 'master' into master 2019-11-27 22:16:40 +01:00
Joao Moreno 83b1a1c2ac
splitview: use TLayoutContext
gridview: propagate top, left in layout
2019-11-27 15:27:24 +01:00
ryenus d75f90976b fix typo: consecutive-word duplications
This fixes unintentional duplications of words, such as `the the`, and
`can can` etc. I also take the chance to make a few wording tweaks to
avoid suspicious duplications.
2019-11-27 11:07:06 +08:00
Johannes Rieken 266f78096e remove smoke test for find ref, rename, goto, and peek, #85377 2019-11-22 11:36:13 +01:00
Alex Ross 4235c7f076 Fix Go To Definition smoketest
Fixes #85276
2019-11-21 09:58:10 +01:00
Miguel Solorio bb4fefc959 Merge remote-tracking branch 'origin/master' into misolori/icon-font-breakpoints 2019-11-14 07:59:06 -08:00
Miguel Solorio a0316e3b30 Update breakpoint glyph name in automation test 2019-11-13 21:18:43 -08:00
Joao Moreno 48af7ba677
fixes #84455 2019-11-13 10:40:09 +01:00
Miguel Solorio 6b43b2cb5e Update breakpoints to codicons 2019-11-08 14:43:12 -08:00
Jason Ginchereau 5c2e24f6ad Remove extra step from readme 2019-11-06 16:26:55 -08:00
Jason Ginchereau 55e06a7080 Add prepare script to package.json 2019-11-06 16:26:55 -08:00
Jason Ginchereau dd90a90a60 Fix minor packaging issues in automation lib 2019-11-04 12:03:51 -08:00
Benjamin Pasero ea89eb903f fix #83805 2019-11-01 09:15:35 +01:00