Benjamin Pasero
bacf6ed2c1
smoke - properly create screenshots and stop instances ( #137220 )
2021-11-15 12:15:25 +01:00
Benjamin Pasero
6f28593438
smoke - retry quick open search ( fix #136499 )
2021-11-15 07:52:12 +01:00
Daniel Imms
3c9b18e135
Remove test only
2021-11-12 06:16:17 -08:00
Daniel Imms
c65c8738f9
Copy and use IWindowDriver in PlaywrightDriver
2021-11-12 06:11:18 -08:00
Daniel Imms
634dae736e
Merge remote-tracking branch 'origin/main' into tyriar/smoke_test_improvements
2021-11-12 05:45:20 -08:00
Daniel Imms
e6caf0da49
Pass terminal profiles test
2021-11-10 12:27:38 -08:00
Daniel Imms
5bfaf29f2b
Fix layering problem
2021-11-10 08:38:02 -08:00
Daniel Imms
6a6a1b65df
Use handles in playwright driver
2021-11-10 08:03:22 -08:00
Benjamin Pasero
bef4dba21f
Parcel update and CI improvements ( #136830 )
...
* 🆙 product
* 🆙 parcel/watcher
* 🆙 parcel/watcher
* tests - separate remote logs from others
* store server logs too
* more tweaks
* fix name
* error when 10s passed
2021-11-10 08:13:56 +01:00
Daniel Imms
bd98431baf
Write basic terminal default profile test
...
Co-authored-by: Megan Rogge <merogge@microsoft.com>
2021-11-09 10:10:54 -08:00
Daniel Imms
628f486b1d
Move playwright driver impl to class
...
Part of #136064
2021-11-09 08:45:08 -08:00
Daniel Imms
28da3051b3
Tidy up smoke test imports
2021-11-09 08:26:39 -08:00
Daniel Imms
281bacb074
Stub out some terminal smoke tests
...
Part of #136064
2021-11-09 08:25:15 -08:00
Daniel Imms
1cbf69d996
Document --headless in smoke tests
2021-11-09 08:24:38 -08:00
João Moreno
1788b8afd8
chore: 🔧 clean smoketest dependencies
2021-11-08 14:58:17 +01:00
Benjamin Pasero
f9e8dc2095
🆙 playwright
2021-11-04 09:27:22 +01:00
Alex Dima
3247c31f6a
Replace Right Single Quotation Mark with Single Quote
2021-11-03 23:34:40 +01:00
Benjamin Pasero
7ca8b0f613
Statusbar - checks if 'Go to Line' works if called from the status bar: ( fix #135962 )
2021-10-28 07:22:45 +02:00
Matt Bierner
bc566d42a1
Try bumping webEndpointUrlTemplate again
...
Reverts dc1a669906
Also bumps distro to pick up new product.json changes
2021-10-26 15:38:11 -07:00
Alexandru Dima
7dfe2e33ea
Fix test running around loading assertCleanState
2021-10-19 11:09:47 +02:00
Alex Dima
11862795ea
Remove LanguageIdentifier
and ensure tests dispose instantiated LanguagesRegistry
objects
2021-10-18 10:29:16 +02:00
Rob Lourens
83fec0220c
Add retry logic for flaky git operations
...
Fix #132218
2021-10-12 17:08:20 -07:00
Alex Dima
898c759f85
Fail the build when webpack has bundling warnings (early prevention of issues like microsoft/monaco-editor#2691 )
2021-10-11 18:14:10 +02:00
Benjamin Pasero
be2f951fde
debt - introduce Promises.withAsyncBody
and adopt in a few places
2021-10-11 13:27:43 +02:00
Matt Bierner
5fc835305a
Re-enable webview tests on web ( #134300 )
...
* Enable webview tests on web
These tests pass fine on Chrome and webkit. On Firefox, the two about loading resources currently fail
I spent a while trying to debug what is going on with these tests. It seems like the service workers is registered properly but `fetch` is never called on it. Skipping these for now
* Remove only
* Fix test
2021-10-01 12:32:29 -07:00
Henning Dieterichs
98c1725c7d
Encode actual and expected value as JSON to enable https://github.com/microsoft/vscode-selfhost-test-provider/pull/2 .
...
Only a proof of concept yet.
2021-09-13 18:44:06 +02:00
Benjamin Pasero
769d5fb521
smoke - disable search smoke tests on windows ( #132218 )
2021-09-06 18:07:58 +02:00
Sandeep Somavarapu
77b1fb79f5
Fix #132233
2021-09-06 14:32:19 +02:00
Johannes Rieken
70e30bc64e
disable flaky/failing smoketest, https://github.com/microsoft/vscode/issues/132233
2021-09-03 11:38:14 +02:00
Benjamin Pasero
a3acef919f
smoke - ignore any failure from capturing screenshot
2021-09-03 09:31:01 +02:00
Raymond Zhao
86d81f35fe
Clarify running remote tests
2021-09-01 19:17:58 -07:00
Benjamin Pasero
cdde5bedbf
web tests - mention how to enable playwright logging
2021-08-26 10:34:17 +02:00
Matt Bierner
4cd3ec8281
Update commit
2021-08-24 14:15:43 -07:00
Matt Bierner
a70fd2fbf6
Bump default webview commit
2021-08-23 18:46:43 -07:00
Benjamin Pasero
90443f7a8a
tests - try to make some tests more robust
2021-08-12 07:48:02 +02:00
Connor Peet
fa8ccff4d8
testing: initial output correlation
2021-08-11 13:08:58 -07:00
Logan Ramos
8bf9cfa21b
Fix spacing
2021-08-11 15:26:20 -04:00
Logan Ramos
2ee9010437
Disable telemetry in tests ( #130591 )
...
* Disable telemetry in tests
* Remove the console log check
2021-08-11 11:49:23 -04:00
dependabot[bot]
0344ecd462
Bump path-parse from 1.0.6 to 1.0.7 in /test/smoke ( #130540 )
2021-08-11 08:21:05 -07:00
Benjamin Pasero
ec9a8fe5b7
web smoke - guard against failing tracing
2021-08-07 15:10:50 +02:00
Rob Lourens
42a8653e39
Mention building browser integration test code
2021-08-06 18:22:41 -07:00
Benjamin Pasero
5e99049e66
smoke - fix web smoke tests
2021-08-05 11:31:04 +02:00
Benjamin Pasero
6957e52e4b
smoke - always create test folder
2021-08-05 10:31:07 +02:00
Benjamin Pasero
b96644b15f
smoke tests - drop 'tmp' and try to deal with tmp path ourself ( #130102 )
2021-08-05 10:04:00 +02:00
Benjamin Pasero
6c3bb99c63
smoke - better exit application handling
2021-08-05 09:05:17 +02:00
Benjamin Pasero
70e6d3f85d
smoke tests - try to fix data migration test ( #129279 )
2021-08-05 07:56:55 +02:00
Benjamin Pasero
bf4a4a6b05
smoke tests - retry data migration tests on windows ( #129279 )
2021-08-04 18:10:00 +02:00
Benjamin Pasero
2f58131321
smoke tests - fix compile issue
2021-08-04 15:46:10 +02:00
Benjamin Pasero
c28ea165cd
smoke tests - try other ways of ensuring the editor is open for data migration ( #129279 )
2021-08-04 15:32:21 +02:00
Benjamin Pasero
db4cda10a8
web - guard against error from stopping tracing on tear down of tests
2021-08-03 14:15:55 +02:00
Benjamin Pasero
0390d98a4e
web tests - print page errors to console
...
//cc @lramos15 this would have detected the missing module
2021-08-03 09:10:47 +02:00
Raymond Zhao
ffceebb909
Revert "Update webviewExternalEndpointCommit"
...
This reverts commit dbe3a22a53
.
2021-07-26 16:38:03 -07:00
Raymond Zhao
d163eabed0
Add troubleshooting step for tmp module
2021-07-26 14:39:44 -07:00
Matt Bierner
dbe3a22a53
Update webviewExternalEndpointCommit
2021-07-26 13:00:08 -07:00
João Moreno
132e3783d0
smoke: fix vscode-test cache location
2021-07-16 15:23:48 +02:00
João Moreno
a9e4cb0874
oops
2021-07-16 12:50:07 +02:00
João Moreno
3c4fdb58a1
fix screenshots in smoketests
...
related to #122685
2021-07-16 11:58:52 +02:00
Rob Lourens
50b3811fdc
Revert "Fix running smoketest multiple times"
...
See https://github.com/microsoft/vscode/pull/124666/files#r662070269
This reverts commit 4d694d7dc8
.
2021-07-14 21:32:51 -07:00
Rob Lourens
4d694d7dc8
Fix running smoketest multiple times
2021-07-14 21:21:27 -07:00
Robo
9520f0a515
chore: update to electron 13 ( #124666 )
...
* chore: bump electron@13.0.1
* chore: update cache for native modules
* chore: bump electron@13.1.2
* chore: bump electron@13.1.4
* chore: fix user data dir length for validateIPCHandleLength check
* chore: always disable uploadToServer on OSS
* chore: use process.contextIsolated property
* chore: bump electron@13.1.6
* fix: getUserDataPath helper
2021-07-13 20:01:10 -07:00
Connor Peet
fa9255c0de
almost complete update for run configurations
2021-07-12 17:28:01 -07:00
João Moreno
05fd05dc00
remove --stable-build
2021-07-12 05:56:27 -07:00
Benjamin Pasero
d85bc647ef
smoke tests - automatically test against stable build ( #127799 )
...
* smoke tests - automatically test against stable build
* fix path on Linux/Windows
* 💄
* retry migration tests
* smoke: always download latest previous stable
* hm
Co-authored-by: João Moreno <joao.moreno@microsoft.com>
2021-07-12 05:44:50 -07:00
João Moreno
d737dc4db3
smoke: simplify localization test
2021-07-12 12:20:34 +02:00
Connor Peet
20790ec994
testing: increase debugger wait timeout
2021-07-09 15:28:35 -07:00
João Moreno
a28d028d2d
Enable automated smoketests on Windows ( #128224 )
2021-07-08 19:10:25 +02:00
Connor Peet
c6d7cfed8a
testing: fix undefined not being reported correctly in results
...
Fixes #125669
2021-07-07 15:28:55 -07:00
Connor Peet
583f6d1418
open the devtools for browser tests when debug is passed
2021-07-07 12:58:19 -07:00
Benjamin Pasero
d0df79be50
webview - remove more traces ( #128128 )
...
* webview - remove more traces
* more removal
2021-07-07 18:28:53 +02:00
Benjamin Pasero
fa032d752d
Update playwright to 1.12.x and enable tracing for smoke tests ( #128061 )
...
* 🆙 playwright
* create trace
2021-07-07 13:23:11 +02:00
Dirk Baeumer
c9aea49a87
Re-enable enhanced localization tests
2021-07-07 10:49:52 +02:00
João Moreno
2c7fc24d63
smoke: ctrl-c should kill all processes
2021-07-06 20:30:20 +02:00
Dirk Baeumer
1a3fd783fe
Disable locale info check.
2021-07-06 15:38:21 +02:00
Dirk Baeumer
ae52915f0c
Improve localization tests
2021-07-06 13:15:43 +02:00
Benjamin Pasero
7a0714a6e5
smoke - harden data migration test
2021-07-06 12:10:08 +02:00
Sandeep Somavarapu
062e6519f8
use vscode smoke test check extension
2021-07-02 10:46:31 +02:00
Benjamin Pasero
99a831f6e8
web - allow integration tests to open a workspace
2021-07-01 15:38:30 +02:00
João Moreno
ca61a42383
web smoke test: bump up port number
2021-06-30 12:01:31 +02:00
João Moreno
a44611d4c6
tests: hide output
2021-06-30 11:07:35 +02:00
Dirk Baeumer
a63e0a0a21
Reenable German translation test based on new API
2021-06-29 09:23:52 +02:00
Robo
92999c339e
fix: setuid helper permission ( #126798 )
...
* ci: fix setuid helper binary permission
* ci: allow privilege for CLONE_NEWPID | CLONE_NEWNET
* ci: fix chrome-sandbox permission with rpm
* ci: fix permissions on snap
* ci: download electron earlier for arm builds
2021-06-22 08:42:30 -07:00
Dirk Baeumer
9cfc4bcb5c
Improve wording for failing test case
2021-06-22 13:30:29 +02:00
Dirk Baeumer
1f2a6cc331
Improve localization smoke test
2021-06-21 13:54:16 +02:00
João Moreno
3d2dea7a9f
fix integration browser tests
2021-06-15 15:15:41 +02:00
João Moreno
9d4274bf64
skip the entire notebook test suite so Code isn't even launched
2021-06-15 14:07:35 +02:00
Benjamin Pasero
81317867a3
web - disable welcome in smoke tests ( fix #126221 )
...
//cc @JacksonKearl
2021-06-15 10:57:29 +02:00
Benjamin Pasero
2ddc1e4fc5
Produce logs during test runs (integration, smoke) and publish as artefacts ( #126065 )
...
* first cut upload log files from integration test runs
* always publish log files
* move logs into integration-tests folder
* also produce logs for smoke tests
* store remote log files
* wire in logspath arg properly
* always publish logs
* enable logs for browser based smoke tests
* log only in verbose
2021-06-15 08:33:26 +02:00
João Moreno
85a36ae074
enable smoketest on linux
2021-06-11 12:19:17 +02:00
Alexandru Dima
0c87771e7b
Merge pull request #125754 from microsoft/alex/update-playwright
...
Update to `playwright@1.11.1`
2021-06-10 23:00:14 +02:00
Ladislau Szomoru
291ec03bc3
Smoke tests - run each suite in its own user-data-dir ( #125670 )
...
* Initial commit for isolated smoke tests
* Do not wait for the explorer view when restarting
* Debug failed localization test
* User data path suffix length
* Kill server when application exits
* Do not run yarn install
* Refactor application start/stop
* Reverted some changes
* Missed one
* One more change to revert
* Restored one more file
* Pull request feedback
2021-06-10 06:40:57 -07:00
Alexandru Dima
911ef74bbb
Merge remote-tracking branch 'origin/main' into alex/update-playwright
2021-06-10 09:27:13 +02:00
Alexandru Dima
b1bc7be9d1
Do not rely on console.log
for exiting tests
2021-06-09 21:47:18 +02:00
Benjamin Pasero
33f84b36fd
tests - disable getting started in integration tests and smoke tests ( #125808 )
...
* tests - disable getting started in integration tests and smoke tests
* --skip-getting-started => --skip-welcome
Co-authored-by: Jackson Kearl <jakearl@microsoft.com>
2021-06-09 18:36:42 +00:00
Henning Dieterichs
00123b32a7
Updates sinon from 1.17 to 11.1.
2021-06-09 10:03:46 +02:00
Henning Dieterichs
294b3bdf16
Revert "Include sinon-test in renderer.html / index.html"
...
This reverts commit e4e0f8be89
.
2021-06-08 17:18:34 +02:00
Henning Dieterichs
e4e0f8be89
Include sinon-test in renderer.html / index.html
2021-06-08 17:16:54 +02:00
Ladislau Szomoru
4e0cf885d4
Don't wait for the explorer when restarting
2021-06-07 15:34:37 +02:00
Ladislau Szomoru
b003560579
Use --disable-workspace-trust for the test runs
2021-06-07 09:59:26 +02:00
Ladislau Szomoru
e2d0e05038
Do not run yarn install as part of the smoke tests
2021-06-06 21:14:37 +02:00
Benjamin Pasero
802648f2a1
electron - adopt some newer APIs and 💄 main code
2021-06-04 09:22:38 +02:00