Connor Peet
a0b548807a
eng: add assertHeap method for memory assertions ( #198334 )
...
This adds an `assertHeap` function that can be used in tests. It
takes a heap snapshot, and asserts the state of classes in memory. This
works in Node and the Electron sandbox, but is a no-op in the browser.
Snapshots are process asynchronously and will report failures at the end
of the suite.
This method should be used sparingly (e.g. once at the end of a suite to
ensure nothing leaked before), as gathering a heap snapshot is fairly
slow, at least until V8 11.5.130 (https://v8.dev/blog/speeding-up-v8-heap-snapshots ).
When used, the function will ensure the test has a minimum timeout
duration of 20s to avoid immediate failures.
It takes options containing a mapping of class names, and assertion functions
to run on the number of retained instances of that class. For example:
```ts
assertSnapshot({
classes: {
ShouldNeverLeak: count => assert.strictEqual(count, 0),
SomeSingleton: count => assert(count <= 1),
}
});
```
Closes https://github.com/microsoft/vscode/issues/191920
2023-11-15 10:41:22 -08:00
Henning Dieterichs
e2670a457f
Fixes "_b is not defined" error
2023-11-15 16:53:00 +01:00
Henning Dieterichs
9ac90beb07
Always report monaco loading errors
2023-11-15 16:53:00 +01:00
Daniel Imms
0fa8f868a5
Correct setting name in smoke test
2023-11-11 05:15:09 -08:00
Daniel Imms
d9520bd5dc
Add smoke test for multi-line prompt sticky scroll
2023-11-09 08:28:19 -08:00
Daniel Imms
4b2ed32ec3
Clean up, simplify smoke test
2023-11-08 11:15:18 -08:00
Daniel Imms
3794d74d3c
Fix polling error compile
2023-11-08 09:49:39 -08:00
Daniel Imms
29ddbd371e
Simplify polling
2023-11-08 09:39:40 -08:00
Daniel Imms
35ae6b1925
Use a polling approach for writing and asserting
2023-11-08 09:20:44 -08:00
Daniel Imms
d2432a3545
Prevent shell data from leaking into empty term
2023-11-08 08:02:01 -08:00
Daniel Imms
9ad04e81aa
Combine write data calls
2023-11-08 07:42:25 -08:00
Daniel Imms
bff9161987
Make empty terminal smoke test technique reusable
2023-11-08 07:16:24 -08:00
Daniel Imms
bd2d20551d
Make sticky scroll smoketest even more consistent
2023-11-08 07:11:14 -08:00
Daniel Imms
90d1e81ce9
Make sticky scroll smoketest more consistent
2023-11-08 06:30:51 -08:00
Daniel Imms
26db70d00a
Fix sticky scroll smoketest on linux
2023-11-08 05:58:03 -08:00
Daniel Imms
64ac05a2e9
Add simple terminal sticky scroll smoke test
2023-11-08 05:23:01 -08:00
Daniel Imms
1532b5aebd
Add xterm scope to moore places
2023-11-02 06:34:09 -07:00
Sandeep Somavarapu
f8f9f06401
whenWorkbenchRestored was not implemented in the driver in previous releases ( #197068 )
2023-10-31 13:43:02 +01:00
Sandeep Somavarapu
519c8072f3
poll to wait for workbench to be restored ( #197059 )
2023-10-31 11:23:50 +01:00
Sandeep Somavarapu
bee0ea18bd
Move wait for workbench restoration to Application ( #197053 )
...
#195850 : Move wait for workbench restoration to
Application#checkWindowReady
2023-10-31 09:00:40 +01:00
Raymond Zhao
e9e1f8a132
Revert "Separate Settings editor open and search steps" ( #196997 )
...
Revert "Separate Settings editor open and search steps (#196866 )"
This reverts commit 932e49579b
.
2023-10-30 09:53:19 -07:00
Raymond Zhao
932e49579b
Separate Settings editor open and search steps ( #196866 )
2023-10-30 07:50:27 -07:00
Connor Peet
c2a6932e9e
eng: onboard to the extension test runner ( #195570 )
...
* eng: onboard to the extension test runner
Adds a `.vscode-test.js` file that uses the new extension test CLI to
run tests. Also, onboards the markdown-language-features as the first
built-in extension to use it.
With the `ms-vscode.extension-test-runner` extension installed, the
markdown-language-features' tests can be run and debugged easily in
the UI :)
* fixup
2023-10-13 13:11:05 -07:00
Raymond Zhao
e20515c62e
Bump dependencies for debug sub-dependency ( #195513 )
2023-10-13 09:01:12 -07:00
Raymond Zhao
88fc434af4
Mitigate smoke test failure #195491 ( #195493 )
2023-10-12 20:03:27 +02:00
Sandeep Somavarapu
9a611bbe20
retry after waiting for workbench restore ( #195300 )
2023-10-10 16:05:45 -07:00
Sandeep Somavarapu
2f51809ca3
Fix extensions smoke test ( #195264 )
...
#193046
- add waitForWorkbenchRestored method to driver
- move driver to workbench
- wait for workbench to restore if command is not found
2023-10-10 20:11:30 +02:00
Raymond Zhao
b63441dbc9
Hide ToC during search if requested ( #194821 )
...
Fixes #194812
2023-10-10 09:49:00 -07:00
João Moreno
a5d71aad39
Cleanup dependencies ( #195026 )
...
* move build dependencies to devDependencies
* build: bump tree-sitter
* dependencies cleanup
* remove leftover file
2023-10-09 09:34:15 +02:00
Tyler James Leonhardt
bd41b74fd1
Dedupe strings in tf-idf index & include exactLabelMatch
in runCommand
in smoke tests ( #195085 )
2023-10-08 16:47:51 -07:00
Connor Peet
c6a9da71a2
eng: allow snapshot mutation messages locally ( #194498 )
...
* eng: allow snapshot mutation messages locally
Fixes https://github.com/microsoft/vscode/issues/192439
Fixes https://github.com/microsoft/vscode/issues/194493
* keep snapshot tests allowed
2023-09-29 18:36:27 +01:00
Connor Peet
31067371f2
eng: fix snapshot tests in macos webkit for real? ( #193734 )
...
Second attempt at this, which should work. Stop trying to use
exposeFunction, which seems to work poorly on macOS webkit in CI, and
just run a server with HTTP endpoints to do the "RPC."
Reuses Alex's "yaserver" module that we were already using for other
tests. Uses a secure random prefix for security in each run.
2023-09-21 22:48:21 +01:00
Connor Peet
8730f56c09
eng: add io warmup for webkit tests in ci ( #193711 )
...
Should fix the issue that @roblourens and @Yoyokrazy were hitting with snapshot tests on macOS WebKit in CI. Not pretty, but I'd rather do this than spend a bunch of time chasing down something that certainly seems to be a browser issue.
2023-09-21 11:03:20 -07:00
Benjamin Pasero
6b9583d2dc
fix ( #192807 )
...
* fix
* fix
* fix
* fix
2023-09-11 12:54:53 -07:00
Benjamin Pasero
0c5c400ea5
debt - more polish in global test reporter ( #192774 )
...
* debt - more polish in global test reporter
* cleanup
* cleanup
* fixes
2023-09-11 17:16:16 +02:00
Benjamin Pasero
edd2f9f3f1
eng - fail test that logs unexpected output ( #192700 )
...
eng - fail test that logs
2023-09-11 14:35:48 +02:00
Tyler James Leonhardt
a4a2d8f0f4
Rename --disable-keytar
to --use-inmemory-secretstorage
( #192312 )
...
This renames the flag as the title suggests but keeps `--disable-keytar` in the `deprecates` section so it still works.
Fixes https://github.com/microsoft/vscode/issues/191498
2023-09-08 17:58:32 +02:00
Sandeep Somavarapu
2aa8453e35
Merge pull request #192270 from microsoft/sandy081/dreadful-ferret
...
#191860 - retry if command is not found
2023-09-06 11:59:04 +02:00
Sandeep Somavarapu
9ed384ffe7
fix while check
2023-09-06 11:10:35 +02:00
Sandeep Somavarapu
7b15902db0
only check for No matching commands text
2023-09-06 10:58:27 +02:00
Sandeep Somavarapu
6e93ce037b
feedback
2023-09-06 10:30:13 +02:00
Robo
ab2afd626f
chore: disable hardware acceleration support for linux smoke tests ( #192265 )
2023-09-06 16:58:16 +09:00
Sandeep Somavarapu
7a0fecc0a7
#191860 - retry if command is not found
2023-09-06 09:36:50 +02:00
Johannes Rieken
137b724984
Merge branch 'main' into joh/corporate-canid
2023-09-05 13:50:57 +02:00
Johannes
8f4d4d4bad
workaround browser bug, fix browser test debugging
2023-09-05 11:47:13 +02:00
Sandeep Somavarapu
eafe1c398d
#191860 skip until insiders is released
2023-09-04 17:29:31 +02:00
Sandeep Somavarapu
63d4fe776b
fix #191860 ( #192121 )
2023-09-04 13:30:46 +02:00
Tyler James Leonhardt
79277e0b8f
Skip flakey smoke test ( #191936 )
...
* Skip flakey smoke test
ref https://github.com/microsoft/vscode/issues/191860
* skip at describe since there's only 1 test
2023-08-31 23:34:22 +02:00
Alpha Romer Coma
7ef754c2f6
Fix supported markdown-lint violations in markdown files ( #190750 )
...
docs: fix supported markdownlint violations
2023-08-24 08:37:25 +00:00
Raymond Zhao
a08322ae0a
Add delay to Settings editor search for smoke tests ( #190903 )
...
Ref #190896
2023-08-21 20:54:48 +01:00