Commit graph

1670 commits

Author SHA1 Message Date
Connor Peet 81ea8669f2
eng: support runGlob in browser unit tests (#199979)
Fixes #183507
2023-12-04 12:14:25 -08:00
Sandeep Somavarapu 5a7b7be28a
throw error (#199653) 2023-11-30 12:58:41 +01:00
Josh Soref 69ddb3f3c6
Write out Cannot (#198377)
spelling: cannot

Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2023-11-20 17:22:21 +00:00
Connor Peet a0b548807a
eng: add assertHeap method for memory assertions (#198334)
This adds an `assertHeap` function that can be used in tests. It
takes a heap snapshot, and asserts the state of classes in memory. This
works in Node and the Electron sandbox, but is a no-op in the browser.
Snapshots are process asynchronously and will report failures at the end
of the suite.

This method should be used sparingly (e.g. once at the end of a suite to
ensure nothing leaked before), as gathering a heap snapshot is fairly
slow, at least until V8 11.5.130 (https://v8.dev/blog/speeding-up-v8-heap-snapshots).

When used, the function will ensure the test has a minimum timeout
duration of 20s to avoid immediate failures.

It takes options containing a mapping of class names, and assertion functions
to run on the number of retained instances of that class. For example:

```ts
assertSnapshot({
	classes: {
		ShouldNeverLeak: count => assert.strictEqual(count, 0),
		SomeSingleton: count => assert(count <= 1),
	}
});
```

Closes https://github.com/microsoft/vscode/issues/191920
2023-11-15 10:41:22 -08:00
Henning Dieterichs e2670a457f Fixes "_b is not defined" error 2023-11-15 16:53:00 +01:00
Henning Dieterichs 9ac90beb07 Always report monaco loading errors 2023-11-15 16:53:00 +01:00
Daniel Imms 0fa8f868a5
Correct setting name in smoke test 2023-11-11 05:15:09 -08:00
Daniel Imms d9520bd5dc
Add smoke test for multi-line prompt sticky scroll 2023-11-09 08:28:19 -08:00
Daniel Imms 4b2ed32ec3
Clean up, simplify smoke test 2023-11-08 11:15:18 -08:00
Daniel Imms 3794d74d3c
Fix polling error compile 2023-11-08 09:49:39 -08:00
Daniel Imms 29ddbd371e
Simplify polling 2023-11-08 09:39:40 -08:00
Daniel Imms 35ae6b1925
Use a polling approach for writing and asserting 2023-11-08 09:20:44 -08:00
Daniel Imms d2432a3545
Prevent shell data from leaking into empty term 2023-11-08 08:02:01 -08:00
Daniel Imms 9ad04e81aa
Combine write data calls 2023-11-08 07:42:25 -08:00
Daniel Imms bff9161987
Make empty terminal smoke test technique reusable 2023-11-08 07:16:24 -08:00
Daniel Imms bd2d20551d
Make sticky scroll smoketest even more consistent 2023-11-08 07:11:14 -08:00
Daniel Imms 90d1e81ce9
Make sticky scroll smoketest more consistent 2023-11-08 06:30:51 -08:00
Daniel Imms 26db70d00a
Fix sticky scroll smoketest on linux 2023-11-08 05:58:03 -08:00
Daniel Imms 64ac05a2e9
Add simple terminal sticky scroll smoke test 2023-11-08 05:23:01 -08:00
Daniel Imms 1532b5aebd
Add xterm scope to moore places 2023-11-02 06:34:09 -07:00
Sandeep Somavarapu f8f9f06401
whenWorkbenchRestored was not implemented in the driver in previous releases (#197068) 2023-10-31 13:43:02 +01:00
Sandeep Somavarapu 519c8072f3
poll to wait for workbench to be restored (#197059) 2023-10-31 11:23:50 +01:00
Sandeep Somavarapu bee0ea18bd
Move wait for workbench restoration to Application (#197053)
#195850: Move wait for workbench restoration to
Application#checkWindowReady
2023-10-31 09:00:40 +01:00
Raymond Zhao e9e1f8a132
Revert "Separate Settings editor open and search steps" (#196997)
Revert "Separate Settings editor open and search steps (#196866)"

This reverts commit 932e49579b.
2023-10-30 09:53:19 -07:00
Raymond Zhao 932e49579b
Separate Settings editor open and search steps (#196866) 2023-10-30 07:50:27 -07:00
Connor Peet c2a6932e9e
eng: onboard to the extension test runner (#195570)
* eng: onboard to the extension test runner

Adds a `.vscode-test.js` file that uses the new extension test CLI to
run tests. Also, onboards the markdown-language-features as the first
built-in extension to use it.

With the `ms-vscode.extension-test-runner` extension installed, the
markdown-language-features' tests can be run and debugged easily in
the UI :)

* fixup
2023-10-13 13:11:05 -07:00
Raymond Zhao e20515c62e
Bump dependencies for debug sub-dependency (#195513) 2023-10-13 09:01:12 -07:00
Raymond Zhao 88fc434af4
Mitigate smoke test failure #195491 (#195493) 2023-10-12 20:03:27 +02:00
Sandeep Somavarapu 9a611bbe20
retry after waiting for workbench restore (#195300) 2023-10-10 16:05:45 -07:00
Sandeep Somavarapu 2f51809ca3
Fix extensions smoke test (#195264)
#193046
- add waitForWorkbenchRestored method to driver
- move driver to workbench
- wait for workbench to restore if command is not found
2023-10-10 20:11:30 +02:00
Raymond Zhao b63441dbc9
Hide ToC during search if requested (#194821)
Fixes #194812
2023-10-10 09:49:00 -07:00
João Moreno a5d71aad39
Cleanup dependencies (#195026)
* move build dependencies to devDependencies

* build: bump tree-sitter

* dependencies cleanup

* remove leftover file
2023-10-09 09:34:15 +02:00
Tyler James Leonhardt bd41b74fd1
Dedupe strings in tf-idf index & include exactLabelMatch in runCommand in smoke tests (#195085) 2023-10-08 16:47:51 -07:00
Connor Peet c6a9da71a2
eng: allow snapshot mutation messages locally (#194498)
* eng: allow snapshot mutation messages locally

Fixes https://github.com/microsoft/vscode/issues/192439
Fixes https://github.com/microsoft/vscode/issues/194493

* keep snapshot tests allowed
2023-09-29 18:36:27 +01:00
Connor Peet 31067371f2
eng: fix snapshot tests in macos webkit for real? (#193734)
Second attempt at this, which should work. Stop trying to use
exposeFunction, which seems to work poorly on macOS webkit in CI, and
just run a server with HTTP endpoints to do the "RPC."

Reuses Alex's "yaserver" module that we were already using for other
tests. Uses a secure random prefix for security in each run.
2023-09-21 22:48:21 +01:00
Connor Peet 8730f56c09
eng: add io warmup for webkit tests in ci (#193711)
Should fix the issue that @roblourens and @Yoyokrazy were hitting with snapshot tests on macOS WebKit in CI. Not pretty, but I'd rather do this than spend a bunch of time chasing down something that certainly seems to be a browser issue.
2023-09-21 11:03:20 -07:00
Benjamin Pasero 6b9583d2dc
fix (#192807)
* fix

* fix

* fix

* fix
2023-09-11 12:54:53 -07:00
Benjamin Pasero 0c5c400ea5
debt - more polish in global test reporter (#192774)
* debt - more polish in global test reporter

* cleanup

* cleanup

* fixes
2023-09-11 17:16:16 +02:00
Benjamin Pasero edd2f9f3f1
eng - fail test that logs unexpected output (#192700)
eng - fail test that logs
2023-09-11 14:35:48 +02:00
Tyler James Leonhardt a4a2d8f0f4
Rename --disable-keytar to --use-inmemory-secretstorage (#192312)
This renames the flag as the title suggests but keeps `--disable-keytar` in the `deprecates` section so it still works.

Fixes https://github.com/microsoft/vscode/issues/191498
2023-09-08 17:58:32 +02:00
Sandeep Somavarapu 2aa8453e35
Merge pull request #192270 from microsoft/sandy081/dreadful-ferret
#191860 - retry if command is not found
2023-09-06 11:59:04 +02:00
Sandeep Somavarapu 9ed384ffe7
fix while check 2023-09-06 11:10:35 +02:00
Sandeep Somavarapu 7b15902db0
only check for No matching commands text 2023-09-06 10:58:27 +02:00
Sandeep Somavarapu 6e93ce037b
feedback 2023-09-06 10:30:13 +02:00
Robo ab2afd626f
chore: disable hardware acceleration support for linux smoke tests (#192265) 2023-09-06 16:58:16 +09:00
Sandeep Somavarapu 7a0fecc0a7
#191860 - retry if command is not found 2023-09-06 09:36:50 +02:00
Johannes Rieken 137b724984
Merge branch 'main' into joh/corporate-canid 2023-09-05 13:50:57 +02:00
Johannes 8f4d4d4bad
workaround browser bug, fix browser test debugging 2023-09-05 11:47:13 +02:00
Sandeep Somavarapu eafe1c398d
#191860 skip until insiders is released 2023-09-04 17:29:31 +02:00
Sandeep Somavarapu 63d4fe776b
fix #191860 (#192121) 2023-09-04 13:30:46 +02:00