Benjamin Pasero
05de5834b0
smoke - add test to verify an editor can be saved
2021-12-10 13:45:08 +01:00
Benjamin Pasero
4667cac14b
smoke - more obvious tests setup
2021-12-10 13:32:08 +01:00
Rob Lourens
e5637ce9af
Fix #138748
2021-12-09 10:00:25 -08:00
Johannes Rieken
ee3e404b71
disable failing smoketest, https://github.com/microsoft/vscode/issues/138748
2021-12-09 12:53:27 +01:00
Benjamin Pasero
9c7387bb5a
smoke - bring back stable smoke tests
2021-12-09 11:05:41 +01:00
Benjamin Pasero
27e38a8e27
smoke - always create screenshot on failure on desktop
2021-12-09 09:51:55 +01:00
Benjamin Pasero
ae0ee547ba
smoke - reimplement test handlers
2021-12-09 09:33:51 +01:00
Benjamin Pasero
158bd2507e
smoke - always have a logger
2021-12-09 08:48:42 +01:00
Benjamin Pasero
acc0803f38
cleanup automation
2021-12-09 07:03:29 +01:00
Rob Lourens
1341ca3d7f
Remove timeouts in search smoketest.
...
Improvements came from waiting for search to complete before clicking buttons, clearing previous results before starting the search, and adding a retry around the clicking.
2021-12-08 15:34:35 -08:00
Benjamin Pasero
18cba4882d
smoke - more logging
2021-12-08 15:23:27 +01:00
Benjamin Pasero
64562e2a0e
smoke - reimplement logging
2021-12-08 14:13:41 +01:00
Benjamin Pasero
2c68d4de7e
smoke - always log with trace
2021-12-08 10:50:27 +01:00
Benjamin Pasero
fbad065eea
Playwright: record a trace per failing test, not suite ( #138600 )
...
* smoke - record traces per test and not entire suite
* smoke - only persist failing tests
* smoke - cleanup
* smoke - more logging
* smoke - push a test failure to proof the point
* smoke - switch back to chrome for smoke tests
* smoke - warn when exit takes 10s
* Revert "smoke - push a test failure to proof the point"
This reverts commit e572a0c40d
.
2021-12-08 10:09:30 +01:00
Benjamin Pasero
13c0ed811e
🆙 playwright & set trace names ( #138539 )
2021-12-06 19:42:05 +01:00
Benjamin Pasero
2085b19a51
smoke - allow 30s max for deleting test path ( #137725 )
2021-12-06 14:09:02 +01:00
Benjamin Pasero
e8e0fb874d
smoke - disable test that is flaky still
2021-12-06 13:44:01 +01:00
Benjamin Pasero
fe227dacb7
lifecycle - introduce and adopt finalVeto
for backups ( #138055 )
2021-12-06 11:16:57 +01:00
Benjamin Pasero
e1caacebce
backup - cancel pending operations on shutdown and handle cancellation better ( #138055 )
2021-12-06 10:55:33 +01:00
Benjamin Pasero
9d427e4df4
smoke test tweaks
...
- remove timeout on shutdown
- log exactly where time is spend on shutdown (web)
- stop spawning code when terminated
2021-12-02 07:34:13 +01:00
Megan Rogge
4a21019476
fix #138238 , skip failing test
2021-12-01 08:50:26 -08:00
Megan Rogge
c0f21fa378
fix #138239 , skip test
2021-12-01 08:38:28 -08:00
Megan Rogge
7b3078d931
fix #137795
2021-11-30 12:48:58 -08:00
Megan Rogge
7f7fad2f9e
fix #137798
2021-11-30 12:38:52 -08:00
Daniel Imms
faf6f0e1fd
Setup terminal tests for 3 retries to minimize impact on build
...
This isn't a great long term solution but it should help reduce failures
for now.
Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge
005947e3b8
fix #137722
...
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge
e89889fe54
fix #137799
2021-11-30 11:21:01 -08:00
Megan Rogge
18725fc147
set default profile to pwsh for only windows for #137225
2021-11-30 10:57:59 -08:00
Megan Rogge
4be98a3bce
set default to pwsh instead of bash for #137725
2021-11-30 10:21:15 -08:00
Benjamin Pasero
7b6c1065c7
smoke - temporary bring back timeout
2021-11-30 11:04:39 +01:00
Benjamin Pasero
1af6cb0edc
smoke test tweaks
2021-11-29 17:53:11 +01:00
Benjamin Pasero
e241749320
smoke - print more backup info
2021-11-29 14:05:40 +01:00
Benjamin Pasero
5bb653374f
smoke - diagnose failing backup test
2021-11-29 09:56:19 +01:00
Benjamin Pasero
cbbba8e69a
smoke - unique user data dir for stable tests too
2021-11-29 09:11:23 +01:00
Benjamin Pasero
c42793d035
smoke - do not fail build when unable to delete workspace folder (workaround #137725 )
2021-11-29 08:49:37 +01:00
Benjamin Pasero
a5efd80ee0
Revert "smoke - print task list when deleting workspace path fails"
...
This reverts commit 368154bd0b
.
2021-11-29 08:46:35 +01:00
Benjamin Pasero
368154bd0b
smoke - print task list when deleting workspace path fails
2021-11-29 08:04:30 +01:00
Benjamin Pasero
e71b28a444
Smoke test lifecycle changes ( #137969 )
...
* rewrite teardown
* 💄
* avoid spam errors
* 💄
* split spawning browser from electron
* await copyExtension
* cleanup
* refactor methods
* cleanup
* cleanup
* cleanup
* 🆙 deps
2021-11-28 10:30:52 +01:00
Benjamin Pasero
13ff6baa3f
fix smoke tests
2021-11-26 14:45:35 +01:00
Benjamin Pasero
8d250e99e7
smoke - wait for tab becoming dirty before exit
2021-11-26 11:00:15 +01:00
Benjamin Pasero
a11814c57a
smoke - switch away from potentially flaky editors.selectTab
method
2021-11-26 09:22:19 +01:00
Benjamin Pasero
6f2239307b
Smoke test tweaks ( #137809 )
...
* smoke - move data migration tests into one and align
* fix app starting
* `createWorkspaceFile` is not async
* 💄
* support screenshot on failure even for stable app
* smoke - try to remove timeout (#137847 )
* improve exit call
2021-11-25 14:37:22 +01:00
Daniel Imms
eeae10e56c
Skip flaky test
...
Part of #137795
2021-11-24 10:04:38 -08:00
Daniel Imms
653e5cdaee
Skip flaky test
...
Part of #137808
2021-11-24 09:59:22 -08:00
Daniel Imms
f880669743
Merge pull request #137763 from microsoft/tyriar/cleanup_smoke
...
Move terminal smoke tests into a single suite and reduce boilterplate
2021-11-24 09:54:50 -08:00
Daniel Imms
07d986443d
Skipping flaky test
...
Part of #137799
2021-11-24 09:50:26 -08:00
Daniel Imms
42bd3e884b
More clean up of terminal smoke test init
2021-11-23 15:46:51 -08:00
Rob Lourens
2932ec095d
Add retry to quickaccess tests
...
Fix #137733
2021-11-23 15:35:48 -08:00
Daniel Imms
d7f10626b8
Clean up terminal smoke test setup
...
Part of #136064
2021-11-23 15:18:38 -08:00
Daniel Imms
68e491f99f
Re-enable other smoke tests
2021-11-23 14:50:52 -08:00