summaryrefslogtreecommitdiff
path: root/tools/wpt.ts
AgeCommit message (Collapse)Author
2023-05-10chore(core): Parallelize all WPT tests and reduce timeouts for expected ↵Matt Mastracci
failures (#19061) This speeds up WPT tests in two ways: 1. The `WebCryptoAPI` tests are slow, so create a parallel bucket for each individual test instead of one for all the `WebCryptoAPI` tests. 2. If a test is expected to fail, use a shorter timeout (1 minute rather than 4).
2023-04-13chore: add test duration to WPT (#18680)Bartek Iwańczuk
To make it easier to debug which tests are slowing us down. Tests taking more than 5s have duration printed in red, taking more than 1s in yellow and less than 1s are printed without color.
2023-03-03wpt: unlock nightly with --no-ignore (#17998)Filip Skokan
When I was testing the code in #17892 I had updated expectations and didn't catch this. This PR fixes the the expectation file format to not be checked when --no-ignore is passed during [nightly](https://github.com/denoland/deno/actions/runs/4319520368/jobs/7538796572#step:9:46) runs.
2023-03-02test(wpt): implement process timeout, fix expectations update, and more... ↵Filip Skokan
(#17892) - relands #17872 - updates the timeouts to be re-configurable just for CI - fixes `./tools/wpt.ts update` - adds option not "ignore" during, applied to wpt epoch runs only
2023-01-16chore: update dlint to v0.37.0 for GitHub Actions (#17295)Kenta Moriuchi
Updated third_party dlint to v0.37.0 for GitHub Actions. This PR includes following changes: * fix(prefer-primordials): Stop using array pattern assignments * fix(prefer-primordials): Stop using global intrinsics except for `SharedArrayBuffer` * feat(guard-for-in): Apply new guard-for-in rule
2023-01-15chore: update std submodule and its imports (#17408)Asher Gomez
2023-01-12chore(ci): try some wpt parallelism (#17375)David Sherret
2023-01-02chore: update copyright year to 2023 (#17247)David Sherret
Yearly tradition of creating extra noise in git.
2022-09-27chore(wpt): add ability to ignore a test file (#16056)Bartek Iwańczuk
2022-08-05chore(tools): update wpt setup to new spawn api (#15407)Nayeem Rahman
2022-05-18refactor: use spawn API across codebase (#14414)Leo Kettmeir
2022-04-16fix(tools/wpt): replace deprecated writeAllSync and writeAll (#14282)Feng Yu
2022-01-20chore: update copyright year (#13434)Yoshiya Hinosawa
2022-01-06chore(wpt): add "--inspect-brk" flag to WPT runner (#13267)Sean Michael Wykes
2021-10-17chore(wpt): disable broken tests (#12385)Bert Belder
* 'request-upload.h2' and 'redirect-upload.h2' only work with a functional HTTP2 test harness server, otherwise they're flaky. * Fetch request streaming tests require a server that doesn't choke on requests that use 'Transfer-Encoding: chunked'.
2021-10-08chore(wpt): Enable WPT worker tests (#12222)Andreu Botella
Classic workers were implemented in denoland#11338, which also enabled the WPT tests in the `workers` directory. However, the rest of WPT worker tests were not enabled because a number of them were hanging due to web-platform-tests/wpt#29777. Now that that WPT issue is fixed, the bulk of worker tests can be enabled. There are still a few tests that hang, and so haven't been enabled. In particular: - The following tests seem to hang because a promise fails to resolve. We can detect such cases in non-worker tests because the process will exit without calling the WPT completion callback, but in worker tests the worker message ops will keep the event loop running. This will be fixed when we add timeouts to WPT tests (denoland#9460). - `/fetch/api/basic/error-after-response.any.worker.html` - `/html/webappapis/microtask-queuing/queue-microtask-exceptions.any.worker.html` - `/webmessaging/message-channels/worker-post-after-close.any.worker.html` - `/webmessaging/message-channels/worker.any.worker.html` - `/websockets/Create-on-worker-shutdown.any.worker.html` - The following tests apparently hang because a promise rejection is never handled, which will kill the process in the main thread but not in workers (denoland#12221). - `/streams/readable-streams/async-iterator.any.worker.html` - `/workers/interfaces/WorkerUtils/importScripts/report-error-setTimeout-cross-origin.sub.any.worker.html` - `/workers/interfaces/WorkerUtils/importScripts/report-error-setTimeout-redirect-to-cross-origin.sub.any.worker.html` - `/workers/interfaces/WorkerUtils/importScripts/report-error-setTimeout-same-origin.sub.any.worker.html`
2021-08-16feat(runtime): support classic workers for internal testing (#11338)Andreu Botella
This commit implements classic workers, but only when the `--enable-testing-features-do-not-use` flag is provided. This change is not user facing. Classic workers are used extensively in WPT tests. The classic workers do not support loading from disk, and do not support TypeScript. Co-authored-by: Luca Casonato <hello@lcas.dev>
2021-07-12chore(wpt): Mark a WPT test as failed if it exits before completion (#11371)Andreu Botella
Currently, a WPT test is considered failed if its status code is anything other than 0, regardless of whether the test suite completed running or not, and any subtests that haven't finished running are not considered to be failures. But a test can exit with a zero status code before it has completed running, if the event loop has run out of tasks because of a bug in one of the ops, leading to false positives. This change fixes that.
2021-07-07Revert "tests: parallelize test runs in wpt" (#11321)Luca Casonato
This reverts commit 7edb1d713c036583e2ba3caf0df042835781a49c.
2021-07-07tests: escape lone surrogates in wptreport (#11310)Andreu Botella
2021-07-06tests: parallelize test runs in wpt (#11306)Luca Casonato
2021-06-26chore: use local deno_std in tools scripts (#11122)Bartek Iwańczuk
2021-06-23tests: fix bug in WPT test harness (#10920)Bert Belder
2021-06-14tests: fix wpt epoch ci job (#10960)Luca Casonato
2021-06-06tests: generate and upload wptreport.json (#10869)Luca Casonato
These reports can be consumed by tools like `wptreport` or https://wpt.fyi. The old style report could be removed in a future PR when wpt.deno.land is updated.
2021-06-05tests: fix wpt runner expected test file failures (#10856)Luca Casonato
2021-06-03build: collect wpt results as json (#10823)Luca Casonato
2021-05-10feat: add WebStorage API (#7819)crowlKats
This commit introduces localStorage and sessionStorage.
2021-05-09chore: update wpt (#10509)Luca Casonato
2021-02-19chore: rename default branch to main (#9503)Luca Casonato
2021-01-28fix(tools): fix typo in wpt cli output (#9303)Dezső Mészáros
2021-01-27tests: new typescript WPT runner (#9269)Luca Casonato