deno/.github
Matt Mastracci dcbbcd23f5
refactor: split integration tests from CLI (part 1) (#22308)
This PR separates integration tests from CLI tests into a new project
named `cli_tests`. This is a prerequisite for an integration test runner
that can work with either the CLI binary in the current project, or one
that is built ahead of time.

## Background

Rust does not have the concept of artifact dependencies yet
(https://github.com/rust-lang/cargo/issues/9096). Because of this, the
only way we can ensure a binary is built before running associated tests
is by hanging tests off the crate with the binary itself.

Unfortunately this means that to run those tests, you _must_ build the
binary and in the case of the deno executable that might be a 10 minute
wait in release mode.

## Implementation

To allow for tests to run with and without the requirement that the
binary is up-to-date, we split the integration tests into a project of
their own. As these tests would not require the binary to build itself
before being run as-is, we add a stub integration `[[test]]` target in
the `cli` project that invokes these tests using `cargo test`.

The stub test runner we add has `harness = false` so that we can get
access to a `main` function. This `main` function's sole job is to
`execvp` the command `cargo test -p deno_cli`, effectively "calling"
another cargo target.

This ensures that the deno executable is always correctly rebuilt before
running the stub test runner from `cli`, and gets us closer to be able
to run the entire integration test suite on arbitrary deno executables
(and therefore split the build into multiple phases).

The new `cli_tests` project lives within `cli` to avoid a large PR. In
later PRs, the test data will be split from the `cli` project. As there
are a few thousand files, it'll be better to do this as a completely
separate PR to avoid noise.
2024-02-09 13:33:05 -07:00
..
ISSUE_TEMPLATE chore: fix issue template discord link (#21885) 2024-01-10 12:43:45 +01:00
mtime_cache chore: upgrade CI workflows to use Node 20 (#22304) 2024-02-06 21:47:44 +00:00
workflows refactor: split integration tests from CLI (part 1) (#22308) 2024-02-09 13:33:05 -07:00
CODE_OF_CONDUCT.md Update code-of-conduct email (#18162) 2023-03-13 17:14:06 +00:00
PULL_REQUEST_TEMPLATE.md chore: Update PR template (#22340) 2024-02-07 19:54:08 -07:00
SECURITY.md chore: update SECURITY.md (#21766) 2024-01-02 17:53:01 -05:00