cargo/tests/testsuite/generate_lockfile.rs

231 lines
5.9 KiB
Rust
Raw Normal View History

2019-11-25 02:42:45 +00:00
//! Tests for the `cargo generate-lockfile` command.
use cargo_test_support::registry::{Package, RegistryBuilder};
use cargo_test_support::{basic_manifest, paths, project, ProjectBuilder};
use std::fs;
#[cargo_test]
fn adding_and_removing_packages() {
let p = project()
Implement a registry source # cargo upload The cargo-upload command will take the local package and upload it to the specified registry. The local package is uploaded as a tarball compressed with gzip under maximum compression. Most of this is done by just delegating to `cargo package` The host to upload to is specified, in order of priority, by a command line `--host` flag, the `registry.host` config key, and then the default registry. The default registry is still `example.com` The registry itself is still a work in progress, but the general plumbing for a command such as this would look like: 1. Ensure the local package has been compressed into an archive. 2. Fetch the relevant registry and login token from config files. 3. Ensure all dependencies for a package are listed as coming from the same registry. 4. Upload the archive to the registry with the login token. 5. The registry will verify the package is under 2MB (configurable). 6. The registry will upload the archive to S3, calculating a checksum in the process. 7. The registry will add an entry to the registry's index (a git repository). The entry will include the name of the package, the version uploaded, the checksum of the upload, and then the list of dependencies (name/version req) 8. The local `cargo upload` command will succeed. # cargo login Uploading requires a token from the api server, and this token follows the same config chain for the host except that there is no fallback. To implement login, the `cargo login` command is used. With 0 arguments, the command will request that a site be visited for a login token, and with an argument it will set the argument as the new login token. The `util::config` module was modified to allow writing configuration as well as reading it. The support is a little lacking in that comments are blown away, but the support is there at least. # RegistrySource An implementation of `RegistrySource` has been created (deleting the old `DummyRegistrySource`). This implementation only needs a URL to be constructed, and it is assumed that the URL is running an instance of the cargo registry. ## RegistrySource::update Currently this will unconditionally update the registry's index (a git repository). Tuning is necessary to prevent updating the index each time (more coming soon). ## RegistrySource::query This is called in the resolve phase of cargo. This function is given a dependency to query for, and the source will simply look into the index to see if any package with the name is present. If found, the package's index file will be loaded and parsed into a list of summaries. The main optimization of this function is to not require the entire registry to ever be resident in memory. Instead, only necessary packages are loaded into memory and parsed. ## RegistrySource::download This is also called during the resolve phase of cargo, but only when a package has been selected to be built (actually resolved). This phase of the source will actually download and unpack the tarball for the package. Currently a configuration file is located in the root of a registry's index describing the root url to download packages from. This function is optimized for two different metrics: 1. If a tarball is downloaded, it is not downloaded again. It is assumed that once a tarball is successfully downloaded it will never change. 2. If the unpacking destination has a `.cargo-ok` file, it is assumed that the unpacking has already occurred and does not need to happen again. With these in place, a rebuild should take almost no time at all. ## RegistrySource::get This function is simply implemented in terms of a PathSource's `get` function by creating a `PathSource` for all unpacked tarballs as part of the `download` stage. ## Filesystem layout There are a few new directories as part of the `.cargo` home folder: * `.cargo/registry/index/$hostname-$hash` - This is the directory containing the actual index of the registry. `$hostname` comes from its url, and `$hash` is the hash of the entire url. * `.cargo/registry/cache/$hostname-$hash/$pkg-$vers.tar.gz` - This is a directory used to cache the downloads of packages from the registry. * `.cargo/registry/src/$hostname-$hash/$pkg-$vers` - This is the location of the unpacked packages. They will be compiled from this location. # New Dependencies Cargo has picked up a new dependency on the `curl-rust` package in order to send HTTP requests to the registry as well as send HTTP requests to download tarballs.
2014-07-18 15:40:45 +00:00
.file("src/main.rs", "fn main() {}")
2018-07-24 22:35:01 +00:00
.file("bar/Cargo.toml", &basic_manifest("bar", "0.0.1"))
.file("bar/src/lib.rs", "")
.build();
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock1 = p.read_lockfile();
// add a dep
p.change_file(
"Cargo.toml",
r#"
[package]
name = "foo"
authors = []
version = "0.0.1"
[dependencies.bar]
path = "bar"
"#,
);
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock2 = p.read_lockfile();
assert_ne!(lock1, lock2);
// change the dep
p.change_file("bar/Cargo.toml", &basic_manifest("bar", "0.0.2"));
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock3 = p.read_lockfile();
assert_ne!(lock1, lock3);
assert_ne!(lock2, lock3);
// remove the dep
println!("lock4");
p.change_file(
"Cargo.toml",
r#"
[package]
name = "foo"
authors = []
version = "0.0.1"
"#,
);
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock4 = p.read_lockfile();
assert_eq!(lock1, lock4);
}
#[cargo_test]
fn no_index_update_sparse() {
let _registry = RegistryBuilder::new().http_index().build();
no_index_update();
}
#[cargo_test]
fn no_index_update_git() {
no_index_update();
}
2018-01-31 21:12:19 +00:00
fn no_index_update() {
Package::new("serde", "1.0.0").publish();
let p = project()
2018-03-14 15:17:44 +00:00
.file(
"Cargo.toml",
r#"
2020-09-27 00:59:58 +00:00
[package]
name = "foo"
authors = []
version = "0.0.1"
[dependencies]
serde = "1.0"
"#,
2018-12-08 11:19:47 +00:00
)
.file("src/main.rs", "fn main() {}")
2018-01-31 21:12:19 +00:00
.build();
p.cargo("generate-lockfile")
.with_stderr("[UPDATING] `[..]` index")
.run();
2018-01-31 21:12:19 +00:00
p.cargo("generate-lockfile -Zno-index-update")
.masquerade_as_nightly_cargo(&["no-index-update"])
.with_stdout("")
.with_stderr("")
.run();
2018-01-31 21:12:19 +00:00
}
#[cargo_test]
fn preserve_metadata() {
let p = project()
.file("src/main.rs", "fn main() {}")
2018-07-24 22:35:01 +00:00
.file("bar/Cargo.toml", &basic_manifest("bar", "0.0.1"))
.file("bar/src/lib.rs", "")
.build();
p.cargo("generate-lockfile").run();
let metadata = r#"
[metadata]
bar = "baz"
foo = "bar"
"#;
2016-08-25 08:34:25 +00:00
let lock = p.read_lockfile();
let data = lock + metadata;
p.change_file("Cargo.lock", &data);
// Build and make sure the metadata is still there
p.cargo("build").run();
2016-08-25 08:34:25 +00:00
let lock = p.read_lockfile();
assert!(lock.contains(metadata.trim()), "{}", lock);
// Update and make sure the metadata is still there
p.cargo("update").run();
2016-08-25 08:34:25 +00:00
let lock = p.read_lockfile();
assert!(lock.contains(metadata.trim()), "{}", lock);
}
#[cargo_test]
fn preserve_line_endings_issue_2076() {
let p = project()
.file("src/main.rs", "fn main() {}")
2018-07-24 22:35:01 +00:00
.file("bar/Cargo.toml", &basic_manifest("bar", "0.0.1"))
.file("bar/src/lib.rs", "")
.build();
let lockfile = p.root().join("Cargo.lock");
p.cargo("generate-lockfile").run();
2018-08-29 06:11:10 +00:00
assert!(lockfile.is_file());
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock0 = p.read_lockfile();
2019-01-14 10:20:10 +00:00
assert!(lock0.starts_with("# This file is automatically @generated by Cargo.\n# It is not intended for manual editing.\n"));
let lock1 = lock0.replace("\n", "\r\n");
p.change_file("Cargo.lock", &lock1);
p.cargo("generate-lockfile").run();
2016-08-25 08:34:25 +00:00
let lock2 = p.read_lockfile();
2019-01-14 10:20:10 +00:00
assert!(lock2.starts_with("# This file is automatically @generated by Cargo.\r\n# It is not intended for manual editing.\r\n"));
assert_eq!(lock1, lock2);
}
#[cargo_test]
fn cargo_update_generate_lockfile() {
let p = project().file("src/main.rs", "fn main() {}").build();
let lockfile = p.root().join("Cargo.lock");
2018-08-29 06:11:10 +00:00
assert!(!lockfile.is_file());
2023-11-15 22:33:27 +00:00
p.cargo("update").with_stderr("").run();
2018-08-29 06:11:10 +00:00
assert!(lockfile.is_file());
fs::remove_file(p.root().join("Cargo.lock")).unwrap();
2018-08-29 06:11:10 +00:00
assert!(!lockfile.is_file());
2023-11-15 22:33:27 +00:00
p.cargo("update").with_stderr("").run();
2018-08-29 06:11:10 +00:00
assert!(lockfile.is_file());
}
#[cargo_test]
fn duplicate_entries_in_lockfile() {
let _a = ProjectBuilder::new(paths::root().join("a"))
.file(
"Cargo.toml",
r#"
[package]
name = "a"
authors = []
version = "0.0.1"
[dependencies]
common = {path="common"}
"#,
2018-12-08 11:19:47 +00:00
)
.file("src/lib.rs", "")
.build();
2018-07-24 22:35:01 +00:00
let common_toml = &basic_manifest("common", "0.0.1");
let _common_in_a = ProjectBuilder::new(paths::root().join("a/common"))
.file("Cargo.toml", common_toml)
.file("src/lib.rs", "")
.build();
let b = ProjectBuilder::new(paths::root().join("b"))
.file(
"Cargo.toml",
r#"
[package]
name = "b"
authors = []
version = "0.0.1"
[dependencies]
common = {path="common"}
a = {path="../a"}
"#,
2018-12-08 11:19:47 +00:00
)
.file("src/lib.rs", "")
.build();
let _common_in_b = ProjectBuilder::new(paths::root().join("b/common"))
.file("Cargo.toml", common_toml)
.file("src/lib.rs", "")
.build();
2019-02-03 04:01:23 +00:00
// should fail due to a duplicate package `common` in the lock file
b.cargo("build")
.with_status(101)
.with_stderr_contains(
"[..]package collision in the lockfile: packages common [..] and \
common [..] are different, but only one can be written to \
2018-09-25 07:02:52 +00:00
lockfile unambiguously",
2018-12-08 11:19:47 +00:00
)
.run();
}