2018-07-09 16:30:20 +00:00
|
|
|
---
|
|
|
|
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
# Main collection of env. vars to set for all tasks and scripts.
|
2018-07-09 16:30:20 +00:00
|
|
|
env:
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
####
|
|
|
|
#### Global variables used for all tasks
|
|
|
|
####
|
2019-07-18 20:23:30 +00:00
|
|
|
# Name of the ultimate destination branch for this CI run, PR or post-merge.
|
2019-07-10 14:14:00 +00:00
|
|
|
DEST_BRANCH: "master"
|
2018-07-09 16:30:20 +00:00
|
|
|
# Overrides default location (/tmp/cirrus) for repo clone
|
2020-06-25 21:38:33 +00:00
|
|
|
GOPATH: &gopath "/var/tmp/go"
|
2020-01-31 17:50:27 +00:00
|
|
|
GOBIN: "${GOPATH}/bin"
|
2020-06-25 21:38:33 +00:00
|
|
|
GOCACHE: "${GOPATH}/cache"
|
|
|
|
GOSRC: &gosrc "/var/tmp/go/src/github.com/containers/podman"
|
|
|
|
CIRRUS_WORKING_DIR: *gosrc
|
2019-03-22 13:44:03 +00:00
|
|
|
# The default is 'sh' if unspecified
|
2018-07-09 16:30:20 +00:00
|
|
|
CIRRUS_SHELL: "/bin/bash"
|
|
|
|
# Save a little typing (path relative to $CIRRUS_WORKING_DIR)
|
|
|
|
SCRIPT_BASE: "./contrib/cirrus"
|
2020-10-22 12:19:31 +00:00
|
|
|
# Runner statistics log file path/name
|
|
|
|
STATS_LOGFILE_SFX: 'runner_stats.log'
|
|
|
|
STATS_LOGFILE: '$GOSRC/${CIRRUS_TASK_NAME}-${STATS_LOGFILE_SFX}'
|
CI: format cirrus logs
This introduces a new cirrus helper script, logformatter.
Usage is:
[commands...] | logformatter TEST-NAME
It reformats its input into a readable, highlighed, linkable
form. Some features:
- boring stuff (timestamps, standard podman options) is
deemphasized
- important stuff (warnings, errors) is emphasized
- in-page links to the actual failures
- active links to source files
- jumps to bottom of page on load, because that's where
the errors are. (All errors are linked)
Add it to select test commands (integration, system) and
add a new artifacts_html, run in the 'always' block, which
uploads generated *.log.html into Cirrus; from there we
generate a live URL that can be viewed in browser.
Unfortunately, due to security concerns in Cirrus, it is
not currently possible to make the link a live one.
Kludge: add a line of dashes after Restoring images; without this,
the first test ("systemd PID 1") has no dashes before it, so
logformatter doesn't see it.
Signed-off-by: Ed Santiago <santiago@redhat.com>
2020-02-27 15:17:37 +00:00
|
|
|
|
2019-01-17 17:30:27 +00:00
|
|
|
####
|
2019-08-07 14:39:05 +00:00
|
|
|
#### Cache-image names to test with (double-quotes around names are critical)
|
2020-06-25 21:38:33 +00:00
|
|
|
####
|
2021-03-01 15:18:59 +00:00
|
|
|
FEDORA_NAME: "fedora-34beta"
|
|
|
|
PRIOR_FEDORA_NAME: "fedora-33"
|
2020-11-12 14:10:18 +00:00
|
|
|
UBUNTU_NAME: "ubuntu-2010"
|
|
|
|
PRIOR_UBUNTU_NAME: "ubuntu-2004"
|
2020-03-04 18:36:48 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Google-cloud VM Images
|
2021-03-01 15:18:59 +00:00
|
|
|
IMAGE_SUFFIX: "c5032481331085312"
|
2020-06-25 21:38:33 +00:00
|
|
|
FEDORA_CACHE_IMAGE_NAME: "fedora-${IMAGE_SUFFIX}"
|
|
|
|
PRIOR_FEDORA_CACHE_IMAGE_NAME: "prior-fedora-${IMAGE_SUFFIX}"
|
|
|
|
UBUNTU_CACHE_IMAGE_NAME: "ubuntu-${IMAGE_SUFFIX}"
|
|
|
|
PRIOR_UBUNTU_CACHE_IMAGE_NAME: "prior-ubuntu-${IMAGE_SUFFIX}"
|
2019-01-17 17:30:27 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Container FQIN's
|
|
|
|
FEDORA_CONTAINER_FQIN: "quay.io/libpod/fedora_podman:${IMAGE_SUFFIX}"
|
|
|
|
PRIOR_FEDORA_CONTAINER_FQIN: "quay.io/libpod/prior-fedora_podman:${IMAGE_SUFFIX}"
|
|
|
|
UBUNTU_CONTAINER_FQIN: "quay.io/libpod/ubuntu_podman:${IMAGE_SUFFIX}"
|
|
|
|
PRIOR_UBUNTU_CONTAINER_FQIN: "quay.io/libpod/prior-ubuntu_podman:${IMAGE_SUFFIX}"
|
2019-03-04 21:57:20 +00:00
|
|
|
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
####
|
2020-06-25 21:38:33 +00:00
|
|
|
#### Control variables that determine what to run and how to run it.
|
|
|
|
#### N/B: Required ALL of these are set for every single task.
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
####
|
2021-01-21 19:56:34 +00:00
|
|
|
TEST_FLAVOR: # int, sys, ext_svc, validate, automation, etc.
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_ENVIRON: host # 'host' or 'container'
|
|
|
|
PODBIN_NAME: podman # 'podman' or 'remote'
|
|
|
|
PRIV_NAME: root # 'root' or 'rootless'
|
2020-10-06 18:12:49 +00:00
|
|
|
DISTRO_NV: # any {PRIOR_,}{FEDORA,UBUNTU}_NAME value
|
2020-06-25 21:38:33 +00:00
|
|
|
VM_IMAGE_NAME: # One of the "Google-cloud VM Images" (above)
|
|
|
|
CTR_FQIN: # One of the "Container FQIN's" (above)
|
2020-01-29 20:38:51 +00:00
|
|
|
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Default timeout for each task
|
|
|
|
timeout_in: 60m
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
|
2019-03-19 21:14:40 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
gcp_credentials: ENCRYPTED[a28959877b2c9c36f151781b0a05407218cda646c7d047fc556e42f55e097e897ab63ee78369dae141dcf0b46a9d0cdd]
|
|
|
|
|
|
|
|
|
|
|
|
# Attempt to prevent flakes by confirming all required external/3rd-party
|
|
|
|
# services are available and functional.
|
|
|
|
ext_svc_check_task:
|
|
|
|
alias: 'ext_svc_check' # int. ref. name - required for depends_on reference
|
|
|
|
name: "Ext. services" # Displayed Title - has no other significance
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: &tags "$CIRRUS_TAG != ''" # Don't run on tags
|
2020-06-25 21:38:33 +00:00
|
|
|
# Default/small container image to execute tasks with
|
|
|
|
container: &smallcontainer
|
|
|
|
image: ${CTR_FQIN}
|
|
|
|
# Resources are limited across ALL currently executing tasks
|
|
|
|
# ref: https://cirrus-ci.org/guide/linux/#linux-containers
|
|
|
|
cpu: 2
|
|
|
|
memory: 2
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: ext_svc
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
2021-01-21 19:56:34 +00:00
|
|
|
# NOTE: The default way Cirrus-CI clones is *NOT* compatible with
|
|
|
|
# environment expectations in contrib/cirrus/lib.sh. Specifically
|
|
|
|
# the 'origin' remote must be defined, and all remote branches/tags
|
|
|
|
# must be available for reference from CI scripts.
|
|
|
|
clone_script: &full_clone |
|
|
|
|
cd /
|
|
|
|
rm -rf $CIRRUS_WORKING_DIR
|
|
|
|
mkdir -p $CIRRUS_WORKING_DIR
|
|
|
|
git clone --recursive --branch=$DEST_BRANCH https://x-access-token:${CIRRUS_REPO_CLONE_TOKEN}@github.com/${CIRRUS_REPO_FULL_NAME}.git $CIRRUS_WORKING_DIR
|
|
|
|
cd $CIRRUS_WORKING_DIR
|
|
|
|
git remote update origin
|
|
|
|
if [[ -n "$CIRRUS_PR" ]]; then # running for a PR
|
|
|
|
git fetch origin pull/$CIRRUS_PR/head:pull/$CIRRUS_PR
|
|
|
|
git checkout pull/$CIRRUS_PR
|
|
|
|
else
|
|
|
|
git reset --hard $CIRRUS_CHANGE_IN_REPO
|
|
|
|
fi
|
|
|
|
make install.tools
|
|
|
|
|
2020-10-20 16:01:13 +00:00
|
|
|
setup_script: &setup '$GOSRC/$SCRIPT_BASE/setup_environment.sh'
|
2020-10-22 12:19:31 +00:00
|
|
|
main_script: &main '/usr/bin/time --verbose --output="$STATS_LOGFILE" $GOSRC/$SCRIPT_BASE/runner.sh'
|
|
|
|
always: &runner_stats
|
|
|
|
runner_stats_artifacts:
|
|
|
|
path: ./*-${STATS_LOGFILE_SFX}
|
|
|
|
type: text/plain
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
|
|
|
# Execute some quick checks to confirm this YAML file and all
|
|
|
|
# automation-related shell scripts are sane.
|
|
|
|
automation_task:
|
|
|
|
alias: 'automation'
|
|
|
|
name: "Check Automation"
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: &branches_and_tags "$CIRRUS_PR == '' || $CIRRUS_TAG != ''" # Don't run on branches/tags
|
2020-06-25 21:38:33 +00:00
|
|
|
container: *smallcontainer
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: automation
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
|
|
|
TEST_ENVIRON: container
|
2021-01-21 19:56:34 +00:00
|
|
|
clone_script: *full_clone
|
2020-06-25 21:38:33 +00:00
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
|
|
|
# N/B: This task is critical. It builds all binaries and release archives
|
|
|
|
# for the project, using all primary OS platforms and versions. Assuming
|
|
|
|
# the builds are successful, a cache is stored of the entire `$GOPATH`
|
|
|
|
# contents. For all subsequent tasks, the _BUILD_CACHE_HANDLE value
|
|
|
|
# is used as a key to reuse this cache, saving both time and money.
|
|
|
|
# The only exceptions are tasks which only run inside a container, they
|
|
|
|
# will not have access the cache and therefore must rely on cloning the
|
|
|
|
# repository.
|
|
|
|
build_task:
|
|
|
|
alias: 'build'
|
|
|
|
name: 'Build for $DISTRO_NV'
|
|
|
|
gce_instance: &standardvm
|
|
|
|
image_project: libpod-218412
|
|
|
|
zone: "us-central1-a"
|
|
|
|
cpu: 2
|
|
|
|
memory: "4Gb"
|
|
|
|
# Required to be 200gig, do not modify - has i/o performance impact
|
|
|
|
# according to gcloud CLI tool warning messages.
|
|
|
|
disk: 200
|
|
|
|
image_name: "${VM_IMAGE_NAME}" # from stdenvars
|
|
|
|
matrix: &platform_axis
|
|
|
|
# Ref: https://cirrus-ci.org/guide/writing-tasks/#matrix-modification
|
|
|
|
- env: &stdenvars
|
|
|
|
DISTRO_NV: ${FEDORA_NAME}
|
|
|
|
# Not used here, is used in other tasks
|
|
|
|
VM_IMAGE_NAME: ${FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
|
|
|
# ID for re-use of build output
|
|
|
|
_BUILD_CACHE_HANDLE: ${FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
2021-03-01 15:18:59 +00:00
|
|
|
- env:
|
|
|
|
DISTRO_NV: ${PRIOR_FEDORA_NAME}
|
|
|
|
VM_IMAGE_NAME: ${PRIOR_FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${PRIOR_FEDORA_CONTAINER_FQIN}
|
|
|
|
_BUILD_CACHE_HANDLE: ${PRIOR_FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
2020-06-25 21:38:33 +00:00
|
|
|
- env:
|
|
|
|
DISTRO_NV: ${UBUNTU_NAME}
|
|
|
|
VM_IMAGE_NAME: ${UBUNTU_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${UBUNTU_CONTAINER_FQIN}
|
|
|
|
_BUILD_CACHE_HANDLE: ${UBUNTU_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
- env:
|
|
|
|
DISTRO_NV: ${PRIOR_UBUNTU_NAME}
|
|
|
|
VM_IMAGE_NAME: ${PRIOR_UBUNTU_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${PRIOR_UBUNTU_CONTAINER_FQIN}
|
|
|
|
_BUILD_CACHE_HANDLE: ${PRIOR_UBUNTU_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: build
|
|
|
|
# Ref: https://cirrus-ci.org/guide/writing-tasks/#cache-instruction
|
|
|
|
gopath_cache: &gopath_cache
|
|
|
|
folder: *gopath # Required hard-coded path, no variables.
|
|
|
|
fingerprint_script: echo "$_BUILD_CACHE_HANDLE"
|
|
|
|
# Cheat: Clone here when cache is empty, guaranteeing consistency.
|
|
|
|
populate_script: *full_clone
|
|
|
|
# A normal clone would invalidate useful cache
|
|
|
|
clone_script: &noop mkdir -p $CIRRUS_WORKING_DIR
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: &binary_artifacts
|
2020-10-22 12:19:31 +00:00
|
|
|
<<: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
gosrc_artifacts:
|
|
|
|
path: ./* # Grab everything in top-level $GOSRC
|
|
|
|
type: application/octet-stream
|
|
|
|
binary_artifacts:
|
|
|
|
path: ./bin/*
|
|
|
|
type: application/octet-stream
|
|
|
|
|
2020-10-12 18:12:40 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Confirm the result of building on at least one platform appears sane.
|
|
|
|
# This confirms the binaries can be executed, checks --help vs docs, and
|
|
|
|
# other essential post-build validation checks.
|
|
|
|
validate_task:
|
|
|
|
name: "Validate $DISTRO_NV Build"
|
|
|
|
alias: validate
|
2021-01-21 19:56:34 +00:00
|
|
|
# This task is primarily intended to catch human-errors early on, in a
|
|
|
|
# PR. Skip it for branch-push, branch-create, and tag-push to improve
|
|
|
|
# automation reliability/speed in those contexts. Any missed errors due
|
|
|
|
# to nonsequential PR merging practices, will be caught on a future PR,
|
|
|
|
# build or test task failures.
|
|
|
|
skip: *branches_and_tags
|
2020-04-15 16:01:23 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- ext_svc_check
|
|
|
|
- automation
|
|
|
|
- build
|
|
|
|
# golangci-lint is a very, very hungry beast.
|
|
|
|
gce_instance: &bigvm
|
|
|
|
<<: *standardvm
|
|
|
|
cpu: 8
|
|
|
|
memory: "16Gb"
|
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: validate
|
|
|
|
gopath_cache: &ro_gopath_cache
|
|
|
|
<<: *gopath_cache
|
|
|
|
reupload_on_changes: false
|
|
|
|
clone_script: *noop
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
2020-10-12 18:12:40 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Exercise the "libpod" API with a small set of common
|
|
|
|
# operations to ensure they are functional.
|
|
|
|
bindings_task:
|
|
|
|
name: "Test Bindings"
|
|
|
|
alias: bindings
|
2020-11-10 19:01:23 +00:00
|
|
|
only_if: ¬_docs $CIRRUS_CHANGE_TITLE !=~ '.*CI:DOCS.*'
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *branches_and_tags
|
2020-02-03 19:39:18 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
|
|
|
gce_instance: *standardvm
|
2020-02-03 19:39:18 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: bindings
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
2021-01-19 15:42:25 +00:00
|
|
|
# Build the "libpod" API documentation `swagger.yaml` and
|
|
|
|
# publish it to google-cloud-storage (GCS).
|
2020-06-25 21:38:33 +00:00
|
|
|
swagger_task:
|
|
|
|
name: "Test Swagger"
|
|
|
|
alias: swagger
|
|
|
|
depends_on:
|
|
|
|
- build
|
2021-01-19 15:42:25 +00:00
|
|
|
gce_instance: *standardvm
|
2020-06-25 21:38:33 +00:00
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: swagger
|
2021-01-19 15:42:25 +00:00
|
|
|
# TODO: Due to podman 3.0 activity (including new images), avoid
|
|
|
|
# disturbing the status-quo just to incorporate this one new
|
|
|
|
# container image. Uncomment line below when CI activities normalize.
|
|
|
|
#CTR_FQIN: 'quay.io/libpod/gcsupld:${IMAGE_SUFFIX}'
|
|
|
|
CTR_FQIN: 'quay.io/libpod/gcsupld:c4813063494828032'
|
|
|
|
GCPJSON: ENCRYPTED[927dc01e755eaddb4242b0845cf86c9098d1e3dffac38c70aefb1487fd8b4fe6dd6ae627b3bffafaba70e2c63172664e]
|
|
|
|
GCPNAME: ENCRYPTED[c145e9c16b6fb88d476944a454bf4c1ccc84bb4ecaca73bdd28bdacef0dfa7959ebc8171a27b2e4064d66093b2cdba49]
|
|
|
|
GCPPROJECT: 'libpod-218412'
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
clone_script: *noop # Comes from cache
|
2020-06-25 21:38:33 +00:00
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
|
|
|
# Check that all included go modules from other sources match
|
2021-01-19 16:19:46 +00:00
|
|
|
# what is expected in `vendor/modules.txt` vs `go.mod`. Also
|
|
|
|
# make sure that the generated bindings in pkg/bindings/...
|
|
|
|
# are in sync with the code.
|
|
|
|
consistency_task:
|
|
|
|
name: "Test Code Consistency"
|
|
|
|
alias: consistency
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2019-03-19 21:14:40 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
|
|
|
container: *smallcontainer
|
2019-03-19 21:14:40 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
<<: *stdenvars
|
2021-01-19 16:19:46 +00:00
|
|
|
TEST_FLAVOR: consistency
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_ENVIRON: container
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
|
|
|
clone_script: *full_clone # build-cache not available to container tasks
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
|
|
|
# There are several other important variations of podman which
|
|
|
|
# must always build successfully. Most of them are handled in
|
|
|
|
# this task, though a few need dedicated tasks which follow.
|
|
|
|
alt_build_task:
|
|
|
|
name: "$ALT_NAME"
|
|
|
|
alias: alt_build
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2019-05-01 14:37:50 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
2019-05-01 14:37:50 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: "altbuild"
|
|
|
|
gce_instance: *standardvm
|
|
|
|
matrix:
|
|
|
|
- env:
|
|
|
|
ALT_NAME: 'Build Each Commit'
|
|
|
|
- env:
|
|
|
|
ALT_NAME: 'Windows Cross'
|
|
|
|
- env:
|
|
|
|
ALT_NAME: 'Build Without CGO'
|
|
|
|
- env:
|
|
|
|
ALT_NAME: 'Test build RPM'
|
2021-01-11 16:17:42 +00:00
|
|
|
- env:
|
|
|
|
ALT_NAME: 'Alt Arch. Cross'
|
2021-01-13 20:05:04 +00:00
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
clone_script: *noop # Comes from cache
|
2020-06-25 21:38:33 +00:00
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
# Confirm building a statically-linked binary is successful
|
|
|
|
static_alt_build_task:
|
|
|
|
name: "Static Build"
|
|
|
|
alias: static_alt_build
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2018-12-12 12:57:18 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
|
|
|
# Community-maintained task, may fail on occasion. If so, uncomment
|
|
|
|
# the next line and file an issue with details about the failure.
|
2021-01-28 16:47:05 +00:00
|
|
|
# allow_failures: $CI == $CI
|
2020-06-25 21:38:33 +00:00
|
|
|
gce_instance: *bigvm
|
2020-02-27 16:43:47 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: "altbuild"
|
|
|
|
# gce_instance variation prevents this being included in alt_build_task
|
|
|
|
ALT_NAME: 'Static build'
|
|
|
|
# Do not use 'latest', fixed-version tag for runtime stability.
|
|
|
|
CTR_FQIN: "docker.io/nixos/nix:2.3.6"
|
2021-01-25 11:02:22 +00:00
|
|
|
# Authentication token for pushing the build cache to cachix.
|
|
|
|
# This is critical, it helps to avoid a very lengthy process of
|
|
|
|
# statically building every dependency needed to build podman.
|
|
|
|
# Assuming the pinned nix dependencies in nix/nixpkgs.json have not
|
|
|
|
# changed, this cache will ensure that only the static podman binary is
|
|
|
|
# built.
|
|
|
|
CACHIX_AUTH_TOKEN: ENCRYPTED[df0d4d0a67474e8ea49cc503221dcb912b7e2ba45c8ec4bf2e5fd9c49a18ac21c24bacee59b5393355ed9e4358d2baef]
|
2020-06-25 21:38:33 +00:00
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|
2019-07-10 13:52:31 +00:00
|
|
|
|
2019-06-29 20:30:57 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Confirm building the remote client, natively on a Mac OS-X VM.
|
|
|
|
osx_alt_build_task:
|
|
|
|
name: "OSX Cross"
|
|
|
|
alias: osx_alt_build
|
2019-06-29 20:30:57 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
2020-02-27 16:43:47 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
<<: *stdenvars
|
|
|
|
# OSX platform variation prevents this being included in alt_build_task
|
|
|
|
TEST_FLAVOR: "altbuild"
|
|
|
|
ALT_NAME: 'OSX Cross'
|
|
|
|
osx_instance:
|
|
|
|
image: 'catalina-base'
|
|
|
|
script:
|
|
|
|
- brew install go
|
|
|
|
- brew install go-md2man
|
|
|
|
- make podman-remote-darwin
|
|
|
|
- make install-podman-remote-darwin-docs
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|
2019-06-14 17:28:47 +00:00
|
|
|
|
2020-04-16 17:25:26 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# This task is a stub: In the future it will be used to verify
|
|
|
|
# podman is compatible with the docker python-module.
|
|
|
|
docker-py_test_task:
|
|
|
|
name: Docker-py Compat.
|
|
|
|
alias: docker-py_test
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
Cirrus: Document and codify base-image production
A number of images required for future testing are not present in GCE.
Importing them is a long proscribed process prone to errors and
complications.
Improve this situation by documenting, and encoding the majority of the
steps required. Due to the required complexity, these are clearly
identified as 'semi-automated'. This means a discerning eye is
sometimes needed to address unforeseen problems (networking issues,
format or packaging changes, etc).
Nevertheless, having these steps in writing, will reduce current and
future maintenance burden while supporting future testing needs of
RHEL, Fedora and Fedora Atomic Host.
Also:
* Add necessary configuration, scripts, and Makefile updates needed to
prepare RHEL, Fedora, & FAH cloud images for use in GCE. This
is a complex, multi-step process where the cloud image is booted
un a local user-mod qemu-kvm instance, where it can be modified.
From there, it's converted into a specific format, and imported into
GCE. Lastly, the imported raw disk data is made available as a GCE
VM image.
Note: As of this commit, the RHEL base-image builds (CentOS has native
image), however neither RHEL or CentOS cache-images build correctly.
* Left testing on FAH disabled, the GCE/Cirrus integration needs needs more
work. Specifically, the python3-based google startup script service
throws a permission-denied (as root) when trying to create a temp.
directory. Did not investigate further, though manually running the
startup script does allow the libpod tests to start running.
* Enabled Fedora 29 image to execute tests and general use.
* Utilize the standardized F28-based container image for gating
of more the intensive unit and integration testing. Update
documentation to reflect this as the standard platform for
these checks. Rename tasks with shorter names and to better
reflect their purpose.
* Cirrus: Trim unnecessary env vars before testing since the vast
majority are only required for orchestration purposes. Since most
are defined within `.cirrus.yml`, it's a good place to store the
list of undesirables. Since each of the cirrus-scripts runs in
it's own shell, unsetting these near the end will have no
consequence. Also trim down the number of calls to show_env_vars()
Signed-off-by: Chris Evich <cevich@redhat.com>
2018-11-07 14:35:18 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- build
|
2020-10-14 15:39:27 +00:00
|
|
|
gce_instance: *standardvm
|
2020-06-25 21:38:33 +00:00
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: docker-py
|
|
|
|
TEST_ENVIRON: container
|
|
|
|
gopath_cache: *ro_gopath_cache
|
2020-10-14 15:39:27 +00:00
|
|
|
clone_script: *noop # Comes from cache
|
2020-06-25 21:38:33 +00:00
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
2020-10-08 15:47:27 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Does exactly what it says, execute the podman unit-tests on all primary
|
|
|
|
# platforms and release versions.
|
|
|
|
unit_test_task:
|
|
|
|
name: "Unit tests on $DISTRO_NV"
|
|
|
|
alias: unit_test
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2020-06-25 21:38:33 +00:00
|
|
|
depends_on:
|
|
|
|
- validate
|
|
|
|
matrix: *platform_axis
|
|
|
|
gce_instance: *standardvm
|
2019-03-06 16:47:24 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: unit
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-10-22 12:19:31 +00:00
|
|
|
always: *runner_stats
|
2020-06-25 21:38:33 +00:00
|
|
|
|
2020-10-08 15:47:27 +00:00
|
|
|
|
|
|
|
apiv2_test_task:
|
|
|
|
name: "APIv2 test on $DISTRO_NV"
|
|
|
|
alias: apiv2_test
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-10-08 15:47:27 +00:00
|
|
|
depends_on:
|
|
|
|
- validate
|
|
|
|
gce_instance: *standardvm
|
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: apiv2
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: &logs_artifacts
|
2020-10-22 12:19:31 +00:00
|
|
|
<<: *runner_stats
|
2020-11-04 14:33:14 +00:00
|
|
|
# Required for `contrib/cirrus/logformatter` to work properly
|
|
|
|
html_artifacts:
|
|
|
|
path: ./*.html
|
|
|
|
type: text/html
|
2020-10-08 15:47:27 +00:00
|
|
|
package_versions_script: '$SCRIPT_BASE/logcollector.sh packages'
|
|
|
|
df_script: '$SCRIPT_BASE/logcollector.sh df'
|
|
|
|
audit_log_script: '$SCRIPT_BASE/logcollector.sh audit'
|
|
|
|
journal_script: '$SCRIPT_BASE/logcollector.sh journal'
|
|
|
|
podman_system_info_script: '$SCRIPT_BASE/logcollector.sh podman'
|
2020-10-22 12:19:31 +00:00
|
|
|
time_script: '$SCRIPT_BASE/logcollector.sh time'
|
2020-10-08 15:47:27 +00:00
|
|
|
|
2020-12-02 14:45:08 +00:00
|
|
|
compose_test_task:
|
2021-03-31 22:32:56 +00:00
|
|
|
name: "compose test on $DISTRO_NV ($PRIV_NAME)"
|
2020-12-02 14:45:08 +00:00
|
|
|
alias: compose_test
|
2021-01-18 16:17:17 +00:00
|
|
|
only_if: *not_docs
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-12-02 14:45:08 +00:00
|
|
|
depends_on:
|
|
|
|
- validate
|
|
|
|
gce_instance: *standardvm
|
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: compose
|
2021-03-31 22:32:56 +00:00
|
|
|
matrix:
|
|
|
|
- env:
|
|
|
|
PRIV_NAME: root
|
|
|
|
- env:
|
|
|
|
PRIV_NAME: rootless
|
2020-12-02 14:45:08 +00:00
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: *logs_artifacts
|
|
|
|
|
2020-10-08 15:47:27 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Execute the podman integration tests on all primary platforms and release
|
|
|
|
# versions, as root, without involving the podman-remote client.
|
|
|
|
local_integration_test_task: &local_integration_test_task
|
|
|
|
# Integration-test task name convention:
|
|
|
|
# <int.|sys.> <podman|remote> <Distro NV> <root|rootless>
|
|
|
|
name: &std_name_fmt "$TEST_FLAVOR $PODBIN_NAME $DISTRO_NV $PRIV_NAME $TEST_ENVIRON"
|
|
|
|
alias: local_integration_test
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *branches_and_tags
|
2020-06-25 21:38:33 +00:00
|
|
|
depends_on:
|
|
|
|
- unit_test
|
|
|
|
matrix: *platform_axis
|
|
|
|
gce_instance: *standardvm
|
|
|
|
timeout_in: 90m
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: int
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2021-01-26 20:05:00 +00:00
|
|
|
always: &int_logs_artifacts
|
|
|
|
<<: *logs_artifacts
|
|
|
|
ginkgo_node_logs_artifacts:
|
|
|
|
path: ./test/e2e/ginkgo-node-*.log
|
|
|
|
type: text/plain
|
2020-10-08 15:47:27 +00:00
|
|
|
|
2019-03-04 21:57:20 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Nearly identical to `local_integration_test` except all operations
|
|
|
|
# are performed through the podman-remote client vs a podman "server"
|
|
|
|
# running on the same host.
|
|
|
|
remote_integration_test_task:
|
|
|
|
<<: *local_integration_test_task
|
|
|
|
alias: remote_integration_test
|
2019-03-04 21:57:20 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: int
|
|
|
|
PODBIN_NAME: remote
|
2019-06-12 13:59:31 +00:00
|
|
|
|
2019-03-14 15:57:46 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Run the complete set of integration tests from inside a container.
|
|
|
|
# This verifies all/most operations function with "podman-in-podman".
|
|
|
|
container_integration_test_task:
|
|
|
|
name: *std_name_fmt
|
|
|
|
alias: container_integration_test
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *branches_and_tags
|
2019-05-30 15:56:21 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- unit_test
|
|
|
|
matrix: &fedora_vm_axis
|
|
|
|
- env:
|
|
|
|
DISTRO_NV: ${FEDORA_NAME}
|
|
|
|
_BUILD_CACHE_HANDLE: ${FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
VM_IMAGE_NAME: ${FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
2021-03-01 15:18:59 +00:00
|
|
|
- env:
|
|
|
|
DISTRO_NV: ${PRIOR_FEDORA_NAME}
|
|
|
|
_BUILD_CACHE_HANDLE: ${PRIOR_FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
VM_IMAGE_NAME: ${PRIOR_FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${PRIOR_FEDORA_CONTAINER_FQIN}
|
2020-06-25 21:38:33 +00:00
|
|
|
gce_instance: *standardvm
|
|
|
|
timeout_in: 90m
|
2019-05-30 15:56:21 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: int
|
|
|
|
TEST_ENVIRON: container
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2021-01-26 20:05:00 +00:00
|
|
|
always: *int_logs_artifacts
|
2020-06-25 21:38:33 +00:00
|
|
|
|
2020-11-04 14:33:14 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Execute most integration tests as a regular (non-root) user.
|
|
|
|
rootless_integration_test_task:
|
|
|
|
name: *std_name_fmt
|
|
|
|
alias: rootless_integration_test
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *branches_and_tags
|
2019-05-10 23:02:01 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- unit_test
|
|
|
|
matrix: *fedora_vm_axis
|
|
|
|
gce_instance: *standardvm
|
|
|
|
timeout_in: 90m
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: int
|
|
|
|
PRIV_NAME: rootless
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2021-01-26 20:05:00 +00:00
|
|
|
always: *int_logs_artifacts
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
|
|
|
|
# Always run subsequent to integration tests. While parallelism is lost
|
|
|
|
# with runtime, debugging system-test failures can be more challenging
|
|
|
|
# for some golang developers. Otherwise the following tasks run across
|
|
|
|
# the same matrix as the integration-tests (above).
|
|
|
|
local_system_test_task: &local_system_test_task
|
|
|
|
name: *std_name_fmt
|
|
|
|
alias: local_system_test
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2020-02-20 17:01:14 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- local_integration_test
|
|
|
|
matrix: *platform_axis
|
|
|
|
gce_instance: *standardvm
|
2020-02-20 17:01:14 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: sys
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: *logs_artifacts
|
2020-02-20 17:01:14 +00:00
|
|
|
|
2019-08-28 16:39:36 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
remote_system_test_task:
|
|
|
|
<<: *local_system_test_task
|
|
|
|
alias: remote_system_test
|
2019-08-11 16:47:15 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- remote_integration_test
|
2019-08-11 16:47:15 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: sys
|
|
|
|
PODBIN_NAME: remote
|
2019-08-28 16:39:36 +00:00
|
|
|
|
2021-02-09 21:33:19 +00:00
|
|
|
buildah_bud_test_task:
|
|
|
|
name: *std_name_fmt
|
|
|
|
alias: buildah_bud_test
|
|
|
|
skip: *tags
|
|
|
|
only_if: *not_docs
|
|
|
|
depends_on:
|
|
|
|
- local_integration_test
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: bud
|
|
|
|
DISTRO_NV: ${FEDORA_NAME}
|
|
|
|
# Not used here, is used in other tasks
|
|
|
|
VM_IMAGE_NAME: ${FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
|
|
|
# ID for re-use of build output
|
|
|
|
_BUILD_CACHE_HANDLE: ${FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
PODBIN_NAME: podman
|
|
|
|
gce_instance: *standardvm
|
|
|
|
timeout_in: 45m
|
|
|
|
clone_script: *noop
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: *int_logs_artifacts
|
2020-01-17 15:41:40 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
rootless_system_test_task:
|
|
|
|
name: *std_name_fmt
|
|
|
|
alias: rootless_system_test
|
2021-01-06 15:41:29 +00:00
|
|
|
skip: *tags
|
2020-10-12 18:12:40 +00:00
|
|
|
only_if: *not_docs
|
2019-10-31 18:48:06 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- rootless_integration_test
|
|
|
|
matrix: *fedora_vm_axis
|
|
|
|
gce_instance: *standardvm
|
2020-05-12 16:23:35 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
TEST_FLAVOR: sys
|
|
|
|
PRIV_NAME: rootless
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: *logs_artifacts
|
|
|
|
|
2020-12-15 21:40:16 +00:00
|
|
|
# FIXME: we may want to consider running this from nightly cron instead of CI.
|
|
|
|
# The tests are actually pretty quick (less than a minute) but they do rely
|
|
|
|
# on pulling images from quay.io, which means we're subject to network flakes.
|
|
|
|
#
|
|
|
|
# FIXME: how does this env matrix work, anyway? Does it spin up multiple VMs?
|
|
|
|
# We might just want to encode the version matrix in runner.sh instead
|
|
|
|
upgrade_test_task:
|
|
|
|
name: "Upgrade test: from $PODMAN_UPGRADE_FROM"
|
|
|
|
alias: upgrade_test
|
|
|
|
skip: *tags
|
|
|
|
only_if: *not_docs
|
|
|
|
depends_on:
|
|
|
|
- local_system_test
|
|
|
|
matrix:
|
|
|
|
- env:
|
|
|
|
PODMAN_UPGRADE_FROM: v1.9.0
|
|
|
|
- env:
|
|
|
|
PODMAN_UPGRADE_FROM: v2.0.6
|
|
|
|
- env:
|
|
|
|
PODMAN_UPGRADE_FROM: v2.1.1
|
|
|
|
gce_instance: *standardvm
|
|
|
|
env:
|
|
|
|
TEST_FLAVOR: upgrade_test
|
|
|
|
DISTRO_NV: ${FEDORA_NAME}
|
|
|
|
VM_IMAGE_NAME: ${FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
# ID for re-use of build output
|
|
|
|
_BUILD_CACHE_HANDLE: ${FEDORA_NAME}-build-${CIRRUS_BUILD_ID}
|
|
|
|
clone_script: *noop
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
|
|
|
always: *logs_artifacts
|
2020-11-04 14:33:14 +00:00
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# This task is critical. It updates the "last-used by" timestamp stored
|
|
|
|
# in metadata for all VM images. This mechanism functions in tandem with
|
|
|
|
# an out-of-band pruning operation to remove disused VM images.
|
|
|
|
meta_task:
|
|
|
|
name: "VM img. keepalive"
|
|
|
|
alias: meta
|
|
|
|
container:
|
|
|
|
cpu: 2
|
|
|
|
memory: 2
|
|
|
|
image: quay.io/libpod/imgts:$IMAGE_SUFFIX
|
|
|
|
env:
|
|
|
|
# Space-separated list of images used by this repository state
|
|
|
|
IMGNAMES: >-
|
|
|
|
${FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
${PRIOR_FEDORA_CACHE_IMAGE_NAME}
|
|
|
|
${UBUNTU_CACHE_IMAGE_NAME}
|
|
|
|
${PRIOR_UBUNTU_CACHE_IMAGE_NAME}
|
|
|
|
BUILDID: "${CIRRUS_BUILD_ID}"
|
|
|
|
REPOREF: "${CIRRUS_REPO_NAME}"
|
|
|
|
GCPJSON: ENCRYPTED[3a198350077849c8df14b723c0f4c9fece9ebe6408d35982e7adf2105a33f8e0e166ed3ed614875a0887e1af2b8775f4]
|
|
|
|
GCPNAME: ENCRYPTED[2f9738ef295a706f66a13891b40e8eaa92a89e0e87faf8bed66c41eca72bf76cfd190a6f2d0e8444c631fdf15ed32ef6]
|
|
|
|
GCPPROJECT: libpod-218412
|
|
|
|
clone_script: *noop
|
|
|
|
script: /usr/local/bin/entrypoint.sh
|
2019-10-31 18:48:06 +00:00
|
|
|
|
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
# Status aggregator for all tests. This task simply ensures a defined
|
|
|
|
# set of tasks all passed, and allows confirming that based on the status
|
|
|
|
# of this task.
|
2018-12-17 19:31:24 +00:00
|
|
|
success_task:
|
2020-06-25 21:38:33 +00:00
|
|
|
name: "Total Success"
|
|
|
|
alias: success
|
|
|
|
# N/B: ALL tasks must be listed here, minus their '_task' suffix.
|
2019-07-31 13:48:14 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- ext_svc_check
|
|
|
|
- automation
|
|
|
|
- build
|
|
|
|
- validate
|
|
|
|
- bindings
|
|
|
|
- swagger
|
2021-01-19 16:19:46 +00:00
|
|
|
- consistency
|
2020-06-25 21:38:33 +00:00
|
|
|
- alt_build
|
|
|
|
- static_alt_build
|
|
|
|
- osx_alt_build
|
|
|
|
- docker-py_test
|
|
|
|
- unit_test
|
2020-10-08 15:47:27 +00:00
|
|
|
- apiv2_test
|
2020-12-02 14:45:08 +00:00
|
|
|
- compose_test
|
2020-06-25 21:38:33 +00:00
|
|
|
- local_integration_test
|
|
|
|
- remote_integration_test
|
|
|
|
- rootless_integration_test
|
|
|
|
- container_integration_test
|
|
|
|
- local_system_test
|
|
|
|
- remote_system_test
|
|
|
|
- rootless_system_test
|
2020-12-15 21:40:16 +00:00
|
|
|
- upgrade_test
|
2021-02-09 21:33:19 +00:00
|
|
|
- buildah_bud_test
|
2020-06-25 21:38:33 +00:00
|
|
|
- meta
|
|
|
|
container: *smallcontainer
|
2018-12-17 19:31:24 +00:00
|
|
|
env:
|
2020-06-25 21:38:33 +00:00
|
|
|
CTR_FQIN: ${FEDORA_CONTAINER_FQIN}
|
|
|
|
TEST_ENVIRON: container
|
|
|
|
clone_script: *noop
|
|
|
|
script: /bin/true
|
|
|
|
|
|
|
|
|
|
|
|
# When a new tag is pushed, confirm that the code and commits
|
|
|
|
# meet criteria for an official release.
|
|
|
|
release_task:
|
|
|
|
name: "Verify Release"
|
|
|
|
alias: release
|
2021-01-06 15:41:29 +00:00
|
|
|
only_if: *tags
|
2020-03-20 09:55:23 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- success
|
|
|
|
gce_instance: *standardvm
|
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: release
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|
|
|
|
|
2020-06-25 21:38:33 +00:00
|
|
|
|
|
|
|
# When preparing to release a new version, this task may be manually
|
2021-01-06 15:41:29 +00:00
|
|
|
# activated at the PR stage to verify the build is proper for a potential
|
|
|
|
# podman release.
|
|
|
|
#
|
2020-06-25 21:38:33 +00:00
|
|
|
# Note: This cannot use a YAML alias on 'release_task' as of this
|
|
|
|
# comment, it is incompatible with 'trigger_type: manual'
|
|
|
|
release_test_task:
|
|
|
|
name: "Optional Release Test"
|
|
|
|
alias: release_test
|
|
|
|
only_if: $CIRRUS_PR != ''
|
|
|
|
trigger_type: manual
|
2020-09-04 18:11:45 +00:00
|
|
|
depends_on:
|
2020-06-25 21:38:33 +00:00
|
|
|
- success
|
|
|
|
gce_instance: *standardvm
|
|
|
|
env:
|
|
|
|
<<: *stdenvars
|
|
|
|
TEST_FLAVOR: release
|
|
|
|
gopath_cache: *ro_gopath_cache
|
|
|
|
clone_script: *noop # Comes from cache
|
|
|
|
setup_script: *setup
|
|
|
|
main_script: *main
|
2020-11-04 14:33:14 +00:00
|
|
|
always: *binary_artifacts
|