systemd/test
Zbigniew Jędrzejewski-Szmek 0f714a34c4 test: drop redirection to tty in integration tests
I *think* this was originally added to make it easier to see what was happening
in tests. Later we added the functionality to print the journal on failure, so
this redirection has stopped being useful.

In https://github.com/systemd/systemd/pull/13719#issuecomment-539292650
@filbranden shows that grep tries to write to stdout and fails. In general,
we should not assume that writing to the console it always possible. We have
special code to handle this in pid1 after all:

99    19:22:10.731965 fstat(1,  <unfinished ...>
99    19:22:10.731993 <... fstat resumed>{st_mode=S_IFCHR|0620, st_rdev=makedev(0x88, 0), ...}) = 0
99    19:22:10.732070 write(1, "ExecStartPost={ path=/bin/echo ; argv[]=/bin/echo ${4_four_ex} ; ignore_errors=no ; start_time=[Mon 2019-10-07 19:22:10 PDT] ; stop_time=[Mon 209-10-07 19:22:10 PDT] ; pid=97 ; code=exited ; status=0 }\n", 203) = -1 EIO (Input/output error)
99    19:22:10.732174 write(2, "grep: ", 6) = -1 EIO (Input/output error)
99    19:22:10.732226 write(2, "write error", 11) = -1 EIO (Input/output error)
99    19:22:10.732263 write(2, ": Input/output error", 20) = -1 EIO (Input/output error)
99    19:22:10.732298 write(2, "\n", 1 <unfinished ...>
99    19:22:10.732325 <... write resumed>) = -1 EIO (Input/output error)
99    19:22:10.732349 exit_group(2)     = ?
99    19:22:10.732424 +++ exited with 2 +++

Removing the redirection should make the tests less flakey.

Replaces #13719.

While at it, also drop NotifyAccess=all. I think it was added purposefully in
TEST-20-MAINPIDGAMES, and then cargo culted to newer tests.
2019-10-08 08:48:48 +02:00
..
fuzz Merge pull request #13696 from keszybz/keep-dhcp-on-restart 2019-10-03 11:25:12 +02:00
hwdb
journal-data
loopy.service.d
mocks
TEST-01-BASIC test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-02-CRYPTSETUP test: replace $TESTDIR/root with $initdir 2019-08-17 12:29:08 -04:00
TEST-03-JOBS test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-04-JOURNAL test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-05-RLIMITS test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-06-SELINUX test: use "ln -fs" 2019-07-30 13:27:06 +02:00
TEST-07-ISSUE-1981 test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-08-ISSUE-2730 test: use "ln -fs" 2019-07-30 13:27:06 +02:00
TEST-09-ISSUE-2691 test: use "ln -fs" 2019-07-30 13:27:06 +02:00
TEST-10-ISSUE-2467 test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-11-ISSUE-3166 test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-12-ISSUE-3171 test: add create_empty_image_rootdir() to simplify testcase setup 2019-07-16 18:05:15 -04:00
TEST-13-NSPAWN-SMOKE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-14-MACHINE-ID test: use "ln -fs" 2019-07-30 13:27:06 +02:00
TEST-15-DROPIN pid1: use a cache for all unit aliases 2019-07-30 14:01:46 +02:00
TEST-16-EXTEND-TIMEOUT Merge pull request #13119 from keszybz/unit-loading-2 2019-07-30 17:55:37 +02:00
TEST-17-UDEV-WANTS test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-18-FAILUREACTION test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-19-DELEGATE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-20-MAINPIDGAMES test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-21-SYSUSERS meson: make nologin path build time configurable 2019-07-18 12:46:35 +02:00
TEST-22-TMPFILES tests: add test for suid/sgid handling in tmpfiles 2019-04-30 09:18:23 +02:00
TEST-23-TYPE-EXEC test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-24-UNIT-TESTS test: replace $TESTDIR/root with $initdir 2019-08-17 12:29:08 -04:00
TEST-25-IMPORT test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-26-SETENV test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-27-STDOUTFILE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-28-PERCENTJ-WANTEDBY Merge pull request #13119 from keszybz/unit-loading-2 2019-07-30 17:55:37 +02:00
TEST-29-UDEV-ID_RENAMING test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-30-ONCLOCKCHANGE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-31-DEVICE-ENUMERATION test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-32-OOMPOLICY test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-33-CLEAN-UNIT test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-34-DYNAMICUSERMIGRATE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-35-NETWORK-GENERATOR network-generator: rename generated unit files 2019-07-30 02:30:09 +09:00
TEST-36-NUMAPOLICY test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-37-RUNTIMEDIRECTORYPRESERVE test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-39-EXECRELOAD test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
TEST-40-EXEC-COMMAND-EX test: drop redirection to tty in integration tests 2019-10-08 08:48:48 +02:00
test-execute test-execute: Filter /dev/.lxc in exec-dynamicuser-statedir.service 2019-10-04 11:56:29 +02:00
test-network Merge pull request #12818 from yuwata/network-issue-8726 2019-10-03 15:21:35 +02:00
test-path
test-resolve
test-umount
unit-.service.d
unit-with-.service.d
unit-with-multiple-.service.d
unit-with-multiple-dashes.service.d
.gitignore
a-conj.service tests: Check trivial loop between two jobs 2019-06-26 23:16:31 +02:00
a.service
b.service
basic.target
c.service
create-sys-script.py
d.service
daughter.service cgroup v2: Don't require CPU controller for CPU accounting in 4.15+ 2018-11-18 12:21:41 +00:00
dml-discard-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-discard-set-ml.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-discard.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-override-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-override.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-set-dml.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-set-ml.service cgroup: Test that it's possible to set memory protection to 0 again 2019-05-08 12:06:32 +01:00
dml-passthrough.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
e.service
end.service
f.service
g.service
grandchild.service
h.service
hello-after-sleep.target
hello.service
hwdb-test.sh
i.service tests: Check job ordering on execution cycles 2019-06-26 23:16:31 +02:00
loopy.service
loopy2.service
loopy3.service
loopy4.service
meson.build core: ExecCondition= for services 2019-07-17 11:35:02 +02:00
mkosi.build.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
mkosi.default.networkd-test codespell: fix spelling errors 2019-04-29 16:47:18 +02:00
mkosi.nspawn.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
networkd-test.py test: print an error when networkctl returns an unexpected EC 2019-07-31 16:33:12 +02:00
nomem.slice cgroup: Add DisableControllers= directive to disable controller in subtree 2018-12-03 15:40:31 +00:00
nomemleaf.service cgroup: Add DisableControllers= directive to disable controller in subtree 2018-12-03 15:40:31 +00:00
parent-deep.slice
parent.slice
README.testsuite test: allow use of nested KVM 2019-09-27 15:42:38 -07:00
rule-syntax-check.py rule-syntax-check: allow PROGRAM as an assignment 2019-02-10 19:06:58 +01:00
run-integration-tests.sh scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
run-unit-tests.py
sched_idle_bad.service
sched_idle_ok.service
sched_rr_bad.service
sched_rr_change.service
sched_rr_ok.service
shutdown.target
sleep.service
sockets.target
son.service
splash.bmp
sys-script.py
sysinit.target
sysv-generator-test.py codespell: fix spelling errors 2019-04-29 16:47:18 +02:00
test-efi-create-disk.sh scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
test-exec-deserialization.py
test-functions nspawn: rename UNIFIED_CGROUP_HIERARCHY to SYSTEMD_NSPAWN_UNIFIED_HIERARCHY 2019-10-01 10:21:13 -07:00
testsuite.target
timers.target
udev-test.pl test: add test cases for empty string match 2019-09-11 09:06:15 +09:00
unit-with-multiple-dashes.service
unstoppable.service

The extended testsuite only works with UID=0. It contains of several
subdirectories named "test/TEST-??-*", which are run one by one.

To run the extended testsuite do the following:

$ ninja -C build  # Avoid building anything as root later
$ sudo test/run-integration-tests.sh
ninja: Entering directory `/home/zbyszek/src/systemd/build'
ninja: no work to do.
--x-- Running TEST-01-BASIC --x--
+ make -C TEST-01-BASIC BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run
make: Entering directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
TEST CLEANUP: Basic systemd setup
TEST SETUP: Basic systemd setup
...
TEST RUN: Basic systemd setup [OK]
make: Leaving directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
--x-- Result of TEST-01-BASIC: 0 --x--
--x-- Running TEST-02-CRYPTSETUP --x--
+ make -C TEST-02-CRYPTSETUP BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run

If one of the tests fails, then $subdir/test.log contains the log file of
the test.

To run just one of the cases:

$ sudo make -C test/TEST-01-BASIC clean setup run

Specifying the build directory
==============================

If the build directory is not detected automatically, it can be specified
with BUILD_DIR=:

$ sudo BUILD_DIR=some-other-build/ test/run-integration-tests

or

$ sudo make -C test/TEST-01-BASIC BUILD_DIR=../../some-other-build/ ...

Note that in the second case, the path is relative to the test case directory.
An absolute path may also be used in both cases.

Configuration variables
=======================

TEST_NO_QEMU=1
    Don't run tests under QEMU

TEST_NO_NSPAWN=1
    Don't run tests under systemd-nspawn

TEST_NO_KVM=1
    Disable QEMU KVM autodetection (may be necessary when you're trying to run the
    *vanilla* QEMU and have both qemu and qemu-kvm installed)

TEST_NESTED_KVM=1
    Allow tests to run with nested KVM. By default, the testsuite disables
    nested KVM if the host machine already runs under KVM. Setting this
    variable disables such checks

QEMU_MEM=512M
    Configure amount of memory for QEMU VMs (defaults to 512M)

QEMU_SMP=1
    Configure number of CPUs for QEMU VMs (defaults to 1)

KERNEL_APPEND='...'
    Append additional parameters to the kernel command line

NSPAWN_ARGUMENTS='...'
    Specify additional arguments for systemd-nspawn

QEMU_TIMEOUT=infinity
    Set a timeout for tests under QEMU (defaults to infinity)

NSPAWN_TIMEOUT=infinity
    Set a timeout for tests under systemd-nspawn (defaults to infinity)

INTERACTIVE_DEBUG=1
    Configure the machine to be more *user-friendly* for interactive debuggung
    (e.g. by setting a usable default terminal, suppressing the shutdown after
    the test, etc.)

The kernel and initramfs can be specified with $KERNEL_BIN and $INITRD.
(Fedora's or Debian's default kernel path and initramfs are used by default)

A script will try to find your QEMU binary. If you want to specify a different
one with $QEMU_BIN.

Debugging the qemu image
========================

If you want to log in the testsuite virtual machine, you can specify additional
kernel command line parameter with $KERNEL_APPEND and then log in as root.

$ sudo make -C test/TEST-01-BASIC KERNEL_APPEND="systemd.unit=multi-user.target" run

Root password is empty.