qemu/tests/avocado
Alex Bennée 500f73b1aa tests/avocado: disable sh4 rd2 tests on Gitlab
Running repeated invocations on a number of test boxes show a fairly
high error rate:

  $ retry.py -n 100 -c -- ./tests/venv/bin/avocado run tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d
  retry.py called with ['./tests/venv/bin/avocado', 'run', 'tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d']
  Results:
  Run, Ret, Pass/Fail, Time, Total Pass, Total Run
  ...
  Results summary:
  0: 94 times (94.00%), avg time 2.254 (0.00 varience/0.04 deviation)
  1: 3 times (3.00%), avg time 1.837 (0.02 varience/0.14 deviation)
  8: 3 times (3.00%), avg time 91.288 (0.02 varience/0.15 deviation)

Examining the logs they fall into various categories of un-handled
unaligned access by user space and unexpected FPU usage by the kernel
which ultimately lead to the failure to reach the login prompt. This
could be bugs in the translator that only get hit occasionally or just
a flaky kernel - its hard to tell. To avoid these failures gating CI
lets skip on GitLab.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Cc: Thomas Huth <thuth@redhat.com>
Cc: Yoshinori Sato <ysato@users.sourceforge.jp>
Cc: Magnus Damm <magnus.damm@gmail.com>
Message-Id: <20221027183637.2772968-21-alex.bennee@linaro.org>
2022-10-31 20:37:59 +00:00
..
avocado_qemu tests/avocado: reduce the default timeout to 120s 2022-09-20 16:27:04 +01:00
virtiofs_submounts.py.data
boot_linux.py tests/avocado: extend the timeout for x86_64 tcg tests 2022-10-31 20:37:58 +00:00
boot_linux_console.py tests/avocado: disable sh4 rd2 tests on Gitlab 2022-10-31 20:37:59 +00:00
boot_xen.py
cpu_queries.py
empty_cpu_model.py
hotplug_cpu.py
info_usernet.py tests/avocado: set -machine none for userfwd and vnc tests 2022-10-31 20:37:59 +00:00
intel_iommu.py
linux_initrd.py
linux_ssh_mips_malta.py tests/avocado/linux_ssh_mips_malta.py: add missing accel (tcg) tag 2022-03-08 19:38:17 +01:00
load_bflt.py
machine_aarch64_virt.py tests/avocado: update aarch64_virt test to exercise -cpu max 2022-04-20 16:04:16 +01:00
machine_arm_canona1100.py
machine_arm_integratorcp.py
machine_arm_n8x0.py
machine_aspeed.py tests/avocado/machine_aspeed.py: Fix typos on buildroot 2022-10-24 11:20:15 +02:00
machine_avr6.py
machine_m68k_nextcube.py
machine_microblaze.py
machine_mips_fuloong2e.py
machine_mips_loongson3v.py
machine_mips_malta.py
machine_rx_gdbsim.py
machine_s390_ccw_virtio.py target/s390x: support PRNO_TRNG instruction 2022-09-26 17:23:11 +02:00
machine_sparc64_sun4u.py
machine_sparc_leon3.py
migration.py tests/avocado/migration: Get find_free_port() from the ports 2022-08-30 07:55:43 +02:00
multiprocess.py
pc_cpu_hotplug_props.py
ppc_74xx.py avocado/ppc_74xx.py: check TCG accel for all tests 2022-03-14 15:57:17 +01:00
ppc_405.py avocado/ppc_405.py: check TCG accel in test_ppc_ref405ep() 2022-03-14 15:57:17 +01:00
ppc_bamboo.py tests/avocado: Add missing require_netdev('user') checks 2022-10-11 17:25:50 +02:00
ppc_mpc8544ds.py avocado/ppc_mpc8544ds.py: check TCG accel in test_ppc_mpc8544ds() 2022-03-14 15:57:17 +01:00
ppc_prep_40p.py avocado/ppc_prep_40p.py: check TCG accel in all tests 2022-03-14 15:57:17 +01:00
ppc_pseries.py
ppc_virtex_ml507.py avocado/ppc_virtex_ml507.py: check TCG accel in test_ppc_virtex_ml507() 2022-03-14 15:57:17 +01:00
README.rst
replay_kernel.py avocado/replay_kernel.py: make tcg-icount check in run_vm() 2022-03-14 15:57:17 +01:00
replay_linux.py tests/avocado: Do not run tests that require libslirp if it is not available 2022-08-29 15:28:51 +02:00
reverse_debugging.py
smmu.py
tcg_plugins.py tests/avocado: fix tcg_plugin mem access count test 2021-11-29 15:12:56 +00:00
tesseract_utils.py
version.py
virtio-gpu.py
virtio_check_params.py tests: install "qemu" namespace package into venv 2022-06-06 09:26:54 +02:00
virtio_version.py tests: install "qemu" namespace package into venv 2022-06-06 09:26:54 +02:00
virtiofs_submounts.py
vnc.py tests/avocado: set -machine none for userfwd and vnc tests 2022-10-31 20:37:59 +00:00
x86_cpu_model_versions.py

=============================================
Integration tests using the Avocado Framework
=============================================

This directory contains integration tests. They're usually higher
level, and may interact with external resources and with various
guest operating systems.

For more information, please refer to ``docs/devel/testing.rst``,
section "Integration tests using the Avocado Framework".