freebsd-src/tools/regression
Warner Losh 6bfca4dcab tools: Automated cleanup of cdefs and other formatting
Apply the following automated changes to try to eliminate
no-longer-needed sys/cdefs.h includes as well as now-empty
blank lines in a row.

Remove /^#if.*\n#endif.*\n#include\s+<sys/cdefs.h>.*\n/
Remove /\n+#include\s+<sys/cdefs.h>.*\n+#if.*\n#endif.*\n+/
Remove /\n+#if.*\n#endif.*\n+/
Remove /^#if.*\n#endif.*\n/
Remove /\n+#include\s+<sys/cdefs.h>\n#include\s+<sys/types.h>/
Remove /\n+#include\s+<sys/cdefs.h>\n#include\s+<sys/param.h>/
Remove /\n+#include\s+<sys/cdefs.h>\n#include\s+<sys/capsicum.h>/

Sponsored by:		Netflix
2023-11-26 22:24:01 -07:00
..
aio/aiop tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
audit/audit_pipe_ioctl Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
bpf Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
capsicum/syscalls tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
ccd/layout Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
compat32/aarch64 arm64: add tests for swp/swpb emulation 2023-05-15 10:42:16 -05:00
doat Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
environ Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
ethernet/ethermulti tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
fsx Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
gaithrstress Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
geom Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
geom_gpt tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
include Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
ipfw/fwd Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
ipsec Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
iscsi Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
kgssapi Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
kthread/kld tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
lib/libc/regex Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
mlock Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
msdosfs Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
net/if_tap Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
net80211 Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
netinet tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
netinet6 tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
nfsmmap Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
p1003_1b Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
poll Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
posixsem tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
posixsem2 Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
priv Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
pthread Remove my middle name. 2023-08-17 15:08:30 +02:00
redzone9 tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
rpcsec_gss Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
security tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
sigqueue Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
sockets tools: Automated cleanup of cdefs and other formatting 2023-11-26 22:24:01 -07:00
sysvmsg Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
sysvsem Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
sysvshm Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
tls Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
tmpfs Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
ufs/uprintf Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
usb Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
usr.bin Remove $FreeBSD$: one-line sh pattern 2023-08-16 11:55:03 -06:00
zfs Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
README Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00
TODO Remove $FreeBSD$: one-line bare tag 2023-08-16 11:55:20 -06:00

This directory is for regression test programs.

A regression test program is one that will exercise a particular bit of the
system to check that we have not reintroduced an old bug.

Tests should be implemented in files with a .t extension.  Each .t file
can contain more than one test, and can be implemented in any scripting
language -- /bin/sh, Perl...

The test protocol is quite simple.  At its most basic, each .t file should, 
when run, print a line in this format:

   1..m

where m is the number of tests that will be run.

Each test should produce a single line of output.  This line should start
with one of

   ok n
   not ok n

to indicate whether or not the test succeeded.  'n' is the test's number.
Anything after this on the line (up to the first '#' if present) is 
considered to be the name of the test.  Naming tests is optional, but 
encouraged.

A test may be written which is conditional, and may need to be skipped.
For example, the netinet tests require 'options INET' in the kernel.
A test may be skipped by printing '# skip Reason for skipping' after the
test name.  For example,

    ok 1 - netinet # skip 'options INET' not compiled in

A test may be flagged as 'todo'.  This indicates that you expect the test
to fail (perhaps because the necessary functionality hasn't been written
yet).  'todo' tests are expected to fail, so when they start working the
test framework can alert you to this happy occurrence.  Flag these tests 
with a '# TODO' comment after the test name

    not ok 1 - infiniteloop # TODO write test for an infinite loop

This is modelled on the protocol followed by the Test::Harness Perl
module (and therefore much of the automated testing carried out by the 
Perl community).  More documentation can be found at:

    http://search.cpan.org/~petdance/Test-Harness-2.42/lib/Test/Harness.pm

To run the tests and parse their output install the devel/p5-Test-Harness
port.  This includes the prove(1) command which is used to run the tests
and collate the output.

    prove geom_concat		# run all the tests in geom_concat
    prove -r lib		# run all tests in lib/, and subdirectories
    prove -r -v lib		# as above, with verbose output
    prove -r			# run *all* the tests

Tests that are for parts of the base system should go into a directory here
which is the same as their path relative to src/, for example the uuencode(1)
utility resides in src/usr.bin/uuencode so its regression test resides in
src/tools/regression/usr.bin/uuencode.

To avoid the pre-commit check program complaining about the lack of
CVS keywords in test data files, use a .in suffix for input files and
a .out suffix for output files.

To execute individual regression tests for binaries that you are
developing, add their directory in the path before running the tests.
Example:
cd /usr/src/tools/regression/usr.bin
(PATH=/home/user/src/experimental/jot:$PATH ; make SUBDIR=jot)

Please make a subdir per other regression test, and add a brief description to
this file.

acct		Exercise the integer to float conversion used in acct(5)
geom		Some tests and an out-of-kernel simulator for the GEOM code
nfsmmap		Some tests to exercise some tricky cases in NFS and mmap
p1003_1b	Exercise 1003.1B scheduler
pipe		Pipe code regression test
fsx		General filesystem exerciser
sysvmsg 	SysV IPC Message Queue Regression Utility
sysvsem 	SysV IPC Semaphore Regression Utility
sysvshm 	SysV IPC Shared Memory Regression Utility
gaithrstress	General threaded getaddrinfo(3) exerciser
date		Date(1) + format string regression test