Commit graph

53 commits

Author SHA1 Message Date
Sylvestre Ledru adaba54026 gnu/ci: move the operations into script to run them locally 2021-05-22 09:33:15 +02:00
Sylvestre Ledru 73b47b8c76 gnu/ci: install the dep into a separate task 2021-05-21 18:33:05 +02:00
Sylvestre Ledru 52a7e07b3e
Merge pull request #2226 from nbraud/pin-GNU-tests
CI: Stabilise the version of GNU tests used in CI
2021-05-20 16:30:32 +02:00
Sylvestre Ledru 0c6a848314
gnu results: also add the date (#2236) 2021-05-19 20:33:28 +02:00
Sylvestre Ledru 7bf342fa52 publish the results of the gnu testsuite as a json file too 2021-05-18 23:05:49 +02:00
Sylvestre Ledru 047d775e5e gh action: fix the GNU testsuite job 2021-05-17 21:24:58 +02:00
nicoo f46b119493 CI: Stabilise the version of GNU tests used in CI
The “GNU tests” task is routinely broken on `master`.
Broken CI is worse than no CI, as it teaches people to ignore errors.

This PR pins the versions of the GNU testsuite (and GNUlib) used,
to current stable versions, so this task stops breaking unexpectedly.

Presumably, someone will update `GNU.yml` when a new stable version
of the GNU coreutils is released, but I'm not volunteering.
2021-05-17 21:07:05 +02:00
jaggededgedjustice fb2ae04b8f
Remove broken GNU test for printf (#2095) 2021-04-21 14:22:05 +02:00
jaggededgedjustice 88d0bb01c0
Add shuf tests (#1958)
* Add tests for shuf

* Fixup GNU tests for shuf
2021-03-28 17:52:01 +02:00
James Robson 56da6b4a2c Fix test setup 2021-03-22 17:48:12 +00:00
James Robson 027d5e6d9d Fix yaml syntax 2021-03-21 22:31:15 +00:00
James Robson 40677bdc7a Fix more problems with utils that aren't being tested 2021-03-21 20:49:15 +00:00
James Robson 0f77b54aeb Fix typo 2021-03-21 15:11:48 +00:00
James Robson 4352d47ac3 Don't fail the job if test-suite.log is missing 2021-03-21 14:45:34 +00:00
James Robson 0a661a6da2 Remove use of which to set system binaries 2021-03-20 22:15:47 +00:00
James Robson 570e456496 clean up workflow script 2021-03-14 15:59:17 +00:00
James Robson 7c219fd128 clean up sed commands 2021-03-14 15:34:22 +00:00
James Robson d8c3d1d51d Use system utils 2021-03-14 15:32:30 +00:00
James Robson 78ec6d1e5a Revert "Revert "Remove unbuffer""
This reverts commit 8dae8b798a.
2021-03-06 21:24:28 +00:00
James Robson 8dae8b798a Revert "Remove unbuffer"
This reverts commit bbce179115.
2021-03-06 16:35:22 +00:00
James Robson b098bd5ec2 Fix tests still failing for the wrong reason 2021-03-05 21:40:16 +00:00
James Robson e42479b79b fail tests for any binary not built 2021-03-04 20:50:57 +00:00
James Robson 3b93995132 generate all factor scripts 2021-03-04 19:11:38 +00:00
James Robson 20082971be Use system sha1sum in factor tests 2021-03-04 17:33:31 +00:00
James Robson a395af7ee7 Create *sum binaries for tests 2021-02-27 14:35:31 +00:00
James Robson bbce179115 Remove unbuffer
This causes the make process to hang for some reason, and it itsn't providing any real advantage so it's taken out
2021-02-27 13:25:13 +00:00
James Robson 03619d867e More tight timeouts 2021-02-25 18:18:30 +00:00
James Robson 1cef9aa046 Add timeouts to other tests that hang 2021-02-24 17:47:30 +00:00
James Robson 4cca2b651a Keep producing logs even if make hangs 2021-02-24 17:28:20 +00:00
James Robson e89387c089 Try removing seq-precision 2021-02-23 19:49:11 +00:00
James Robson b19afebad8 Shorten the timeout on seq-precision 2021-02-23 09:58:06 +00:00
James Robson dc49415829 Stop seq-precision.sh causing jams in make 2021-02-22 19:29:45 +00:00
James Robson b92b88a822 Add 4 hour global timeout for protection 2021-02-22 19:29:00 +00:00
James Robson 16c8b3cbba Use system timeout command 2021-02-22 09:19:43 +00:00
James Robson 89f74948e0 Typo 2021-02-21 15:52:18 +00:00
James Robson 4e90de44cc Move timeout to per-test script
Move to a timeout applied to each script and re add the tests that are hanging so they show as failing
2021-02-21 15:51:03 +00:00
James Robson cebb58c5b4 Rename install for testing 2021-02-21 13:36:16 +00:00
James Robson f2013e47b3 Use which to find system utils 2021-02-21 11:14:14 +00:00
James Robson 910f6d102f Fix script name 2021-02-21 09:53:11 +00:00
James Robson b3dea739f4 Fix script name 2021-02-21 09:36:03 +00:00
James Robson a73c34c735 Stop tests failing on utils that aren't the focu of the test 2021-02-20 17:17:03 +00:00
James Robson eb8cdcf44a Re-add fixed test 2021-02-20 15:07:47 +00:00
Sylvestre Ledru 842b6dd75f Remove tests checking for --version & --help
Not really interesting for us and logs are too big
2021-02-13 19:31:47 +01:00
Sylvestre Ledru 091cdd6a8d
Extract the result of the GNU testsuite executions as a warning (#1718) 2021-02-11 15:42:41 +01:00
James Robson d4a30fdff0 Skip sort test that will hang 2021-02-04 18:42:43 +00:00
James Robson 4573ce44e1 Kill make on timeout so it can't delete the running log 2021-02-04 18:08:00 +00:00
James Robson 96219692a4 Archive logs 2021-02-03 21:43:34 +00:00
James Robson 7fe5a08b23 Use timeout to protect against hangs 2021-02-03 21:43:34 +00:00
James Robson 5808d56f12 Skip tests that hang 2021-02-03 21:43:34 +00:00
James Robson 84b0573f7d Fix $PATH in tests 2021-02-03 21:43:34 +00:00