Commit graph

483 commits

Author SHA1 Message Date
James Robson 0f77b54aeb Fix typo 2021-03-21 15:11:48 +00:00
James Robson 4352d47ac3 Don't fail the job if test-suite.log is missing 2021-03-21 14:45:34 +00:00
James Robson 0a661a6da2 Remove use of which to set system binaries 2021-03-20 22:15:47 +00:00
James Robson c804ec3ba3 Merge branch 'master' into polish-gnu-tests 2021-03-18 20:59:41 +00:00
Theophile Trunck 0ac5dbe44d Add CICD for busytest 2021-03-14 20:30:53 +01:00
James Robson 570e456496 clean up workflow script 2021-03-14 15:59:17 +00:00
James Robson 7c219fd128 clean up sed commands 2021-03-14 15:34:22 +00:00
James Robson d8c3d1d51d Use system utils 2021-03-14 15:32:30 +00:00
James Robson 78ec6d1e5a Revert "Revert "Remove unbuffer""
This reverts commit 8dae8b798a.
2021-03-06 21:24:28 +00:00
James Robson 64e0b0018a Merge branch 'master' into polish-gnu-tests 2021-03-06 16:51:33 +00:00
James Robson 8dae8b798a Revert "Remove unbuffer"
This reverts commit bbce179115.
2021-03-06 16:35:22 +00:00
James Robson b098bd5ec2 Fix tests still failing for the wrong reason 2021-03-05 21:40:16 +00:00
James Robson e42479b79b fail tests for any binary not built 2021-03-04 20:50:57 +00:00
James Robson 3b93995132 generate all factor scripts 2021-03-04 19:11:38 +00:00
James Robson 20082971be Use system sha1sum in factor tests 2021-03-04 17:33:31 +00:00
James Robson a395af7ee7 Create *sum binaries for tests 2021-02-27 14:35:31 +00:00
James Robson bbce179115 Remove unbuffer
This causes the make process to hang for some reason, and it itsn't providing any real advantage so it's taken out
2021-02-27 13:25:13 +00:00
James Robson 03619d867e More tight timeouts 2021-02-25 18:18:30 +00:00
James Robson 1cef9aa046 Add timeouts to other tests that hang 2021-02-24 17:47:30 +00:00
James Robson 4cca2b651a Keep producing logs even if make hangs 2021-02-24 17:28:20 +00:00
James Robson e89387c089 Try removing seq-precision 2021-02-23 19:49:11 +00:00
James Robson b19afebad8 Shorten the timeout on seq-precision 2021-02-23 09:58:06 +00:00
Chad Brewbaker bb54669a5d
Fix macOS aarch64 compile errors (#1724) 2021-02-23 10:25:06 +01:00
James Robson dc49415829 Stop seq-precision.sh causing jams in make 2021-02-22 19:29:45 +00:00
James Robson b92b88a822 Add 4 hour global timeout for protection 2021-02-22 19:29:00 +00:00
James Robson 16c8b3cbba Use system timeout command 2021-02-22 09:19:43 +00:00
James Robson 89f74948e0 Typo 2021-02-21 15:52:18 +00:00
James Robson 4e90de44cc Move timeout to per-test script
Move to a timeout applied to each script and re add the tests that are hanging so they show as failing
2021-02-21 15:51:03 +00:00
James Robson cebb58c5b4 Rename install for testing 2021-02-21 13:36:16 +00:00
James Robson f2013e47b3 Use which to find system utils 2021-02-21 11:14:14 +00:00
James Robson 910f6d102f Fix script name 2021-02-21 09:53:11 +00:00
James Robson b3dea739f4 Fix script name 2021-02-21 09:36:03 +00:00
James Robson a73c34c735 Stop tests failing on utils that aren't the focu of the test 2021-02-20 17:17:03 +00:00
James Robson eb8cdcf44a Re-add fixed test 2021-02-20 15:07:47 +00:00
Sylvestre Ledru 842b6dd75f Remove tests checking for --version & --help
Not really interesting for us and logs are too big
2021-02-13 19:31:47 +01:00
Sylvestre Ledru 091cdd6a8d
Extract the result of the GNU testsuite executions as a warning (#1718) 2021-02-11 15:42:41 +01:00
James Robson d4a30fdff0 Skip sort test that will hang 2021-02-04 18:42:43 +00:00
James Robson 4573ce44e1 Kill make on timeout so it can't delete the running log 2021-02-04 18:08:00 +00:00
James Robson 96219692a4 Archive logs 2021-02-03 21:43:34 +00:00
James Robson 7fe5a08b23 Use timeout to protect against hangs 2021-02-03 21:43:34 +00:00
James Robson 5808d56f12 Skip tests that hang 2021-02-03 21:43:34 +00:00
James Robson 84b0573f7d Fix $PATH in tests 2021-02-03 21:43:34 +00:00
James Robson 84965ad8c3 Use make to build all binaries 2021-02-03 21:43:34 +00:00
jaggededgedjustice 20046013fb
Cleanup gnu test script (#1701) 2021-01-21 23:56:02 +01:00
jaggededgedjustice 4eb6edaf52
Add gnu tests (#1699) 2021-01-21 08:19:08 +01:00
Roy Ivy III 07d52c7741 docs ~ add corrective spell-checker global exceptions 2020-11-08 20:00:11 -06:00
Roy Ivy III b6cafa9e10 fix ~ remove extraneous step within GHA MinRSV 2020-11-08 20:00:11 -06:00
Roy Ivy III daa5868da4 maint/CICD ~ add 'Cargo.lock' format testing and protection 2020-10-24 20:56:41 -05:00
Roy Ivy III 3a4f12c2fb maint/CICD ~ improve robustness of MinRustV package dependency calculation 2020-10-14 21:42:09 -05:00
Roy Ivy III 72a5d93a4d maint/CICD ~ remove old/unneeded grcov setup scripting 2020-08-19 09:13:09 -05:00
Roy Ivy III 63315747a5 maint/CICD ~ job naming improvement (decreased jargon) + feature name normalization 2020-08-16 17:02:19 -05:00
Roy Ivy III bb4b20db81 maint/CICD ~ use alternate grcov configuration recipe (direct CLI options)
- `ignore` and `excl-br-line` options used to target code coverage analysis
- direct/repeated (non-DRY) CLI options are used by necessity (`grcov` is ignoring command line env variables)
2020-08-16 17:02:19 -05:00
Roy Ivy III 9711e5ad42 maint/CICD ~ update CICD code coverage recipe 2020-08-10 10:20:15 -05:00
Roy Ivy III 1c9b12c0d2 maint/CICD ~ add individual uutil/sub-crate testing to CICD code coverage 2020-08-10 10:19:42 -05:00
Roy Ivy III 137b26def6 maint/CICD ~ add individual uutil/sub-crate testing to CICD 2020-08-10 10:19:41 -05:00
nicoo dc6b9a8d62
CI: Improve annotations (#1584)
* CI: Only run rustfmt in one environment

- This displays clippy warnings even when rustfmt fails.
- This avoids displaying 3 copies of the same rustfmt warning as Github
  annotations.
- Avoids duplicated work.

* CI: Suppress warnings when building for the oldest toolchain version

We had cases of warnings emitted due to `rustc` bugs that were fixed
in non-obsolete versions.

* factor: Remove a workaround for warnings on obsolete rustc
2020-08-10 16:53:32 +02:00
Roy Ivy III d3ef4bd7da maint/CICD ~ update 'actions/upload-artifact' to 'v2' 2020-07-25 11:09:10 -05:00
Roy Ivy III 51cb023cd7 maint/CICD ~ pass CI from environment to cross containers 2020-06-13 21:54:21 -05:00
Sylvestre Ledru 5926315507 bump the minimal version of rustc to 1.32 2020-06-08 22:54:28 +02:00
Sylvestre Ledru 78c04a254e refactor ~ rename MinSRV => MinRustV 2020-06-02 12:23:48 -05:00
Roy Ivy III 1d327d31c0 docs ~ add comments (based on PR feedback) 2020-06-01 09:10:21 -05:00
Roy Ivy III a7cbf6c9fd maint/CICD ~ remove cargo fmt gating for 'windows'
- unneeded after reorg
- but issue still remains; see GH:/rust-lang/rustfmt#3590
2020-05-30 01:16:21 -05:00
Roy Ivy III cc8a2be6f5 maint/CICD ~ add support for DPKG generation and extra ARM-CPU build targets 2020-05-30 01:15:35 -05:00
Roy Ivy III 16840f8cd4 maint/CICD ~ update GHA for 'coreutils' name change 2020-05-29 22:59:47 -05:00
Roy Ivy III d9de816757
maint/build ~ allow code coverage upload failures without breaking the build (warning instead of error) (#1526) 2020-05-25 22:47:42 +02:00
Sylvestre Ledru 157dc38492 quick fix(coverage): grcov arg 'output-file' has been renamed to 'output-path' 2020-05-13 11:01:41 +02:00
Roy Ivy III 7a64ad1ebc maint/CICD ~ add commentary for 'Style' warning output => annotation conversions 2020-05-02 23:12:50 -05:00
Roy Ivy III a57214fa10 maint/CICD ~ change 'Style' job to a more robust, "allow-failure"-type, state
## [why]

Compiler and clippy warnings will change over time. To avoid build failures due to some
updated allow/warn categories for more future rust versions, the tests using the
toolchain utilities are converted to a form which will always "pass" but will push any
errors/warnings to the GHA UI as annotations.

Additional build-breaking tests utilizing more stable tools (or local scripts) can be
added at a later date if/when desired.

This should prevent CI failures for already known-working builds.
2020-05-02 17:02:25 -05:00
Roy Ivy III 312d9b9543 maint/CICD ~ fix coverage build failures by pinning to known-working nightly toolchain
## [why]

Code coverage must currently use some unstable features in nightly rust builds. The
nightly builds are, by definition, unstable and subject to frequent breaking changes.
To prevent CI build breakage, the toolchain is pinned to a specific known working set.

Note: (maint!) this will require periodic review until code coverage is more fully
implemented/integrated into Rust and moved into the stable channel.

- refs: <https://github.com/mozilla/grcov/issues/427>, <https://github.com/newsboat/newsboat/issues/916>
2020-05-02 16:53:08 -05:00
Roy Ivy III dfc0617a2e maint/CICD ~ update x86_64-pc-windows-gnu build target to 'stable' (for use with rust v1.43.0+) 2020-05-02 16:44:36 -05:00
Roy Ivy III 0ab6e6a19a maint/CICD ~ refactor MacOS feature use (aline with feature reorg) 2020-04-25 01:57:21 -05:00
Roy Ivy III 4813e97a71 maint/CICD ~ add work-around for absorption of cargo tree into cargo
- see [GH:rust-lang/cargo#8062](https://github.com/rust-lang/cargo/pull/8062) for more information
2020-04-15 10:10:40 -05:00
Roy Ivy III 0d355d1073 maint/CICD ~ enable testing for beta-x86_64-pc-windows-gnu to GHA:CICD 2020-04-15 10:09:48 -05:00
Roy Ivy III 58a0ed2a4f maint/CICD ~ show cargo tree tool version information during CICD 2020-04-15 10:08:30 -05:00
Roy Ivy III 48dd6a2c81 maint/CICD ~ improve code coverage process and tooling 2020-04-14 13:46:18 -05:00
Roy Ivy III aea98a40e0 maint/CICD ~ add cargo fmt style testing of tests 2020-04-14 00:07:00 -05:00
Roy Ivy III 7eeb58ae3a maint/docs ~ add spell-checker exceptions 2020-04-12 16:57:11 -05:00
Roy Ivy III ab9da0aa63 maint/CICD ~ fix GITHUB_REF parsing 2020-04-12 16:56:03 -05:00
Roy Ivy III 4cf8487053 maint/CICD ~ improve tooling info display and include build dependency info 2020-04-12 16:56:03 -05:00
Roy Ivy III 05c829471e maint/CICD ~ generalize README and LICENSE matches for use in dpkg builds 2020-04-12 16:56:03 -05:00
Roy Ivy III 69408fc8cc maint/CICD ~ fix MinSRV testing (use correct toolchain) 2020-04-12 16:56:03 -05:00
Roy Ivy III b57ee7e131 maint/CICD ~ fix features option for GHA 2020-04-12 16:56:03 -05:00
Roy Ivy III ebc29e813b maint/CICD ~ add GitHub:Actions (GHA) CICD 2020-04-11 18:50:09 -05:00