Commit graph

1011 commits

Author SHA1 Message Date
LovecraftianHorror 452e97b921
Add blobs to the totals for jupyter (#868) 2021-12-19 23:05:19 +01:00
LovecraftianHorror cf1c64faa2
Remove deprecated aho corasick .byte_classes(false) toggle (#867) 2021-12-19 16:08:39 +01:00
XAMPPRocky 9ea344445c
Delete audit.yml
Haven't found it useful enough compared to how annoying it is.
2021-12-13 11:11:29 +01:00
Maciej XGQT Barć 4d5d8d28ae
languages.json: Racket - add scrbl extension and racket env (#850)
Signed-off-by: Maciej Barć <xgqt@riseup.net>
2021-11-21 19:02:46 +01:00
Po-Yu Hsieh 8cf79f31b1
Language Support for ATS (#840)
* Adding spec and test for ATS

* Update language support list

* Corrects language spec and test assertions

Details:
 - Specifies quotation format
 - Correct key for specifying line comment
 - Correct expected test assertions (passed)

* Fix inconsistent JSON formatting in languages.json

* Update extension list

Details:
 - To make it comply with github's linguist def
2021-11-19 16:56:26 +01:00
tuesdaycodes a7e9d3c689
add jinja2 language (#848)
* add jinja2

* add jinja2 test data
2021-11-19 15:54:06 +01:00
laixintao 901bd4556f
update readme: add tokei-pie in related tools. (#847) 2021-11-19 09:31:46 +01:00
refaelsh 9a35b2d4e1
Add missing space (#834) 2021-09-24 07:07:19 +02:00
dependabot[bot] a8d2d1d902
Bump serde from 1.0.127 to 1.0.128 (#816)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.127 to 1.0.128.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.127...v1.0.128)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-08-23 08:15:06 +02:00
dependabot[bot] 015dfa85b0
Bump serde_cbor from 0.11.1 to 0.11.2 (#815)
Bumps [serde_cbor](https://github.com/pyfisch/cbor) from 0.11.1 to 0.11.2.
- [Release notes](https://github.com/pyfisch/cbor/releases)
- [Commits](https://github.com/pyfisch/cbor/compare/v0.11.1...v0.11.2)

---
updated-dependencies:
- dependency-name: serde_cbor
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-08-16 08:28:55 +02:00
Alexander Pupeikis 4fd51a0069
add Korn shell to supported languages (#810)
Update test/data/ksh.ksh
2021-08-06 10:25:46 +02:00
Adam Lesperance 1097ecaf77
Option to reverse sort entries (#802) 2021-08-04 15:28:33 +02:00
Adam Lesperance ab8dd1bf85
Fix clippy warnings (#801) 2021-08-04 15:27:17 +02:00
dependabot[bot] 8b936d2730
Bump serde from 1.0.126 to 1.0.127 (#809)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.126 to 1.0.127.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.126...v1.0.127)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-08-03 11:42:42 +02:00
dgcampea 617edbfab4
Add AWK support (#797) 2021-08-03 11:42:25 +02:00
QuarticCat c1397f3446
Beautify help messages (#791)
* Enable wrap_help feature of clap

* Enable `AppSettings::ColoredHelp` of clap

* Run `cargo fmt --all`

Co-authored-by: XAMPPRocky <4464295+XAMPPRocky@users.noreply.github.com>
2021-06-30 16:00:04 +02:00
Caden Haustein cc363d5f25
Fix audit warning (#789)
Co-authored-by: XAMPPRocky <4464295+XAMPPRocky@users.noreply.github.com>
2021-06-27 06:40:39 +02:00
dependabot[bot] a5d2cca4b7
Bump ignore from 0.4.17 to 0.4.18 (#785)
Bumps [ignore](https://github.com/BurntSushi/ripgrep) from 0.4.17 to 0.4.18.
- [Release notes](https://github.com/BurntSushi/ripgrep/releases)
- [Changelog](https://github.com/BurntSushi/ripgrep/blob/master/CHANGELOG.md)
- [Commits](https://github.com/BurntSushi/ripgrep/compare/ignore-0.4.17...ignore-0.4.18)

---
updated-dependencies:
- dependency-name: ignore
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-27 06:39:16 +02:00
dependabot[bot] fd8d33c371
Bump arbitrary from 1.0.0 to 1.0.1 (#773)
Bumps [arbitrary](https://github.com/rust-fuzz/arbitrary) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/rust-fuzz/arbitrary/releases)
- [Changelog](https://github.com/rust-fuzz/arbitrary/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-fuzz/arbitrary/commits)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-27 06:39:05 +02:00
dependabot[bot] e1b65452a4
Bump serde from 1.0.125 to 1.0.126 (#765)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.125 to 1.0.126.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.125...v1.0.126)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-27 06:38:51 +02:00
Caden Haustein 4382ff75a5
Update git2 (#793) 2021-06-21 13:20:17 +02:00
Vincent de Phily abacbc525b
Fix rustsec advisories, add cargo audit github workflow (#750)
* Update various deps, closing RUSTSEC-2020-0146 and RUSTSEC-2021-0023

This is a simple `cargo update`, needed to close these `cargo audit` reports:

Crate:         generic-array
Version:       0.12.3
Title:         arr! macro erases lifetimes
Date:          2020-04-09
ID:            RUSTSEC-2020-0146
URL:           https://rustsec.org/advisories/RUSTSEC-2020-0146
Solution:      Upgrade to >=0.8.4, <0.9.0 OR >=0.9.1, <0.10.0 OR >=0.10.1, <0.11.0 OR >=0.11.2, <0.12.0 OR >=0.12.4, <0.13.0 OR >=0.13.3
Dependency tree:
generic-array 0.12.3
├── digest 0.8.1
│   └── sha-1 0.8.2
│       └── pest_meta 2.1.3
│           └── pest_generator 2.1.3
│               └── pest_derive 2.1.0
│                   └── tera 1.6.1
│                       └── tokei 12.1.2
└── block-buffer 0.7.3
    └── sha-1 0.8.2

Crate:         rand_core
Version:       0.6.1
Title:         Incorrect check on buffer length when seeding RNGs
Date:          2021-02-12
ID:            RUSTSEC-2021-0023
URL:           https://rustsec.org/advisories/RUSTSEC-2021-0023
Solution:      Upgrade to >=0.6.2
Dependency tree:
rand_core 0.6.1
├── rand_hc 0.3.0
│   └── rand 0.8.2
│       ├── tera 1.6.1
│       │   └── tokei 12.1.2
│       └── tempfile 3.2.0
│           └── tokei 12.1.2
├── rand_chacha 0.3.0
│   └── rand 0.8.2
└── rand 0.8.2

These deps were updated:

Updating bstr v0.2.14 -> v0.2.15
Updating byteorder v1.4.2 -> v1.4.3
Updating cc v1.0.66 -> v1.0.67
Removing cfg-if v0.1.10
Removing const_fn v0.4.5
Updating crossbeam-epoch v0.9.1 -> v0.9.3
Updating crossbeam-utils v0.8.1 -> v0.8.3
Updating dtoa v0.4.7 -> v0.4.8
Updating encoding_rs v0.8.26 -> v0.8.28
Updating env_logger v0.8.2 -> v0.8.3
Updating form_urlencoded v1.0.0 -> v1.0.1
Updating generic-array v0.12.3 -> v0.12.4
Updating getrandom v0.2.1 -> v0.2.2
Updating git2 v0.13.15 -> v0.13.17
Updating hex v0.4.2 -> v0.4.3
Updating idna v0.2.0 -> v0.2.2
Updating libc v0.2.82 -> v0.2.93
Updating libgit2-sys v0.12.17+1.1.0 -> v0.12.18+1.1.0
Updating lock_api v0.4.2 -> v0.4.3
Updating log v0.4.13 -> v0.4.14
Updating memoffset v0.6.1 -> v0.6.3
Updating once_cell v1.5.2 -> v1.7.2
Updating parking_lot_core v0.8.2 -> v0.8.3
Updating proc-macro2 v1.0.24 -> v1.0.26
Updating quote v1.0.8 -> v1.0.9
Updating rand v0.8.2 -> v0.8.3
Updating rand_core v0.6.1 -> v0.6.2
Removing redox_syscall v0.1.57
Removing redox_syscall v0.2.4
  Adding redox_syscall v0.2.5
Updating regex-syntax v0.6.22 -> v0.6.23
Updating serde_yaml v0.8.15 -> v0.8.17
Updating syn v1.0.60 -> v1.0.68
Updating tera v1.6.1 -> v1.7.0
Updating thread_local v1.1.0 -> v1.1.3
Updating tinyvec v1.1.0 -> v1.2.0
Updating typenum v1.12.0 -> v1.13.0
Updating unicode-bidi v0.3.4 -> v0.3.5
Updating unicode-normalization v0.1.16 -> v0.1.17
Updating url v2.2.0 -> v2.2.1
Updating walkdir v2.3.1 -> v2.3.2
Updating wasi v0.10.1+wasi-snapshot-preview1 -> v0.10.2+wasi-snapshot-preview1

* Add github workflow to run cargo audit

While dependabot helps somewhat, it only seems to catch direct dependencies, and doesn't give any
more prominence to security issues. This github workflow is taken from
https://github.com/rust-github/template/ and creates issues instead of pull requests.

* Update Cargo.lock

Co-authored-by: XAMPPRocky <4464295+XAMPPRocky@users.noreply.github.com>
2021-06-08 15:46:42 +02:00
Jonathan Li 434eeb77cc
Add LOLCODE support (#768)
* Add lolcode support

* Retrigger build
2021-06-08 15:45:57 +02:00
Bryan Horstmann 10bfa54f8d
Support terragrunt hcl extension for HCL language (#780) 2021-06-08 15:45:28 +02:00
XAMPPRocky 414fe7a665
Update README.md 2021-06-01 05:45:40 +02:00
schaffung ec75b4ff6d
Changing cargo command (#770)
The cargo command when run with `cargo install --git https://github.com/XAMPPRocky/tokei.git`
fails as there are multiple packages with binaries inside the project. For a particular package,
we'd have to add the name of the package, hence adding `tokei`

Fixes: #769
2021-05-18 08:55:11 +02:00
maru143 bec944484e
Add extensions to supported languages output (#745) 2021-05-18 07:21:16 +02:00
Rachael Wright-Munn d90631d1bc
Add Color to Tokei (#751)
* Introduce Color to Tokei

* Add minimal color documentation

* fixup! Add minimal color documentation

Co-authored-by: XAMPPRocky <4464295+XAMPPRocky@users.noreply.github.com>
2021-05-18 07:18:43 +02:00
John Benediktsson 95740ccd23
Add support for the Factor language. (#746) 2021-05-09 20:29:27 +02:00
Caden Haustein 9ad40fa5ec
Add Mlatu language (#748) 2021-05-09 20:28:50 +02:00
adamnemecek 9a37230153
added wgsl + metal shading languages (#754) 2021-05-09 20:28:00 +02:00
Alexandru Macovei cd7bd6d4a2
Cache embedding regexes (#730)
* Run cargo fmt and apply clippy lints from rust 1.51.0

* Rename can_perform_single_line_analisys to try_perform_single_line_analisys and streamline body

* Remove ops::Add impl for CodeStats; only AddAssign is meaningful and used

* Add embedding module to cache heuristic regexes used to detect embedded languages

* Add separate embedding tests; Not all cases can be execised with a single test

* Simplify html embedding test file_triggeringprincipal_frame_1.html until quoting issues are resolved
2021-05-09 20:15:10 +02:00
Michael Macnair 66967a1b9e
Fuzzing (#726)
* Add fuzzing support

See fuzz/README.md for details. Example bug: #725

* improve fuzz docs

* fuzzing: make relevant config part of input

Most of the config is to do with what files to parse, however
one setting - treat_doc_strings_as_comments - does impact parse_from_slice

* fuzzing: improve docs + config clarity

* fuzz/README.md: install instructions + another todo item
2021-05-09 20:05:14 +02:00
Charlie Ozinga 9f4f457a3a
Apply --compact output to --files (#722) 2021-05-09 20:00:10 +02:00
Janfel 63433c9c20
Add .asd file extension for Common Lisp (#718)
The de-facto standard build facility for Common Lisp, ASDF, uses Common Lisp files with the extension .asd.
2021-05-09 19:58:47 +02:00
eulegang 3346143ced
add OpenPolicyAgent support and test (#740)
Co-authored-by: eulegang <eulegang@eulegang.dev>
2021-05-09 19:57:59 +02:00
Janfel 36d55f75b0
Change Lisp display name to Common Lisp (#717)
The term “Lisp” refers to a family of languages, not just to Common Lisp.
2021-05-09 19:57:18 +02:00
Erin Power 0dc8481425 Update Cargo.lock 2021-05-09 14:18:39 +02:00
Yijun Yu e14733dac5
Add --streaming flag (#678)
* Parallelize tokei counters and subsequent processing of individual files with additional options: tokei -f --cmd <shell_script> --folder <output_folder>. Here the shell script is expected to accept three arguments: shell_script <filename> <language> <output_folder>

* change /bin/sh to /bin/bash so that the batch process runs well with bash script

* implement the --streaming option for exactly this purpose: it should print out the paths and language types of all files per line to the stdout for downstream processing in the pipe

* fixing the option struct by replacing streaming option with a function option as an extension; skipping the serialization for the extended field

* handle for_each_fn when it is None

* fixing: default for_each_fn should be None

* Adding the Streaming options for batch processing: simple => text, json => json, none => ignore

* resolving the merging conflicts

* change String to Report, and formatting the simple output to reserve enough spaces for path

* fixing the format so it does not truncate long paths

* simplifying the format for the Json output

* introduce a commented header to the simple output format

* removed the None option as it is unnessary

Co-authored-by: Yijun Yu <yijun.yu@gmail.com>
Co-authored-by: Yijun Yu <yijun.yu@huawei.com>
2021-04-30 18:37:33 +02:00
dependabot-preview[bot] ae0eb66a10
Upgrade to GitHub-native Dependabot (#760)
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-04-30 08:03:33 +02:00
dependabot-preview[bot] 76deacc955 Bump regex from 1.4.5 to 1.4.6
Bumps [regex](https://github.com/rust-lang/regex) from 1.4.5 to 1.4.6.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.4.5...1.4.6)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-04-23 04:59:41 +00:00
dependabot-preview[bot] 446f55fa5e Bump serde from 1.0.124 to 1.0.125
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.124 to 1.0.125.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.124...v1.0.125)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-23 05:11:17 +00:00
dependabot-preview[bot] f81cfb1186 Bump regex from 1.4.4 to 1.4.5
Bumps [regex](https://github.com/rust-lang/regex) from 1.4.4 to 1.4.5.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.4.4...1.4.5)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-15 04:52:49 +00:00
dependabot-preview[bot] 1b96925651 Bump serde from 1.0.123 to 1.0.124
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.123 to 1.0.124.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.123...v1.0.124)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-12 06:53:30 +00:00
dependabot-preview[bot] 1457b75282 Bump regex from 1.4.3 to 1.4.4
Bumps [regex](https://github.com/rust-lang/regex) from 1.4.3 to 1.4.4.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.4.3...1.4.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-12 05:11:43 +00:00
XAMPPRocky 41f43a6f12
Update mean_bean_ci.yml 2021-03-11 13:56:09 +01:00
maru143 2c60aab35c
fix: typo (#734) 2021-03-11 13:55:45 +01:00
dependabot-preview[bot] a5a8b6a66d Bump serde_json from 1.0.63 to 1.0.64
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.63 to 1.0.64.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.63...v1.0.64)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-03-01 04:59:42 +00:00
dependabot-preview[bot] 61d82f3b62 Bump serde_json from 1.0.62 to 1.0.63
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.62 to 1.0.63.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.62...v1.0.63)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-26 04:59:25 +00:00
Michael Macnair cc8f9607ad
README.md: describe .tokeignore file (#721)
Should help pre-empt questions like #333
2021-02-24 14:11:34 +01:00