Commit Graph

37 Commits

Author SHA1 Message Date
Wu Tingfeng
8f286cc669
Add JSON5 support for languages.json (#986) 2023-04-25 09:42:32 +02:00
Alexandru Macovei
cd7bd6d4a2
Cache embedding regexes (#730)
* Run cargo fmt and apply clippy lints from rust 1.51.0

* Rename can_perform_single_line_analisys to try_perform_single_line_analisys and streamline body

* Remove ops::Add impl for CodeStats; only AddAssign is meaningful and used

* Add embedding module to cache heuristic regexes used to detect embedded languages

* Add separate embedding tests; Not all cases can be execised with a single test

* Simplify html embedding test file_triggeringprincipal_frame_1.html until quoting issues are resolved
2021-05-09 20:15:10 +02:00
Erin Power
9d21266980 use raw string in build 2020-06-21 21:17:01 +02:00
Erin Power
250bff9edf Normalize path in build 2020-06-21 20:39:51 +02:00
Erin Power
28917c4ad3 Add jupyter support 2020-06-21 18:59:17 +02:00
Erin Power
d4ef84320b Refactor context parsing and add initial support for HTML. 2020-06-21 15:15:16 +02:00
Erin Power
c06fa65dd9 Refactor cli_utils into Printer and add Rust context 2020-06-19 08:44:03 +02:00
Erin Power
a9fca66a5f Rename hbs file to tera 2020-06-18 20:54:08 +02:00
Erin Power
9068a72622 Implement literate languages and context parsing for markdown 2020-06-14 10:46:56 +02:00
Erin Power
f7867930cd fmt 2020-06-03 11:35:28 +02:00
Erin Power
1283f0a4ce Move parser from using Stats to CodeStats where appropiate 2020-06-03 11:08:57 +02:00
Erin Power
2342baa0dd Move codegen to use Tera 2020-05-28 09:28:09 +02:00
Nick Hackman
96b47ab404
Verbatim strings (#535)
* Added CSharp example

Using example from #330, for testing purposes

* Updated Rust test case

Rust test case now has a verbatim string that fails, with current
version of Tokei.

* Added C++ verbatim string to example

C++ Syntax makes this incredibly difficult to parse using the current
infrastructure, `R"PREFIX(    )PREFIX"` where PREFIX can be almost anything.

* Updated F# Test to have verbatim string

* Add support for "verbatim_quotes"

Quotes that neglect the `\"` rule, in the case of python as mentioned
in #330 it produces the correct outcome with Tokei currently.

* Add support for verbatim_quotes in syntax

Properly keeps track of current state and handles escapes properly in
the case of being inside of a verbatim_quote

* Added `verbatim_quotes` to CONTRIBUTING.md
2020-05-28 07:55:14 +02:00
Erin Power
c4a4734967 Fixed stats statistics and add test 2020-04-02 18:18:37 +02:00
Erin Power
fdf3f8cb27
Minor refactor and fix warning 2020-02-16 18:19:05 +01:00
Atul Bhosale
fcd555ad9f Format code using 'cargo fmt' (#399) 2019-10-30 20:31:24 +01:00
lzutao
5323ca8761 build: Fix warnings on trait objects without dyn (#349)
* chore: Use dyn Trait

* build: Bump handlerbars

* build: Bump serde_cbor

* build: Bump compatible dependencies
2019-07-19 09:00:45 +02:00
Aaron Power
755070ee84 Implemented config files 2019-01-10 11:11:39 +01:00
Aaron Power
a48f0818f5 Reverted API change 2018-10-17 13:41:08 +01:00
Aaron Power
47a334e8a8 fixed build issue 2018-10-16 18:33:12 +01:00
Aaron Power
b8f90c2e6d Moved language data to LanguageType, added language filters, and added benchmark script. 2018-08-24 16:46:42 +01:00
Aaron Power
51c04a030d Refactored some of build.rs 2018-05-12 10:54:48 +01:00
Aaron Power
9d3103e3bb Updated to use fs::read 2018-05-12 10:35:23 +01:00
Igor Gnatenko
01791bd793 add support for Meson (#169)
* add support for Meson

Fixes: https://github.com/Aaronepower/tokei/issues/168
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>

* tests: add meson.build

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>

* remove unused variable

warning: unused variable: `key`
  --> build.rs:31:10
   |
31 |     for (key, ref mut item) in json.get_mut("languages")
   |          ^^^
   |
   = note: #[warn(unused_variables)] on by default
   = note: to avoid this warning, consider using `_key` instead

Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2018-01-27 16:47:52 +00:00
Aaron Power
553736fe8f Fixed minor parser inaccuracies 2018-01-26 13:17:55 +00:00
Igor Gnatenko
39cd9d64c8 deps: update handlebars to 0.30 (#179)
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
2018-01-25 15:12:27 +00:00
Aaron Power
8817762d7b Updated log, made changes recommended by clippy 2018-01-13 17:45:11 +00:00
Aaron Power
f53c796f27 Changed how tokei searches through files.
Updated dependencies
Changed languages.json formatting
2017-08-11 00:07:58 +01:00
James Gilles
7849edfa34 Support "filenames" key, mk. 2 (#115)
* Support "filenames" key for Makefile-style languages

* Remove debugging statement

* Add CMake

* Cleaner docs and tests

* Add scons, handle languages with no extensions
2017-06-05 15:28:52 +01:00
Aaron Power
d3dc298708 Updated to use serde_derive, better tests, now uses macro for cli, updated dependencies 2017-02-15 19:42:08 +00:00
Aaron Power
c08f113c2d version 5: optimised stats, language generation 2017-01-03 00:02:18 +00:00
Aaron Power
759e49d1ea Version bump 2016-12-08 23:31:36 +00:00
Aaron Power
5c11e76c88 Updated dependencies, changed some unwraps with expect, and made
build process drier
2016-12-08 23:31:35 +00:00
Aaron Power
913752de0c Switched to using ignore, more parallelisation 2016-11-27 15:57:22 +00:00
Aaronepower
1e6a4c1015 feature parity 2016-06-07 12:09:22 +01:00
Aaronepower
5ecad644f4 Re ordering the files 2016-05-29 20:31:57 +01:00
Aaron Power
350cb5f30f 2.1.0 IO 2016-05-22 18:07:16 +01:00