Commit graph

128 commits

Author SHA1 Message Date
Alexandre Bury 66ad75df30 Bump zstd to 0.13.2 2024-07-05 18:17:32 -04:00
Alexandre Bury e470f0021d Bump zstd to 0.13.1 2024-03-27 11:02:24 -04:00
Alexandre Bury 9d7b44ab86 Bump zstd to 0.13.0
Changes:
* Bump zstd-safe to 7.0.0.
* Fix potential buffer overflow (#231).
* Some doc improvement.
2023-10-11 11:45:24 -04:00
Jake Shadle d84bac590a
Cleanup crate packages (#241) 2023-09-10 22:09:53 -04:00
Alexandre Bury 5872d291ac Raise rust version to 1.64 2023-07-19 21:49:00 -04:00
Alexandre Bury 73d2cabfa2 Bump versions to remove metadata 2023-07-19 09:40:54 -04:00
Alexandre Bury 12867809bf zstd-rs 0.12.3 2023-01-31 09:40:40 -05:00
Alexandre Bury f6c95e7b4b Add comment in Cargo.toml re: lto features 2023-01-30 09:41:51 -05:00
Jiahao XU bd75cb48ea
Re-enable lto support guarded behind feature flags (#198)
- fat-lto for fat lto, will override thin-lto if specified
- thin-lto for thin lto, will fallback to fat-lto is not supported

Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>

Signed-off-by: Jiahao XU <Jiahao_XU@outlook.com>
2023-01-26 21:22:26 -05:00
Alexandre Bury 1c49557922 Bump zstd to 0.12.2 2023-01-11 11:05:28 -05:00
Alexandre Bury 55cb65476f Update MSRV for no default features 2022-12-06 10:35:34 -05:00
Alexandre Bury ae9b6d5d3c Bump zstd to 0.12.1 2022-12-06 09:48:55 -05:00
Alexandre Bury 067d8979da Add MSRV to cargo.tomls 2022-11-28 12:02:52 -05:00
Alexandre Bury fcdd4b3a50 Implement Debug & Display for ContentSizeError 2022-11-23 09:03:48 -05:00
Alexandre Bury fe3ebe80fa Small zstd-safe refactor
* Take `Option<usize>` for `set_pledged_size` rather than rely on caller
  using `CONTENTSIZE_UNKNOWN`.
* Return `Option<NonZeroU64>` for `get_decompressed_size`.
* Replace `u32` with `Option<NonZeroU32>` for dictionary IDs
* Replace redundant functions that were just forwarding calls to
  `CCtx`/`DCtx`/...
* Added documentation for all items
* Fixed some functions not returning a `Result` when they should have.
* Add `disable_dictionary` to `CCtx` and `DCtx`.
* `DCtx::reset()` now takes a reset directive, just like `CCtx::reset`
* Removed deprecated `CCtx::reset_cstream`.
2022-11-22 15:46:40 -05:00
Alexandre Bury c9fb51b8b7 Update dev-dependencies 2022-10-04 15:58:54 -04:00
Alexandre Bury 94f79b0a7b Bump versions 2022-05-11 13:30:01 -04:00
Nazar Mokrynskyi 4051a08e58
Avoid exact version of zstd-safe (#148) 2022-05-11 13:25:05 -04:00
Alexandre Bury ed00cb5112 Bump version to 0.11.1 2022-03-15 09:45:01 -04:00
Alexandre Bury 3a6c7fa76b Bump version to 0.11.0
zstd-sys 2.0.0
zstd-safe 5.0.0

Breaking changes:
- Dictionary-training operations have been moved behind a zdict_builder feature.
2022-03-09 15:49:19 -05:00
Alexandre Bury b4026bff46 Bump version to 0.10.1
zstd-sys 1.6.4
zstd-safe 4.1.5
2022-03-09 14:08:23 -05:00
quininer d6bfa32d09
zstd-sys: impl wasm32-unknown-unknown support (#139)
* impl wasm32-unknown-unknown support

* Add zdict feature for zstd-sys

* Fix comment

* Fix wasm DEBUGLEVEL :'D

* Add zdict_builder feature to zstd/zstd-safe

* Fix test
2022-01-28 13:54:49 -05:00
Alexandre Bury 753cc629be Bump version to 0.10.0 2022-01-21 16:05:01 -05:00
Alexandre Bury ac903ac6f8 Update zstd to v1.5.2 2022-01-21 12:53:45 -05:00
Alexandre Bury ef1f2aee44 Add doc-cfg tags 2022-01-14 11:44:18 -05:00
Alexandre Bury d682288689 Update clap dependency in examples 2022-01-06 13:33:21 -05:00
Alexandre Bury ef3b9cc175 zstd-safe: move [u8; N] implementation behind "arrays" feature. 2021-12-23 10:40:18 -05:00
Alexandre Bury d3ba4a7ccf Move multithread method behind zstdmt feature 2021-12-23 10:40:18 -05:00
Alexandre Bury 03ae1355f4 Update zstd to v1.5.1 2021-12-23 10:40:18 -05:00
Alexandre Bury 974e2f22bd Bump versions 2021-06-09 09:01:23 -04:00
Alexandre Bury 0a48ea0689 Remove in-tree async support; redirect to async-compression. 2021-06-09 08:55:22 -04:00
Alexandre Bury 3636f9e9f7 Bump version to 0.8.3 2021-06-03 21:20:15 -04:00
Alexandre Bury e098711452 Bump version to 0.8.2 2021-06-01 19:48:01 -04:00
Alexandre Bury 6713e1dd79 Update to zstd 1.5.0
Expose more experimental parameters in zstd-safe.
2021-05-14 09:07:47 -07:00
Alexandre Bury 2dead48d00 Update version to zstd=0.8.0 / zstd-safe=4.0.0 2021-05-03 10:40:07 -07:00
Alexandre Bury 4ecd2b6ab7
Add Container trait for resizable bytes container (#113)
* Add `Container` trait for resizable bytes container
2021-04-28 09:14:52 -07:00
Alexandre Bury cd0450d78c Update version 2021-04-01 14:26:20 -07:00
Denis K 7d33cd5870
Added feature "thin" for reducing binary size (#108)
* Added support of "thin" feature to reduce library size using recommendations from zstd/lib.

* Reverted error strings.

* Fixed build with GCC.

* Fixed comment.

Co-authored-by: Denis K <@tonlabs.io>
2021-03-26 09:35:28 -07:00
Alexandre Bury 281cb30e60 Add experimental feature to zstd 2021-03-23 09:04:17 -07:00
Alexandre Bury 33196e4397 Replace lorem ipsup test file with public domain text 2021-03-23 08:42:12 -07:00
Alexandre Bury 91d87400a1 Update zstd to v1.4.9 2021-03-03 12:48:25 -08:00
phiresky 6637f8f8c1
add debug feature to enable zstd debug logs (#99)
ZSTD sometimes doesn't output very helpful information by default. This adds a feature to enable debug logging from zstd.

before:
```
training dict of size 1503kB with 196608 samples of total size 150338kB (of 196608 samples seen)
Error: Training dictionary failed

Caused by:
    Error (generic)
```

what is happen??!!

after with features = ["debug"]:

```
[2020-12-20T16:16:04Z DEBUG sqlite_zstd::dict_training] training dict of size 1503kB with 196608 samples of total size 150338kB (of 196608 samples seen)
zstd/lib/dictBuilder/zdict.c: ZDICT_trainFromBuffer
Trying 5 different sets of parameters
d=8
Training on 147456 samples of total size 100940410
Testing on 49152 samples of total size 49397760
Computing frequencies
k=50
Breaking content into 30067 epochs of size 3357
zstd/lib/dictBuilder/zdict.c: ZDICT_finalizeDictionary
Failed to select dictionary
20%       k=537
Breaking content into 2799 epochs of size 36063
zstd/lib/dictBuilder/zdict.c: ZDICT_finalizeDictionary
Failed to select dictionary
40%       k=1024
Breaking content into 1468 epochs of size 68760
zstd/lib/dictBuilder/zdict.c: ZDICT_finalizeDictionary
Failed to select dictionary
60%       k=1511
Breaking content into 994 epochs of size 101549
zstd/lib/dictBuilder/zdict.c: ZDICT_finalizeDictionary
Failed to select dictionary
80%       k=1998
Breaking content into 752 epochs of size 134229
zstd/lib/dictBuilder/zdict.c: ZDICT_finalizeDictionary
Failed to select dictionary
Error: Training dictionary failed

Caused by:
    Error (generic)
```
2020-12-20 08:55:57 -08:00
Alexandre Bury d48087e7e6 Update lifetime around contexts and dictionaries
Fix lifetime bounds when using prepared dictionaries.
Adds inherent implementation methods to objects in zstd-safe.
2020-12-19 23:38:26 -08:00
Alexandre Bury 9ca2568514 Update zstd to v1.4.7 2020-12-17 08:31:48 -08:00
Alexandre Bury 6185d828eb Forward pkg-config feature 2020-06-15 10:13:29 -07:00
Alexandre Bury 4090ae28c1 Update zstd-rs to 0.5.3, expose zstdmt feature. 2020-06-13 23:29:05 -07:00
Alexandre Bury 0be7863572 Update zstd to v1.4.5 2020-05-23 21:18:22 -07:00
Alexandre Bury 01d6107c91 Update zstd to v1.4.4 2019-11-05 11:46:33 -08:00
Alexandre Bury 8656e6baed Update cc dependency and release new version 2019-10-15 08:22:13 -07:00
Alexandre Bury 19f91f915a Move to 2018 edition 2019-10-03 14:53:46 -07:00