jqnatividad/qsv 0.99.1

on GitHub

Even though this is a patch release, it actually contains a lot of new features and improvements.
This was done so that qsv version 0.99.0 and below can upgrade to this release, as the self-update logic
in older versions compared versions as strings, and not as semvers, preventing the older versions from updating as the yanked 0.100.0 is less than anything 0.99.0 and below when compared as strings.

The changelog below is a combination of the changelog of the yanked 0.100.0 and the changes since 0.99.0.

Added

• snappy: add validate subcommand #920
• sniff: can now sniff snappy-compressed files - on the local file system and on URLs #925
• schema & stats: stats now has a --stats-binout option which schema takes advantage of #931
• schema: added example NYC 311 JSON schema validation file generated by qsv schema c956212
• to: added snappy auto-compression/decompression support 09a7afd
• to: added dirs as input source a31fb3b and 4d4dd54
• to: added unit tests for sqlite, postgres, xslx and datapackage 16f2b7e 808b018 10739c5
• add dotenv file support #936 and #937

Changed

• stats & schema: major performance improvement (30x faster) with stats binary format serialization/deserialization 73b4b20
• snappy: misc improvements in #921
• stats: Refine stats binary format caching in #932
• bump embedded Luau from 0.5.71 to 0.5.73 d0ea7c8
• Better OOM checks. It now has two distinct modes - NORMAL and CONSERVATIVE, with NORMAL being the default. Previously, the CONSERVATIVE heuristic was the default and it was causing too many false positives #935
• Bump actions/setup-python from 4.5.0 to 4.6.0 by @dependabot in #934
• Bump emdedded Luau from 0.5.67 to 0.5.71 a67bd3e
• Bump qsv-stats from 0.7 to 0.8 9a6812a
• Bump serde from 1.0.159 to 1.0.160 by @dependabot in #918
• Bump cached from 0.42.0 to 0.43.0 by @dependabot in #919
• Bump serde_json from 1.0.95 to 1.0.96 by @dependabot in #922
• Bump pyo3 from 0.18.2 to 0.18.3 by @dependabot in #923
• Bump ext-sort from 0.1.3 to 0.1.4 by @dependabot in #929
• cargo update bump several indirect dependencies
• pin Rust nightly to 2023-04-23

Removed

• snappy is even snappier when we removed 8-cpu cap for even faster compression - going from 1.75 gb/sec to 2.25 gb/sec for the NYC 311 test data 🚀 19acf2f

Fixed

• excel: Float serialization correctness by @bluepython508 in #933
• luau: only create qsv_cache directory when needed #930
• luau: make qsv_shellcmd() helper function work with Windows f867158 and cc24acb
• Self update semver parsing fixed so versions are compared as semvers, not as strings. This prevented self-update from updating from 0.99.0 to 0.100.0 as 0.99.0 > 0.100.0 when compared as strings. #940
• fixed werr macro to also format! messages c3ceaf7

New Contributors

• @bluepython508 made their first contribution in #933

Full Changelog: 0.99.0...0.99.1