github dathere/qsv 2.1.0

pre-release3 hours ago

[2.1.0] - 2025-01-12

Highlights:

  • join & joinp fine-tuning continues, with several key transformation options (--ignore-leading-zeros & --norm-unicode); join fixes for --right-anti and --right-semi joins; and reverting a join performance regression with 2.0.0.
  • pivotp uses more summary statistics for even smarter aggregation suggestions
  • qsv 2.0.0 was not published to crates.io as our patched fork of MiniJinja had some dependencies that prevented publishing. With MiniJinja 2.6.0 now released - qsv 2.1.0 will now be available on crates.io again, allowing more straightforward installation for DP+.

Added

  • join: add --ignore-leading-zeros option #2430
  • joinp add --norm-unicode option to unicode normalize join keys #2436
  • pivotp added more smart aggregation suggestions #2428
  • template: added to qsvdp binary variant 9df85e6
  • benchmarks: added pivotp benchmark 92e4c51

Changed

  • joinp: refactored --ignore-leading-zeros handling #2433
  • Migrate from unmaintained dynfmt to dynfmt2 #2421
  • deps: bump csvlens to latest upstream 52c766d
  • deps: bump to latest csv qsv-optimized fork 58ac650
  • deps: bumped MiniJinja to 2.6.0 8176368
  • deps: bump to latest Polars upstream
  • deps: bump qsv-stats to 0.26.0
  • build(deps): bump azure/trusted-signing-action from 0.5.0 to 0.5.1 by @dependabot in #2420
  • build(deps): bump base62 from 2.0.3 to 2.1.0 by @dependabot in #2419
  • build(deps): bump base62 from 2.1.0 to 2.2.0 by @dependabot in #2426
  • build(deps): bump phf from 0.11.2 to 0.11.3 by @dependabot in #2417
  • build(deps): bump pyo3 from 0.23.3 to 0.23.4 by @dependabot in #2431
  • build(deps): bump serde_json from 1.0.134 to 1.0.135 by @dependabot in #2416
  • build(deps): bump tokio from 1.42.0 to 1.43.0 by @dependabot in #2423
  • build(deps): bump uuid from 1.11.0 to 1.11.1 by @dependabot in #2427
  • apply several clippy suggestions
  • bumped numerous indirect dependencies to latest versions
  • bumped Rust nightly from 2024-12-19 to 2025-01-05 (same version used by Polars)
  • bump MSRV to latest Rust stable - v1.84.0

Fixed

  • join: revert optimization that actually resulted in a performance regression e42af2b
  • join: --right-anti and --right-semi joins didn't swap headers properly #2435
  • count: polars-powered count didn't use the right data type SQL count(*) d8c1524

Full Changelog: 2.0.0...2.1.0

Don't miss a new qsv release

NewReleases is sending notifications on new releases.