jqnatividad/qsv 0.133.0

on GitHub

Highlights

1

This release doubles down on Polars' capabilities, as we now, as a matter of policy track the latest polars upstream. If you think qsv has a torrid release schedule, you should see Polars. They're constantly fixing bugs, adding new features and optimizations! To keep up, we've added Polars revision info to the --version output, and the --envlist option now includes Polars relevant env vars. We've also added support for the POLARS_BACKTRACE_IN_ERR env var to control whether Polars backtraces are included in error messages. We also removed the to parquet subcommand as its redundant with the Polars-powered sqlp's ability to create parquet files. This removes the HUGE duckdb dependency, which should markedly make compile times shorter and binaries much smaller.

Other highlights include:

• New edit command that allows you to edit CSV files.
• The count command's --width option now includes record width stats beyond max length (avg, median, min, variance, stddev & MAD).
• The fixlengths command now has --quote and --escape options.
• The stats command adds a sort_order streaming statistic.

Added

• count: expanded --width options, adding record width stats beyond max length (avg, median, min, variance, stddev & MAD). Also added --json output when using --width #2099
• edit: add qsv edit command by @rzmk in #2074
• fixlengths: added --quote and --escape options #2104
• stats: add sort_order streaming statistic #2101
• polars: add polars revision info to --version output e60e44f
• polars: added Polars relevant env vars to --envlist option 0ad68fe
• polars: add & document POLARS_BACKTRACE_IN_ERR env var f9cc559

Changed

• Optimize polars optflags #2089
• deps: bump polars 0.42.0 to latest upstream at time of release 3b7af51
• bump polars to latest upstream, removing smartstring #2091
• build(deps): bump actions/setup-python from 5.1.1 to 5.2.0 by @dependabot in #2094
• build(deps): bump flate2 from 1.0.32 to 1.0.33 by @dependabot in #2085
• build(deps): bump flexi_logger from 0.28.5 to 0.29.0 by @dependabot in #2086
• build(deps): bump indexmap from 2.4.0 to 2.5.0 by @dependabot in #2096
• build(deps): bump jsonschema from 0.18.0 to 0.18.1 by @dependabot in #2084
• build(deps): bump serde from 1.0.208 to 1.0.209 by @dependabot in #2082
• build(deps): bump serde_json from 1.0.125 to 1.0.127 by @dependabot in #2079
• build(deps): bump sysinfo from 0.31.2 to 0.31.3 by @dependabot in #2077
• build(deps): bump qsv-stats from 0.18.0 to 0.19.0 by @dependabot in #2100
• build(deps): bump tokio from 1.39.3 to 1.40.0 by @dependabot in #2095
• apply select clippy lint suggestions
• updated several indirect dependencies
• made various doc and usage text improvements
• pin Rust nightly to 2024-08-26 from 2024-07-26, aligning with Polars pinned nightly

Fixed

• Ensure portable binaries are "added" to the publish zip archive, instead of replacing all the binaries with just the portable version. Fixes #2083. 34ad206

Removed

• removed to parquet subcommand as its redundant with sqlp's ability to create parquet files. This also removes the HUGE duckdb dependency, which should markedly make compile times shorter and binaries much smaller #2088
• removed smartstring dependency now that Polars has its own compact inlined string type 47f047e
• removed to parquet benchmark

Full Changelog: 0.132.0...0.133.0