jqnatividad/qsv 0.108.0

on GitHub

Another big Quicksilver release with lots of new features and improvements!

The two Polars-powered commands - joinp and sqlp - have received significant attention. joinp now supports asof joins and the --try-parsedates option. sqlp now has several Parquet format options, along with a --low-memory option.

Other new features include:

• A new cat rowskey --group option that emulates csvkit's csvstack command.
• SIMD-accelerated UTF-8 validation for the input command.
• A --field-separator option for the flatten command.
• The sniff command now uses the excellent file-format crate for mime-type detection on ALL platforms, not just Linux, as was the case when we were using the libmagic library.

Also, QuickSilver now has optimized builds for Apple Silicon. These builds are created using native Apple Silicon self-hosted Action Runners, which means we can enable all qsv features without being constrained by cross-compilation limitations and GitHub’s Action Runner’s disk/memory constraints. Additionally, we compile Apple Silicon builds with M1/M2 chip optimizations enabled to maximize performance.

Finally, qsv startup should be noticeably faster, thanks to @vi’s PR to avoid sysinfo::System::new_all.

Added

• joinp: added asof join & --try-parsedates option #1059
• cat: emulate csvkit's csvstack #1067
• input: SIMD-accelerated utf8 validation 88e1df2
• sniff: replace magic with file-format crate, enabling mime-type detection on all platforms #1069
• sqlp: add --low-memory option d95048e
• sqlp: added parquet format options c179cf4 a861ebf
• flatten: add --field-separator option #1068
• Apple Silicon binaries built on native Apple Silicon self-hosted Action Runners, enabling all features and optimized for M1/M2 chips

Changed

• input: minor improvements 62cff74
• joinp: align option names with join command #1058
• sqlp: minor improvements
• changed all GitHub action workflows to account for the new Apple Silicon builds
• Bump rust_decimal from 1.29.1 to 1.30.0 by @dependabot in #1049
• Bump serde_json from 1.0.96 to 1.0.97 by @dependabot in #1051
• Bump calamine from 0.21.0 to 0.21.1 by @dependabot in #1052
• Bump strum from 0.24.1 to 0.25.0 by @dependabot in #1055
• Bump actix-governor from 0.4.0 to 0.4.1 by @dependabot in #1060
• Bump csvs_convert from 0.8.5 to 0.8.6 by @dependabot in #1061
• Bump itertools from 0.10.5 to 0.11.0 by @dependabot in #1062
• Bump serde_json from 1.0.97 to 1.0.99 by @dependabot in #1065
• Bump indexmap from 1.9.3 to 2.0.0 by @dependabot in #1066
• Bump calamine from 0.21.1 to 0.21.2 by @dependabot in #1071
• cargo update bump various indirect dependencies
• pin Rust nightly to 2021-06-23

Fixed

• Avoid sysinfo::System::new_all by @vi in #1064
• correct typos project-wide #1072

Removed

• removed libmagic dependency from all GitHub action workflows

New Contributors

• @vi made their first contribution in #1064

Full Changelog: 0.107.0...0.108.0