jqnatividad/qsv 0.111.0

on GitHub

This is the first in a series of "Giddy-up" 🏇🏽 releases.

As Quicksilver matures, we will continue to tweak it in our goal to be the 🚀 fastest general purpose CSV data-wrangling CLI toolkit available.

"Giddy-up" 🏇🏽 releases increase performance by:

• taking advantage of new Rust features as they become available
• using new libraries that are faster than the ones we currently use
• optimizing our code to take advantage of new features in the libraries we use
• using new algorithms that are faster than the ones we currently use
• taking advantage of more hardware features (SIMD, multi-core, etc.)
• adding reproducible benchmarks that are automatically updated on release to track our progress

As it is, Quicksilver has an aggressive release tempo - with more than 160 releases since its initial release in December 2020. This was made possible by the solid foundation of Rust and the xsv project from which qsv was forked. We will continue to build on this foundation by adding more CI tests and starting to track code coverage so we can continue to iterate aggressively with confidence.

Apart from "giddy-up" releases, Quicksilver will also have "carousel" 🎠 releases that will focus on making the toolkit more accessible to non-technical users.

"Carousel" 🎠 releases will include:

• more documentation
• more examples
• more tutorials
• more recipes in the Cookbook
• multiple GUI wrappers around the CLI
• integrations with common desktop tools like Excel, Google Sheets, Open Office, etc.
• tighter integration with the CKAN ecosystem, with a focus on helping data publishers & data coordinators maintain a high quality data/metadata catalog

Hopefully, this will make qsv more accessible to non-technical users, and help them get more value out of their data. Special attention will be given to "open data" use cases - enabling non-profits, governments and regular citizens tap raw open data and convert it to actionable insight - making open data useful, usable and used.

Every now and then, we'll also have "Unicorn" 🦄 releases that will add MAJOR new features to the toolkit (e.g. 10x type features like the integration of Pola.rs into qsv).

We will also add a new Technical Documentation section to the wiki to document qsv's architecture and how each command works. The hope is doing so will lower the barrier to contributions and help us grow the community of qsv contributors.

Added

• sort: add --faster option #1190
• describegpt: add -Q, --quiet option by @rzmk in #1179

Changed

• stats: refactor init_date_inference #1187
• join: cache has_headers result in hot loop e53edaf
• search & searchset: amortize allocs #1188
• stats: use fast-float to convert string to float #1191
• sqlp: more examples, apply clippy::needless_borrow lint ff37a04 and b8e1f77
• use fast-float project-wide (apply, applydp, schema, sort, validate) #1192
• fine tune publishing workflows to enable universally available CPU features a1dccc7
• build(deps): bump serde from 1.0.179 to 1.0.180 by @dependabot in #1176
• build(deps): bump pyo3 from 0.19.1 to 0.19.2 by @dependabot in #1177
• build(deps): bump qsv-dateparser from 0.9.0 to 0.10.0 by @dependabot in #1178
• build(deps): bump qsv-sniffer from 0.9.4 to 0.10.0 by @dependabot in #1180
• build(deps): bump indicatif from 0.17.5 to 0.17.6 by @dependabot in #1182
• Bump to qsv stats 0.11 #1184
• build(deps): bump serde from 1.0.180 to 1.0.181 by @dependabot in #1185
• build(deps): bump qsv_docopt from 1.3.0 to 1.4.0 by @dependabot in #1186
• build(deps): bump filetime from 0.2.21 to 0.2.22 by @dependabot in #1193
• build(deps): bump regex from 1.9.1 to 1.9.2 by @dependabot in #1194
• build(deps): bump regex from 1.9.2 to 1.9.3 by @dependabot in #1195
• build(deps): bump serde from 1.0.181 to 1.0.182 by @dependabot in #1196
• build(deps): bump tempfile from 3.7.0 to 3.7.1 by @dependabot in #1199
• build(deps): bump strum_macros from 0.25.1 to 0.25.2 by @dependabot in #1200
• build(deps): bump serde from 1.0.182 to 1.0.183 by @dependabot in #1201
• cargo update bump several indirect dependencies
• apply select clippy lint suggestions
• pin Rust nightly to 2023-08-07

Removed

• temporarily remove rand/simd_support feature when building nightly as its causing the nightly build to fail 0a66fdb

Fixed

• fixed typos from documentation by @a5dur in #1203

New Contributors

• @a5dur made their first contribution in #1203

Full Changelog: 0.110.0...0.111.0