dathere/qsv 8.0.0

on GitHub

[8.0.0] - 2025-10-06

¹
Findable, Accessible, Interoperable & Reusable (FAIR) Data is AI-Ready Data.

A week and a half after launching our "People's API" AI Chatbot and "AI-Ready" service, we fine-tune qsv further, as it powers the FAIRification engine that allows us to "open your data" (as a verb) - to infer and calculate AI-Ready, FAIR metadata at blazing speed even for large datasets.

This release features:

• describegpt fixes and improvements
• table can now produce "aligned" TSV and Fixed Width format files
• validate now has Extended Input Support in its RFC 4180 validation mode
• extdedup fixed to dedupe arbitrarily large csv or text files
• luau upgraded from 0.690 to 0.693
• PowerPC64 pre-built binaries - making it more convenient to use qsv on this "power"ful 😉 platform that's widely used in research (thanks to IBM-provided access to its native GitHub Action ppc64le runners! For the next release - qsv on IBM Z Mainframes!)

These changes set the stage for even more advanced, powerful, configurable FAIRification capabilities to

make ALL your Data AI-Ready, Useful, Usable & Used by Machines & Humans alike.

Added

• table: add leftendtab alignment option #3004
• table: add leftfwf (Fixed Width Format) alignment option 590c861
• validate: add Extended Input Support to RFC 4180 validation mode #3012
• added PowerPC64 LE Linux prebuilt

Changed

• describegpt: fine-tuned default LLM Prompt template (v3.1.0) 00e52a3 6b09b7e 5be7f2e
• luau: bump embedded Luau from 0.690 to 0.693 #3017
• schema: make Decimal Type Scale configurable for polars schema with QSV_POLARS_DECIMAL_SCALE env var - f20edd5
• updated optimized csv crate, adding non-allocating StringRecord::trim() and more inline()s 4a1c82a
• deps: bump calamine to 0.31.0 bd7a04c
• deps: Bump polars to 0.51.0 from 0.50.0 at py-1.33.1 tag #2995
• deps: bump polars to 0.51.0 at py-1.34.0-beta.4 tag at revision b973cac (latest upstream) #3022
• deps: bump polars to 0.51.0 at py-1.35.0 tag revision b973cac 4164875
• deps: replace tabwriter with renamed fork qsv-tabwriter #3010
• deps: use patched fork of whatlang-rs. Though our PR was merged, there is still no new release 6afff4f
• build(deps): bump base62 from 2.2.2 to 2.2.3 by @dependabot[bot] in #3003
• build(deps): bump bytemuck from 1.23.2 to 1.24.0 by @dependabot[bot] in #3026
• build(deps): bump chrono from 0.4.41 to 0.4.42 by @dependabot[bot] in #2974
• build(deps): bump fancy-regex from 0.16.1 to 0.16.2 by @dependabot[bot] in #3000
• build(deps): bump flate2 from 1.1.2 to 1.1.3 by @dependabot[bot] in #3027
• build(deps): bump flexi_logger from 0.31.2 to 0.31.3 by @dependabot[bot] in #3005
• build(deps): bump flexi_logger from 0.31.3 to 0.31.4 by @dependabot[bot] in #3008
• build(deps): bump indexmap from 2.11.0 to 2.11.1 by @dependabot[bot] in #2973
• build(deps): bump indexmap from 2.11.1 to 2.11.3 by @dependabot[bot] in #2993
• build(deps): bump indexmap from 2.11.3 to 2.11.4 by @dependabot[bot] in #2999
• build(deps): bump libc from 0.2.175 to 0.2.176 by @dependabot[bot] in #3009
• build(deps): bump mlua from 0.11.3 to 0.11.4 by @dependabot[bot] in #3021
• build(deps): bump regex from 1.11.2 to 1.11.3 by @dependabot[bot] in #3011
• build(deps): bump redis from 0.32.5 to 0.32.6 by @dependabot[bot] in #3016
• build(deps): bump qsv-stats from 0.38.0 to 0.39.0 by @dependabot[bot] in #3028
• build(deps): bump qsv-stats from 0.39.0 to 0.39.1 by @dependabot[bot] in #3029
• build(deps): bump redis from 0.32.6 to 0.32.7 by @dependabot[bot] in #3025
• build(deps): bump serde from 1.0.219 to 1.0.223 by @dependabot[bot] in #2983
• build(deps): bump serde from 1.0.223 to 1.0.224 by @dependabot[bot] in #2988
• build(deps): bump serde from 1.0.224 to 1.0.225 by @dependabot[bot] in #2994
• build(deps): bump serde from 1.0.225 to 1.0.226 by @dependabot[bot] in #3002
• build(deps): bump serde from 1.0.226 to 1.0.227 by @dependabot[bot] in #3014
• build(deps): bump serde from 1.0.227 to 1.0.228 by @dependabot[bot] in #3019
• build(deps): bump serde_json from 1.0.143 to 1.0.145 by @dependabot[bot] in #2981
• build(deps): bump semver from 1.0.26 to 1.0.27 by @dependabot[bot] in #2982
• build(deps): bump sysinfo from 0.37.0 to 0.37.1 by @dependabot[bot] in #3015
• build(deps): bump sysinfo from 0.37.1 to 0.37.2 by @dependabot[bot] in #3024
• build(deps): bump tempfile from 3.21.0 to 3.22.0 by @dependabot[bot] in #2975
• build(deps): bump tempfile from 3.22.0 to 3.23.0 by @dependabot[bot] in #3007
• build(deps): bump toml from 0.9.6 to 0.9.7 by @dependabot[bot] in #3001
• pin zip to 4.6, as zip 5 has features that are not widely adopted b231a23
• applied select clippy lint suggestions
• updated indirect dependencies
• bumped MSRV to Rust 1.90

Fixed

• describegpt: init cache vars even when --no-cache is used #2970
• describegpt: --base-url option being ignored #2977
• schema: delimiter detection #2998
• extdedup: really use memmapped ondisk hash table #3020

Removed:

• removed powerpc64-le cross-compilation directive now that we have access to IBM-provided native PowerPC GH Action runner 9659bfc
• removed macOS on Intel (x86_64-apple-darwin) prebuilt binaries

Full Changelog: 7.1.0...8.0.0