github johnkerl/miller v6.23.0
Miller 6.23.0: performance improvements and bugfixes

42 minutes ago

Performance

  • Cached regexes are looked up before compiling in regexpCompileCached: #2292
  • The CSV reader skips the per-field key lookup when the header has no duplicates: #2291
  • The JSON writer skips the escape loop for strings that need no escapes: #2321

Bug fixes

Input handling

  • UTF-8 BOM handling is fixed for gzipped CSV input: #2278
  • A leading UTF-8 BOM is now stripped for TSV and CSV-lite: #2281

Time and date functions

  • fsec2hms and fsec2dhms carry rounded fractional seconds correctly: #2282
  • strptime and gmt2sec now work for dates outside the int64 nanosecond range: #2285
  • File-backed TZ values are supported: #2247

String functions

  • strmatchx reports starts and ends as UTF-8 character positions, not byte positions: #2287
    Follow-up docs and generated-file regeneration: #2288

Number formatting

  • fmtnum now picks its formatter from the conversion verb, not from the end of the format string: #2295
    Follow-ups: #2297
  • fmtnum and --ofmt accept the C verbs %i, %u, %D and %U: #2298

Integer arithmetic

  • int ** int is computed exactly rather than through float64 where possible: #2296
    Extra unit-test cases (5**0, MinInt64**1): #2299
  • Integer zero divisors no longer cause a panic in ./, madd, msub, mmul and mexp: #2300
  • mexp results are reduced for exponents 0 and 1: #2301
  • abs, ceil, floor, round and sgn stay exact for ints above 2**53: #2309
  • Unary minus of the minimum int, and roundm on large ints, are fixed: #2311

Other

  • arrayify leaves its input unchanged: #2317
    Same for the Mlrval.Arrayify receiver: #2320
  • On Windows under Git Bash or MSYS2, sh is now found on the PATH: #2289
  • The mand.mlr magnitude calculation is fixed: #2257

Documentation, build and release tooling

  • Doubled cd in the library-setup docs is fixed: #2276
  • Prepipe commands that take flags are now quoted in help examples: #2275
  • LICENSE.txt is identified as BSD-2-Clause for GitHub's licensee: #2241
  • The releaser script uses Draft rather than Pre-release: #2261
  • make -C man build fails when groff is missing or the manpage pipeline fails: #2302
    Regenerated with the new groff version: #2303
  • creach is no longer used in docgen: #2313
  • ~/.mlrrc is suppressed in make docs: #2316
  • Go version is now 1.26.10: #2274
  • YAML dependency switched to go.yaml.in/yaml/v3: #2319

Dependency bumps (Dependabot)

  • github.com/klauspost/compress 1.20.0 to 1.20.4: #2258, #2269, #2304
  • golang.org/x/term 0.46.0 to 0.48.0: #2264, #2305
  • golang.org/x/text 0.42.0 to 0.44.0: #2262, #2306
  • golang.org/x/sys 0.49.0 to 0.50.0: #2294
  • pault.ag/go/debian 0.21.0 to 0.21.4: #2279, #2284, #2310
  • github.com/lestrrat-go/strftime 1.2.0 to 1.2.1: #2283
  • goreleaser/goreleaser-action 7.2.3 to 7.3.0: #2270
  • actions/upload-artifact 7.0.1 to 7.0.2: #2266
  • actions/setup-go 7.0.0 to 7.1.0: #2318
  • codeql-action group updates: #2259, #2265, #2272, #2280, #2290, #2293

New Contributors

Full Changelog: v6.22.0...v6.23.0

Don't miss a new miller release

NewReleases is sending notifications on new releases.