johnkerl/miller v6.18.1

v6.18.1: DKVPX file format; misc. features and bugfixes

on GitHub

New features

• DKVPX file format: New file format added (#2002)
• hasvalue builtin function: New function for value existence checks (#2026)
• Fixed-width support for PPRINT reader: Read fixed-width input via PPRINT (#1999)
• Unicode printing support for barred output: Improved barred output rendering (#1984)
• Regexed field-selection for mlr sort-within-records: Select fields by regex when sorting (#1964)
• LRU-caching for split: Performance improvement for mlr split (#2003)

Bug fixes

• #1639: stats1 null_count with --fr regex now gives correct results (#1994)
• #1784: Fixed inconsistent mapexcept behavior (#2004)
• #1998: Fixed PPRINT barred reader over-reading columns with ragged/implicit headers (#2005)
• YAML output: Preserve key order (#2034)
• Array compare: Fix crash when arrays contain absent values (#2039)
• mlr step: Fix race condition (#2041)
• sub/gsub: Correct handling of "\n" in replacement (#2042)
• Windows CI fix (#2044)

Internals and tooling

• Upgraded to Go 1.25 (#2012)
• Replaced GOCC parser-generator with PGPG (#2015)
• Simplified positional-indexing syntax in mlr.bnf (#2008)
• Experimental mlr script mode (#2009)
• Multiple staticcheck cleanups (#2006, #2007)

Documentation

• New record-templating and custom record-output formatting examples (#1988, #1989)
• Updated performance numbers and language-timings reorg (#1990, #1991, #2000)
• DeepWiki badge added to README (#1986, #1987)

New Contributors

• @lawrence3699 made their first contribution in #2034

Full details

• Fix #1639: stats1 null_count with --fr regex gives wrong results by @cobyfrombrooklyn-bot in #1994
• Add regexed field-selection to sort-within-records by @johnkerl in #1964
• Fix Windows CI fail on PR #1994 by @johnkerl in #2044
• Add unicode printing support for barred output by @balki in #1984
• Run make dev after PR 1984 by @johnkerl in #1985
• Add badge for DeepWiki to README by @aborruso in #1986
• Add record-templating example to docs by @johnkerl in #1988
• Add docs example on custom record-output formatting by @johnkerl in #1989
• Update performance numbers by @johnkerl in #1990
• Update DeepWiki badge placement in README.md by @johnkerl in #1987
• Update performance docs by @johnkerl in #1991
• Add fixed width support for pprint reader by @balki in #1999
• Language-timings reorg by @johnkerl in #2000
• Add DKVPX file format by @johnkerl in #2002
• Add LRU-caching for split by @johnkerl in #2003
• Fix #1784: inconsistent mapexcept behavior by @johnkerl in #2004
• Fix #1998: PPRINT barred input reader reads only one extra column with ragged and implicit headers by @johnkerl in #2005
• Some fixes for staticcheck by @johnkerl in #2006
• More staticcheck fixes by @johnkerl in #2007
• Simplify positional-indexing syntax in mlr.bnf; push logic to .go source by @johnkerl in #2008
• Experiment with mlr script by @johnkerl in #2009
• Use Go 1.25 by @johnkerl in #2012
• Replace GOCC parser-generator with PGPG by @johnkerl in #2015
• Add hasvalue builtin function by @balki in #2026
• Run make dev after PR #2026 by @johnkerl in #2027
• fix: preserve key order in YAML output by @lawrence3699 in #2034
• Fix crash on array compare containing absent values by @balki in #2039
• Fix race condition in mlr step by @johnkerl in #2041
• Use "\n" in replace for gsub and sub by @johnkerl in #2042

Dependency updates

• Bump github/codeql-action from 4.32.3 to 4.32.4 by @dependabot[bot] in #1993
• Bump goreleaser/goreleaser-action from 6.4.0 to 7.0.0 by @dependabot[bot] in #1992
• Bump actions/setup-go from 6.2.0 to 6.3.0 by @dependabot[bot] in #1995
• Bump actions/upload-artifact from 6.0.0 to 7.0.0 by @dependabot[bot] in #1996
• Bump github/codeql-action from 4.32.4 to 4.32.5 by @dependabot[bot] in #2001
• Bump github/codeql-action from 4.32.5 to 4.32.6 by @dependabot[bot] in #2010
• Bump golang.org/x/text from 0.34.0 to 0.35.0 by @dependabot[bot] in #2014
• Bump golang.org/x/term from 0.40.0 to 0.41.0 by @dependabot[bot] in #2013
• Bump github/codeql-action from 4.32.6 to 4.33.0 by @dependabot[bot] in #2016
• Bump actions/cache from 5.0.3 to 5.0.4 by @dependabot[bot] in #2017
• Bump github/codeql-action from 4.33.0 to 4.34.1 by @dependabot[bot] in #2019
• Bump github.com/klauspost/compress from 1.18.4 to 1.18.5 by @dependabot[bot] in #2018
• Bump actions/setup-go from 6.3.0 to 6.4.0 by @dependabot[bot] in #2024
• Bump github/codeql-action from 4.34.1 to 4.35.1 by @dependabot[bot] in #2023
• Bump github.com/mattn/go-isatty from 0.0.20 to 0.0.21 by @dependabot[bot] in #2031
• Bump golang.org/x/sys from 0.42.0 to 0.43.0 by @dependabot[bot] in #2030
• Bump golang.org/x/text from 0.35.0 to 0.36.0 by @dependabot[bot] in #2032
• Bump golang.org/x/term from 0.41.0 to 0.42.0 by @dependabot[bot] in #2033
• Bump actions/upload-artifact from 7.0.0 to 7.0.1 by @dependabot[bot] in #2036
• Bump actions/cache from 5.0.4 to 5.0.5 by @dependabot[bot] in #2037
• Bump github/codeql-action from 4.35.1 to 4.35.2 by @dependabot[bot] in #2038

Full Changelog: v6.17.0...v6.18.0