johnkerl/miller v6.11.0

CSV/TSV auto-unsparsify, regex-fieldname support for reorder/sub/ssub/gsub, strmatch DSL function, and more

on GitHub

Features

• Auto-unsparsify CSV and TSV on output by @johnkerl in #1479
  • Issue #1418
  • https://miller.readthedocs.io/en/latest/record-heterogeneity/#rectangular-file-formats-csv-and-pretty-print
  • https://miller.readthedocs.io/en/latest/file-formats/#csvtsvasvusvetc
• mlr reorder with regex support by @johnkerl in #1473
  • https://miller.readthedocs.io/en/latest/reference-verbs/index.html#reorder
• Implement all/by-regex field selection (-a/-r) for mlr sub, gsub, and ssub by @johnkerl in #1480
  • https://miller.readthedocs.io/en/latest/reference-dsl-builtin-functions/index.html#sub
  • https://miller.readthedocs.io/en/latest/reference-dsl-builtin-functions/index.html#gsub
  • https://miller.readthedocs.io/en/latest/reference-dsl-builtin-functions/index.html#ssub
• Preserve regex captures across stack frames by @johnkerl in #1447
• Document and unit-test regex-capture reset logic by @johnkerl in #1451
• New strmatch/strmatchx DSL functions by @johnkerl in #1448
  • https://miller.readthedocs.io/en/latest/reference-dsl-builtin-functions/index.html#strmatch
  • https://miller.readthedocs.io/en/latest/reference-dsl-builtin-functions/index.html#strmatchx
• Implement mlr uniq -x by @johnkerl in #1457
  • https://miller.readthedocs.io/en/latest/reference-verbs/index.html#uniq
• On-line help info for mlr join --lk "" by @johnkerl in #1458
  • https://miller.readthedocs.io/en/latest/reference-verbs/index.html#join
• Fix PR 1462: remove limit of 1000 on dedupe field names by @johnkerl in #1463
• Support PPRINT barred input by @johnkerl in #1472
  • https://miller.readthedocs.io/en/latest/file-formats/
• Support markdown format on input by @johnkerl in #1478
  • https://miller.readthedocs.io/en/latest/file-formats/

Bugfixes

• mlr --norc was erroring by @johnkerl in #1450
• Have clean_whitespace re-run type inference by @johnkerl in #1464

Internals

• Rename internal regex functions by @johnkerl in #1446
• Replace deprecated io/ioutil functions by @Juneezee in #1452
• Internal name-neatens by @johnkerl in #1475
• Fix typos in tests for PPRINT barred input by @johnkerl in #1476
• Don't run regression tests twice in GitHub CI by @johnkerl in #1477
• Miller 6.11.0 by @johnkerl in #1481

Dependencies

• Bump actions/upload-artifact from 3.1.3 to 4.0.0 by @dependabot in #1445
• Bump golang.org/x/term from 0.15.0 to 0.16.0 by @dependabot in #1466
• Bump actions/cache from 3.3.2 to 3.3.3 by @dependabot in #1468
• Bump actions/upload-artifact from 4.0.0 to 4.1.0 by @dependabot in #1469
• Bump actions/cache from 3.3.3 to 4.0.0 by @dependabot in #1470
• Bump actions/upload-artifact from 4.1.0 to 4.2.0 by @dependabot in #1471

Full Changelog: v6.10.0...v6.11.0