jqnatividad/qsv 0.22.0

on GitHub

MAJOR NEW FEATURES

• generate command. Generate test data by profiling a CSV using Markov decision process machine learning.
• add --no-headers option to rename command (see discussion #81)
• New environment variables:
  • QSV_DEFAULT_DELIMITER - single ascii character to use as delimiter. Overrides --delimeter option.
    Defaults to "," (comma) for CSV files and "\t" (tab) for TSV files, when not set. Note that this will also set the delimiter for qsv's output. Adapted from xsv PR by @camerondavison.
  • QSV_NO_HEADERS - when set, the first row will NOT be interpreted as headers. Supersedes QSV_TOGGLE_HEADERS.
  • QSV_MAX_JOBS - number of jobs to use for parallelized commands (currently frequency, split and stats). If not set, max_jobs is set
    to number of logical processors divided by four. See Parallelization for more info.
  • QSV_REGEX_UNICODE - if set, makes search, searchset and replace commands unicode-aware.
    For increased performance, these commands are not unicode-aware and will ignore unicode values when matching and will panic when unicode characters are used in the regex.
• Added parallelization heuristic (num_cpus/4), in connection with QSV_MAX_JOBS.

See CHANGELOG for details.