Byron/dua-cli v2.39.0

on GitHub

The main feature this release is parallel deletion, both for collecting files to be deleted as well as the deletion itself. On my local disk, it now reaches 144k files/s overall deletion performance.

New Features

• delete files in parallel
  Recursive deletion now uses the same worker count selected with --threads for
  the initial filesystem scan, to accelerate the collection of files to be deleted,
  as well as the deletion of files.

  When marked directories are deleted, dua now:

  1. walks the selected tree without (following symbolic links as usual)
  2. collects regular files and symbolic links;
  3. removes those entries across the configured workers;
  4. removes directories from deepest to shallowest after their contents are gone on a single thread.

  A value of 1 keeps deletion effectively serial. Larger values allow
  independent file removals to overlap, which is most useful for large directory
  trees or filesystems with concurrent metadata operations.

Bug Fixes

• open errors and cleanup/gitignored footer labels

Refactor

• use jwalk for parallel, symlink-safe deletion
  Replace the hand-rolled stack traversal in delete_directory_recursively
  with a jwalk WalkDir (follow_links=false, skip_hidden=false). This is
  the same walker the rest of dua uses for scanning, so deletion now
  benefits from parallel traversal on multi-core machines.

  Behaviour preserved:

  • Symlinks are removed without following them (remove_file on the link).
  • Directories are removed deepest-first so each remove_dir sees an
    empty directory.
  • Error counting and byte accounting unchanged.

  Adds unit tests covering: single file, nested tree, symlink safety,
  and missing-path error reporting.

Test

• Make traversal tree tests filesystem-independent
  That way, tests will work locally.

Commit Statistics

• 10 commits contributed to the release over the course of 4 calendar days.
• 8 days passed between releases.
• 4 commits were understood as conventional.
• 0 issues like '(#ID)' were seen in commit messages

Commit Details