Release Notes:
This release introduces the --random-order flag to solve a common problem with large archives: ensuring all pages get a fair chance to be saved.
What's New
When archiving a long list of URLs, jobs often can't finish in a single run due to rate limiting. This meant that pages early in the list were archived repeatedly, while pages at the end might never be.
The new --random-order flag shuffles the entire list of URLs before starting. Over multiple runs, this gives every page an equal chance of being submitted, dramatically improving the completeness of large archives over time.
How to Use:
archiver --sitemaps https://example.com/sitemap.xml --random-order