-
v8.0
-
New
- GhostArchive Source: Added GhostArchive as a new URL source for
-mode UAND-mode R. This source doesn't have an API, so waymore crawls the HTML pages directly to extract archived URLs. The source paginates automatically until no more results are found. For-mode Rit will download the WARC files and extract the HTTP Responses and extra URLs from them. - Added
-xgaargument to exclude checks for links from ghostarchive.org. - Updated
--providersargument to acceptghostarchiveas a valid provider value. - Added
.aviftoFILTER_URLandimage/aviftoFILTER_MIMEinconfig.ymland default values inDEFAULT_FILTER_URLandDEFAULT_FILTER_MIME.
- GhostArchive Source: Added GhostArchive as a new URL source for
-
Changed
- Remove
application/pdffromFILTER_MIMEinconfig.ymland default values inDEFAULT_FILTER_MIME. These files can contain valuable information and should not be filtered out.
- Remove
-