Added
- Camwhores.tv support
- Flugel-anime support
- Missav support
- Beeg.com support
- efukt support
- Vipergirls support
- Initial HLS support (requires ffmpeg)
- Support for any WordPress media site. See: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances
- Support for any Discourse site See: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances
- Add a config option to disable specific crawlers: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#disable_crawlers
- Add new
ssl_context
config option: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context - Add a config option to map unknown URLs to generic crawlers: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/generic_crawlers_instances
Changed
- Date parsing errors will be logged as warnings, not errors
- Use an asynchronous DNS resolver
- Use native system certificates by default, with fallback to
certifi
. See: https://script-ware.gitbook.io/cyberdrop-dl/reference/configuration-options/global-settings/general#ssl_context - Some crawlers have a new logic to create a filename. The name format for newly downloaded files may not match previous versions.
- Config options that take format strings will be validated at startup
- URLs will only be processed once, ignoring duplicates, even if they come from different crawlers. ex: If you have a dropbox URL in
URLs.txt
and CDL finds that same URL while crawling a forum, it will silently ignore the URL from the forum. - General performance improvements
- New blocked domains:
gfycat
ko-fi.com
paypal.me
amazon.com
throne.com
youtu.be
youtube.com
linktr.ee
beacons.page
beacons.ai
allmylinks.com
Deprecated
- Support for 32-bit Python and 32-bit operating systems in general is deprecated. On a future version, the start scripts will explicitly fail when trying to install on 32-bit systems. This deprecation only applies to the start scripts. 32-bit versions can still be installed manually via
pip
, but the user may need to compile any missing wheels.
Removed
no-ui
optionallow_insecure_connections
option- Importing cookies from multi browsers is no longer supported. CDL will only try to extract cookies from a single browser. The
browsers
option was renamedbrowser
Fixed
ImportError: cannot import name 'MethodType'
on startup- Handle errors while processing confirmation links (Xenforo)
- Redgifs not being downloaded (Xenforo)
- Attachments not being downloaded (Xenforo)
- Posts not being fully scraped if a single link in them failed (Xenforo)
- Download from user profiles (xHamster)
- Folder downloads (Cyberfile)
- Do not crash when using the
Create file hashes
option from the main menu - Do not download "related" or "favorites" videos from a profile (PornHub)
KeyError
when using the--separate-posts
option- Using Real Debrid no longer causes CDL to crash
- Image downloads (HotPic)
- Do not try to download emojis (twitter_images)
- Fix albums downloads (saint)
- Handle all possible response errors (reddit)
- Do not use reddit's
user-agent
for every site - Fix
unclose client session
error at the end of a run - Fix parsing of dropbox folders URLS
- Handle embeded URLS (box.com)
- [Regression] Fixed free space check when using network drives (windows)