mikf/gallery-dl v1.27.0

on GitHub

Extractors

Additions

• [mastodon] add favorite, list, and hashtag extractors (#5529)
• [mastodon] add support for card images
• [pixeldrain] add support for single-file album downloads (#5641)
• [reddit] support comment embeds (#5366)
• [seiga] re-implement login with username & password
• [tapas] add creator extractor (#5306)
• [vsco] add avatar extractor (#5341)
• [wikimedia] support wiki.gg wikis

Fixes

• [4archive] fix extraction
• [8chan] fix file downloads by sending a TOS cookie (#5578)
• [artstation] disable TLS 1.2 ciphers by default (#5564, #5658)
• [bluesky] filter reposts only for user timelines (#5528)
• [common] disable check_hostname for custom SSLContexts (#3614, #4891, #5576)
• [exhentai] fix Multi-Page Viewer detection (#4969)
• [exhentai] fix blank page detection
• [hiperdex] update domain to hiperdex.top (#5635)
• [hotleak] download files returning a 404 status code (#5395)
• [imgur] match URLs with title slugs (#5593)
• [kemonoparty] fix KeyError - 'path' for posts without files (#5368, #5394, #5422, #5488)
• [kemonoparty] fix crash on posts with missing datetime info (#5422)
• [mastodon] send canonical true/false boolean values (#5516)
• [newgrounds] update and fix login procedure (#5109)
• [patreon] fix bootstrap data extraction (#5624)
• [poipiku] fix downloading R-18 posts (#5567)
• [poipoku] avoid language-specific extraction (#5590, #5591)
• [realbooru] fix videos and provide fallback URLs (#2530)
• [slideshare] fix extraction
• [subscribestar] fix file URLs (#5631)
• [twitter] update domain to x.com (#5597)
• [twitter] transfer twitter.com cookies to x.com (#5597)
• [twitter] prevent crash when extracting birdwatch metadata (#5403)
• [twitter] handle missing expanded_url fields (#5463, #5490)
• [wikimedia] suppress exception for entries without imageinfo (#5384)
• [wikimedia] fix exception for files with empty metadata

Improvements

• [exhentai] detect CAPTCHAs during login (#5492)
• [foolfuuka] improve board pattern & support pages (#5408)
• [furaffinity] match fxfuraffinity.net/fxraffinity.net/xfuraffinity.net URLs (#5511, #5568)
• [gelbooru] improve pagination logic for meta tags (#5478)
• [kemonoparty:favorite] return artists/posts in native order and support sort and order query parameters (#5375, #5620)
• [oauth] use Extractor.request() for HTTP requests to support proxy servers etc (#5433)
• [pixiv] change sanity_level debug message to a warning (#5180)
• [twitter] improve username & password login procedure (#5445)
• [twitter] wait for rate limit reset before encountering a 429 error (#5532)
• [twitter] match fixvx.com URLs (#5511)
• [twitter] match Tweet URLs with query parameters (#5371, #5372)
• [twitter] match /photo/ and /video/ Tweet URLs (#5443, #5601)

Options

• [common] add sleep-429 option (#5160)
• [common] implement skip-filter option (#5255)
• [common] implement keywords-eval option (#5621)
• [kemonoparty] add announcements option (#5262)
• [pixiv:novel] add covers option (#5373)
• [twitter] implement relogin option (#5445)

Downloaders

• [http] add MIME type and signature for .m4v files (#5505)

Post Processors

• [mtime] do not overwrite _mtime values with None (#5439)
• [ugoira] log errors for general exceptions

Archives

• [archive] move DownloadArchive code into its own module
• [archive] implement DownloadArchiveMemory class (#5255)
• [archive] add archive-mode option (#5255)

Cookies

• [cookies] use temporary file when saving cookies.txt files (#5461)
• [cookies] optimize _find_most_recently_used_file() for exact profiles (#5538)
• [cookies] set proper expires value for Chrome session cookies

Documentation

• [docs] update docs/configuration links (#5059, #5369, #5423)
• [docs] update link to "nightly" builds (#5618)
• [docs] replace AnchorJS with custom script
• [docs] update defaults of sleep-request, browser, tls12
• [docs] complete Authentication info in docs/supportedsites

Formatter

• [formatter] allow dots in '...' literals (#5539)

Output

• [output] enable colored output by default
• [output] extend output.colors (#2566)
• [output] support NO_COLOR environment variable
• [output] add --no-colors command-line option
• [output] add -w/--warning command-line option (#5474)

Tests

• [tests] select unused port number for local HTTP server
• [tests] allow filtering extractor result tests by URL or comment
• [tests] mark tests with missing auth as only_matching

Update

• implement update-related command-line options (#5233)
  • -U/--update updates an executable file to the latest release
  • --update-check checks if the local version is up to date
  • --update-to allows switching to a different release channel (stable or dev)
    as well as upgrading/downgrading to a specific tag.
    • --update-to dev
    • --update-to dev@2024.05.25
    • --update-to v1.25.2
  • (non-executable installations have only access to -U/--update-check for version checks)

Miscellaneous

• add workaround for requests 2.32.3 issues (#5665)
• fix exit status of --clear-cache/--list-extractors/--list-modules
• restore LD_LIBRARY_PATH for executables built with PyInstaller (#5421)
• store match and groups values in Extractor objects