yt-dlp/yt-dlp-nightly-builds 2023.06.05.154505

yt-dlp nightly 2023.06.05.154505

on GitHub

Core changes

• Add --no-quiet by pukkandan
• Add option --xff by pukkandan
• Auto-select default format in -f- (#7101) by ivanskodje, pukkandan
• Deprecate internal Youtubedl-no-compression header (#6876) by coletdjnz
• Do not translate newlines in --print-to-file by pukkandan
• Ensure pre-processor errors do not block --print by pukkandan (With fixes in 17ba434)
• Implement --color flag (#6904) by Grub4K
• Improve HTTP redirect handling (#7094) by coletdjnz
• Merged with youtube-dl d1c6c5 by pukkandan (With fixes in edbe5b5 by bashonly)
• Populate filename and urls fields at all stages of --print by pukkandan (With fixes in b5f61b6)
• Relaxed validation for numeric format filters by pukkandan
• Support decoding multiple content encodings (#7142) by coletdjnz
• Support loading info.json with a list at it's root by pukkandan
• Workaround erroneous urllib Windows proxy parsing (#7092) by coletdjnz
• cookies
  • Defer extraction of v11 key from keyring by Grub4K
  • Move YoutubeDLCookieJar to cookies module (#7091) by coletdjnz
  • Support custom Safari cookies path (#6783) by NextFire
  • Update for chromium changes (#6897) by mbway
• Cryptodome: Fix __bool__ by pukkandan
• jsinterp
  • Do not compile regex by pukkandan
  • Handle NaN in bitwise operators by pukkandan
  • Handle negative numbers better by pukkandan
• outtmpl
  • Allow \n in replacements and default. by pukkandan
  • Support str.format syntax inside replacements by pukkandan
• update
  • Better error handling by pukkandan
  • Implement --update-to repo by Grub4K, pukkandan
• utils
  • js_to_json: Implement template strings (#6623) by Grub4K
  • locked_file: Fix for virtiofs (#6840) by brandon-dacrib
  • traverse_obj
    • Allow iterables in traversal (#6902) by Grub4K
    • More fixes (#6959) by Grub4K
  • write_string: Fix noconsole behavior by Grub4K

Extractor changes

• Do not exit early for unsuitable url_result by pukkandan
• Do not warn for invalid chapter data in description by pukkandan
• Extract more metadata from ISM by pukkandan
• abematv: Add fallback for title and description extraction and extract more metadata (#6994) by Lesmiscore
• acast: Support embeds (#7212) by pabs3
• adobepass: Handle Charter_Direct MSO as Spectrum (#6824) by bashonly
• aeonco: Support Youtube embeds (#6591) by alexklapheke
• ARDBetaMediathek: Add thumbnail (#6890) by StefanLobbenmeier
• bibeltv: Fix extraction, support live streams and series (#6505) by flashdagger
• bilibili
  • Support festival videos (#6547) by qbnu
  • SpaceVideo: Extract signature (#7149) by elyse0
• biliIntl: Add comment extraction (#6079) by HobbyistDev
• bitchute: Add more fallback subdomains (#6907) by Neurognostic
• booyah: Remove extractor by pukkandan
• BrainPOP: Add extractors (#6106) by MinePlayersPE
• bravotv
  • Detect DRM (#7171) by bashonly
  • Fix extractor (#6568) by bashonly
• camfm: Add extractors (#7083) by garret1317
• cbc
  • Fix live extractor, playlist _VALID_URL (#6625) by makew0rld
  • Ignore 426 from API (#6781) by jo-nike
  • gem: Update _VALID_URL (#6499) by makeworld-the-better-one
• cbs: Add ParamountPressExpress extractor (#6604) by bashonly
• cbsnews: Overhaul extractors (#6681) by bashonly
• chilloutzone: Fix extractor (#6445) by bashonly
• clipchamp: Add extractor (#6978) by bashonly
• comedycentral: Add support for movies (#7108) by sqrtNOT
• crtvg: Add extractor (#7168) by ItzMaxTV
• crunchyroll: Rework with support for movies, music and artists (#6237) by Grub4K
• dacast: Add extractors (#6896) by bashonly
• daftsex: Update domain and embed player url (#5966) by JChris246
• DigitalConcertHall: Support films (#7202) by ItzMaxTV
• dlf: Add extractors (#6697) by nick-cd
• drtv: Fix radio page extraction (#6552) by viktor-enzell
• elevensports: Add extractor (#7172) by ItzMaxTV
• europarl: Rewrite extractor (#7114) by HobbyistDev
• eurosport: Improve _VALID_URL (#7076) by HobbyistDev
• facebook: Fix metadata extraction (#6856) by ringus1
• foxnews: Fix extractors (#7222) by bashonly
• generic
  • Accept values for fragment_query, variant_query (#6600) by bashonly (With fixes in 9bfe0d1)
  • Add extractor-args hls_key, variant_query (#6567) by bashonly
  • Attempt to detect live HLS (#6775) by bashonly
• genius: Add support for articles (#6474) by bashonly
• globalplayer: Add extractors (#6903) by garret1317
• gmanetwork: Add extractor (#5945) by HobbyistDev
• gronkh: Extract duration and chapters (#6817) by satan1st
• hentaistigma: Remove extractor by pukkandan
• hidive: Fix login by pukkandan
• hollywoodreporter: Add extractors (#6614) by bashonly
• hotstar: Support /shows/ URLs (#7225) by bashonly
• hrefli: Add extractor (#6762) by selfisekai
• idolplus: Add extractor (#6732) by ping
• iq: Set more language codes (#6476) by D0LLYNH0
• iwara
  • Accept old URLs by Lesmiscore
  • Fix format sorting (#6651) by hasezoey
  • Fix typo by Lesmiscore
  • Implement login (#6721) by toomyzoom
  • Overhaul extractors (#6557) by Lesmiscore
  • Report private videos (#6641) by Lesmiscore
• JStream: Add extractor (#6252) by Lesmiscore
• jwplatform: Update _extract_embed_urls (#6383) by carusocr
• kick: Make initial request non-fatal by bashonly
• LastFM: Rewrite playlist extraction (#6379) by hatienl0i261299, pukkandan
• line: Remove extractors (#6734) by sian1468
• livestream: Support videos with account id (#6324) by theperfectpunk
• medaltv: Fix clips (#6502) by xenova
• mediastream: Improve WinSports and embed extraction (#6426) by bashonly
• Mzaalo: Add extractor (#7163) by ItzMaxTV
• nbc: Fix NBCStations direct mp4 formats (#6637) by bashonly
• nebula: Add beta.nebula.tv (#6516) by unbeatable-101
• nekohacker: Add extractor (#7003) by hasezoey
• nhk
  • Add NhkRadiru extractor (#6819) by garret1317
  • Fix API extraction (#7180) by menschel, sjthespian
• niconico
  • Download comments from the new endpoint (#6773) by Lesmiscore
  • live: Add extractor (#5764) by Lesmiscore
• NiconicoSeries: Fix extraction (#6898) by sqrtNOT
• nubilesporn: Add extractor (#6231) by permunkle
• opencast
  • Add ltitools to _VALID_URL (#6371) by C0D3D3V
  • Fix format bug (#6512) by C0D3D3V
• owncloud: Add extractor (#6533) by C0D3D3V
• Parler: Rewrite extractor (#6446) by JChris246
• pgatour: Add extractor (#6613) by bashonly
• playsuisse: Support new url format (#6528) by sbor23
• polskieradio: Improve extractors (#5948) by selfisekai
• pornez: Support new URL formats (#6792) by zhgwn
• pornhub: Set access cookies to fix extraction (#6685) by arobase-che, Schmoaaaaah
• rai: Rewrite extractors (#5940) by danog, nixxo
• recurbate: Add extractor (#6297) by mrscrapy
• reddit
  • Add login support (#6950) by bashonly
  • Support cookies and short URLs (#6825) by bashonly
• rokfin: Re-construct manifest url (#6507) by vampirefrog
• rottentomatoes: Fix extractor (#6844) by JChris246
• rozhlas: Extract manifest formats (#6590) by bashonly
• rtvc: Add extractors (#6578) by elyse0
• rumble
  • Detect timeline format by pukkandan
  • Fix videos without quality selection by pukkandan
• sbs: Overhaul extractor for new API (#6839) by bashonly, dirkf, vidiot720
• shemaroome: Pass stream_key header to downloader (#7224) by bashonly
• sonyliv: Fix login with token (#7223) by bashonly
• stageplus: Add extractor (#6838) by bashonly
• substack: Fix extraction (#7218) by bashonly
• sverigesradio: Support slug URLs (#7220) by bashonly
• teamcoco: Fix extractor (#6437) by bashonly
• telecaribe: Expand livestream support (#6601) by bashonly
• tencent: Fix fatal metadata extraction (#7219) by bashonly
• thesun: Update _VALID_URL (#6522) by hatienl0i261299
• tiktok
  • Extract 1080p adaptive formats (#7228) by bashonly
  • Fix and improve metadata extraction (#6777) by bashonly
  • Fix mp3 formats (#6615) by bashonly
  • Improve TikTokLive extractor (#6520) by bashonly
• triller: Support short URLs, detect removed videos (#6636) by bashonly
• tvp: Use new API (#6989) by selfisekai
• tvplay: Remove outdated domains (#7106) by ivanskodje
• twitch
  • Extract original size thumbnail (#6629) by JC-Chung
  • Fix is_live (#6500) by elyse0
  • Support mobile clips (#6699) by bepvte
  • Update _CLIENT_ID and add extractor-arg (#7200) by bashonly
  • vod: Support links from schedule tab (#7071) by falbrechtskirchinger
• twitter
  • Default to GraphQL, handle auth errors (#6957) by bashonly
  • spaces: Add release_timestamp (#7186) by CeruleanSky
• vrt: Overhaul extractors (#6244) by bashonly, bergoid, jeroenj
• weverse: Add extractors (#6711) by bashonly (With fixes in fd5d93f)
• wevidi: Add extractor (#6868) by truedread
• weyyak: Add extractor (#7124) by ItzMaxTV
• whyp: Add extractor (#6803) by CoryTibbettsDev
• wrestleuniverse: Fix extraction, add login (#6982) by bashonly, Grub4K
• wykop: Add extractors (#6140) by selfisekai
• YahooGyaOIE, YahooGyaOPlayerIE: Delete extractors due to website close (#6218) by Lesmiscore
• youku: Improve error message (#6690) by carusocr
• youporn: Extract m3u8 formats by pukkandan
• youtube
  • Add client name to format_note when -v (#6254) by Lesmiscore, pukkandan
  • Add extractor-arg include_duplicate_formats by pukkandan
  • Bypass throttling for -f17 by pukkandan
  • Construct fragment list lazily by pukkandan (With fixes in e389d17)
  • Define strict uploader metadata mapping (#6384) by coletdjnz
  • Extract heatmap data (#7100) by tntmod54321
  • Extract more metadata for comments (#7179) by coletdjnz
  • Extract uploader metadata for feed/playlist items by coletdjnz
  • Fix comment loop detection for pinned comments (#6714) by coletdjnz
  • Fix continuation loop with no comments (#7148) by coletdjnz
  • Fix parsing comment_count (#6523) by nick-cd
  • Handle incomplete initial data from watch page (#6510) by coletdjnz
  • Revert default formats to https by pukkandan
  • Support podcasts and releases tabs by coletdjnz
  • Support shorter relative time format (#7191) by coletdjnz
  • music, search_url: Extract title (#7102) by kangalio
• zdf: Fix formats extraction by bashonly
• zingmp3: Fix and improve extractors (#6367) by hatienl0i261299
• zoom
  • Fix extractor (#6741) by shreyasminocha
  • Fix share URL extraction (#6789) by bashonly

Downloader changes

• curl: Fix progress reporting by pukkandan

Postprocessor changes

• Fix chapters if duration is not extracted (#6037) by bashonly
• EmbedThumbnail, FFmpegMetadata: Fix error on attaching thumbnails and info json for mkv/mka (#6647) by Lesmiscore
• ffmpegfixupm3u8pp: Check audio codec before fixup (#6778) by bashonly
• FixupDuplicateMoov: Fix bug in triggering by pukkandan

Misc. changes

• Add automatic duplicate issue detection by pukkandan
• build
  • Fix macOS target by Grub4K
  • Implement build verification using --update-to by bashonly, Grub4K
  • Pin pyinstaller version for MacOS by pukkandan
  • Various build workflow improvements by bashonly, Grub4K
• cleanup: Miscellaneous: 6f2287c by pukkandan
• cleanup, utils: Split into submodules (#7090) by coletdjnz, pukkandan
• cli_to_api: Add script by pukkandan
• devscripts: make_changelog: Various improvements by Grub4K
• docs: Misc improvements by pukkandan