github datawhores/OF-Scraper 3.0

latest releases: 2b538b9, 1510c51, a41d5b1...
15 months ago
  • addition cdms, including up to 3 auto choices
  • true multiprocessor support controllable via threads option
  • past use of threads as sem count depreciated
  • control download sem limit per thread via download-sem option
  • advanced config menu
  • support for httpx and aiohttp, for those on older version experiencing ssl errors this may help
  • fix for the infinite pin loop
  • discord queue removed and replaced with native logging implementation
  • shutdown process revamped and improved
  • prompt menu revamped and more dynamic
  • better support for Macs including in prompt menu
  • simplify keys in prompt menu
  • bug fixes for empty content-length response
  • bug fixes for empty content-type response
  • normalization of paths
    -improved output of text via bs4
  • optional toggle of download-progress bars
  • dynamically updating total download size count in MB/GB
  • use sessionbuilder class when possible
  • limited like.py via sems
  • update to how cache is used retrieve posts
  • increase chunk size, for better performance
  • decrease number of updates for progress bars, for better performance
  • threading of logs
  • better binary compatibility
  • change --media-type via command line
  • new config options
    • backend
    • download-sems
    • downloadbars
    • keydb_api
    • file_size_min
  • new arguments
    • --downloadsems
    • --downloadthreads
    • --mediatype
    • --neg-filter
    • --size-min
    • --size-max
  • manual mode now requires a url or filename input
  • removal of cache limit on key from cdm, as they don't seem to expire
  • more log statements
  • remove validators for placeholders, since the options have gotten too advanced
  • remove globals when possible, other then in download.py where they are need for threads and processes
  • fix for your_name username replacement for edge cases
  • some fixes for auth
  • fix for truncated issue on caused by mp4 parsing failure
  • neg filter for filtering post out post where regex is true

Don't miss a new OF-Scraper release

NewReleases is sending notifications on new releases.