github datawhores/OF-Scraper 3.4

latest releases: 256903e, 3.12.9, ddae54d...
10 months ago
  • Instructions for fixing shared libraries FFmpeg issue
    see: https://of-scraper.gitbook.io/of-scraper/faq#13.-ffmpeg-shared-library-not-found-error

  • Fix for comparing same paths on setting date

    • This should better support things like network drives
  • Revamp download code

    • moved into own folder
    • some longer functions have been split up into sub functions
    • some common code put into common.py and keyhelpers.py
    • tenacity context provider is used in some causes for better readability, and control. Compared to using the decorator
    • Better handle of file descriptors or open files, and making sure they are closed on exit
    • some bug fixes to improve download outcomes
  • new Metadata Download mode * sets script to not add any new download to disk, but the same actions will be carried out including adding new posts and media to database, the download status will be set based on presence of file on disk

  • Changes to Linux binaries

    • pyinstaller entry-point has been change to fix issue with parsing args
  • manual key mode doesn't seem to work with some of the HTTP clients, so forcing use of one that works for now

  • Better logging of threads/processes, which should help diagnose the source of hangs

  • Adding timeouts to certain threads to force closure on long instances of inactivity

  • appendlog config option
    *each log will be placed into separate sub folders based on the current day. When the script starts a new log file will be created in the current sub folder



Don't miss a new OF-Scraper release

NewReleases is sending notifications on new releases.