github datawhores/OF-Scraper 3.1

latest releases: 9f3b50f, 3.10.16, df1edee...
10 months ago
  • uvloop for linux
  • auto create db backup
  • other logger can now get separate process at 2 threads min
  • threads==0 will force downloads on main thread always
  • main thread forced for downloads less less then download-sems
  • Some optimizations with asyncio via remove removing blocking code
  • custom optimize for more flexibility
  • Slight rework of username retrieval
  • Fixes for frozen releases aka binaries on windows
  • Optimization for getting total for auto-resume download
  • Protection for Database failures
  • auto set boundaries for getting new posts only, for timeline and messages
  • option to switch cache mode
  • add excluded-post
  • support user-lists
  • support --media-type override
  • optimize database operation
  • example check current posts, and only inserting new posts
  • set default process type to fork-server on linux
  • show user number progress on low
  • max open file option in config
  • permanent api cache, instead will be appended to
    • db will be used to verify if a full scan is required
  • insert media before download, like posts from APIs
  • Fix some responsetypes being set as "posts" in some instances
  • add header to profile download @newdenim
  • support for --user in docker @dunngitter
  • spelling @McGargan81
  • @merqwury for previous label support

Don't miss a new OF-Scraper release

NewReleases is sending notifications on new releases.