github datawhores/OF-Scraper 3.9.1

latest releases: 2b538b9, 1510c51, a41d5b1...
6 months ago

Merge Database
menu option to merge all databases in a directory recursively into a single database
It might be a good idea to back up your previous database, new columns will be added to previous database during the merging process

We need to be able to pull model_id from the old tables, if a database has multiple potential model_ids, then we will not automatically pull this data, the data is pulled from the profile table

This basically means you won't be able to merge two merged tables together

Other changes

  • fix issues with expired downloads
    • the previous fix was not working, so the download class had to be rewritten to basically reduce the number of retries, check mode will fail quickly and use some logic to gather new links from the ap
  • 429 min paused increased, hopefully this will help with rate limiting
  • fix some errors with transition, including missing unlocked value in media table
  • fix issue where profile table was missing unique value constraint
  • retrieve new signature on 403, because this could indicate the current ones have expired
    • also each time a new session object is made
  • fix issue where keydb was missing a needed constant value
  • fix issue where config files where not made, automatically
  • remove proxy_auth because auth can be sent through the proxy url, and httpx doesn't support seperate parameter

Don't miss a new OF-Scraper release

NewReleases is sending notifications on new releases.