datawhores/OF-Scraper 3.13.1

Release 3.13.1

on GitHub

Release Notes

This release introduces a significant overhaul of the application's core systems, focusing on improved configuration management.

🚀 Major Features & Refinements

1. Advanced Rate-Limit Handling with SessionSleep

The session management system has been completely redesigned with the new SessionSleep class.

• Shared Sleep State: Added the ability to share SessionSleep objects across multiple sessionManager instances, allowing different parts of the application to respect a unified backoff state.

2. Environment Variable Loading

Advanced Configuration has been centralized and streamlined with a clear order of precedence, making it easier to manage settings for different environments.

• Loading Hierarchy:
  1. System Environment Variables (Highest Priority)
  2. Explicit .env files via --env-file argument
  3. Hardcoded Defaults (Lowest Priority)
• Support for --env-file: You can now specify one or more .env files from the command line, with later files overriding earlier ones. This is ideal for managing development, staging, and production environments.
• Removed Constants: Replaced constants controlled via config file with a centralized env module that is populated based on the new loading hierarchy, improving flexibility and removing magic numbers.
• Centralized Declaration: All env_variables are declared within the of_env folder.

3. Enhanced Scripting and Customization

The previous custom code-execution system has been replaced.

• New Scripting Hooks: Introduced naming_script and download_skip_script to allow for fine-grained control over file naming and download logic.

⚙️ Fixes & Improvements

• Post & Media Hierarchy Refactor: The data models for posts and media have been refactored with a new PostCollection class, improving data consistency and simplifying internal logic.
• Like/Unlike Action Update: The like and unlike actions have been updated to align with recent API changes, ensuring they function correctly.