github datawhores/OF-Scraper 3.13
Release 3.13

latest releases: 3.13.8+ff25bf58.1753149971, 3.13.8+dae566c2.1753149870, 3.13.8...
2 months ago

✨ New Features & Enhancements

  • SSL Validation Control: New config Option to explicitly disable SSL validation directly in the configuration file.
  • Revamped Check Modes: A comprehensive overhaul of how different check modes operate for more robust and flexible checks
  • Enhanced Filtering & Sorting:
    • Introduced more granular filters for better content discovery.
    • Improved sorting capabilities for refined organization of results.
  • Pagination Support: Added pagination to improve navigation and loading of large result sets.
  • Run Statistics Printout: (Thanks to @dunngitter!) Now includes start and end times in the run statistics printout for better tracking.
  • Log expire after: New config option to limit the length a long exists, before auto deletion

🚀 Performance & Core Improvements

  • Transition to uv (from Pipx): All internal references to pipx have been replaced with uv, leveraging uv's speed and efficiency for dependency management.
    • uv also supports automatic managment of python installs
  • Integrated FFmpeg (via pyffmpeg): FFmpeg is now automatically managed and internal to the project via pyffmpeg, this simplifying setup by removing the internal download scripts
  • Download Limiting: Refactoring of the download system to use semaphores (sems) for a easier download rate limiting.
  • Chunk Read Timeout: A timeout has been implemented for reading data chunks from websites, preventing hangs on slow connections.
  • Logging System Overhaul: Significant refactoring of the logging system, with many old functions removed or changed for a cleaner, more maintainable codebase.

🐛 Bug Fixes

  • Docker Creation Fix: Resolved an issue that prevented correct Docker image creation locally/via GitHub Actions
  • --after Command Fixes:
    • Improved logging specifically for the --after option.
    • Fixed a bug where the --after argument was always incorrectly set to zero.
  • Duplicate Arguments Fix: Addressed an issue causing duplicated arguments during execution.
  • Efficient Streaming Fix: No longer reads full response data into memory when streaming, reducing memory usage, especially for large downloads.
  • Large Download Memory Fix (for httpx): Specifically addresses issues where downloads using httpx would attempt to store complete data in memory before writing to disk.
  • User Data Retrieval Fix: Resolved a bug affecting the retrieval of user data.
  • Filter User List Bug Fix (Alt+X): Fixed a bug where filtering a user list could incorrectly reset to zero with the Alt+X action.
  • Leaky Bucket Limiter Fix: Addressed an issue with the aiolimiter leaky bucket implementation.
  • Length Fix Addressed an issue with the length config_options switch.

🐳 Docker Specific Updates

  • Multi-Architecture Images: Docker images now support multiple architectures, improving compatibility across different systems.

  • Enhanced User Handling: Improved user handling within Docker images using an entry-script, allowing for more dynamic control of the permissions and environment of the docker run

  • New Docker Image Branches: Introduced dedicated dev and stable branches for Docker images.

    • latest tag Modified to update for every commit
  • Reduced Image Size: Significantly reduced the Docker image size to approximately ~100MB.

  • uv in Docker: pipx references in the Docker image have been replaced with uv.
    Thanks to Use: Astronaut — for helping to further optimize the build process

📦 Binaries

  • Updated and re-enabled binaries for all supported platforms

Don't miss a new OF-Scraper release

NewReleases is sending notifications on new releases.