github D4Vinci/Scrapling v0.3.5
Release v0.3.5

latest releases: v0.4.6, v0.4.5, v0.4.4...
6 months ago

Necessary release that fixes multiple issues

🚀 New Stuff

  • All browser-based fetchers (DynamicFetcher/StealthyFetcher/...) and their session classes are now fetching websites 15-20%:

    1. Page management is now much faster due to the logic improvement by @AbdullahY36 in #87
    2. Optimized the validation logic overall and improved page creation for sync fetches, which together introduced a lot of speed improvements
  • Big improvements to the stealth mode in DynamicFetcher and its session classes by replacing rebrowser-playwright with PatchRight:

    1. Before this update, rebrowser-playwright was turned off when you enabled stealth and real_chrome because they weren't doing well together, but now we don't have this issue with PatchRight
    2. You can now interact with Closed-Shadow Roots since PatchRight can handle them automatically.

🐛 Bug Fixes

  • Fixed a bug that happens while using the re method from the Selectors class.
  • Fixed a bug with uncurl and curl2fetcher commands in the Web Scraping Shell that made curl's --data-raw flag parse incorrectly.
  • Fixed a bug with the view command in the Web Scraping Shell that depended on the website's encoding to happen.
  • Fixed a bug with content converting that affected the mcp mode and extract commands.

New Contributors

🙏 Special thanks to our Discord community for all the continuous testing and feedback


Big shoutout to our biggest Sponsors

Don't miss a new Scrapling release

NewReleases is sending notifications on new releases.