github D4Vinci/Scrapling v0.2.6

latest releases: v0.4.2, v0.4.1, v0.4...
15 months ago

What's changed

New features

  • Now the PlayWrightFetcher can use the real browser directly with the real_chrome argument passed to the PlayWrightFetcher.fetch function but this requires you to have Chrome browser installed. Scrapling will launch an instance of your Chrome browser and you can use most of the options as normal. (Before you only had the cdp_url argument to do so)
  • Pumped up the version of headers generated for real browsers.

Bugs Squashed

  1. Turns out the format of the browser headers generated by BrowserForge was outdated which made Scrapling detected by some protections so now BrowserForge is only used to generate real useragent.
  2. Now the hide_canvas argument is turned off by default as it's being detected by Google's ReCaptcha.

Note

A friendly reminder that maintaining and improving Scrapling takes a lot of time and effort which I have been happily doing for months even though it's becoming harder. So, if you like Scrapling and want it to keep improving, you can help by supporting me through the Sponsor button.

Don't miss a new Scrapling release

NewReleases is sending notifications on new releases.