github D4Vinci/Scrapling v0.4.11
Release v0.4.11

3 hours ago

A solid update bringing the first platform spider template, a faster parser, and important fixes 🎉

🚀 New Stuff and quality of life changes

  • Added ShopifySpider, the first platform spider template! Extract every product from any Shopify-powered store through its JSON API without touching the website's HTML. Subclass it, set the store's domain, and you are done (Check the docs)
    from scrapling.spiders import ShopifySpider
    
    class MyStore(ShopifySpider):
        target_website = "example.com"
    
    result = MyStore().start()
  • Added --executable-path to the CLI browser commands. Both scrapling extract fetch and scrapling extract stealthy-fetch now accept a custom Chromium-compatible browser executable, and fall back to the SCRAPLING_EXECUTABLE_PATH environment variable when the option isn't passed, bringing full parity with the MCP server (Solves #371)
    scrapling extract fetch "https://example.com" page.html --executable-path "/path/to/chromium"

🤖 Quality of life changes

  • Made find_by_text and find_by_regex up to ~2x faster when first_match is enabled (the default) by wrapping elements lazily so the search stops at the first match, by @yetval in #370
  • Updated the benchmarks with the new numbers against the latest versions of all libraries.
  • Updated contribution rules

🐛 Bug Fixes

  • Fixed the MCP server's fetch tools crashing on pages containing control characters with the error All strings must be XML compatible, by @yetval in #368 (Fixes #366)

🙏 Special thanks to the community for all the continuous testing and feedback


Big shoutout to our Platinum Sponsors:

Don't miss a new Scrapling release

NewReleases is sending notifications on new releases.