github D4Vinci/Scrapling v0.2.98

latest releases: v0.4.5, v0.4.4, v0.4.3...
12 months ago

This is an essential update for everyone to enjoy Scrapling as it's intended fully

What's changed

Various memory usage and speed optimizations

  • All selection methods' memory usage is ~40% of previous memory usage and the speed slightly increased.
  • Implemented Lazy loading for all submodules of the library so now what you use is what you load, for example:
    Before the update this import from scrapling import Adaptor was using 30-40mb of RAM because it loaded all fetchers and stuff with it too, now it uses ~1.2mb.
  • The last update made the library use ~32% memory it used before with a large requests pool, now we adjusted the caching further to use even less than that.
  • Overall speed increase in the parser by a slight 2-5%

Thanks for all your support and donations!


Big shoutout to our biggest Sponsor: Scrapeless

Scrapeless Banner

Don't miss a new Scrapling release

NewReleases is sending notifications on new releases.