Skip to content

v0.2.98

Compare
Choose a tag to compare
@D4Vinci D4Vinci released this 17 Mar 13:26
· 424 commits to main since this release
e60d0cb

This is an essential update for everyone to enjoy Scrapling as it's intended fully

What's changed

Various memory usage and speed optimizations

  • All selection methods' memory usage is ~40% of previous memory usage and the speed slightly increased.
  • Implemented Lazy loading for all submodules of the library so now what you use is what you load, for example:
    Before the update this import from scrapling import Adaptor was using 30-40mb of RAM because it loaded all fetchers and stuff with it too, now it uses ~1.2mb.
  • The last update made the library use ~32% memory it used before with a large requests pool, now we adjusted the caching further to use even less than that.
  • Overall speed increase in the parser by a slight 2-5%

Thanks for all your support and donations!


Big shoutout to our biggest Sponsor: Scrapeless

Scrapeless Banner