v0.2.98
This is an essential update for everyone to enjoy Scrapling as it's intended fully
What's changed
Various memory usage and speed optimizations
- All selection methods' memory usage is ~40% of previous memory usage and the speed slightly increased.
- Implemented Lazy loading for all submodules of the library so now what you use is what you load, for example:
Before the update this importfrom scrapling import Adaptor
was using30-40mb
of RAM because it loaded all fetchers and stuff with it too, now it uses~1.2mb
. - The last update made the library use ~32% memory it used before with a large requests pool, now we adjusted the caching further to use even less than that.
- Overall speed increase in the parser by a slight 2-5%
Thanks for all your support and donations!