github crwlrsoft/crawler v1.9.4

latest releases: v2.1.3, v2.1.2, v2.1.1...
3 months ago

Fixed

  • When using HttpLoader::cacheOnlyWhereUrl() to restrict caching, the filter rule is not only applied when adding newly loaded responses to the cache, but also for using cached responses. Example: a response for https://www.example.com/foo is already available in the cache, but $loader->cacheOnlyWhereUrl(Filter::urlPathStartsWith('/bar/')) was called, the cached response is not used.

Don't miss a new crawler release

NewReleases is sending notifications on new releases.