It appears that CheerioCrawler
was correctly retiring sessions on timeouts
and blocked status codes (401, 403, 429), whereas PuppeteerCrawler
did not.
Apologies for the omission, this release fixes the problem.
- Fix sessions not being retired on blocked status codes in
PuppeteerCrawler
. - Fix sessions not being marked bad on navigation timeouts in
PuppeteerCrawler
. - Update
apify-shared
to version0.5.0
.