github germondai/trawl v0.3.0

latest releases: v1.0.0, v0.7.0, v0.6.0...
7 hours ago
  • a42b3a1 add concurrency limiter to prevent oom under burst load
  • 182d3dc surface browser pool exhaustion as 429 not 500
  • 002e55d add scripts/test-scrape-burst.sh for /scrape load testing
  • 6cfa87c bump default browser pool size to 3
  • efaf0c9 make acquire timeout configurable, default 15s
  • 59ba779 document BROWSER_ACQUIRE_TIMEOUT_MS and HTTP 429 on pool exhaustion
  • 83c30c6 fix BROWSER_POOL_SIZE default, document BROWSER_ACQUIRE_TIMEOUT_MS

Don't miss a new trawl release

NewReleases is sending notifications on new releases.