github germondai/trawl v1.6.0

3 hours ago

Highlights

  • Flexible session caching: adds a bounded in-memory session cache for simple single-instance deployments while preserving Redis as the default
  • Broader anti-bot coverage: detects DuckDuckGo anomaly pages and adds safe support for embedded ALTCHA and Friendly Captcha proof-of-work widgets
  • Better scrape control: introduces configurable minimum tiers and failover, round-robin, or random proxy-pool selection
  • Richer diagnostics and capture: optionally returns bounded challenge-wall evidence and portable MHTML page archives
  • Correct proxy responses: removes stale browser-decoded content-encoding headers that could break automatically decompressing clients
  • Consistent browser fingerprints: adds an optional full-font image and restricts compact images to compatible Linux profiles
  • Updated runtime stack: upgrades Bun, Camoufox, Redis, nginx, Patchright, Biome, Zod, Nuxt SEO, and related dependencies to their latest mutually compatible versions

Major changes

Full changelog: v1.5.0...v1.6.0

Don't miss a new trawl release

NewReleases is sending notifications on new releases.