v1.14.0 Release
We're excited to announce the release of Firecrawl v1.14.0, packed with cool updates.
- Authenticated scraping (Join the waitlist here)
- Zero data retention for enterprise (Email us at help@firecrawl.com to enable it)
- Improved p75 speeds
- New MCP version w/ maxAge + better tool calling
- Open Researcher Example (Open Source Researcher). See repo
- And so much more 🔥
What's Changed
- fix json format on search (ENG-2529) by @mogery in #1729
- proxy used improvement by @mogery in #1727
- add pdf prefetch log for debugging (ENG-2542) by @mogery in #1734
- (feat/ledger) Ledger events by @nickscamara in #1728
- fix(auto_charge): bad hourly counter logic by @mogery in #1736
- feat: implement IDN support with Punycode encoding by @devin-ai-integration in #1735
- feat(scrapeURL): ask user to increase timeout if there's a DOM.getDocument or queryAXTree error by @mogery in #1739
- feat(queue-worker): decrease job lock duration to pick up jobs on dead workers faster by @mogery in #1737
- feat(crawl-status): better creditsUsed field by @mogery in #1738
- (fix/sdk) Fixes Extract with show_sources=True causes JSON parsing error by @nickscamara in #1740
- fix(map): pass timeout to sitemap fetch by @mogery in #1741
- feat(api): zero data retention (ENG-2376) by @mogery in #1687
- Fix protocol change in firecrawl services by @nickscamara in #1742
- Fix queue worker liveness endpoint for self-hosted environments (ENG-2587) by @devin-ai-integration in #1747
- feat(firecrawl): add integration parameter support and enhance kwargs handling by @ftonato in #1715
- bugfix zero_data_retention param and certifi dependency by @rafaelsideguide in #1749
- Add health check endpoint for Playwright service (ENG-2585) by @devin-ai-integration in #1752
- Add URL depth validation to crawl requests (ENG-2617) by @devin-ai-integration in #1753
- fix(api/deep-research): bad default values leading to bug on self-host by @mogery in #1754
- Make error message for backwards crawling more clear by @micahstairs in #1758
- Implement JavaScript-only base href handling (ENG-2302) by @devin-ai-integration in #1756
- fix(html-transformer): check base tag when resolving relative URLs by @mogery in #1761
- html-transformer improvements by @mogery in #1762
- Implement fallback mechanism for onlyMainContent scraping (ENG-2499) by @devin-ai-integration in #1759
- Add end-to-end test for deep research functionality (ENG-2627) by @devin-ai-integration in #1760
- feat: add waitFor validation rule to enforce waitFor <= timeout/2 by @devin-ai-integration in #1751
- fix: replace hardcoded search billing with calculateCreditsToBeBilled by @devin-ai-integration in #1714
- feat(scrapeURL/fire-engine): start AB testing by @mogery in #1763
Full Changelog: v1.13.0...v1.14.0