[1.183.0] — 2026-08-14
Added (scanner) — smarter duplicate detection: the same job re-listed with a tracking link no longer shows up twice.
Added
- The scanner now recognises a posting by a canonical URL key, so the same role re-listed with a tracking parameter (
?utm_…,gclid, …), overhttpvshttps, or with a trailing slash /#fragmentis treated as the one posting it is — no duplicate row in your scan results or pipeline, and no wasted evaluation on a job you have already seen. Genuinely different postings (a kept functional id likegh_jid) still count separately.
Notes
- New
server/lib/url-key.mjs, wired into both scanners' dedup and the pipeline writer. It deliberately under-strips — it never merges two distinct postings. Tests:tests/url-key.test.mjs(+5),tests/parsers.test.mjs(+1). Suite: 2477 (+6).