This release removes the in-memory NDJSON line-size cap by switching FHIR NDJSON reads to a streaming json.Decoder, fixes CRTDL enrichment to preserve unknown fields, and pulls in TORCH v1.0.0-alpha.20 plus the usual dependency refresh.
What's Changed
Breaking Changes
- NDJSON reader uses
json.Decoderinstead ofbufio.Scanner— Removes the per-line memory cap that broke streams with single Bundles larger thanpipeline.max_ndjson_line_size_mb. The config knob is gone (configs containing it are silently ignored). Malformed JSON in a stream now aborts the read instead of being silently skipped per line. #337 (closes #335)
Bug Fixes
- Preserve unknown fields during CRTDL enrichment — Enrichment no longer drops fields the parser does not model #357
Internal & CI
- Track Go toolchain via
go.modfor Renovate — Toolchain version is now managed in one place #355 - Fix dead link to
crtdl-preprocessinganchor in dimp guide #369 - Stabilize docs deploy — Revert to
npm installand discard lockfile mutation before the gh-pages checkout to keep deploys idempotent #371 #374
Dependency Updates
- TORCH
v1.0.0-alpha.20#340 - samply/blaze
v1.7.0#332 aws-sdk-go-v2/service/s3v1.101.0#338 #349github.com/klauspost/compressv1.18.6#341- golangci-lint
v2.12.2#343 #344 #348 - nginx-unprivileged
v1.31(+ digest updates) #347 #360 #366 - PostgreSQL
18.4(+ digest updates) #359 #364 - Vue
v3.5.34#362, Vitev8.0.13#361 #365 - step-security/harden-runner
v2.19.3#345 #363 - sigstore/cosign-installer
v4.1.2#350 - github/codeql-action digest updates #342 #353
- debian:bookworm-slim digest update #358
- Lock file maintenance #346 #367