- ⚡ PeerDB now pulls from Postgres and pushes to ClickHouse in parallel, by default
- 🔧 Introduced knobs to tune memory usage of PeerDB inserts to ClickHouse via chunking #2484 and #2485
- 📊 Added collection of more metrics such as errors emitted and rows synced #2454
- ✅ Improved validation for read replica Postgres instances below PG16 #2483
- 🚀 Re-architected parallelized syncs to ClickHouse and single table sync performance ttps://github.com//pull/2480
What's Changed
- feat: add more metrics by @iamKunalGupta in #2454
- PEERDB_CLICKHOUSE_NORMALIZATION_PARTS by @serprex in #2478
- mysql: GetVersionConnector by @serprex in #2477
- tailwindcss v4 by @serprex in #2481
- Make default channel size for normalize batches as 128 by @iskakaushik in #2482
- Drop mirror: introduce opt-in setting to skip destination dropping by @Amogh-Bharadwaj in #2455
- [validate] check if we're in recovery below PG16 for CDC by @heavycrystal in #2483
- Turn on PEERDB_PARALLEL_SYNC_NORMALIZE by default by @serprex in #2484
- Fix chunking with enabled primary key updates by @serprex in #2480
- PEERDB_CLICKHOUSE_INITIAL_LOAD_PARTS_PER_PARTITION by @serprex in #2485
- cdc flow: only sleep for 10 minutes for panics & application errors by @serprex in #2443
- always spawn heartbeatRoutine asap in activity by @serprex in #2490
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions in #2486 - remove ureq by @serprex in #2495
- nexus: remove async-recursion by @serprex in #2496
- nexus: consistent binary serialization by @serprex in #2497
- Edit peer button: separate peer type fetch by @Amogh-Bharadwaj in #2499
- fix ui charts by @serprex in #2501
- mysql by @serprex in #2395
- feat: add context propagator and use it to enrich metrics with flow metadata by @iamKunalGupta in #2493
- alerting: tag mysql errors by @serprex in #2508
- feat: add alert classifier by @iamKunalGupta in #2494
Full Changelog: v0.23.0...v0.24.0