🚀 What's New in PeerDB
- Edit Mirror Upgrades: 🪞 Updated table removal logic and enabled per-mirror environment updates directly from Edit Mirror. #2025
- Advance LSN Handling: 🏁 The Log Sequence Number (LSN) now advances even when a PKM request is made before receiving any records. #2068
- CDC Efficiency Boosts: 🚀 We now bypass CDC storage when handling logical emit messages, resulting in faster processing. #2080
- API Enhancements: 🛠️ You now have direct access to CDC and initial load stats in the API, giving more transparency into your data processes. #2085
- Limit for CDC Stats: 🎛️ We've added a limit field to control CDC stats requests, offering finer control over your data queries. #2086
- Enhanced CDC Updates: 🔄 Now updating not-present columns from old tuples as well for better CDC data accuracy. #2092
🛠 Improvements & Fixes
- Numeric Type Interface: 🔢 Improved numeric type interface and fixed ClickHouse support, enhancing compatibility and usability. #2084
- Kafka Logging Optimization: 📝 Switched Kafka client logging to use activity logger, enhancing logging clarity and efficiency. #2088
- Clickhouse Standardization: 🔗 We standardized ClickHouse naming conventions for smoother operation. #2089
- Merge Tree for Raw Tables: 🌲 Implemented merge tree and adjusted order by for ClickHouse raw tables to improve query performance. #2104
- Dependency Updates & Logs Fixes: 🧹 General maintenance: updated dependencies and fixed multiple "!BADKEY" logs. #2093, #2100
🧑💻 Developer Experience
- Temporal Version Upgrade: ⏳ Upgraded Temporal version in the Docker stack for better performance and new features. #2081
- Revert Avro File Changes: 🔄 Reverted a previous method to write Avro files to S3 to avoid unnecessary complexity. #2095
- Environment Validation: ✔️ JSON validation added to envString, ensuring more robust environment configurations. #2082
Enjoy the improved experience and as always, happy syncing! 😊