getdozer/dozer v0.4.0

Development Release - v0.4.0

on GitHub

Bug Fixes

• Improve performance of date parsing (#2306)
• Remove ApiEndpoint::name to be consistent with other kinds of sinks (#2316)
• Log aerospike sink error and increase batch timeout (#2336)
• Dozer-core now propagates recoverable errors instead of panicking (#2348)
• Don't bail out if log manager can't be started (#2365)
• Read full message in aerospike tcp server (#2368)
• Fix table indexes usage in aerospike connector (#2370)
• Avoid sending repeated messages when error happens in Oracle log miner (#2373)
• Fix oracle connector update parser (#2386)
• i8 -> c_char (#2410)
• Fix dummy sink performance output (#2411)
• Oracle source skips uncommitted operations that are before another commit (#2413)
• Oracle source replication dead loop (#2416)
• Oracle redo log can have NULL REDO_SQL (#2418)
• Aggregate transactions during replication to avoid losing part of long running transactions (#2423)

Features

• Enable postgres continue ingestion (#2290)
• Snowflake sink (#2266)
• Support different kinds of endpoints (#2294)
• Implement batch processing for stateless processors (#2319)
• Continue mysql ingestion (#2322)
• Webhook-connector (#2355)
• Clickhouse sink (#2353)
• Oracle connector snapshotting (#2359)
• Oracle replication (#2361)
• Aerospike ingestion (#2366)
• Use http1 server for aerospike (#2374)
• Dozer ui and dozer ui update (#2376)
• Stop ingestion after number of events in dummy sink (#2394)
• Print average latency in dummy sink (#2395)
• Allow aerospike sink to handle multiple tables (#2393)
• Support integer on oracle ingestion/sink (#2419)

Fix

• Revert oracle resumability and fix snapshot data insert (#2425)

Miscellaneous Tasks

• Move last_checkpoint from Source::start to SourceFactory::build (#2264)
• Add latency measuring code in dummy sink (#2318)
• Diable stateful output port (#2330)
• Adapt UI for multiple tables in 1 sink (#2408)
• Add dev container (#2412)
• Stop using larger runners (#2417)
• Add oracle instant client library to docker image (#2421)
• Clean up dozer_sql::builder (#2424)
• Remove clones and duplicated code in dozer_sql::builder (#2428)
• Update version number to 0.4.0 (#2432)

Performance

• Stop using record store (#2307)
• Add Operation::BatchInsert (#2308)

Refactor

• Change OpIdentifier to RestartableState (#2263)
• Asyncify Source (#2329)
• Make source state source wide instead of per table (#2344)
• Send source state and op id to sink (#2354)
• Make connector methods take unique reference (#2358)
• Remove dozer-lambda (#2380)
• Respect source transaction boundaries (#2335)
• Handle schema and types in aerospike (#2375)
• Remove dozer-api (#2388)
• Guarentee operation order inside a transaction (#2389)
• Remove dozer-cache (#2390)

Support

Contact us at https://getdozer.io