getdozer/dozer v0.1.0

Development Release - v0.1.0

on GitHub

Bug Fixes

• Handled groupby with no dimensions fields (#68)
• first flag in CacheIterator was not set correctly (#101)
• CacheIterator descending from past db end (#105)
• Fix cache changes on update operation (#116)
• Benches report missing the comparison (#183)
• Fix schema validation when only some tables are used (#174)
• Wait until all schema initialized before start grpc server (#187)
• Secondary index key should never be empty (#200)
• Make dynamic server optional

Documentation

• Add build dependences in README (#96)

Features

• Reorganise into a mono repo (#6)
• Merge pipeline code (#7)
• Merge api (#8)
• Implement first version of storage (#17)
• Refactor connector * iterator behavior (#24)
• Update issue templates
• Implement type conversion for postgresql (#25)
• Implement basic cache operations (#48)
• Implement secondary indexes (#49)
• Implement query bench (#50)
• Implement proper schema id usage in snapshotter and refactor mapping (#51)
• Implement simple orchestrator (#61)
• Init dozer ci (#77)
• Include concurrency and multiple restore keys (#82)
• Implement multi ingestion sources (#78)
• Implement continue of replication messages stream handling (#94)
• Dozer-api REST (#86)
• Allows to specify state store options (#112)
• Add FullText IndexType (#121)
• Multi-key indexer for state store (#127)
• Implement e2e tests (#130)
• Supports for transactions across multiple threads (#132)
• Implement auth module and middleware (#109)
• Implement the Aggregation Builder (#129)
• Remove schema registry (#138)
• Implement plan generation (#149)
• Write github action for Long running tests, Performance benchmarks, Code vulnerability, Code coverage etc (#146)
• Add import google libs when generate proto with special type (#165)
• Implement schema validator for postgresql (#128)
• Implement indexed record store (#181)
• Implement eth connector (#178)
• Implement cursor modify operations (#182)
• Introduce generic GRPC queries (#194)
• Support descending fields in sorted inverted index (#202)
• Implement release process (#204)

Miscellaneous Tasks

• Include lock file
• Refactor name and minor changes (#16)
• Convert REST to GRPC (#20)
• Fix warnings (#63)
• Fix schema insert and warnings (#72)
• Remove sql scripts (#76)
• Run on every branch
• Use slices instead (#79)
• Fix dozer.yaml (#84)
• Restore branch after refactor (#81)
• Switch error management to anyhow (#85)
• Fix clippy warnings (#88)
• Add log4rs file + logging for processors (#90)
• Improve ci build time (#89)
• Generate schema_id in Sink (#98)
• Make clippy mandatory (#99)
• Refactor cache params (#104)
• Use unwrap instead of ? in tests.
• Record.get_value() returning Result (#115)
• Moved files (#122)
• Inject pipeline_details (#123)
• Make minor improvements to CLI experience. (#135)
• Remove debug messages (#141)
• Make run the default command (#142)
• Refactor indexes into multiple dbs (#167)
• Use 1.64.0 (#177)
• Introduce array types, uint and remove record type (#175)
• Refactor ingestion to connectors & ingestor (#179)
• Introduce a few orchestrator improvements (#184)
• Switch to stable (#188)
• Remove duplicate get_key method (#195)
• Remove an unnecessary unwrap (#196)
• Fix channel & safe generation (#198)
• Bulid secondary index key only from values. (#197)
• Use ipv4 address as default for grpc (#203)
• Update nightly benches script (#201)

Refactor

• Refactor e2e (#64)
• Improve cache interface (#83)
• Build Processing logic on Schema update (#92)
• Dynamic schema support for groupby (#95)
• Remove references to lmdb::Database (#100)
• Use dynamic query value instead of field (#117)
• Migrated to thiserror for dozer-sql and dozer-core (#124)
• Introduce typed errors (#125)
• Refactor errors and reuse exported libs (#126)
• Encapsulate arc in lmdb-sys and tests cleanup (#134)
• Change IndexDefinition from struct to enum (#147)
• Remove state store (#180)
• Unify the Expression builders (#160)

Ref

• Groupby refactor + processor impl (#56)

Support

Contact us at https://getdozer.io