Added
- Added block data file caching (called
ATM), this is to reduce the memory usage of component keeping block objects in memory. - Added transforms: LogFilter, MultiLogFilter, CallToFilter, MultiCallToFilter to only return transaction traces that match logs or called addresses.
- Added support for irreversibility indexes in firehose to prevent replaying reorgs when streaming old blocks.
- Added support for log and call indexes to skip old blocks that do not match any transform filter.
Changed
- Updated all Firehose stack direct dependencies.
- Updated confusing flag behavior for
--common-system-shutdown-signal-delayand its interaction withgRPCconnection draining infirehosecomponent sometimes preventing it from shutting down. - Reporting an error is if flag
merge-threshold-block-ageis way too low (< 30s).
Removed
- Removed some old components that are not required by Firehose stack directly, the repository is as lean as it ca now.
Fixed
- Fixed Firehose gRPC listening address over plain text.
- Fixed automatic merging of files within the
mindreaderis much more robust then before.
Full Changelog
- 3ac8ec4 Add NewEthBlockIndexer() for convenience
- 6273adf Add TestEthBlockIndexProvider_Matches()
- ad4e41d Add TestEthBlockIndexProvider_NextMatching()
- 44eb852 Add TestEthBlockIndexProvider_WithinRange()
- d21f4ac Add docstrings to EthBlockIndexer
- 85238a3 Add multi-log filter transform
- 57c299a Add stubs for BlockIndexProvider
- d341b4a Added changelog for v0.10.0-rc.1
- ad161f7 Added git push prior release to ensure GitHub created release creates the correct tag
- d1f1751 Bump node-manager (moving some backup related stuff in there)
- 633a782 Extract WriteIndex() and ReadIndex() to bstream
- 52cd6af Extract chain-agnostic ProcessBlock() logic to bstream
- dbb5101 Fixed release script when doing a real non dry run
- 58042c9 Implement Index filter on eth.Address and eth.Hash
- 2ccd1ae Instantiating ProtocolSpefificModules
- 6954b53 Merge pull request #24 from streamingfast/stepd/multi-filter
- c29b0e7 Merge pull request #25 from streamingfast/froch/block-indexer
- d96cf3a Merge remote-tracking branch 'origin/develop' into froch/block-indexer
- 52871e4 Remove LogAddressIndex implementations in favor of BlockIndex
- 4a299ae Removed blockmeta and trxdb from sf-ethereum public
- 6a2cc3a Removing snapshotter dependency
- 02e63d7 Replace NewLogAddressIndexProvider() with NewEthBlockIndexProvider()
- e42aeb5 Replace NewLogAddressIndexer() with NewEthBlockIndexer()
- 166858e Rework EthBlockIndexProvider to accept a filterFunc
- 6c3fe6a Sanitize go.mod a bit
- 7cfb743 Updated bunch of dependencies to get proper logger name
- 0f2b0f4 Updated dlauncher to latest version
- 31e4f56 Updated to correct released version
- af40cee Updated to latest dlauncher
- ff0fc01 Updated to latest dlauncher and logging library
- e528270 Updated to latest version of bstream, pbgo, dgrpc, relayer, merger and blockmeta
- c4b08b0 Updated to latest version of everything
- da46fb0 Updated to streamingfast/overseer
- 0583610 Wrap a bstream.transform.BlockIndexer as an EthBlockIndexer
- 34d9054 account indexing tool to also produce irreversible blocks and start from where it left off
- bfd49b2 add proper logging of log/call filter transforms
- fc70c15 adjust accoutn_indexer to start from lowest of irreversible/account index
- 21aca49 bump bstream for startblock index matching fix
- f73cd60 bump bstream so firehose always sends start-block even when filtered
- 321e255 bump bstream to fix firehose cursor on indexed filesource
- 7b4bbbf bump bstream with my refactors on froch PR
- add26a0 bump bstream, firehose to fix stop-block bug in indexes
- 738745b bump deps to fix mindreader merging directly
- c136aa6 bump node-manager to fix double-compressed oneblockfiles
- 30bde30 bump node-manager to fix file deletion
- 75649ed bump node-manager/merger to fix direct merging
- 878a640 bump node-manager: merge immediately on boundary
- 29a8fbb change 'transforms' to 'transform' in proto, bump some index libs
- 24ac3a1 fix confusing flag behavior for grpcShutdownGracePeriod sometimes preventing firehose from shutting down
- 50787c9 fix logfilter event matching with no topic
- 35d5311 go mod tidy
- b3725d9 iadd MultiCallToFilter transform and all that jazz
- a0e3e44 opiniated failure if merge-threshold-block-age is way too low streamingfast/node-manager#23
- 443639f remove firehose flag to gen irr.index, bump libs
- 9465b6b simplify logic in log_address_index