github malbeclabs/doublezero-offchain offchain-scheduler/v0.1.0

Changelog

  • 65b05e7 2z-cli: add missing configuration (#78)
  • dc67c12 2z-cli: add packaging support (#73)
  • f5b56fe 2z-cli: passport request Solana validator access (#38)
  • 6dc6bf9 Add README
  • 2c12187 Add aggregate validator stake by city
  • 07e944a Add aggregated telem data to DZ ledger
  • a6e2327 Add backoff support
  • 89e11ac Add crates/2z-cli (#34)
  • ad4ecdc Add csv exporter for cross checking
  • b2b0083 Add demand exporter
  • 2517400 Add demand_generator workspace
  • dfb056c Add docs
  • e935191 Add epoch based filtering
  • a920231 Add finalize transaction (#58)
  • 2dcec9f Add historical epoch lookup for internet telemetry data (#33)
  • cc96d40 Add merkle_generator
  • 45368a5 Add retry/backoff to Jito/solana RPC calls (#87)
  • ea157bd Add scheduler app to manage debt lifecycle processes (#183)
  • e333b83 Add some configuration around recording telemetry
  • ea626bb Add support for demand generation
  • 0bea92e Add support to consolidate shapley values
  • 04d1e4f Add support to construct merkle root
  • 8c65796 Add support to post contributor-rewards merkle root (#50)
  • 9efb213 Add support to read back agg telem data from DZ ledger
  • d05175b Add unit test with test data snapshot
  • 313a639 Add unit tests
  • 049116a Address review cmt, rm unnecessary import
  • e8f7359 Address review cmts
  • b76a6f5 Build devices tbl, calc shapley output per city demand
  • 27f9ca4 Build public links
  • ac6c4fd Build public links using exchange based inet telem data (#23)
  • f5d4fb5 Bump README
  • 3f13dec Bump deps
  • 601ebed Bump deps, fix types
  • 940aabf Bump stable rust and fixup clippy warnings (#109)
  • 15afe3c Cleanup and simplification
  • 2cb8e82 Cleanup deps
  • 358ee95 Cleanup, add TODOs
  • 757fd4a Clippy fixes
  • 14b1771 Consolidate all ledger operations in single module
  • 8c9858d Construct input to store to ledger
  • 6d90aa3 Derive rewards accountant key from ProgramConfig (#59)
  • af0f9bd E2E functionality for validator debt collection and publishing (#74)
  • 5e9a082 Enhance aggregated telemetry stats (#30)
  • ee42d5d Export city_stats for optional debugging
  • 77023c8 Export demands separately
  • dbfd952 Extract city weight calculation to shared utility
  • 4e8281d Extract data preparation to dedicated module
  • a6a7837 Extract ledger operations to dedicated module
  • b24b4b5 Faster CI
  • b98339b Feat: add support to ingest internet latency samples
  • 733b72e Fix Exchange Code Mappings for Public Links (#63)
  • 47ae230 Fix api token security, retries and concurrent requests
  • b11d30c Fix deps, fix clippy warning (#145)
  • f8d5f66 Fix from_solana to from_raw
  • 6ea387d Fix internet historical telem data lookup (#56)
  • 9acda65 Fix sanity test
  • c59a07e Fix: avoid self loops and use sat sub for prev epoch
  • 5a7abaa Fix: cleanup backoff
  • 84ba17c Fix: cleanup settings, add example config, CLI docs (#60)
  • 4150860 Fix: configuration and defaults
  • f9adb4f Fix: defaults for shapley calculations (#52)
  • 98fd2c1 Fix: deprecate time range based filtering
  • e90962a Fix: early returns, retries for RPC calls
  • 7c48de7 Fix: remove custom deserialization for DZD latency samples
  • c535b59 Fix: remove unwrap when making record key
  • 4a5a6fb Fix: units for shapley inputs
  • 8f7d7a2 Fix: update dependencies and improve access request handling (#64)
  • 9d4dcf0 Fix: use correct priority calculation formula, update test
  • 8185b36 Fixup configuration to be driven by env vars
  • 3a3073b Fixup environment example
  • ce6b808 Fixup ledger storage for shapley output
  • a5a268d Fixup tests
  • 4578098 Initial commit
  • 6ebb5b7 Jg/validator sig update (#39)
  • bc447b0 Maintenance tasks
  • 16d0e4a Merge pull request #1 from doublezerofoundation/rg/maintenance
  • 87e9347 Merge pull request #10 from doublezerofoundation/rg/config-changes
  • 23e7ddf Merge pull request #11 from doublezerofoundation/rg/write-telem-agg
  • b788e2f Merge pull request #12 from doublezerofoundation/rg/consolidate-shapley
  • b36407e Merge pull request #18 from doublezerofoundation/rg/consolidate
  • ca013ed Merge pull request #19 from doublezerofoundation/rg/prep-offchain-components
  • 667a72b Merge pull request #2 from doublezerofoundation/jg/ci-private-crates
  • 5b8248b Merge pull request #20 from doublezerofoundation/jg/integration
  • 8e2bc54 Merge pull request #5 from doublezerofoundation/rg/rework-fetching
  • 5c8173c Merge pull request #5 from malbeclabs/rg/demand-generation
  • 19082a4 Merge pull request #6 from doublezerofoundation/rg/rework-demand-generation
  • 9ca9814 Merge pull request #7 from doublezerofoundation/rg/deprecate-time-based-filtering
  • e82b619 Merge pull request #8 from doublezerofoundation/rg/ingest-internet-samples
  • 1e24b72 Merge pull request #9 from doublezerofoundation/rg/build-devices
  • 1684f6e More cleanup and simplification
  • c9755cc Parallelize Shapley calculations and add RPC rate limiting
  • ea133ef Post validator payment merkle roots (#42)
  • 4b6e6ca Prepare for off-chain components
  • 9716e25 Remove build.rs, no longer needed
  • a15dcb6 Remove close-record
  • ae72ff8 Remove debugging
  • 2559c69 Remove epoch warmup handling
  • 2317bcc Remove operator_uptime, contiguity_bonus & demand_multiplier defaults
  • f11d36a Remove some TODOs
  • 28a3201 Remove unused dep
  • ea8db2b Remove unused param
  • 419bca4 Rename 2z (#84)
  • 6386157 Rename payments to debts (#53)
  • fb8c464 Reorg
  • 710dd0c Restructure data preparation with PreparedData type
  • d3415eb Reuse existing serviceability data
  • c2326d0 Rework
  • dbc5bf5 Rework after bumping deps
  • f599b61 Rework, simplification
  • dd2f60a Rm demand.rs
  • 9090b5d Sentinel: retry all rpc calls on 503 (#103)
  • be7a15e Sentinel: retry on ECONNRESET (#177)
  • ba1fe0a Simplify
  • 5e276bc Simplify epoch finding, add tests and modularize
  • 923984a Standardize all ledger writes to use write_to_ledger
  • 9c9153a Switch all maps to BTreeMap and sets to BTreeSet (#44)
  • 04ec724 Switch to use indexed merkle leaves (#31)
  • 594da08 Unify configuration system and remove unused parameters
  • cdd2c1c Update README
  • cd256a8 Update dependencies
  • fd9a071 Update dependencies to version 0.6.3 for doublezero packages and adjust itertools and hashbrown versions (#83)
  • 6561e23 Update revenue_distribution payments to debt (#75)
  • 174c8ef Update to use correct shapley API
  • 4121561 Working CI
  • 2ab2e9a Write merkle root and add verification cli
  • 32d3eed add action to deploy scheduler (#2193)
  • aeec745 add action to deploy scheduler (#2193) (#204)
  • d3492f7 add doublezero-solana-fork-cli (#140)
  • 4db8719 add env vars for mint_key, ledger and solana rpcs (#1408) (#51)
  • 23ae664 add packaging for sentinel (#25)
  • 3eac616 add pr template (#179)
  • ff80d50 add sol-conversion-admin-cli (#156)
  • b4a9ae9 add toolchain file (#35)
  • 7003467 add validator-revenue crate (#1316) (#26)
  • cbb2a8f add verify_merkle_root function (#77)
  • 72b496b bump doublezero-solana-cli version to 0.1.10 (#151)
  • c90041f cargo config for pulling private crates
  • eee87c9 chore(workspace): update changelogs (#178)
  • b5907fa clean up (#139)
  • 7f79cdc configure goreleaser devnet release and default unit file (#47)
  • 129171a contributor-rewards: First pass at CLI polish (#57)
  • 4f97f3f contributor-rewards: Fix scheduler for dry-run mode (#97)
  • 047c1a5 contributor-rewards: Modular CLI (#70)
  • f392bf9 contributor-rewards: add observability via metrics (#90)
  • f5c42d7 contributor-rewards: add quadratic penalty for uptime (#148)
  • c520ba4 contributor-rewards: add release support (#72)
  • a2ddc6c contributor-rewards: add scheduler support (#86)
  • 3fe12c0 contributor-rewards: add support to handle AccessPass (#92)
  • 6a7940b contributor-rewards: add telemetry rent cmd (#81)
  • 1f43bec contributor-rewards: enhance metrics for shapley computations (#100)
  • e628824 contributor-rewards: fix reward proportion discrepancies (#143)
  • 9723228 contributor-rewards: rm shapley_input req for writing telem aggs (#71)
  • 20ad324 crate/validator-debt: output result of write_debts to tabled format (#88)
  • 01fd26e doublezero-solana: add Solana validator deposit commands (#111)
  • 555f8ed doublezero-solana: lamports -> SOL (#115)
  • a283a54 feat(contributor-rewards): Add S3 storage for snapshots (#174)
  • 06edfd1 feat(contributor-rewards): add granular support to skip writes (#203)
  • 7b75b09 feat(scheduler): Automatically finalize distribution (#200)
  • 5d70c6c feat(scheduler): automate calculate distribution (#199)
  • b0171cc feat(solana-cli): add --specific-dex option for harvest-2z (#189)
  • 1cd80e3 feat(solana-cli): add revenue-distribution fetch distribution --view argument (#182)
  • 704e49d feat(solana-cli): add revenue-distribution fetch validator-debts command (#201)
  • 75e95d4 feat(solana-cli): add revenue-distribution harvest-2z command (#180)
  • 1393d3d feat(validator-debt): add prom metrics (#116)
  • 1b31b29 feat(validator-debt): use s3 bucket to fetch validator keys (#196)
  • 1d67f78 fix versioned transaction handling; more logging (#48)
  • de6eb95 fix(contributor-rewards): add Distribution merkle root check to idempotency (#202)
  • 2ec1a07 fix(contributor-rewards): ci fix to derive default (#176)
  • d35ac71 fix(contributor-rewards): handle grace period for scheduling rewards (#186)
  • e06cf37 fix(contributor-rewards): make scheduler retry infinitely (#198)
  • 40382be fix(goreleaser): Install binaries in /usr/bin/ instead of /usr/local/bin (#185)
  • 499c555 fix(revenue-distribution-admin): update migration command (#195)
  • 527c9c7 fix(sentinel): retry on conn reset, one more time (#184)
  • 83124a3 fix(solana-cli): correct default limit price for convert-2z and harvest-2z (#190)
  • ec83f27 fix(validator-debt): automate initialize distribution with new scheduler (#197)
  • 1abcae8 fix(workspace): bump stable rust (#175)
  • 43e9aa5 fix(workspace): group imports per rust unstable standards (#181)
  • 2334430 fix(workspace): version bump contributor-rewards, sentinel, and solana-validator-debt (#188)
  • c4989c2 fix: update leader scheduler check (#166)
  • bae3785 grant release task access to the private repos to pull (#45)
  • f8eb846 handle websocket server disconnects (#37)
  • c036b7e match releaser package to crate name (#46)
  • 26f9fe8 migrate sentinel from solana-programs repo (#21)
  • a45dba9 move binaries to /usr/bin: update changelogs and systemd units (#187)
  • 72dac39 payment to debt (#1439) (#55)
  • abf28be port client-tools and admin CLIs from doublezero-solana (#154)
  • 8945c76 post revenue to ledger (#1080) (#27)
  • 934ff53 release: add rpm build (#94)
  • 38839cf release: cleanup cargo registry (#169)
  • 35c0197 release: explicitly specify release name (#168)
  • f685211 remove sentinel setting new validator airdrop (#40)
  • 35f723d sentinel: Add retry logic for access pass operations (#99)
  • a585322 sentinel: Disable leader schedule check (#98)
  • b1a5bf9 sentinel: accept mainnet-beta env moniker (#62)
  • 9b1e000 sentinel: add allow_multiple_ips to access pass args, bump deps (#158)
  • 98eb11f sentinel: change error to reason for known sig verification failure (#171)
  • ec2cb4e sentinel: cli flag to control RPC polling interval for access requests (#136)
  • 2a66626 sentinel: drain outstanding access requests (#144)
  • 1609a68 sentinel: entirely remove websocket support (#160)
  • 6089c1e sentinel: fix websocket reconnection, improve error resilience (#131)
  • c83d884 sentinel: fixup sentinel listener init to also use retries (#132)
  • 7e28868 sentinel: handle multiple requests in a transaction (#127)
  • 48dd8c4 sentinel: handle requests with backup IDs (#105)
  • 3111cff sentinel: read access mode from account data instead of transaction (#107)
  • 4b3b966 sentinel: simplify leader schedule check (#157)
  • ea36d77 sentinel: validator ip fetching and issuing access pass (#29)
  • 56d4a44 sentinel: verify_qualifiers return empty vec on SignatureVerify error (#122)
  • 0f6d338 sentinel: version 0.1.9 (#153)
  • b3f606a solana-cli: add SOL conversion commands (#159)
  • e48cc6e solana-cli: add find subcommand to locate nodes by ID or IP address (#108)
  • a2f00fe solana-cli: add revenue-distribution relay distribute-rewards command (#173)
  • a8cc585 solana-cli: add find validator command and prepare access functionality (#121)
  • ceeee9f solana-cli: add token balances and more info in stdout (#162)
  • f9510c8 solana-cli: clean up (#104)
  • c6d7550 solana-cli: display balance for uninitialized deposit account (#137)
  • a7baaa0 solana-cli: fetch revenue distribution account for epoch (#128)
  • 84a1e38 solana-cli: fetch solana validator deposit accounts (#125)
  • 8b1c546 solana-cli: fix CHANGELOG (#167)
  • e4c11ab solana-cli: fix backup validator leader schedule check output (#150)
  • ceea240 solana-cli: fix instruction data when requesting access (#149)
  • fcb97b3 solana-cli: fix validator deposits not found (#135)
  • c466f1a solana-cli: uptick to 0.2.2 (#191)
  • 7edea8d solana-cli: version 0.1.1 (#152)
  • 0069d7b solana-fork: add god mode (#146)
  • f22d286 test private repo integration with dz-solana
  • 1970632 update access pass creation to delegate funding to serviceability (#32)
  • 4d03585 update merkle root to use indexed methods / functions (#1413) (#49)
  • d74e843 v0.1.0 (#2193)
  • 6e1bc20 validator-debt: add CI workflow for release (#114)
  • fab9521 validator-debt: add CLI (#91)
  • b68c1e9 validator-debt: add checks after writing to ledger (#95)
  • 68fbc63 validator-debt: add find Solana epoch command (#119)
  • f7bdfe5 validator-debt: add missing mainnet check (#117)
  • def9991 validator-debt: add packaging and service support (#110)
  • 3338096 validator-debt: add pay debt commands (#80)
  • 4e4a183 validator-debt: default epoch to latest for calculating debt (#133)
  • 3471a67 validator-debt: ensure distribution has passed calculation_allowed_timestamp (#93)
  • b8e45cc validator-debt: estimate block time if slot is skipped (#126)
  • c40bbcd validator-debt: fetch validator pubkeys from access passes (#82)
  • f458179 validator-debt: fix fetched epoch (#118)
  • 29d80f5 validator-debt: handle overlapping Solana epochs (#96)
  • fb63fc9 validator-debt: import from and export to CSV, add verify command, bug fixes (#147)
  • fe84a86 validator-debt: integrate slack notifications (#161)
  • a75789e validator-debt: option to post to DZ ledger only (#130)
  • 01e78bc validator-debt: parse program logs, attach exported csv to slack msg (#163)
  • 007de06 validator-debt: schedule initializing distributions (#106)
  • f5ae909 validator-debt: separate initialize_distribution into its own process (#89)
  • e8e75e4 validator-debt: update solana epoch finder (#129)
  • cabe835 workspace: add support for release-plz (#164)
  • 7c693d3 workspace: fix release-plz.toml to exclude libs and use correct tag (#165)
  • 3dc4af5 workspace: remove release plz (#170)
  • a112b64 wrap dz instruction properly (#54)
  • b12ac3b wrap message verification in offchain message (#43)

Don't miss a new doublezero-offchain release

NewReleases is sending notifications on new releases.