Mainnet 18

Major Changes

• [Execution] upgrade cadence to secure-cadence-m9 (#2516) @j1010001
• [Consensus & Collection] Merge Signer-indices to master (#2414) @zhangchiqing
• [Access] Add execution data requester (#1895) @peterargue

Misc

• [Util CL] fix logging current statecommitment in execution state extraction (#2610) @zhangchiqing
• [Testing] localnet: switch from docker log driver to promtail (#2609) @SaveTheRbtz
• [Access] Use Connection Pool Logic (#2613) @lolpuddle
• Add ledger checkpoint status files to gitignore (#2607) @jordanschalm
• [Logging] Fix implementation of script logging (#2528) @koko1123
• [util] update cmd to get seal for sealed block (#2587) @zhangchiqing
• [Tool] Export transactions for height range (#2442) @zhangchiqing
• [Access] Implement Connection Pooling for RPC Connections in AN (#2412) @lolpuddle
• [Networking] Downgrades libp2p pubsub version (#2592) @yhassanzadeh13
• [Crypto] performance improvement of SSWU map to curve (#2570) @tarakby
• sync engine optimization (#2548) @danielholmes839
• [State Sync] Lookup ExecutionResult directly instead of using index (#2566) @peterargue
• Update to Cadence v0.24.1 and Go SDK v0.26.1 (#2583) @turbolent
• [Protocol State] Index seal by sealed block id (#2551) @zhangchiqing
• [Testing] Moving convert fixtures to a namespace for test cases (#2533) @zhangchiqing
• [Util CLI] fix encoding in checkpoint-list-trie cmd (#2546) @zhangchiqing
• [Collection] Remove max account index (#2552) @jordanschalm
• [Testing] feat(localnet): use grafana, tempo, loki (#2510) @SaveTheRbtz
• [Testing] Fix flakey component job consumer test (#2538) @peterargue
• [Testing] chore(tests): cleanup TxTracker (#2520) @SaveTheRbtz
• [Testing] quarantine test - TestComponentConsumerSuite-runs_and_notifies_using_pre-notifier (#2555) @gomisha
• [Testing] chore(tests): cleanup worker and add tests (#2503) @SaveTheRbtz
• [Testing] chore(tests): cleanup TxStatsTracker and add tests (#2471) @SaveTheRbtz
• [Testing] chore(tests): move code back to contLoadGenerator.go (#2537) @SaveTheRbtz
• [Testing] feat(localnet): pass through tracing, extensive tracing, and cadence tracing flags (#2542) @SaveTheRbtz
• [Testing] chore(tests): cleanup worker stats tracker and add tests (#2504) @SaveTheRbtz
• Corruptible Conduit Framework Integration (#2397) @yhassanzadeh13
• [Fix] add explicit mapping of cluster prefix -> message codes (#2539) @kc1116
• PR Migrate ingestion engine to new Component interface (#2436) @danielholmes839
• chore(tests): remove unused batchLoadGenerator (#2519) @SaveTheRbtz
• chore(tests): do not go through the resolver for localhost (#2511) @SaveTheRbtz
• Add secure-cadence prefix as a tag to be pushed (#2167) @Kay-Zee
• [Crypto] improve flaky random test (#2509) @tarakby
• [All Nodes] upgrade flow to v0.3.1 (#2534) @zhangchiqing
• Exit validation early for empty collections (#2524) @jordanschalm
• Add BlockHeight to TransactionResultResponse (#2514) @lolpuddle
• Outdated blocks should not be logged as errors (#2372) @AlexHentschel
• Add Atree reporter to execution state extraction (#2461) @fxamacker
• Update to Cadence 8b113c539a2c, atree 525fbc26f40a, and CBOR ad2eae63303f (#2525) @turbolent
• add go workspace files to .dockerignore and .gitignore (#2469) @SaveTheRbtz
• [Signer Indices] Validate guarantors (#2462) @zhangchiqing
• Suggestion for PR #2462 (#2517) @AlexHentschel
• [Networking] Upgrades pubsub version of libp2p (#2515) @yhassanzadeh13
• Read memory limit from state (#2474) @robert-e-davidson3
• chore(tests): mark localnet and benchmarks owned by the performance team (#2512) @SaveTheRbtz
• add jobqueue README (#2373) @zhangchiqing
• upload log level for memory weights (#2493) @zhangchiqing
• chore(tests): fix init-light for localnet (#2508) @SaveTheRbtz
• Upgrade Cadence to secure-cadence-m8 (#2499) @janezpodhostnik
• flaky tests fix test async uploader - Test_AsyncUploader/stopping_component_stops_retrying (#2453) @gomisha
• [Fix] Adding sync request message as a cluster type message (#2495) @yhassanzadeh13
• Add tests to ensure mutations in scripts are discarded (#2482) @dsainati1
• chore(tests): cleanup unused fields from loader (#2470) @SaveTheRbtz
• [Component Manager] Fix race condition (#2349) @smnzhu
• Optimize MTrie reading single path by adding Ledger.GetSingleValue() to boost speed and reduce memory use (#2473) @fxamacker
• Optimize Ledger.Get() by making Forest.Read() use ~5x fewer allocs/op and run ~20% faster (#2477) @fxamacker
• Memory metrics (#2467) @dsainati1
• [BFT Testing] Corruptible Conduit Factory authenticating dictated messages. (#2441) @yhassanzadeh13
• Dan/1536 add cadence execution time metrics (#2394) @danielholmes839
• Upgrade linter to 1.46.2 (#2457) @zhangchiqing
• Remove unused travis yml (#2323) @Kay-Zee
• unquarantining 2 flaky tests that have been consistently passing in quarantine (#2455) @gomisha
• chore(tests): fix load test (#2454) @SaveTheRbtz
• chore(docker): fix parallel image builds (#2447) @SaveTheRbtz
• avoid race condition in validating blocks (#2427) @zhangchiqing
• Suggestion for PR #2414 (#2443) @AlexHentschel
• Memory limit exception for service account (#2437) @turbolent
• Add util command to retrieve snapshot at any height (#2429) @jordanschalm
• Use go 1.18 to build and run binary (#2363) @Kay-Zee
• Secure Cadence (#2337) @janezpodhostnik
• Secure cadence master update (#2433) @m4ksio
• Separate permission setting of contract deploy/update and removal (#2390) @robert-e-davidson3
• Robust Transaction Deduplication (#2385) @jordanschalm
• add flaky skip reason so tests can run in cron job (#2410) @kc1116
• Secure Cadence upgrade to m7 (#2423) @janezpodhostnik
• Secure Cadence flow-go-sdk upgrade (#2417) @janezpodhostnik
• [FVM] Signing errors swapped fix (#2415) @janezpodhostnik
• Log MemoryUsed by transactions. (#2396) @dsainati1
• Allow disabling/enabling permissionless deployment with a transaction (#2376) @janezpodhostnik
• Secure Cadence - merge master (#2400) @janezpodhostnik
• [Execution State] Full search json dump (#1971) @m4ksio
• improve signer indices logging (#2408) @zhangchiqing
• [Crypto] fix race conditions in DKG tests (#2391) @tarakby
• Add new code space for Canary addresses (#2388) @tarakby
• rm duplicate code in getNextAncestryLevel (#1759) @zhiqiangxu
• log bootstrap cmd error (#2259) @zhangchiqing
• fix docker build loader (#2382) @zhangchiqing
• [FVM] Merge default execution/memory weights and state weights (#2374) @janezpodhostnik
• Add test for referencing non-existent address (#2256) @janezpodhostnik
• Update execution verification tests (#2007) @janezpodhostnik
• [FVM] Collapse FVM bench results (#2111) @janezpodhostnik
• Secure Cadence - revert removing addKey api v1 tests (#2344) @janezpodhostnik
• Khalil/1689 Add authorized sender pubsub topic validator (#2317) @kc1116
• Add checksum to signer indices (#2362) @zhangchiqing
• changing the block height range for GetEventsForBlockHeightRange REST… (#2379) @vishalchangrani
• Fix race detector issues. (#2293) @SaveTheRbtz
• Add weights for cadence values and types (#2358) @robert-e-davidson3
• [FVM] signature verification refactoring (#2171) @tarakby
• Add weights for array element overhead and map pre-allocated elements (#2375) @SupunS
• [Signer Indices] upgrade onflow/flow package (#2377) @zhangchiqing
• [Collection] Log collection proposer (#2381) @zhangchiqing
• Update cd.yml to ignore daily tags created through automation (#2368) @sjonpaulbrown
• Update localnet TARGET paths after recent dockerfile changes (#2361) @peterargue
• [BFT Testing] Integrating BFT testing framework with testnet (#2308) @yhassanzadeh13
• Don't push :latest tag by default (#2355) @m4ksio
• Fix linting error (#2356) @zhangchiqing
• Secure Cadence - add memory alloc metering (#2350) @janezpodhostnik
• Secure Cadence - Merge master (#2343) @janezpodhostnik
• Secure Cadence - upgrade to m5 (#2340) @janezpodhostnik
• Secure Cadence - integration test fix (#2338) @janezpodhostnik
• Add extraction report for usage within external tooling (#2239) @sjonpaulbrown
• [BFT Testing] implements wintermute attack orchestrator (#2291) @yhassanzadeh13
• [Tool] add rollback executed height (#2334) @zhangchiqing
• [REST API] Adding missing fields to the ExecutionResult object (#2311) @vishalchangrani
• [Access] update system chunk tx handling in GetTransactionResults API (#2329) @smnzhu
• Memory weight assignment from contract (#2305) @janezpodhostnik
• Smnzhu/system tx port (#2332) @smnzhu
• remove unused test util (#2331) @robert-e-davidson3
• Fixed some tests for AddPublicKey and RemoveePublicKey (#2327) @robert-e-davidson3
• Add observer support to localnet (#2320) @shawnflow
• Fix AN crash (#2326) @m4ksio
• Tx results by block id merged (#2314) @m4ksio
• Create GetTransactionResultsByBlockID API (#2303) @smnzhu
• [Access node] Add random en lookup on receipt lookup failure (#2321) @koko1123
• Fix bootstrap constraint check (#2233) @zhangchiqing
• Add config to limit caching of new proposals while syncing (#2294) @jordanschalm
• implement result reindexing tool (#2289) @smnzhu
• Retry on conflict inserting cluster blocks (#2270) @jordanschalm
• Use block ID from seal (#2287) @Kay-Zee
• Upgrade go-retry v0.1.0->v0.2.3 (#2258) @jordanschalm
• Fix flakey test: TestComponentShutdown (#2269) @jordanschalm
• Use block ID from seal (#2288) @smnzhu
• Fix er indexing on finalization (#2284) @koko1123
• Add mutex around script tracking map (#2283) @koko1123
• Improve DKG & QC contract logging (#2263) @kc1116
• Fix result indexing by block (#2276) @koko1123
• [FVM, EN] pass request context and add timeout for script execution (#2147) @ramtinms
• Merge v0.25 to master (#2266) @turbolent
• Update the private message struct: remove Orig from DKGMessage (#2238) @kc1116
• [Networking] Fixes unicast timeout value for chunk data packs (#2267) @yhassanzadeh13
• unskip unflaky tests and update skip reason for broken tests (#2274) @smnzhu
• Skip cache for lint ci (#2271) @Kay-Zee
• [Networking] Fixes unicast timeout value for chunk data packs (#2268) @yhassanzadeh13

🛠 Improvements

• [Security] Remove unknown codeowners (#2448) @sideninja
• Remove comparison of key in MTrie payload.Equals() and add API comment about payload key (#2201) @fxamacker
• Add missing weights for cadence memory kinds (#2451) @SupunS
• Bump codecov-action v1 to v2 (#2128) @fxamacker
• Add weights to newly introduced memory kinds (#2404) @SupunS
• Permissionless contract updates (#2346) @turbolent
• Add weights for atree values (#2357) @dsainati1
• Drop large files from Linux page cache without external cmd to prevent cumulative cache growth in 148GB increments (#2336) @fxamacker
• Memory weight assignment (#2278) @dsainati1
• Drop checkpoint files from OS file cache to prevent file cache growing to hundreds of GB (#2281) @fxamacker
• Drop checkpoint files from OS file cache to prevent file cache growing to hundreds of GB (#2280) @fxamacker

🐞 Bug Fixes

• Fix underflowing of memory metrics difference values (#2549) @dsainati1

📖 Documentation

• Update docs for HTTP API (#2252) @sideninja