filecoin-project/lotus v1.11.2-rc2

on GitHub

Discussion for this release is here.

This is the second release candidate for Lotus v1.11.2 release that includes a proof patch for v1.11.2-rc1.
lotus v1.11.2 introduces dagstore and many deal-making and market subsystem improvements and new features along with other bug fixes. More detailed changelog will be provided later. One of the most exciting new features we are introducing is Dagstore:

• The dagstore is a component of the markets subsystem in lotus-miner. It is a sharded store to hold large IPLD graphs efficiently, packaged as location-transparent attachable CAR files and it replaces the former Badger staging blockstore. It is designed to provide high efficiency and throughput, and minimize resource utilization during deal-making operations.
• You can read more about dagstore's concepts, terminolog and so on here.
• Note:When you first start your lotus-miner or market subsystem with this release, a one-time/first-time dagstore migration will be triggered. Read this section to learn what the process does, what to expect and how monitor it.
  • That being said, few things to note:
    • it is highly recommended to wait all ongoing data transfer to finish or cancel inbound storage deals that are still transferring, using the lotus-miner data-transfers cancel command before upgrade your market nodes. Reason being that the new dagstore changes attributes in the internal deal state objects, and the paths to the staging CARs where the deal data was being placed will be lost.
    • Rollback Alert(from v1.11.2-rcX to any version lower): If a storage deal is initiated with M1/v1.11.2 release, it needs to get to the StorageDealAwaitingPrecommit state before the you can do a version rollback or the markets process may panic.

Changelog

• github.com/filecoin-project/lotus:
  • bump the version
  • update ffi to b4e4271db8f6e961934cd6ffff44fda3c610b9c0 per #7207
  • upgrade go-data-transfer; propagate deal cancellations.
  • Fix typos
  • Apply suggestions from code review
  • Update CHANGELOG.md
  • fix docsgen
  • lotus v1.11.2-rc prep
  • Update markets, dt and graphsync (filecoin-project/lotus#7160)
  • sealing: Fix RecoverDealIDs loop with changed PieceCID (filecoin-project/lotus#7117)
  • api/command for encoding actor params (filecoin-project/lotus#7150)
  • Fix nits and see if codecov works now with auto (filecoin-project/lotus#7151)
  • Codecov Projects (filecoin-project/lotus#7147)
  • shed: Support raw encoding in cid id (filecoin-project/lotus#7149)
  • rpcenc: Support reader redirect (filecoin-project/lotus#6952)
  • Fix error handling in SectorAddPieceToAny api impl (filecoin-project/lotus#7135)
  • add rice box to required binaries (filecoin-project/lotus#7125)
  • remove m1 templates and make area selection multi-optionable (filecoin-project/lotus#7121)
  • upgrade upstream dependencies. (filecoin-project/lotus#7115)
  • Remove replace directive for multihash dep (#7113) (filecoin-project/lotus#7113)
  • Update to latest FFI (filecoin-project/lotus#7110)
  • release -> master (filecoin-project/lotus#7105)
  • fix(miner): always create miner deal staging directory (#7098) (filecoin-project/lotus#7098)
  • integrate DAG store and CARv2 in deal-making (#6671) (filecoin-project/lotus#6671)
  • fix build after merging #6097. (#7096) (filecoin-project/lotus#7096)
  • feat(miner deals): create subdir to miner repo for staged deals (filecoin-project/lotus#6853)
  • Extending sectors: more practical and flexible tools (filecoin-project/lotus#6097)
  • (filecoin-project/lotus#7088)
  • Lotus release process - how we make releases (filecoin-project/lotus#6944)
  • Strict major minor version checking on v0 and v1 apis (filecoin-project/lotus#7038)
  • (filecoin-project/lotus#7042)
  • Test with latest actors version (filecoin-project/lotus#6998)
  • codecov: fix mock name (filecoin-project/lotus#7039)
  • codecov: fix regexes (filecoin-project/lotus#7037)
  • Magically increase code coverage (filecoin-project/lotus#7036)
  • fix: don't check for t_aux when proving (filecoin-project/lotus#7011)
  • Support --actor in miner actor control list (filecoin-project/lotus#7027)
  • PreCommitPolicy: Don't try to align expirations on proving period boundaries (filecoin-project/lotus#7018)
  • revert pricelist by version to pricelist by epoch (filecoin-project/lotus#7022)
  • Shed: Include network name in genesis-verify (filecoin-project/lotus#7019)
  • Dont panic if input is bad (filecoin-project/lotus#7007)
  • Reduce splitstore memory usage during chain walks (filecoin-project/lotus#6949)
  • fix: vet actors shims (filecoin-project/lotus#6999)
  • fix: more logging in maybeStartBatch error (filecoin-project/lotus#6996)
  • fix flaky TestDealPublisher and re-enable (filecoin-project/lotus#6991)
  • feat: add ChainGetTipSetAfterHeight (filecoin-project/lotus#6990)
  • Remove forgotten non-functioning config from the pre-mainnet days (filecoin-project/lotus#6970)
  • lotus-shed splitstore clear command (filecoin-project/lotus#6967)
  • add explicit error msg if repo dir does not exist (filecoin-project/lotus#6909)
  • update go-libp2p-pubsub to v0.5.4 (filecoin-project/lotus#6958)
  • chore: disable flaky test (filecoin-project/lotus#6957)
  • Test/pledge batching msg prop (filecoin-project/lotus#6537)
  • set buildtype in nerpa and butterfly (filecoin-project/lotus#6085)
  • reasonable max value for initial sector expiration (filecoin-project/lotus#6099)
  • fix skipCount (filecoin-project/lotus#6940)
  • fix bug in MpoolPending message exclusion (filecoin-project/lotus#6945)
  • Improve formatting of workers CLI (filecoin-project/lotus#6942)
  • support MARKETS_API_INFO env var, and markets-repo, markets-api-url CLI flags. (filecoin-project/lotus#6936)
  • Update state machine deps for logging (filecoin-project/lotus#6941)
  • Update deps for more logging in data transfer and markets (filecoin-project/lotus#6937)
  • release v1.11.1 backport -> master (filecoin-project/lotus#6929)
  • make: set default GOCC earlier (filecoin-project/lotus#6932)
  • Moving GC Followup (filecoin-project/lotus#6905)
  • PR #5109 + suggested fix (filecoin-project/lotus#6927)
  • Log more call context during errors (filecoin-project/lotus#6918)
  • make: fix version check when using gotip (filecoin-project/lotus#6916)
  • polish(errors): better state tree errors (filecoin-project/lotus#6923)
  • Update to branches with improved logging (filecoin-project/lotus#6919)
  • adding an RuntimeSubsystems API to storage miner; fix lotus-miner info (filecoin-project/lotus#6906)
  • fix ticket check (filecoin-project/lotus#6882)
  • update go-libp2p-pubsub to v0.5.3 (filecoin-project/lotus#6907)
  • Configurable CC Sector Expiration (filecoin-project/lotus#6803)
  • Drop townhall/chainwatch (filecoin-project/lotus#6912)
  • make: Allow setting Go compiler with GOCC (filecoin-project/lotus#6911)
  • chore: fixup issue templates (filecoin-project/lotus#6899)
  • bump master version to v1.11.2-dev (filecoin-project/lotus#6903)
  • releases -> master for v1.11.0 (filecoin-project/lotus#6894)
  • Reduce entropy in the chain package (filecoin-project/lotus#6889)
• github.com/filecoin-project/go-data-transfer (v1.7.2 -> v1.7.8):
  • send cancel async (#245) (filecoin-project/go-data-transfer#245)
  • release: v1.7.7 (filecoin-project/go-data-transfer#242)
  • reduce channel monitor log verbosity (#241) (filecoin-project/go-data-transfer#241)
  • release: v1.7.6 (filecoin-project/go-data-transfer#239)
  • feat: improve graphsync transport logging (#238) (filecoin-project/go-data-transfer#238)
  • Log completion message flow (#236) (filecoin-project/go-data-transfer#236)
  • Handle data-sent and data-queued events in the TransferFinished state (#233) (filecoin-project/go-data-transfer#233)
  • Log closing of completion channel (#232) (filecoin-project/go-data-transfer#232)
  • fix log statement. (#230) (filecoin-project/go-data-transfer#230)
  • Simplify graphsync cancel (#229) (filecoin-project/go-data-transfer#229)
• github.com/filecoin-project/go-fil-markets (v1.6.2 -> v1.8.1):
  • Update data-transfer and graphsync (#611) (filecoin-project/go-fil-markets#611)
  • close file descriptors + log piece handoff to sealing subsystem (#609) (filecoin-project/go-fil-markets#609)
  • release: v1.8.0. (#605) (filecoin-project/go-fil-markets#605)
  • Revert "refactor: pass deal proposal instead of deal ID to OnDealExpiredOrSlashed (#476)" (#604) (filecoin-project/go-fil-markets#604)
  • migrate to DAG store + CARv2 blockstores for storage and retrieval (#576) (filecoin-project/go-fil-markets#576)
  • release: 1.7.0 (#597) (filecoin-project/go-fil-markets#597)
  • refactor: pass deal proposal instead of deal ID to OnDealExpiredOrSlashed (#476) (filecoin-project/go-fil-markets#476)

Contributors