Lotus v1.13.2 is a highly recommended feature release with remarkable retrieval improvements, new features like worker management, schedule enhancements and so on.
Highlights
- πππImprove retrieval deal experience
- Testing result with MinerX.3 shows the retrieval deal success rate has increased dramatically with faster transfer
speed, you can join or follow along furthur performance testings here. We recommend application developers to integrate with the new
retrieval APIs to provide a better client experience. - πππ Reduce retrieval Time-To-First-Byte over 100x (#7693)
- This change makes most free, small retrievals sub-second
- πππ Partial retrieval ux improvements (#7610)
- New retrieval commands for clients:
lotus client ls
: retrieve and list desired object linkslotus client cat
: retrieve and print the data from the network
- ππ The monolith
ClientRetrieve
method was broken into:ClientRetrieve
which retrieves data into the local repo (or into an IPFS node if ipfs integration is enabled)ClientRetrieveWait
which will wait for the retrieval to completeClientExport
which will export data from the local node- Note: this change only applies to v1 API. v0 API remains unchanged.
- π Support for full ipld selectors was added (for example making it possible to only retrieve list of directories in a deal, without fetching any file data)
- To learn more, see here
- New retrieval commands for clients:
- Testing result with MinerX.3 shows the retrieval deal success rate has increased dramatically with faster transfer
- ππ Sealing scheduler enhancements (#7703,#7269, #7714)
- Workers are now aware of cgroup memory limits
- Multiple tasks which use a GPU can be scheduled on a single worker
- Workers can override default resource table through env vars
- Default value list: https://gist.github.com/magik6k/c0e1c7cd73c1241a9acabc30bf469a43
- ππ Sector storage groups (#7453)
- Storage groups allow for better control of data flow between workers, for example, it makes it possible to define that data from PC1 on a given worker has to have it's PC2 step executed on the same worker
- To set it up, follow the instructions under the
Sector Storage Group
section here
New Features
- Add RLE dump code (#7691)
- Shed: Add a util to list miner faults (#7605)
- lotus-shed msg: Decode submessages/msig proposals (#7639)
- CLI: Add a lotus multisig cancel command (#7645)
- shed: simple wallet balancer util (#7414)
- balancing token balance between multiple accounts
Improvements
- Add verbose mode to
lotus-miner pieces list-cids
(#7699) - retrieval: Only output matching nodes, MatchPath dagspec (#7706)
- Cleanup partial retrieval codepaths ( zero functional changes ) (#7688)
- storage: Use 1M buffers for Tar transfers (#7681)
- Chore/dm level tests plus merkle proof cars (#7673)
- Shed: Add a util to create miners more easily (#7595)
- add timeout flag to wait-api command (#7592)
- add log for restart windows post scheduler (#7613)
- remove jaeger envvars (#7631)
- remove api and jaeger env from docker file (#7624)
- Wdpost worker: Reduce challenge confidence to 1 epoch (#7572)
- add additional methods to lotus gateway (#7644)
- Add caches to lotus-stats and splitcode (#7329)
- remote store: Remove debug printf (#7664)
- docsgen-cli: Handle commands with no description correctly (#7659)
Bug Fixes
- fix docker logic error (#7709)
- add missing NodeType tag (#7559)
- checkCommit should return SectorCommitFailed (#7555)
- ffiwrapper: Validate PC2 by calling C1 with random seeds (#7710)
Dependency Updates
- Update go-graphsync v0.10.6 (#7708)
- update go-libp2p-pubsub to v0.5.6 (#7581)
- Update go-state-types (#7591)
- disable mplex stream muxer (#7689)
- Bump ws from 5.2.2 to 5.2.3 in /lotuspond/front (#7660)
- Bump color-string from 1.5.3 to 1.6.0 in /lotuspond/front (#7658)
- Bump postcss from 7.0.17 to 7.0.39 in /lotuspond/front (#7657)
- Bump path-parse from 1.0.6 to 1.0.7 in /lotuspond/front (#7656)
- Bump tmpl from 1.0.4 to 1.0.5 in /lotuspond/front (#7655)
- Bump url-parse from 1.4.7 to 1.5.3 in /lotuspond/front (#7654)
- github.com/filecoin-project/go-state-types (v0.1.1-0.20210915140513-d354ccf10379 -> v0.1.1):
Others
- Update archive script (#7690)
Contributors
Contributor | Commits | Lines Β± | Files Changed |
---|---|---|---|
@magik6k | 89 | +5200/-1818 | 232 |
Travis Person | 5 | +1473/-953 | 38 |
@arajasek | 6 | +550/-38 | 19 |
@clinta | 4 | +393/-123 | 26 |
@ribasushi | 3 | +334/-68 | 7 |
@jennijuju | 13 | +197/-120 | 67 |
@Kubuxu | 10 | +153/-30 | 10 |
@coryschwartz | 6 | +18/-26 | 6 |
Marten Seemann | 2 | +6/-34 | 5 |
@vyzo | 1 | +3/-3 | 2 |
@hannahhoward | 1 | +3/-3 | 2 |
@ZenGround0 | 2 | +2/-2 | 2 |
@yaohcn | 2 | +2/-2 | 2 |
@jennijuju | 1 | +1/-1 | 1 |
@hunjixin | 1 | +1/-0 | 1 |