Enhancements:
- Ignore Interrupts default true:
- --ignore-interrupts flag is now ENABLED by default, more details on this feature added in v2.1.0.
- kernel list cache config change:
- There is backward incompatible change in this release for configuration file, prior to this release kernel-list-cache-ttl-secs could be set using file-system:kernel-list-cache-ttl-secs, for this release the config should be list:kernel-list-cache-ttl-secs. Passing this value through cli remains the same, no change in that.
- anonymous-access config change:
- There is backward incompatible change in this release for configuration file, prior to this release anonymous access used to access an endpoint that does not require authentication, such as a publicly accessible bucket or test endpoint could be set using auth-config:anonymous-access: true, for this release the config should be gcs-auth:anonymous-access: true. Passing this value through cli remains the same, no change in that.
Dependency Upgrades / CVE fixes:
- Upgraded go lang to 1.22.4.
What's Changed
- Update direct dependencies. by @kislaykishore in #2009
- Add all config-params to params.yaml by @kislaykishore in #1999
- Convert gcloud operations in storage client - 1 by @Tulsishah in #1959
- Add documentation to params.yaml by @kislaykishore in #2010
- Make the spreadsheetId argument optional by @Tulsishah in #2012
- Delete folder api implementation by @Tulsishah in #1954
- fix e2e test for hns bucket by @Tulsishah in #2020
- Validates formatting in CI workflow by @kislaykishore in #2016
- Run all except cache tests concurrently by @kislaykishore in #2022
- Making compute crc method context cancellable by @vadlakondaswetha in #2013
- Use 1.22 as the min Go version by @kislaykishore in #2003
- Set crc32 when converting minobject to object by @vadlakondaswetha in #2028
- Add parallel downloads job by @sethiay in #2005
- Fix copyright URL by @kislaykishore in #2031
- Convert Golang compliant flags to POSIX compliant by @kislaykishore in #2030
- Automate e2e tests on TPC environment by @Tulsishah in #1943
- Make Wait for Download false for all read scenarios when parallel downloads is true by @ankitaluthra1 in #2027
- Kokoro tpc build fix by @Tulsishah in #2033
- Support fstab mount with hyphens by @ashmeenkaur in #1993
- Fix Pytorch v2 model failure by @sethiay in #2037
- Unmarshal the config object by @kislaykishore in #2035
- Implement limit on max-concurrency. by @kislaykishore in #2032
- Add max-download-parallelism validation by @kislaykishore in #2046
- Ignore interrupts by default by @ashmeenkaur in #2034
- [Config CLI Parity] add squash to config structure tags to make decoding easier by @ashmeenkaur in #2044
- [Config-CLI Parity][Fix] Populate config object when config file is not provided by @ashmeenkaur in #2042
- adds get folder method in bucket.go by @ankitaluthra1 in #2041
- Raise error if params.yaml contains invalid fields by @kislaykishore in #2049
- fix gcloud install by @Tulsishah in #2039
- Return error if the config file is invalid. by @kislaykishore in #2048
- Use atleast 1 goroutine for async job by @sethiay in #2056
- Add @kislaykishore as owners for config by @kislaykishore in #2055
- Revert "add squash to config structure tags to make decoding possible… by @ashmeenkaur in #2058
- [Config CLI Parity] temp-dir should be of type resolved path by @ashmeenkaur in #2059
- Add more tests (unit, composite) tests for parallel downloads by @sethiay in #2019
- Remove flakiness in parallel downloads unit tests by @sethiay in #2063
- Add constraints on number of args by @kislaykishore in #2066
- Rename parallel downloads flags by @sethiay in #2064
- Fix race in test by @kislaykishore in #2067
- Use default MaxDownloadParallelism based on number of CPU cores by @sethiay in #2047
- Set default max-parallel-downloads in new config by @kislaykishore in #2072
- Setting defaults for parallel downloads by @sethiay in #2073
- Use truncate and remove function while eviction from job during CRC check by @sethiay in #2015
Full Changelog: v2.2.0...v2.3.0