github juicedata/juicefs v1.2.0-beta1

latest releases: v1.2.1, v1.1.4, v0.2.1...
pre-release7 months ago

This is the first beta release for JuiceFS v1.2. Since v1.1 it has 354 commits from 41 contributors, thanks to @zhijian-pro @davies @zhoucheng361 @SandyXSD @jiefenghuang @polyrabbit @CaitinChen @yuhr123 @Hexilee @tangyoupeng @YunhuiChen @eryugey @timfeirg @Suave @solracsf @kyungwan-nam @xiaogaozi @1ambd4 @stefanb @XDTD @occupyhabit @menwenjun @li1213987842 @testwill @fengleng @deferdeter @camcui @uvletter @T-TRz879 @yuchen-sun @TechQuery @reAsOn2010 @mtnk2005 @kanemathers @JoJossd @sjp00556 @CodingPoeta @abserari @AChangFeng @feeyman @l0wl3vel !

Highlights

New

  • Added a new command compact to trigger compaction on a specified path (#4337)
  • Supports using NFS as object storage (#3823, #4101, #4105, #4111, #4147, #4163, #4718)
  • Supports using Dragonfly as object storage (#4057)
  • Supports using Bunny as object storage (#4719)
  • cmd: add a new option --log-id to append user-specified ID in log (#4040)
  • cmd/format: add a new option --enable-acl to enable POSIX ACL (#4421, #4437, #4443, #4490, #4503, #4518, #4522, #4523, #4516, #4551, #4640)
  • cmd/mount: add a new option --skip-dir-mtime to eliminate burst mtime updates of a directory (#4189)
  • cmd/mount: add a new option --upload-hours to limit the period for background uploads (#4250)
  • cmd/mount: add a new option --cache-expire to set expired time for cached blocks (#4255, #4365, #4434)
  • cmd/mount: add a new option --custom-labels to set labels for metrics (#4312, #4612)
  • cmd/mount: add a new environment variable JFS_MOUNT_TIMEOUT to adjust timeout for checking mount point ready (#4219)
  • cmd/mount: supports restarting mount process gracefully (#4392, #4450, #4487, #4499, #4509, #4511, #4524, #4547, #4555)
  • cmd/gateway: supports IAM and events notify (#4030, #4593, #4622)
  • cmd/gateway&webdav: add a new option --background to support daemon running (#3993, #4631, #4708)
  • cmd/gateway: add a new option --domain to support virtual-host-style requests (#4462)
  • cmd/warmup: add a new option --evict to manually evict cached blocks (#4370)
  • cmd/warmup: and a new option --check to check the ratio of already warmed blocks (#4370)
  • cmd/dump: add a new option --fast=false to reduce memory usage with a slower dump process (#4253)
  • cmd/dump: add a new option --skip-trash to skip the trash directory when backing up metadata (#4479, #4563)
  • cmd/dump: add a new option --threads to adjust speed for dump (#4581)
  • cmd/sync: add a new option --inpace to put file in-place, eliminating the rename operation (#4104)
  • cmd/sync: supports two stars ** and three stars *** to match all files recursively (#4422, #4448, #4460, #4468, #4474)
  • cmd/sync: add a new option --match-full-path to match the filter against full path (#4492)
  • cmd/sync: add p8s metrics to better monitor the sync progress (#4119)
  • meta: supports Open File Description (OFD) lock (#4083)
  • chunk: disk cache switch to consistent hash and add bad disk detection (#4543)
  • object: add query string to disable md5 and crc verification when s3 compatible storage does not support them (#4606)
  • object: add a new environment variable JFS_S3_VHOST_STYLE=1 to enable vhost style (#4697)
  • hadoop: add push-labels option to set custom labels for metrics (#4312)

Changed

  • cmd: support human friendly values for options (#4246, #4558, #4567, #4592, #4641, #4671)
  • cmd/mount: only use writeback_cache to enable fuse writeback (#4632)
  • cmd/gateway: judge loop symbolic links rather than hard-code deep limit (#4045)
  • cmd/gateway: create MinioMetaBucket when it doesn't exist (#4383)
  • cmd/gateway: create .minio.sys directory even if multi-buckets are not enabled (#4367)
  • cmd/sync: limit the maximum memory size for multiple uploads (#4135)
  • cmd/sync: speed up sync for huge file (#4456)
  • cmd/sync: use larger io-size when writing to backends (#4546)
  • cmd/sync: skip listing the destination in force mode (#4602)
  • cmd/sync: use HEAD instead of LIST for a single object (#4623)
  • meta: add mount time in session info (#3987)
  • meta: export meta backup metrics (#4480)
  • meta: force compaction when there are too many slices in one chunk (#4573)
  • meta/tkv & meta/sql: speedup the dump process using multiple threads (#4501)
  • meta/redis: reduce the memory usage when dumping large directories (#4481)
  • meta/badger: upgrade to v4 (#4564)
  • chunk: prefetch the whole block only on successful partial read (#4658)
  • vfs: fuse ops metric supports showing method label (#4554, #4560)
  • vfs: add errno label to fuse ops metric (#4656)
  • object/tos: adjust min part size from 5 MiB to 4 MiB (#4688)
  • object/ceph: allow delete when ceph cluster is full (#4131)
  • object/ceph: speedup list for ceph (#4218)
  • object/ceph: set default path for admin socket and log file (#4608)
  • hadoop: support human friendly values for options (#4655)

Bugfix

  • cmd/gateway: fix ListMultipartUploads sorting rule and support delimiter (#4297)
  • cmd/gateway: fix HEAD directory returns 200 but expect 404 (#4486)
  • cmd/gateway: fix the issue that memory is not released immediately after object downloaded (#4507)
  • cmd/sync: fix the issue that empty files are always synchronized (#4223)
  • cmd/sync: execute chmod after chown to avoid setuid/setgid failure (#4418)
  • cmd/sync: fix the issue that setuid/setgid/sticky bits are not set when using jfs protocol (#4419)
  • meta: fix the issue that df may see negative values (#4591)
  • meta/sql: use upsert in Write() to avoid possible deadlock (#4529)
  • vfs: fix the issue that file entry may still be returned if it's deleted during readdir (#4453)
  • vfs: fix the issue that file length may not be updated immediately after fallocate & copyfilerange (#4427)
  • hadoop: make libjfs singleton to avoid possible jnr weakhashmap infinity loop (#4407)
  • hadoop: fix guid lookupGroup (#4532)
  • hadoop: use auto-increment fs handle to avoid possible conflict (#4411)
  • hadoop: fix the issue that dfsio does not work because mapreduce.output.fileoutputformat.compress is true (#4646)

Don't miss a new juicefs release

NewReleases is sending notifications on new releases.