NVIDIA/DALI v0.27.0

DALI v0.27.0

on GitHub

Key Features and Enhancements

This DALI release includes the following key features and enhancements.

• New operators:
  • CoordTransform Operator for applying a linear transformation to points or vectors (#2288)
  • GaussianBlur Gpu Operator (#2314, #2311, #2254)
  • Nemo ASR Reader (#2234)
  • Resize 3D - operator can now process 3D inputs (#2226)
  • Add Translate affine transform generator (#2297) - in the next release it will be moved to a dedicated module.
• Use true scalars (except in classification readers) - 0-dim Tensors represent scalar values (#2318)
• Adjust documentation after review (#2175)
• Support for ZSTD compression for TIFF files (#2273)
• Support for Run-Length Encodings and Pixelwise Masks in COCO Reader (#2248)
• Support more types in Lookup table (#2290)

Bug fixes

• Fixes crash in RandomBBoxCrop when no labels are provided (#2265)
• Fix minor issues reported by static analysis (#2276)
• Fix detection pipeline test on Ampere (#2304)
• Fix BUILD_LIBSND=OFF build (#2316)
• Fix build for LMDB disabled (#2319)

Improvements

• Update build and test deps to the latest version (#2250)
• Resize 3D + resize tests (#2226)
• Allow passing a <= 0 values in the file list to allow more flexible frame indexing (#2264)
• Extend host decoder to support jpeg2000 (#2270)
• Add file_list argument support to the Numpy reader operator (#2274)
• Allow Slice to silently assume absolute anchor and shape when those are represented by an integer (#2282)
• TransformPoints kernel (#2287)
• Add inline to LookaheadParser methods (#2289)
• Add deprecation handling in backend (#2279)
• Support more types in Lookup table (#2290)
• Adjust documentation after review (#2175)
• Transform points op (#2288)
• Support for ZSTD compression for TIFF files (#2273)
• Support for Run-Length Encodings and Pixelwise Masks in COCO Reader (#2248)
• Extract a DecodeAudio implementation from Audio decoder operator (#2294)
• Extend test_RN50_data_pipeline.py test (#2295)
• Add ConvolutionGPU kernel based on CUTLASS (#2254)
• Add Translate affine transform generator (#2297)
• Add *.cuh and *.inl to list of headers to bundle (#2307)
• Add Nemo ASR reader (#2234)
• Add SeprableConvolutionGPU kernel (#2311)
• Add GaussianBlur Gpu Operator (#2314)
• Use true scalars (except in classification readers) + bug fixes (#2318)
• Add nvjpeg2k support to GPU Image Decoder. Extend nvjpeg memory pool to support nvjpeg2k allocators.
• Adds a separate option to preallocate nvjPEG2k memory (#2347)
• Due to some decoding problems disable nvJPEG2K support for now by the default

Breaking API changes

Deprecated feature

Known issues:

• The video loader operator requires that the key frames occur at a minimum every 10 to 15 frames of the video stream. If the key frames occur at a lesser frequency, then the returned frames may be out of sync.
• The DALI TensorFlow plugin might not be compatible with TensorFlow versions 1.15.0 and later.
  To use DALI with the TensorFlow version that does not have a prebuilt plugin binary shipped with DALI, make sure that the compiler that is used to build TensorFlow exists on the system during the plugin installation. (Depending on the particular version, use GCC 4.8.4, GCC 4.8.5, or GCC 5.4.)
• Due to some known issues with meltdown/spectra mitigations and DALI, DALI shows best performance when run in Docker with escalated privileges, for example:
  • privileged=yes in Extra Settings for AWS data points
  • --privileged or --security-opt seccomp=unconfined for bare Docker

Binary builds

Install via pip for CUDA 10
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/ nvidia-dali-cuda100==0.27.0
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/ nvidia-dali-tf-plugin-cuda100==0.27.0

or for CUDA 11:
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/ nvidia-dali-cuda110==0.27.0
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/ nvidia-dali-tf-plugin-cuda110==0.27.0

Or use direct download links (CUDA 10.0):

• https://developer.download.nvidia.com/compute/redist/nvidia-dali-cuda100/nvidia_dali_cuda100-0.27.0-1699645-py3-none-manylinux2014_x86_64.whl
• https://developer.download.nvidia.com/compute/redist/nvidia-dali-tf-plugin-cuda100/nvidia-dali-tf-plugin-cuda100-0.27.0.tar.gz

Or use direct download links (CUDA 11.0):

• https://developer.download.nvidia.com/compute/redist/nvidia-dali-cuda110/nvidia_dali_cuda110-0.27.0-1699648-py3-none-manylinux2014_aarch64.whl
• https://developer.download.nvidia.com/compute/redist/nvidia-dali-cuda110/nvidia_dali_cuda110-0.27.0-1699648-py3-none-manylinux2014_x86_64.whl
• https://developer.download.nvidia.com/compute/redist/nvidia-dali-tf-plugin-cuda110/nvidia-dali-tf-plugin-cuda110-0.27.0.tar.gz

FFmpeg source code:

• This software uses code of FFmpeg licensed under the LGPLv2.1 and its source can be downloaded here

Libsndfile source code:

• https://developer.download.nvidia.com/compute/redist/nvidia-dali/libsndfile-1.0.28.tar.gz