DALI v0.17.0
Pre-release
Pre-release
Bug fixes
- Fix scalar batch handling in arithmetic ops (#1449)
- Coverity fixes (#1408)
- Fix removal of device_id initialization in OF (#1459)
- Static analysis fixes (#1469)
- Fix start index function (#1482)
- Add missing dependencies to conda recipe (#1483)
- Fix for bundle-wheel.sh (#1499)
- More of static analysis fixes (#1496)
- Fix race between consecutive invocations of stage, reduce number of events (#1493)
- Fixes ExternSource for the GPU (#1452)
- Fix pip package discovery (#1534)
- Wait for thread pool to finish work in BrightnessConstrast (#1549)
- Fix doc string (#1546)
- Fix color operators. (#1555)
- Fix color operators even more (#1558)
- Fix stream usage in HSV and BrighnessContrast. (#1566)
- Fix problem with TensorFlow and cupy tests (#1568)
Improvements
- Add favicon to docs (#1453)
- Resampling ND - ground work (#1366)
- Warp 3D (#1442)
- Add sequence and 3D support in flip operator (#1439)
- Make thread pinning optional in the mixed ImageDecoder (#1465)
- Improve accuracy of 3D rotation (#1466)
- Add ability to read LMDB without any labels stored inside (#1440)
- AudioDecoder for WAV format (#1447)
- Add support for PaddlePaddle (#1371)
- Update docs for
fill_last_batch
parameter to match the real behavior (#1479) - Remove used requirement from paddle SSD demo docs (#1486)
- FFT CPU 1D implementation (based on ffts) (#1446)
- Utilize libcudart.so version to detect the CUDA toolkit version (#1477)
- Allow for more verbose Pipeline's graph logging (#1487)
- CMake switch for audio support (#1480)
- Add polygons mask support to COCOReader (#1455)
- Change TF versions supported by dataset (#1492)
- Additional deps for AudioDecoder (#1485)
- Add ExtractWindows CPU kernel (#1461)
- Add MNIST TensorFlow test (#1467)
- Remove deprecated edge.py (#1498)
- Add PowerSpectrum CPU operator (#1460)
- Add Spectrogram CPU Operator (#1468)
- Add MNIST examples (#1491)
- Add notebooks with example usage of arithmetic ops (#1438)
- Add ToDecibels CPU kernel (#1516)
- Adding librosa dependency to qa/TL1_jupyter_plugins/test.sh (#1517)
- Fix Keras GPU example (#1520)
- Preemphasis operator (#1515)
- Fix for WaitForWork in Preemphasis (#1523)
- AudioDecoder operator (#1481)
- Lower the accuracy threshold for paddle RN50 test (limited to 25 epochs only) (#1528)
- Remove cache options from fused ImageDecoder documentation (#1495)
- Add ToDecibels CPU operator (#1518)
- Add deprecation warning for Python 2.7 (#1521)
- Split tests per framework if possible (#1519)
- Add zlib dependency warning to libtiff build step (#1530)
- Rephrase supported backends documentation (#1497)
- Extend supported ops doc to include info about volumetric data. (#1531)
- Disable clamping when converting from bool (#1536)
- Add adobe analytics tracking script into docs (#1539)
- ColorTwist operator cleanup (#1532)
- NormalDistribution operator (#1529)
- Hide the docs for internal operators (#1542)
- MelFilterBank CPU kernel (#1522)
- Disables cupy test for python 2.7 (#1544)
- Boundary condition handling (#1552)
- Add spaces in Python 2.7 end of life warning (#1553)
- Add MelFilterBank CPU operator (#1535)
- Add more formats to FileReader (#1561)
- Make the presence of unique visitor script counting optional in docs (#1560)
- Adjust color ops; make contrast-neutral gray configurable (#1562)
Breaking API changes
- DALI 0.17 is the last official release for Python 2.7, which reaches the end of life on January 1st, 2020. To stay up to date with DALI, please upgrade to Python 3.5 or later.
- The
asCPU
method is no longer available and has been replaced withas_cpu
. - ColorTwist operator was deprecated and replaced by BrightnessContrast and HSV operators cleanup (#1532)
Known issues:
- The video loader operator requires that the key frames occur at a minimum every 10 to 15 frames of the video stream. If the key frames occur at a lesser frequency, then the returned frames may be out of sync.
- DALI TensorFlow plugin may not be compatible with TensorFlow versions 1.15.0 and/or later. If the user wants to use DALI with TensorFlow version which doesn’t have prebuilt plugin binary shipped with DALI it requires the gcc compiler that matches the one used to build TensorFlow (gcc 4.8.4 or gcc, 4.8.5 or 5.4, depending on the particular version) is present on the system.
- Due to some known issues with meltdown/spectra mitigations and DALI, DALI shows best performance when run in Docker with escalated privileges, for example:
- privileged=yes in Extra Settings for AWS data points
- --privileged or --security-opt seccomp=unconfined for bare Docker
Binary builds
Install via pip for CUDA 9:
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/cuda/9.0 nvidia-dali==0.17.0
or for CUDA 10
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist/cuda/10.0 nvidia-dali==0.17.0
Or use direct download links (CUDA 9.0):
- https://developer.download.nvidia.com/compute/redist/cuda/9.0/nvidia-dali/nvidia_dali-0.17.0-1030352-cp27-cp27mu-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/9.0/nvidia-dali/nvidia_dali-0.17.0-1030352-cp35-cp35m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/9.0/nvidia-dali/nvidia_dali-0.17.0-1030352-cp36-cp36m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/9.0/nvidia-dali/nvidia_dali-0.17.0-1030352-cp37-cp37m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/9.0/nvidia-dali-tf-plugin/nvidia-dali-tf-plugin-0.17.0.tar.gz
Or use direct download links (CUDA 10.0):
- https://developer.download.nvidia.com/compute/redist/cuda/10.0/nvidia-dali/nvidia_dali-0.17.0-1030354-cp27-cp27mu-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/10.0/nvidia-dali/nvidia_dali-0.17.0-1030354-cp35-cp35m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/10.0/nvidia-dali/nvidia_dali-0.17.0-1030354-cp36-cp36m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/10.0/nvidia-dali/nvidia_dali-0.17.0-1030354-cp37-cp37m-manylinux1_x86_64.whl
- https://developer.download.nvidia.com/compute/redist/cuda/10.0/nvidia-dali-tf-plugin/nvidia-dali-tf-plugin-0.17.0.tar.gz
FFmpeg source code:
Libsndfile source code: