This is the release note of v10.0.0a1. See here for the complete list of solved issues and merged PRs.
We are running a Gitter chat for general discussions and quick questions. Feel free to join the channel to talk with developers and users!
Highlights
CUDA 11.0 and 11.1 wheels not available yet in PyPI (#4971)
In the meantime, they can be downloaded from the Assets section below. See #4971 for the detailed instructions.
Changes without compatibility
Current stream is now managed per device (#5172)
CuPy now automatically manages the stream switching when changing a device, so the user is not responsible for changing the stream anymore.
This pull-request also includes a bug fix for #5143. An existing code mixing with stream: blocks and stream.use() may get different results as the stream set via use() API will not be reactivated when exiting a stream context.
s1 = cupy.cuda.Stream()
s2 = cupy.cuda.Stream()
s3 = cupy.cuda.Stream()
with s1:
s2.use()
with s3:
pass
cupy.cuda.get_current_stream() # -> CuPy v10 returns `s1` instead of `s2`.Make cupy.cuda.Device context manager interface thread safe (#5083)
The use of a single cupy.cuda.Device context manager object with multiple threads was leading to incorrect behavior when restoring the previous device since the first versions of CuPy. Now the correct device is restored back so user code relying on this incorrect behavior might need to be updated.
Deprecate cupyx.allow_synchronize and cupyx.DeviceSynchronized APIs (#5226)
These APIs used for detecting when synchronization to a device was happening have been deprecated since they don’t provide reliable behavior.
Changes
Note: many of these PRs are backported to the v9 series and available since the release.
New Features
- CUDA 11.2: Add
MemoryAsyncPoolto supportmalloc_async(#4592) - Add APIs for creating NumPy arrays backed by pinned memory (#4870)
- Support cuSPARSELt (#4883)
- Add gamma distributions to random API (#4905)
- Add
randomfor uniform [0, 1) generation (#4906) - Add
poissondistribution to random API (#4927) - Add SciPy compatible connected_components (#4940)
- Support shared memory in CuPy JIT (#4950)
- Add cupyx.scipy.sparse.kronsum() (#4968)
- Add
hfft2,ihfft2,hfftn, andihfftntocupyx.scipy.fft(#4996) - CuPy JIT: Print kernel code (#5017)
- Add
cupyx.jit.atomic_add(#5169) - CUDA 11.2/11.3: Support
MemoryAsyncPoolstatistics and limits (#5177)
Enhancements
- Ability to pass structured data types by value as kernel parameters (#4829)
- Move the NVTX module to
cupy_backends.cuda.libs(#4930) - Disable CUB SpMV on CUDA 11.x (#4949)
- CuPy JIT: Readable compile error messages (#4991)
- Fix JIT test failures on ROCm (#4998)
- Mark
cupyx.jit.rawkernelas experimental (#5005) - HIP: add
-ftz=true(#5007) - Give gufunc a name (#5013)
- CuPy JIT: Use C++-like typing rule in 'cuda' mode (#5028)
- Add PCI Bus ID to show_config (#5037)
- Print cuSPARSELt version in
show_config(#5054) - Support custom getsource option in CuPy JIT (#5071)
- Make
cupy.cuda.Devicecontext manager interface thread safe (#5083) - Add a new argument
outtocupy.asnumpy()(#5155) - Support cuSPARSELt v0.1.0 (#5158)
- Per device stream (#5172)
- cuTENSOR v1.3.0 for library installer (#5192)
- Add
sum_labelstocupyx.scipy.ndimage.measure(#5200) - Support NCCL v2.9.8 (#5201)
- Fix thrust compilation for ROCm 4.2.0 (#5209)
- Add NVCC path and Python version to
show_config(#5215) - Add CUDA 11.3 headers (#5218)
- Add libraries for CUDA 11.3 (#5219)
- Remove
syncdetectAPIs (#5226)
Bug Fixes
- Use
THRUST_OPTIONAL_CPP11_CONSTEXPR(#5002) - Use async memcpy in
ndarray.copy(#5004) - Fix DLPack
lanes(#5045) - Disable cuFFT plan cache on CUDA 11.1 (#5046)
- Support PTDS in CuPy memory pool (#5072)
- CuPy JIT: Fix range type (#5077)
- Fix
poissonto support lam array (#5087) - Adjust PATH when preloading to load cuDNN v8 correctly on Windows (#5103)
- Bugfix for typing rule of CuPy JIT (#5125)
- Fix TypeError in
svds(#5140) - Properly handle non-contiguous RHS in
cupyx.scipy.sparse.linalg.spsolve(#5168) - Fix integer
scatter_addfailure on Windows (#5173) MemoryAsyncPool: Use the "current" mempool instead of the "default" one (#5191)- Fix
matmulfor input with relaxed strides (#5205) - Add
check_availabilityfor cuTensor routines (#5206) - Fix windows
constexpr(#5233) - Remove duplicated subtraction in
cupy.random.Generator.integers(#5247)
Code Fixes
- Rename
cupy.coresubmodule tocupy._core(#3820) - Fix some internal
cpdeffunctions tocdefin_kernel.pyx(#5084) - Remove
cupy.cupy(#5121) - Cosmetic change in cuSPARSELt stub header (#5149)
- Cosmetic changes of CuPy JIT implementation (#5152)
Documentation
- Follow the latest NumPy/SciPy docs style (#4945)
- Fix docs: cupy-cuda112 now on PyPI (#4957)
- Update installation guide for Conda-Forge (#4985)
- CuPy JIT documentation (#5012)
- Document
cupyx.time.repeat(#5015) - Document
cupy.cuda.runtime.getDeviceProperties(#5016) - More documentation on the supported backends (#5019)
- Add links to Anaconda, Gitter, StackOverflow (#5020)
- Improve the documentation on interoperability (#5023)
- Document
CFunctionAllocatorandManagedMemory(#5025) - Fix code block in installation guide (#5033)
- Improve comments for memory and stream API usage (#5060)
- Point to the correct numpy random docs (#5088)
- Add user guide (#5093)
- Add ROCm limitations to docs (#5107)
- Reorganize API reference pages (#5108)
- Revise ROCm doc (#5122)
- Fix docs of
scatter_add(#5129) - Mention baseline API change in upgrade guide (#5131)
- Fix ROCm wheel install steps (#5133)
- Fix docstring in
coo.py(#5139) - Fix docs in
stream.pyx(#5144) - cuDNN v8.2 on documentation (#5148)
- Mention PTDS in ROCm Limitation (#5159)
- Use Sphinx 4 (#5188)
- cuTENSOR v1.3 on documentation (#5196)
- Fix cuSPARSELt not covered in docs (#5221)
- Add
cupyx.scipy.ndimage.sum_labelsto docs (#5223) - Improve README (#5254)
- Update logo image (#5255)
- Tentatively remove CUDA 11.3 from support list (#5256)
Installation
- Fix Windows dll loading for Conda (#4974)
- Add warnings for duplicate installation (#5032)
- cuDNN v8.2.0 for library installer (#5146)
- Bump version to v10.0.0a1 (#5269)
Examples
- Fix cuSPARSELt example not to use internal function (#4995)
- Update examples for current version of CuPy (#4999)
Tests
- Refactor random tests (#4907)
- Tentatively pin CI to ROCm 4.0.1 (#4961)
- Fix
cutensorimport in the test (#4965) - Make
install_testsrunnable without depending on current path (#4969) - Avoid using
pip install -eon Windows CI for performance (#4970) - Update known base branches in flexCI config (#4973)
- Update list of known branches (#4982)
- Fix
TestStreamcleanup (#5042) - Mark some memory tests as
testing.slow(#5061) - Fix stream usage on D2D copy test under HIP (#5091)
- Xfail tests for random distribution generator under HIP/ROCm (#5096)
- Adjust testing tolerance for
hfftnfor HIP/ROCm (#5099) - Use current device in tests (#5127)
- Fix for updated FlexCI base image (#5164)
- Relax tolerance of
cupyx.jit.atomic_addtest (#5186) - Test build for ROCm 4.0 and latest (#5224)
- Fix mergify configuration (#5248)
Others
- Use bot mode in automatic backport (#5051)
Contributors
The CuPy Team would like to thank all those who contributed to this release!
@anaruse @beingaryan @eternalphane @grlee77 @insertinterestingnamehere @keckj @leofang @povinsahu1909 @UmashankarTriforce