initial support blackwell

[johnnynunez]

10.0 blackwell b100/b200
12.0 blackwell rtx50

[Tom94]

Hi, thanks a bunch for the PR!

Any chance you could also update the list of supported compute capabilities at the top of this file as well as the min/max compute capability conditions here?

[johnnynunez]

Hi, thanks a bunch for the PR!

Any chance you could also update the list of supported compute capabilities at the top of this file as well as the min/max compute capability conditions here?

Yeah for sure, I will add it

[johnnynunez]

Done @Tom94

[johnnynunez]

It's normal failing because is not public yet...

[Tom94]

Wait, I thought this PR was based on already available new CUDA versions. Are you saying the 12.8 version is pure speculation?

I tried searching for it just now and couldn't find anything. Also what's your source for the version 13.0 condition you added to the minimum compute capability?

[johnnynunez]

I tried searching for it just now and couldn't find anything. Also what's your source for the version 13.0 condition you added to the minimum compute capability?

13.0 is speculation. But the other thing is true. I attach here references:
Dao-AILab/flash-attention#1436

[Tom94]

I'll hold off on updating tiny-cuda-nn until there's something official then.

[johnnynunez]

I'll hold off on updating tiny-cuda-nn until there's something official then.

perfect, PR is ready when CUDA 12.8 it comes! Thanks for this library :)

[johnnynunez]

Cuda 12.8 is out
whitepaper: https://docs.nvidia.com/cuda/pdf/ptx_isa_8.7.pdf

[johnnynunez]

@Tom94 merge :)

[johnnynunez]

@Tom94 nvcc warning : Support for offline compilation for architectures prior to '<compute/sm/lto>_75' will be removed in a future release (Use -Wno-deprecated-gpu-targets to suppress warning).

[johnnynunez]

@Tom94 nvcc warning : Support for offline compilation for architectures prior to '<compute/sm/lto>_75' will be removed in a future release (Use -Wno-deprecated-gpu-targets to suppress warning).

yo yes... only gpus with tensor cores will be supported +turing

[Tom94]

Please still remove the 13.0 part. We've got no clear info which precise version will actually drop support for <75, even if it is deprecated. Thanks.

[johnnynunez]

Please still remove the 13.0 part. We've got no clear info which precise version will actually drop support for <75, even if it is deprecated. Thanks.

Done!

[johnnynunez]

@Tom94 fixed typo!

[johnnynunez]