You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is an issue with building CUDA recipes like ONNXRuntime_CUDA, (e.g., JuliaPackaging/Yggdrasil#10420), with CUDNN and/or TensorRT dependencies: The issue is that CUDNN and TensorRT artifacts are only available for a single CUDA 11-minor version (CUDA 11.0), and a single CUDA 12-minor version (CUDA 12.0), so when building for e.g. CUDA 11.8, or 12.6, there are no artifacts for the platform being built.
When the end user installs e.g. ONNXRuntime_CUDA, the CUDA platform augmentation block allows the install of CUDNN 12.0 with ONNXRuntime_CUDA for CUDA 12.6.
The reason there are only CUDA 11.0 and CUDA 12.0 artifacts for CUDNN and TensorRT is that the CUDNN and TensorRT artifacts are just copies of a single set of CUDA 11/12 binary releases from nvidia.
@giordano Would it be an acceptable solution to add the possibility of providing a kwarg to dependencies (Dependency/BuildDependency/HostBuildDependency) to override the platform used in the build, i.e. to use CUDA 12.0 for the platform even though the requested platform is some other CUDA 12 platform? I.e. to override the platform passed to BinaryBuilderBase.setup_dependencies:
This may also be useful in relation to efforts such as JuliaPackaging/Yggdrasil#10223, which could allow installing an x86_64 CUDA SDK dependency, even though the target platform is aarch64.
There is an issue with building CUDA recipes like ONNXRuntime_CUDA, (e.g., JuliaPackaging/Yggdrasil#10420), with CUDNN and/or TensorRT dependencies: The issue is that CUDNN and TensorRT artifacts are only available for a single CUDA 11-minor version (CUDA 11.0), and a single CUDA 12-minor version (CUDA 12.0), so when building for e.g. CUDA 11.8, or 12.6, there are no artifacts for the platform being built.
When the end user installs e.g. ONNXRuntime_CUDA, the CUDA platform augmentation block allows the install of CUDNN 12.0 with ONNXRuntime_CUDA for CUDA 12.6.
The reason there are only CUDA 11.0 and CUDA 12.0 artifacts for CUDNN and TensorRT is that the CUDNN and TensorRT artifacts are just copies of a single set of CUDA 11/12 binary releases from nvidia.
Similar issue for the Torch recipe.
Previously discussed in relation to ONNXRuntime: JuliaPackaging/Yggdrasil#7561 (comment)
The text was updated successfully, but these errors were encountered: