Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
The way AWS reports the VRAM size for L4 is inconsistent with other GPUs. The reported size is 24 base-10 gigabytes, while L4 is actually 24 base-2 gibibytes, same as many other NVIDIA GPUs. Additionally, for multi-unit L4 instances AWS reports the total VRAM size instead of the size of a single unit. This commit hardcodes the correct L4 VRAM size until there are changes from AWS' end.
- Loading branch information