Skip to content

Commit

Permalink
Merge pull request #19 from anarkiwi/l4tu
Browse files Browse the repository at this point in the history
notes.
  • Loading branch information
anarkiwi authored Apr 2, 2024
2 parents 36aa16f + 68c2618 commit b59a2d8
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ Instead of starting torchserve as given in the example, start it with a docker c

```docker run -v $(pwd)/model_store:/model_store -p 8080:8080 --rm --name torchserve -d iqtlabs/torchserve --models <model>=<model>.mar```

* [iqtlabs/cuda-torchserve](https://hub.docker.com/r/iqtlabs/cuda-torchserve): CUDA (11.8 or later) accelerated for amd64 only.
* [iqtlabs/cuda-torchserve](https://hub.docker.com/r/iqtlabs/cuda-torchserve): CUDA (12.1 or later) accelerated for amd64 only.

```docker run --gpus all -v $(pwd)/model_store:/model_store -p 8080:8080 --rm --name torchserve -d iqtlabs/cuda-torchserve --models <model>=<model>.mar```

Expand Down
1 change: 1 addition & 0 deletions docker/Dockerfile.orin-torchserve
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
# https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-pytorch
FROM nvcr.io/nvidia/l4t-pytorch:r35.2.1-pth2.0-py3
ARG PIP_CACHE
ENV DEBIAN_FRONTEND=noninteractive
Expand Down

0 comments on commit b59a2d8

Please sign in to comment.