From cca12f9ddee928b7ad4b089598e4b7a98132c9f8 Mon Sep 17 00:00:00 2001 From: Alex Zhang Date: Mon, 5 Aug 2024 09:56:38 +0800 Subject: [PATCH] build: Add default value for argument 'TRITON_REPO_ORGANIZATION' from sdk Dockerfile (#7437) --- Dockerfile.sdk | 1 + docs/customization_guide/build.md | 12 ++++++------ docs/customization_guide/test.md | 13 ++++++++----- 3 files changed, 15 insertions(+), 11 deletions(-) diff --git a/Dockerfile.sdk b/Dockerfile.sdk index 1524b5ead3..0748277d52 100644 --- a/Dockerfile.sdk +++ b/Dockerfile.sdk @@ -33,6 +33,7 @@ ARG BASE_IMAGE=nvcr.io/nvidia/tritonserver:24.07-py3-min ARG TRITON_CLIENT_REPO_SUBDIR=clientrepo ARG TRITON_PA_REPO_SUBDIR=perfanalyzerrepo +ARG TRITON_REPO_ORGANIZATION=http://github.com/triton-inference-server ARG TRITON_COMMON_REPO_TAG=main ARG TRITON_CORE_REPO_TAG=main ARG TRITON_CLIENT_REPO_TAG=main diff --git a/docs/customization_guide/build.md b/docs/customization_guide/build.md index db16b65c6b..0c1cc08a41 100644 --- a/docs/customization_guide/build.md +++ b/docs/customization_guide/build.md @@ -331,13 +331,13 @@ invocation builds all features and backends available on windows. python build.py --cmake-dir=/build --build-dir=/tmp/citritonbuild --no-container-pull --image=base,win10-py3-min --enable-logging --enable-stats --enable-tracing --enable-gpu --endpoint=grpc --endpoint=http --repo-tag=common: --repo-tag=core: --repo-tag=backend: --repo-tag=thirdparty: --backend=ensemble --backend=tensorrt: --backend=onnxruntime: --backend=openvino: ``` -If you are building on *main* branch then '' will +If you are building on *main* branch then `` will default to "main". If you are building on a release branch then -'' will default to the branch name. For example, if you -are building on the r24.07 branch, '' will default to -r24.07. Therefore, you typically do not need to provide '' at all (nor the preceding colon). You can use a different -'' for a component to instead use the corresponding +`` will default to the branch name. For example, if you +are building on the r24.07 branch, `` will default to +r24.07. Therefore, you typically do not need to provide `` at all (nor the preceding colon). You can use a different +`` for a component to instead use the corresponding branch/tag in the build. For example, if you have a branch called "mybranch" in the [onnxruntime_backend](https://github.com/triton-inference-server/onnxruntime_backend) diff --git a/docs/customization_guide/test.md b/docs/customization_guide/test.md index d664a139d3..e066d31493 100644 --- a/docs/customization_guide/test.md +++ b/docs/customization_guide/test.md @@ -48,7 +48,7 @@ $ ./gen_qa_model_repository $ ./gen_qa_custom_ops ``` -This will create multiple model repositories in /tmp//qa_* +This will create multiple model repositories in /tmp/\/qa_* (for example /tmp/24.07/qa_model_repository). The TensorRT models will be created for the GPU on the system that CUDA considers device 0 (zero). If you have multiple GPUs on your system see the documentation @@ -57,14 +57,17 @@ in the scripts for how to target a specific GPU. ## Build SDK Image Build the *tritonserver_sdk* image that contains the client -libraries, model analyzer, and examples using the following -commands. You must first checkout the branch of the -*client* repo into the clientrepo/ subdirectory. Typically you want to -set to be the same as your current server branch. +libraries, model analyzer, perf analyzer and examples using the following +commands. You must first checkout the `` branch of the +*client* repo into the clientrepo/ subdirectory and the `` +branch of the *perf_analyzer* repo into the perfanalyzerrepo/ subdirectory +respectively. Typically you want to set both `` and `` +to be the same as your current server branch. ``` $ cd $ git clone --single-branch --depth=1 -b https://github.com/triton-inference-server/client.git clientrepo +$ git clone --single-branch --depth=1 -b https://github.com/triton-inference-server/perf_analyzer.git perfanalyzerrepo $ docker build -t tritonserver_sdk -f Dockerfile.sdk . ```