Skip to content

Commit

Permalink
Merge branch 'ibhosale_update' of github.com:triton-inference-server/…
Browse files Browse the repository at this point in the history
…tutorials into ibhosale_update
  • Loading branch information
indrajit96 committed Sep 23, 2024
2 parents 53464ac + 2ccfb19 commit e602365
Showing 1 changed file with 0 additions and 8 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -36,14 +36,6 @@ ENV HF_HOME ${HF_HOME}
# Set the active working directory.
WORKDIR /workspace

# Install a custom version of Triton CLI that support Tensor parallelism and
# the 70B version of Llama models.
RUN pip --verbose install \
--no-cache-dir \
--no-color \
--no-input \
git+https://github.com/triton-inference-server/triton_cli.git@ibhosale/aslb-mn

# Copy the server script.
COPY server.py .

Expand Down

0 comments on commit e602365

Please sign in to comment.