Code

draft pr about non-streaming output #95

Code

Open

BasicCoder wants to merge 2 commits intotriton-inference-server:maintriton-inference-server/tensorrtllm_backend:mainfrom BasicCoder:bc_draft_prBasicCoder/tensorrtllm_backend:bc_draft_prCopy head branch name to clipboard

+20-7

Commits

Commits on Nov 3, 2023

• only output valid model output

  BasicCoder

  committed
  252cf43

  Copy full SHA for 252cf43

• set non-streaming

  BasicCoder

  committed
  57de9f5

  Copy full SHA for 57de9f5