Code

[Model] Add T5 model (2/2) #11901

Code

Open

NickLucche wants to merge 17 commits intovllm-project:mainvllm-project/vllm:mainfrom NickLucche:t5-modelNickLucche/vllm:t5-modelCopy head branch name to clipboard

+1,228-258

Commits

Commits on Jan 9, 2025

• wip

  Show description for 5e59703
  NickLucche

  committed
  5e59703

  Copy full SHA for 5e59703

• add working kernel with padded_max_seq_len as arg

  Show description for 416412d
  NickLucche

  committed
  416412d

  Copy full SHA for 416412d

• add attn_bias case to pagedattn tests

  Show description for 1d1f2a0
  NickLucche

  committed
  1d1f2a0

  Copy full SHA for 1d1f2a0

• format

  Show description for 7fb263d
  NickLucche

  committed
  7fb263d

  Copy full SHA for 7fb263d

• format

  Show description for ac6bf63
  NickLucche

  committed
  ac6bf63

  Copy full SHA for ac6bf63

• enforce last dim of attn bias to be block aligned

  Show description for 5c47f43
  NickLucche

  committed
  5c47f43

  Copy full SHA for 5c47f43

• wip

  Show description for f97939f
  NickLucche

  committed
  f97939f

  Copy full SHA for f97939f

• wip

  Show description for f8df36a
  NickLucche

  committed
  f8df36a

  Copy full SHA for f8df36a

• first working version :)

  NickLucche

  committed
  0d7b0c5

  Copy full SHA for 0d7b0c5

• clean up

  Show description for 43eca38
  NickLucche

  committed
  43eca38

  Copy full SHA for 43eca38

• address missing bos token case

  Show description for b481f5d
  NickLucche

  committed
  b481f5d

  Copy full SHA for b481f5d

• format and clean up

  Show description for 67bdbbc
  NickLucche

  committed
  67bdbbc

  Copy full SHA for 67bdbbc

• t5 tests

  Show description for bd264c7
  NickLucche

  committed
  bd264c7

  Copy full SHA for bd264c7

• format

  Show description for 2d5b4fb
  NickLucche

  committed
  2d5b4fb

  Copy full SHA for 2d5b4fb

• sync with custom attn bias pr

  Show description for dc25e4d
  NickLucche

  committed
  dc25e4d

  Copy full SHA for dc25e4d

• remove spurious files

  Show description for 3eae4f6
  NickLucche

  committed
  3eae4f6

  Copy full SHA for 3eae4f6

• update to use new attention_type interface

  Show description for 455d0cb
  NickLucche

  committed
  455d0cb

  Copy full SHA for 455d0cb