Skip to content

[Infer] Add head_dim=96 dispatch for block attention #1192

[Infer] Add head_dim=96 dispatch for block attention

[Infer] Add head_dim=96 dispatch for block attention #1192