Skip to content

[Infer] Add head_dim=96 dispatch for block attention #1191

[Infer] Add head_dim=96 dispatch for block attention

[Infer] Add head_dim=96 dispatch for block attention #1191