Skip to content

Commit

Permalink
vulkan: Optimize some mat-vec mul quant shaders (#10296)
Browse files Browse the repository at this point in the history
Compute two result elements per workgroup (for Q{4,5}_{0,1}). This reuses
the B loads across the rows and also reuses some addressing calculations.
This required manually partially unrolling the loop, since the compiler
is less willing to unroll outer loops.

Add bounds-checking on the last iteration of the loop. I think this was at
least partly broken before.

Optimize the Q4_K shader to vectorize most loads and reduce the number of
bit twiddling instructions.
  • Loading branch information
jeffbolznv authored Nov 16, 2024
1 parent dd3a6ce commit 772703c
Show file tree
Hide file tree
Showing 4 changed files with 210 additions and 131 deletions.
Loading

0 comments on commit 772703c

Please sign in to comment.