Skip to content

0.1.5

Compare
Choose a tag to compare
@github-actions github-actions released this 09 Jun 00:19
· 298 commits to master since this release
  • Added Q6 and Q8 cache modes
  • Defragment cache in dynamic generator
  • Use SDPA with Torch 2.3.0+
  • Updated wheels to Torch 2.3.1
  • Added Python 3.12 wheels, plus Python 3.9 for ROCm

Full Changelog: v0.1.4...v0.1.5