You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
❯ ls .venv/lib/python3.11/site-packages/flash_attn*
flash_attn-3.0.0b1.dist-info/
flash_attn_3_cuda.cpython-311-x86_64-linux-gnu.so
flash_attn_interface.py
The hopper/padding.py is not present.
It seems to get the full set of padding utils, I need flash_attn.bert_padding which is only available if I install FA2 as well. But installing FA2 and FA3 in the same pip env seems tricky given they have the same package name.
The text was updated successfully, but these errors were encountered:
I'm using FA3 as so:
When I install FA3, the only files installed are:
The
hopper/padding.py
is not present.It seems to get the full set of padding utils, I need
flash_attn.bert_padding
which is only available if I install FA2 as well. But installing FA2 and FA3 in the same pip env seems tricky given they have the same package name.The text was updated successfully, but these errors were encountered: