Skip to content

Commit

Permalink
Fix issue with wan and other attention implementations.
Browse files Browse the repository at this point in the history
  • Loading branch information
comfyanonymous committed Feb 26, 2025
1 parent f37551c commit ea0f939
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions comfy/ldm/wan/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -88,9 +88,9 @@ def qkv_fn(x):
q, k = apply_rope(q, k, freqs)

x = optimized_attention(
q=q.view(b, s, n * d),
k=k.view(b, s, n * d),
v=v,
q.view(b, s, n * d),
k.view(b, s, n * d),
v,
heads=self.num_heads,
)

Expand Down

0 comments on commit ea0f939

Please sign in to comment.