Skip to content

Commit

Permalink
Fix bug in S4Block stepping
Browse files Browse the repository at this point in the history
  • Loading branch information
albertfgu committed Feb 19, 2024
1 parent a246043 commit 35cc242
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/models/sequence/modules/s4block.py
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,7 @@ def step(self, x, state):
if self.bottleneck is not None:
x = self.input_linear(x)
y, next_state = self.layer.step(x, state) # (B C H)
y = self.activation(y)
if self.gate is not None:
y = self.output_gate(y)
y = y * v
Expand Down

0 comments on commit 35cc242

Please sign in to comment.