RWKV is all you need
Pinned Loading
-
LinearAttentionArena
LinearAttentionArena PublicHere we will test various linear attention designs.
-
-
SmallInitEmb
SmallInitEmb PublicLayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.