Skip to content

v8.2.2: Parametric attention with key transformation

Compare
Choose a tag to compare
@danieldk danieldk released this 14 Dec 15:50
b183006

✨ New features and improvements

Add the ParametricAttention_v2 layer, which adds support for key transformations (#913).

👥 Contributors

@danieldk, @honnibal, @ines, @svlandeg