Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add batch splitting in attention layer to hide NIC latency(#14) #1640

Merged
merged 6 commits into from
Feb 7, 2025

Merge remote-tracking branch 'optimum-habana/main' into attn_prompt_b…

0af0d39
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Add batch splitting in attention layer to hide NIC latency(#14) #1640

Merge remote-tracking branch 'optimum-habana/main' into attn_prompt_b…
0af0d39
Select commit
Loading
Failed to load commit list.