Skip to content
Test SHARK

[stateless-llm]Query num_key_value_heads when available to support GQA models. #94

Sign in to view logs

[stateless-llm]Query num_key_value_heads when available to support GQA models.

[stateless-llm]Query num_key_value_heads when available to support GQA models. #94

Run time

Learn about OS pricing on GitHub Actions
Job Run time
test-shark (3.11, nodai-ubuntu-builder-large)
5m 7s
5m 7s