Skip to content

Commit

Permalink
Fix a bug on the flag is not inspected properly.
Browse files Browse the repository at this point in the history
  • Loading branch information
liuliu committed Sep 16, 2024
1 parent eda29de commit d53469e
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -152,7 +152,7 @@ static int _ccv_nnc_scaled_dot_product_attention_forw(const ccv_nnc_cmd_t cmd, c
return CCV_NNC_EXEC_INVALID;
}

const int is_downcast = ((cmd.info.blas.flags & CCV_NNC_GEMM_16F) && q->info.datatype == CCV_16F);
const int is_downcast = ((cmd.info.scaled_dot_product_attention.flags & CCV_NNC_GEMM_16F) && q->info.datatype == CCV_16F);
int attention_is_batched = (batch_size > 1);
ccv_nnc_mfa_attention_params_t params = {
.data_type = mtl_data_type,
Expand Down

0 comments on commit d53469e

Please sign in to comment.