Skip to content

Commit

Permalink
format
Browse files Browse the repository at this point in the history
  • Loading branch information
gc-fu committed Dec 21, 2023
1 parent 39a8a11 commit 861c072
Showing 1 changed file with 0 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -206,7 +206,6 @@ def forward(
position_ids = torch.tensor(decoding_position_ids).long().unsqueeze(-1)
kwargs = {
"input_ids": bigdl_input_ids,
# gc(co): we rely on underlying model to generate position_ids
"position_ids": position_ids,
"attention_mask": attention_mask,
"past_key_values": bigdl_kv_cache,
Expand Down

0 comments on commit 861c072

Please sign in to comment.