[Question]: 关于开启block_attn后模型的停止条件

[wojiaoshihua]

请提出你的问题

我用的是微调后的llama模型，请问，当开启block_attn后，模型的输出总会打满到最大长度，导致额外的输出或者乱码，这个应该如何解决。

[github-actions]

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动，被标记为stale。

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天，即将关闭。