New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

生成近似句子太慢了，有加速的方法吗 #47

Open

shimachao opened this issue May 6, 2023 · 1 comment

shimachao commented May 6, 2023

我这边用3050 显卡生成30个近似句子需要1秒多，大家有加速的思路吗？

Hemeets commented Jul 28, 2023

是直接用的示例代码吗？可以改成batch输入

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment