Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

torch inference mode please #142

Open
BBC-Esq opened this issue May 20, 2024 · 0 comments
Open

torch inference mode please #142

BBC-Esq opened this issue May 20, 2024 · 0 comments

Comments

@BBC-Esq
Copy link
Contributor

BBC-Esq commented May 20, 2024

I noticed that "no grad" is used throughout the script. The newer "inference mode" is better if you're just running inference. Is it possible to use this or would it interfere too much with some of the scripts that are used for training purposes? Possible to use both depending on running inference versus training? Thanks.

For your reference:

https://pytorch.org/docs/stable/generated/torch.autograd.grad_mode.inference_mode.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant