What is the minimum GPU memory. to run it? Can it run with 16G? #6
-
What is the minimum GPU memory. to run it? Can it run with 16G? |
Beta Was this translation helpful? Give feedback.
Answered by
yujincheng08
Nov 6, 2023
Replies: 2 comments
-
Yes. You can change the T5 Model and VAE Model onto CPU, then 16G GPU memory is enough for inference. |
Beta Was this translation helpful? Give feedback.
0 replies
-
According to our test, 11G is enough with the diffuser integration. Remember to turn on offloading. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
yujincheng08
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
According to our test, 11G is enough with the diffuser integration. Remember to turn on offloading.