Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

600M-512px for comfyui not working #147

Open
Pancat009 opened this issue Jan 15, 2025 · 4 comments
Open

600M-512px for comfyui not working #147

Pancat009 opened this issue Jan 15, 2025 · 4 comments
Labels
Answered Answered the question

Comments

@Pancat009
Copy link

I download the Sana_600M_512px model in /checkpoint,
and download the whole Sana_600M_512px_diffusers in /models/diffusers
and copy the vae from /Sana_600M_512px_diffusers/vae to models/vae
but it repots error

Error(s) in loading state_dict for SanaMS:
size mismatch for pos_embed: copying a param with shape torch.Size([1, 256, 1152]) from checkpoint, the shape in current model is torch.Size([1, 1024, 1152]).

image

@lawrence-cj
Copy link
Collaborator

This bug should be fixed if you update the source code here: https://github.com/Efficient-Large-Model/ComfyUI_ExtraModels

Refer: #123

@lawrence-cj lawrence-cj added the Answered Answered the question label Jan 20, 2025
@Pancat009
Copy link
Author

Thank you.
The image can be generated now, but not sure what mistake i've made, the image looks like this

Image

@lawrence-cj
Copy link
Collaborator

Try to specify the precision when you load the weight. Like FP16 or BF16

Refer to: https://github.com/NVlabs/Sana/blob/main/asset/docs/model_zoo.md#-1-we-provide-all-the-links-of-sana-pth-and-diffusers-safetensor-below

@Pancat009
Copy link
Author

I've tried to change resolution, gemma loader, vae type, vae dtype, arrange combination with each other, but still get the blur image.
changing the paramters in Ksampler has no effect neither

Image

Image

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Answered Answered the question
Projects
None yet
Development

No branches or pull requests

2 participants