-
Notifications
You must be signed in to change notification settings - Fork 44
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to use this in Automatic1111 Stable Diffusion Web UI (for SD 1.5, XL etc) #8
Comments
You can't do the one line thing in Auto1111. HiDiffusion is built on the diffusers framework. The "one line" thing only works on UIs that use the diffusers framework. A quick google didn't turn up many options, just https://github.com/invoke-ai/InvokeAI which is still under active development, and an old one, https://github.com/abhishekkrthakur/diffuzers There's a couple of possible places it could go in invokeAI: InvokeAI\invokeai\backend\model_manager\load\model_loaders\stable_diffusion.py But diffuzers looks super simple: diffuzers\diffuzers\text2img.py Best of luck! |
ComfyUI developer Kijai added a simple SD1.5 wrapper implementation of it in his ELLA node: https://github.com/kijai/ComfyUI-ELLA-wrapper. See commit from April 24: https://github.com/kijai/ComfyUI-ELLA-wrapper/commits/main/ However, I've had (and confirmed w/ him that he has had) a reported issue w/ generating non-square resolutions. The fix pushed yesterday which closed the thread here on it did not resolve it unfortunately: (Closed case here):#6 Also per that link the SD.Next developer Vlad is working on incorporating it on his (formerly fork) of A1111. I think it's only in his dev branch for now but that might be the UI to have full implementation first. Even if the non-square problem is worked out,, Kijai's comfy wrapper wouldn't support SDXL since ELLA doesn't. Aparently there are a lot of things to consider when making a node for this specifically. I hope the developers here can make nodes/extensions happen!! |
Is the non-square resolution problem still happens? Man, let me know what model and resolution you are using. |
you run hidiffusion on ComfyUI? |
Developer Kijai added a very limited wrapper implementation of it in a node he created for ELLA. His wrapper only supports the SD1.5 but implemented here: kijai/ComfyUI-ELLA-wrapper@457c9b8 Can find a bunch of the comfy developers in the Banodoco server on Discord (AnimateDiff etc): https://discord.gg/r22ZNk3J I had issues w/ 1080x720 for example. Don't know exactly what I had been trying when I got that error above. I asked the developer of the node (Kijai) and he replied that he had issues even after the latest commit (fix) also. Here are the relevant convos: |
I created this nodes to start testing this technology on ComfyUI: https://github.com/florestefano1975/ComfyUI-HiDiffusion |
Thanks for a way to trial. I assume you can only use the base model it pulls w/ your wrapper here? |
So, does this plugin work properly now? |
Hi,Exactly the same question here. I just use the code for SDXL inference not the ComfyUI. Have u solved the problem yet? |
-> 1710 hidden_states = torch.cat([hidden_states, res_hidden_states], dim=1) RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 90 but got size 45 for tensor number 1 in the list. I just don't know why the feature map is half |
is there any originally implemented extension that can load A1111 webui model? |
You can try the latest hidiffusion version and the problem would be fixed pip3 install hidiffusion -U |
How to use this in Automatic1111 Stable Diffusion Web UI? Can you add steps to readme if its as simple as changing a few lines?
I want to use it with SD 1.5 mainly because it seems to give SD 1.5 a new life (to gen high res images)
The text was updated successfully, but these errors were encountered: