Can Image Prompt works with Pony base models?

[Chi8wah]

Hi, I am new to fooocus. I noticed that Image Prompt works well with all the SDXL base models, but when I use the "pony_v6" preset and switch base model into ponyDiffusionV6XL.safetensors or other checkpoints based on Pony, it seems Image Prompt doesn't work at all, is this as expected?

[Chi8wah]

seems that it is because pony_v6 set Inpain Engine to None?

[IPv6]

Yes, it is expected. Pony is too different to vanilla SDXL, so all inpaint stuff trained for vanilla SDXL simply gives bad results.
So inpainting for Pony usage should be done with more traditional checkpoints.

Same problem with Illustious, it is also different to SDXL

[Chi8wah]

Yes, it is expected. Pony is too different to vanilla SDXL, so all inpaint stuff trained for vanilla SDXL simply gives bad results. So inpainting for Pony usage should be done with more traditional checkpoints.

Same problem with Illustious, it is also different to SDXL

Thanks for reply! I found that if I switch Inpain Engine to v2.6, at least FaceSwap works! Now I find that it works better with animate face and will cause blur on face with human face. I haven't found other problems yet, do you know what else will it cause?

[IPv6]

Good it worked for you. For me it is usually completely broken, so i do not use Pony when inpainting tasks needed

[Chi8wah]

Good it worked for you. For me it is usually completely broken, so i do not use Pony when inpainting tasks needed

It's a pity. I am using aniverse-pony-xl and AniToon - Pony XL
, hope it helps you

[Chi8wah]

But I found a problem. After I restarted fooocus, it seems fooocus has problem reading the "input_image_checkbox" param, cuz when I start with a preset that turns "Image Prompt" on, it never shows in the bash log that

[Fooocus] Downloading control models ...
[Fooocus] Loading control models ...

and the whole Image Prompt tab is not working, but when I start with a preset that turns "Image Prompt" off and manually turn on it or manually switch to a preset that turns it on, only then the bash log shows and FaceSwap starts working, it's really strange!