Flux Xlabs ControlNet does not work in Flux UNET

[JorgeR81]

Expected Behavior

Use Xlabs ControlNet, with Flux UNET, the same way I use it with Flux checkpoint.

Actual Behavior

I have no errors, but GPU usage gets very high.

It just gets stuck in the KSampler stage, before even generating the first step, so I have to cancel the queue.

Steps to Reproduce

Just set up a regular ControlNet workflow, using the Unet loader, with Flux.

Existing Solutions

Now, it requires custom nodes from XLabs.
https://github.com/XLabs-AI/x-flux-comfyui

Other

It seems Flux UNET never worked, even during the Xlabs ControlNet Pull request stage.
But there was a specific error back then:

#4260 (comment)

[JorgeR81]

This seems to be fixed, with the latest updates.

GGUF models are also working, with this.