Specify content type in executed output messages

[christian-byrne]

Feature Idea

Currently there is an animated field being used for webm and animated webp:

ComfyUI/comfy_extras/nodes_images.py

Line 191 in 1650cda

return { "ui": { "images": results, "animated": (True,)} }

ComfyUI/comfy_extras/nodes_images.py

Line 138 in 1650cda

return { "ui": { "images": results, "animated": (animated,) } }

ComfyUI/comfy_extras/nodes_video.py

Line 74 in 5d84607

return {"ui": {"images": results, "animated": (True,)}} # TODO: frontend side

webp and webm need separate handling so animated doesn't help much for the frontend.

In general, the client wants to know the mime type before the request for the resource is actually made, but can only infer from the outputs being in either images or audio or from filename. To reduce burden on client and improve API, either add a field to denote mime type or add videos field.

1. Just add videos field for quick solution:

        results: list[FileLocator] = [{
            "filename": file,
            "subfolder": subfolder,
            "type": self.type
        }]

+       return {"ui": {"videos": results, "animated": (True,)}}

2. Use a field to denote mime type and keep everything in images:

        results: list[FileLocator] = [{
            "filename": file,
            "subfolder": subfolder,
            "type": self.type
+           "mimeType" : "video/webm"
        }]

        return {"ui": {"images": results, "animated": (True,)}}  

Existing Solutions

No response

Other

No response