Run this workflow on InstaSD
Get started in minutes! Run this ComfyUI workflow online - no setup required.
Description
Effortlessly turn visual content into creative inspiration using the Janus Prompt from Image + Flux txt2img workflow in ComfyUI. This setup extracts detailed prompts from any image using Janus, then feeds that description into a Flux-based generation pipeline to create stunning new variationsβall automatically.
π― Features
- Janus Vision-to-Text β Uses
JanusImageUnderstandingto analyze and describe any image. - Prompt Switching β Choose between the generated Janus prompt or your own custom prompt via
Any Switch. - Flux-Optimized Generation β Leverages
FluxGuidancefor fine-tuned output fidelity based on the prompt. - SDXL-Compatible β Works with SD3 latent image initialization for sharp, high-res generation.
- Flexible Prompt Flow β Integrates
easy showAnythingandeasy positivenodes for live prompt control and inspection.
π‘ Use Cases
- Art Remixing β Feed in an artwork or concept image and create new versions based on its description.
- Prompt Engineering β Learn how Janus sees your images and use that data to refine custom prompts.
- Visual Brainstorming β Instantly turn sketches or references into evolved AI concepts.
- Automatic Inspiration β Let the system suggest creative directions based on image context.
- Character Expansion β Generate alternate looks of a character portrait using its own style and mood.
βοΈ How It Works
- Load an Image β Use
LoadImageto input a visual reference (e.g., character or concept art). - Describe with Janus β
JanusModelLoaderandJanusImageUnderstandingextract a natural-language prompt from the image. - View the Prompt β Use
easy showAnythingto preview Janus' description, or mix with your custom input usingAny Switch. - Encode & Guide β
CLIPTextEncodeprocesses the prompt andFluxGuidanceenhances generation control. - Generate the Image β Sample new variations with
KSamplerusing Flux and SD3 latent space. - Decode & Save β Use
VAEDecodeandSaveImageto output the final render.
Credits: pixaroma
Models
| File | Destination | Source |
|---|---|---|
| ae.safetensors | /ComfyUI/models/vae | Download |
| t5-v1_1-xxl-encoder-Q8_0.gguf | /ComfyUI/models/clip | Download |
| clip_l.safetensors | /ComfyUI/models/clip | Download |
| flux1-dev-Q8_0.gguf | /ComfyUI/models/unet | Download |
| pytorch_model.bin | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| preprocessor_config.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| config.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| processor_config.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| special_tokens_map.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| tokenizer.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
| tokenizer_config.json | /ComfyUI/models/Janus-Pro/Janus-Pro-1B | Download |
Nodes
CLIPTextEncodeFluxGuidanceKSamplerVAEDecodeVAELoaderDualCLIPLoaderGGUFEmptySD3LatentImageSaveImageUnetLoaderGGUFJanusImageUnderstandingeasy showAnythingeasy positiveAny Switch (rgthree)Fast Groups Muter (rgthree)LoadImageJanusModelLoader