Preview for Flux ControlNet Union Pro
Flux ControlNet Union Pro workflow diagram

Run this workflow on InstaSD

Get started in minutes! Run this ComfyUI workflow online - no setup required.

Description

Enhance your AI-generated images with Flux Dev Q8 GGUF and ControlNet Union, incorporating LORA for advanced fine-tuning. This ComfyUI workflow allows for detailed control over image generation while leveraging Flux's ControlNet union for precise image conditioning. Ideal for artists, designers, and AI enthusiasts looking to improve AI-generated compositions.


🎯 Features

  • Flux Dev Q8 GGUF Support – Utilizes optimized GGUF models for efficient image generation.
  • ControlNet Union – Enables precise control over image conditioning for better structure and consistency.
  • LORA Integration – Fine-tune AI-generated images with additional LORA models for better style and detail.
  • Customizable Preprocessors – Select from various preprocessors such as Depth Anything for better depth perception.
  • Resolution Control – Easily adjust resolution and aspect ratio to match your needs.

💡 Use Cases

  • Art & Illustration – Create detailed and consistent AI-assisted illustrations.
  • Concept Design – Develop high-quality AI-enhanced concept art.
  • AI-Assisted Creativity – Generate better AI-powered designs with refined image conditioning.
  • Stylized Image Generation – Use LORA to enhance specific styles in AI-generated images.

⚙️ How It Works

  1. Load the Image – Upload an image to work with or start from scratch using an Empty Latent Image node.
  2. Select the Aspect Ratio – Choose a resolution that matches your needs.
  3. Configure ControlNet – Load the Flux ControlNet Union model for structure guidance.
  4. Apply Preprocessors – Use Depth Anything Preprocessor or other available options.
  5. Set Up the AI Model – Load Flux Dev Q8 GGUF with LORA fine-tuning for enhanced image generation.
  6. Add Prompt & Adjust Strength – Input your description and adjust the conditioning strength.
  7. Run the Generation – The KSampler node processes the image, applying all settings.
  8. Preview & Save – View the final output and save your AI-enhanced image.

Credits: pixaroma

Models

FileDestinationSource
flux-dev-controlnet-union.safetensors/ComfyUI/models/controlnetDownload
flux1-dev-Q8_0.gguf/ComfyUI/models/unetDownload
ae.safetensors/ComfyUI/models/vaeDownload
t5-v1_1-xxl-encoder-Q8_0.gguf/ComfyUI/models/clipDownload
clip_l.safetensors/ComfyUI/models/clipDownload
aidmaHyperrealism-FLUX-V0.1.safetensors/ComfyUI/models/lorasDownload

Nodes

VAEDecodeeasy showAnythingEmptySD3LatentImageSaveImageLabel (rgthree)PreviewImageAIO_PreprocessorControlNetLoaderLoadImageFluxResolutionNodeUnetLoaderGGUFFluxGuidanceControlNetApplyAdvancedVAELoaderDualCLIPLoaderGGUFCLIPTextEncodeKSamplerLoraLoaderModelOnly