Run this workflow on InstaSD
Get started in minutes! Run this ComfyUI workflow online - no setup required.
Description
Turn your photos into stunning digital artworks with this advanced SDXL-based Image to Painting workflow in ComfyUI. By integrating LoRA, ControlNet, and upscaling, you can achieve Watercolor, Oil, or Digital Painting styles with exceptional detail and artistic flair.
🎯 Features
- LoRA Styling – Apply stylized looks using models like
EldritchDigitalArt1.3for enhanced painting effects. - ControlNet Guidance – Ensures structural fidelity with control over outlines and depth using
AnyLineArtPreprocessor. - Style Variations – Supports Digital Painting, Watercolor, and Oil Painting outputs.
- Upscaling Pipeline – Boosts resolution using
4x_NMKD-Siax_200k.pthand additional downscale-reencode steps. - Prompt-Based Flexibility – Use
easy positiveprompt nodes to shift between visual themes. - Save Multiple Outputs – Easily save intermediate and final results (e.g., "Watercolor", "Upscale", "UpscaleFinal").
💡 Use Cases
- Art Generation – Turn AI portraits or photos into museum-worthy digital art.
- Book Covers & Prints – Produce styled artwork for commercial or personal projects.
- Social Media Posts – Share artistic edits with a handcrafted look.
- Concept Art – Visualize ideas in watercolor, oil, or digital renderings.
- Fantasy/Medieval Edits – Reimagine photos in stylized, narrative-driven formats.
⚙️ How It Works
- Load Your Image – Input your photo using
LoadImage(e.g., a knight or character scene). - Apply Preprocessing – Use
AIO_PreprocessorwithAnyLineArtPreprocessor_auxfor edge guidance. - Control the Style – Connect
ControlNetLoaderandControlNetApplyAdvancedfor structure-aware generation. - Set Prompts – Use two
easy positivenodes to load LoRA trigger words and stylistic prompts. - Choose Your LoRA – Load a painting style LoRA like
EldritchDigitalArt1.3viaLoraLoader. - Sample Image with KSampler – Generate painted result using SDXL backbone and prompt conditioning.
- Decode & Preview – Use
VAEDecodeTiledto view the stylized image. - Upscale & Refine – Apply upscaling with
ImageUpscaleWithModeland optional final resolution tuning. - Save Your Output – Export as "Watercolor", "Upscale", and "UpscaleFinal" images.
Credits: pixaroma
Models
| File | Destination | Source |
|---|---|---|
| 4x_NMKD-Siax_200k.pth | /ComfyUI/models/upscale_models | Download |
| Juggernaut_X_RunDiffusion.safetensors | /ComfyUI/models/checkpoints | Download |
| EldritchDigitalArt1.3.safetensors | /ComfyUI/models/loras | Download |
| diffusion_pytorch_model_promax.safetensors | /ComfyUI/models/controlnet | Download |
| SDXL-Watercolor.uodQ.safetensors | /ComfyUI/models/loras | Download |
| retroIllustration.1abs.safetensors | /ComfyUI/models/loras | Download |
| eldritchimpressionism.M2Fr.safetensors | /ComfyUI/models/loras | Download |
| classipeintxl21.W20p.safetensors | /ComfyUI/models/loras | Download |
Nodes
Text ConcatenateVAEEncodeUpscaleModelLoaderImageUpscaleWithModelImageScaleByKSamplerVAEDecodeTiledSaveImageCheckpointLoaderSimpleCLIPTextEncodeeasy positiveImageScaleToTotalPixelsControlNetLoaderPreviewImageControlNetApplyAdvancedAIO_PreprocessorFast Groups Muter (rgthree)LoadImageLoraLoader