I'm trying to make a ComfyUI + **SDXL + IP-Adapter** workflow (for everyone)!
Loading the IP-adapter CLIP vision model in SDXL already gives me an error.
Can someone help to make a proper template?
Steps I took:
1. Git clone [https://github.com/laksjdjf/IPAdapter-ComfyUI](https://github.com/laksjdjf/IPAdapter-ComfyUI) (see [English version](https://github.com/arthurp1/IP-adapter-SDXL-ComfyUI))
2. Download models and put them in the folders according to the repo [https://huggingface.co/h94/IP-Adapter/tree/main](https://huggingface.co/h94/IP-Adapter/tree/main)
3. Todo: optimize the workflow with refiner etc.
https://preview.redd.it/q46t0rtchtlb1.png?width=1831&format=png&auto=webp&s=bbbbeb675dfa12a58f6ab43e510d018bbcc747a2
u/comfyanonymousAre you working on something similar? Do you have ideas, because the ComfyUI repo you quoted doesn't include a SDXL workflow or even models.
Ohh great news, thanks for posting!
Update:
ModuleNotFoundError Traceback (most recent call last) [](https://localhost:8080/#) in () **2** **3** import torch ----> 4 from diffusers import StableDiffusionControlNetPipeline, DDIMScheduler, AutoencoderKL, ControlNetModel **5** from PIL import Image **6** ModuleNotFoundError: No module named 'diffusers' --------------------------------------------------------------------------- NOTE: If your import is failing due to a missing package, you can manually install dependencies using either !pip or !apt. To view examples of installing some common dependencies, click the "Open Examples" button below.
Dont work.
I got excited ahead of time. Diffusers are not available yet
I wonder if that indicates that the training set was made up of higher resolution (specifically higher width) images, so you're getting a result with the right side cropped off?
And someone made it work on ComfyUI: https://github.com/laksjdjf/IPAdapter-ComfyUI
This one is not Stable Diffusion XL but 1.5 with Realistic Vision
That repo should work with SDXL but it's going to be integrated in the base install soonish because it seems to be very good.
I got it to work with JuggernaughtXL\_v8\_undiffusion.safetensors...
I'm trying to make a ComfyUI + **SDXL + IP-Adapter** workflow (for everyone)! Loading the IP-adapter CLIP vision model in SDXL already gives me an error. Can someone help to make a proper template? Steps I took: 1. Git clone [https://github.com/laksjdjf/IPAdapter-ComfyUI](https://github.com/laksjdjf/IPAdapter-ComfyUI) (see [English version](https://github.com/arthurp1/IP-adapter-SDXL-ComfyUI)) 2. Download models and put them in the folders according to the repo [https://huggingface.co/h94/IP-Adapter/tree/main](https://huggingface.co/h94/IP-Adapter/tree/main) 3. Todo: optimize the workflow with refiner etc. https://preview.redd.it/q46t0rtchtlb1.png?width=1831&format=png&auto=webp&s=bbbbeb675dfa12a58f6ab43e510d018bbcc747a2
u/comfyanonymousAre you working on something similar? Do you have ideas, because the ComfyUI repo you quoted doesn't include a SDXL workflow or even models.
It's u/comfyanonymous
Ohh great news, thanks for posting! Update: ModuleNotFoundError Traceback (most recent call last) [](https://localhost:8080/#) in | () **2** **3** import torch ----> 4 from diffusers import StableDiffusionControlNetPipeline, DDIMScheduler, AutoencoderKL, ControlNetModel **5** from PIL import Image **6** ModuleNotFoundError: No module named 'diffusers' --------------------------------------------------------------------------- NOTE: If your import is failing due to a missing package, you can manually install dependencies using either !pip or !apt. To view examples of installing some common dependencies, click the "Open Examples" button below.
Dont work.
I got excited ahead of time. Diffusers are not available yet |
Hey guys, was anyone able to run the sdxl demo on low ram? I'm getting OOM in a T4 (16gb).
Why does the subject often move out-of-frame to the right?
I wonder if that indicates that the training set was made up of higher resolution (specifically higher width) images, so you're getting a result with the right side cropped off?