Comfyui AnimateDiffv3 RGB image Sparse Control
Фильм және анимация
AnimateDiffv3 RGB image SparseCtrl example, comfyui workflow w/ Open pose, IPAdapter, and face detailer.
SparseCtrl Github:
guoyww.github.io/projects/SparseCtrl/
AnimateDiff v3 model:
huggingface.co/guoyww/animatediff/tree/main
ComfyUI-Advanced-ControlNet:
github.com/Kosinkadink/ComfyUI-Advanced-ControlNet
Workflow:
drive.google.com/file/d/1X5DqLOOYUvcM5z9Wsx_MJJm_-sdEtEff/view?usp=sharing
00:00 Introduction & Demo
00:45 Workflow walkthrough
02:06 Realistic model results
#comfyui #animatediff #sparsectrl #keyframe #interpolation #stablediffusion #controlnet #ipadapter #facedetailer
Пікірлер: 23
Thank you a bunch for this! Detailed and to the point without needless blahblah.
@JanRTstudio
6 ай бұрын
😄thanks!
Great workflow thanks for sharing
thanks
This channel is underrated. You're the goat @JanRTstudio
@JanRTstudio
3 ай бұрын
Thank you, so glad to hear that!
Great content! Is there a guide on how sparse control rgb/scribble actually work? What I mean how do you know it's placed first and last image? Can you place RGB Sparse Control on frames 1,5,7,9,15,20? How?
@JanRTstudio
5 ай бұрын
Thank you! Yes, that's controlled by the "Sparse method", I am making another video for it and will talk about these methods
and is there also an option where you only need to input 1 image and then its like stable video?
@JanRTstudio
6 ай бұрын
yes, check the video on SparseCtrl github project page, around 1 min it's the demo from single image. In the node you can specify to use it as the starting or ending keyframe
@bkdjart
5 ай бұрын
Can you explain this in more detail? (which node in your workflow option to change to which options). Better yet it would be great if you could make a workflow that can generate a video based on 1 frame image. @@JanRTstudio
@JanRTstudio
5 ай бұрын
Sounds good, I will make another one for it. @@bkdjart
do you know how to do this in A1111 because comfy UI is too complex for me
@JanRTstudio
6 ай бұрын
I saw sd-webui-animatediff updated v3 and adapter support but not this, maybe later
@JUBYANG
5 ай бұрын
The workflow network disk cannot be opened. Can you resend it?@@JanRTstudio
is there a way to contact you?
@JanRTstudio
6 ай бұрын
you can message me via facebook Janrt Stu
So what is "SparseCtrl" doing?
@JanRTstudio
5 ай бұрын
In this example, it actually interpolates two poses (images) to create a smooth animation transition between them, you can find more usages mentioned 0:22
@mehradbayat9665
5 ай бұрын
thank you, is there anyway I can ask you a specific question?@@JanRTstudio
@JanRTstudio
5 ай бұрын
Yes, you can message me on my facebook Janrt Stu@@mehradbayat9665