Creative Exploration - Subject Masking for IPAdapter Masking Animation

Tonight we're going to explore a workflow I developed for rotoscoping out a subject, and building a RGB mask to use IPAdapters attention masks in order to be able to visually prompt with images.
TL;DR
Upload video + 3 images, and you get a fully processed AI video out.
ComfyUI
github.com/comfyanonymous/Com...
Comfy Manager
github.com/ltdrdata/ComfyUI-M...
PhotonLCM Checkpoint
civitai.com/models/306814?mod...
AnimateLCM LoRA
huggingface.co/wangfuyun/Anim...
AnimateLCM Motion Model
huggingface.co/wangfuyun/Anim...
Shatter Motion LoRA by @jeru
civitai.com/models/312519
If you want to support what I'm doing here on the channel and gain exclusive access to the Supporters section of my Discord, please consider joining my Patreon!
/ purz
Socials
www.purz.xyz/
/ purzbeats
/ purzbeats

Пікірлер: 12

  • @Gabriecielo
    @Gabriecielo4 ай бұрын

    The best way of explaining, first about the concept instead of details, then a practical guide on building everything from zero. Really like your ideas!

  • @optimbro
    @optimbro4 ай бұрын

    underrated channel, thanks for this man! lot of things to learn.

  • @001mcv
    @001mcv4 ай бұрын

    This is an excellent for video. Your process got me thinking something along these lines could be used to colorize b&w images. IPadapters for upper background, lower background, body, face, hair, and maybe top and bottom clothes. Don't yet have near the skill to pull such a thing off, so will suggest it for a future exploration by you if you wish. Thanks for the amazing videos/creativity/tip sharing - it's all "Epic" !

  • @dkamhaji
    @dkamhaji4 ай бұрын

    Good stuff as always Purz! I love how zen you are about comfy :) From my explorations with relatively the same idea of ip for character and background using masks, I find that once you are replacing the Bg, this works best when the input videos camera is locked off. So that the new character remains grounded to the new background. Otherwise it starts floating. I also recommend experimenting with injecting tile cn to the BG mask, using the Bg image un-clipvisioned to get a lot of control on how much movement it gets.

  • @musyc1009
    @musyc10093 ай бұрын

    love your vid, very well explainned, informative, thanks for the effort and time

  • @PurzBeats

    @PurzBeats

    3 ай бұрын

    🙏🙏🙏🙏🙏🙏

  • @CosmicFoundry
    @CosmicFoundry4 ай бұрын

    big fan, keep up the great work!

  • @erdmanai
    @erdmanai3 ай бұрын

    Thank you!

  • @adrianfels2985
    @adrianfels29852 күн бұрын

    That intro is beautiful. What tool did you make that with?

  • @PurzBeats

    @PurzBeats

    2 күн бұрын

    @@adrianfels2985 thanks! It’s comfy, animatediff and an obs glsl shader

  • @ronnykhalil
    @ronnykhalil4 ай бұрын

    i love you

  • @toptipss99
    @toptipss99Ай бұрын

    Hello. I'm new to ComfyUI, I found this Workflow or can you share it with me? thank you!