ComfyUI MagicAnimate + DensePose - Local Install

Фильм және анимация

ComfyUI workflow for MagicAnimate and SDXL turbo + Face detailer, and local install tutorial for MagicAnimate and Vid2Densepose to convert customized Dense Pose videos.
00:00 Introduction
00:44 ComfyUI MagicAnimate workflow + SDXL turbo + Face Detailer
03:06 Installation of MagicAnimate
04:14 Installation of Vid2Densepose (Detectron2)
Workflow: drive.google.com/file/d/10cDn...
MagicAnimate: github.com/magic-research/mag...
DensePose video demo: github.com/magic-research/mag...
ComfyUI-MagicAnimate: github.com/thecooltechguy/Com...
ComfyUI-KJNodes: github.com/kijai/ComfyUI-KJNodes
Vid2Densepose: github.com/Flode-Labs/vid2den...
DensePose in Detectron2: github.com/facebookresearch/d...
Folder Structure:
MagicAnimate\
├─.git\
├─appearance_encoder\
│ ├─config.json
│ └─diffusion_pytorch_model.safetensors
├─densepose_controlnet\
│ ├─config.json
│ └─diffusion_pytorch_model.safetensors
├─temporal_attention\
│ └─temporal_attention.ckpt
├─.gitattributes
├─README.md
├─stable-diffusion-v1-5\
│ ├─model_index.json
│ ├─v1-inference.yaml
│ ├─feature_extractor\
│ │ └─preprocessor_config.json
│ ├─safety_checker\
│ │ ├─config.json
│ │ └─pytorch_model.bin
│ ├─scheduler\
│ │ └─scheduler_config.json
│ ├─text_encoder\
│ │ ├─config.json
│ │ └─pytorch_model.bin
│ ├─tokenizer\
│ │ ├─merges.txt
│ │ ├─special_tokens_map.json
│ │ ├─tokenizer_config.json
│ │ └─vocab.json
│ └─unet\
│ ├─config.json
│ └─diffusion_pytorch_model.bin
├─sd-vae-ft-mse\
│ ├─.git\
│ ├─.gitattributes
│ ├─config.json
│ ├─diffusion_pytorch_model.bin
│ ├─README.md
#comfyui #magicAnimate #DensePose #stablediffusion #sdxl #sdxlturbo #facedetailer #detectron #colormatch #animation #vid2densepose #localinstall

Пікірлер: 26

  • @mauidudejuno
    @mauidudejuno6 ай бұрын

    Thank you very much for this video. The installation guide was perfect! I wish everyone was as thorough in explaining tasks.

  • @JanRTstudio

    @JanRTstudio

    6 ай бұрын

    Appreciate your feedback! Glad it helps

  • @eointolster
    @eointolster6 ай бұрын

    Great job on the video man, I have been trying to make good videos like this along with a bunch of other stuff.Its not easy. Following it now and I will see how I go. Thank you

  • @JanRTstudio

    @JanRTstudio

    6 ай бұрын

    Thanks! yes it takes me some time for editing. Keep going, I am sure you will make great content

  • @aifreeart
    @aifreeart6 ай бұрын

    very good

  • @FusionDraw9527
    @FusionDraw95276 ай бұрын

    Thanks for sharing. What a great tool. Very fun.

  • @RhapsHayden
    @RhapsHaydenАй бұрын

    Is this still working for anyone? I did a fresh install of Comfy + Python 3.10.10 and it still cannot load.

  • @zakirtour
    @zakirtour6 ай бұрын

    Hi thank you very much for the video, but I still get the error "controlnet_down_blocks.2.weight, controlnet_down_blocks.8.bias, controlnet_down_blocks.3.bias, controlnet_down_blocks.4.bias, etc... Could you please help me? 🙏

  • @JanRTstudio

    @JanRTstudio

    6 ай бұрын

    did you add other controlnet? if not seems something wrong with \densepose_controlnet\diffusion_pytorch_model.safetensors

  • @kleber1983
    @kleber19835 ай бұрын

    It would help us a lot if you could provide links to densepose videos to download...thx.

  • @JanRTstudio

    @JanRTstudio

    5 ай бұрын

    np, I updated the demo video link in the description. I also found online version in huggingface if you would like to convert your own video: huggingface.co/spaces/fffiloni/video2densepose

  • @user-bc6oo4hq5p
    @user-bc6oo4hq5p6 ай бұрын

    How hand fix?

  • @JanRTstudio

    @JanRTstudio

    6 ай бұрын

    It's hard so far, depending on the accuracy in Densepose video. I expect improvement next year.

  • @mkrl89
    @mkrl893 ай бұрын

    Hi there! Great video tho. I've tried follow it to install Magic Animate nodes but I failed... Maybe you could help. My case is that despite all stuff is downloaded and it shows Magic Animate as installed in Manager I am not able to find those nodes in Comfy. I even tried to use your workflow but those nodes still appear as red boxes. I found out that my terminal shows this info under Magic Animate node: " cannot import name 'PositionNet' from 'diffusers.models.embeddings'" I'd appreciate any ideas what's wrong :)

  • @ngaibac97
    @ngaibac976 ай бұрын

    very slow.......:(

  • @JanRTstudio

    @JanRTstudio

    6 ай бұрын

    yep, had to speed it up by 8 times

  • @kleber1983
    @kleber19835 ай бұрын

    nevermind, it doesnt work for me, got this: D:\AI_STUFF\CONFY UI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-MagicAnimate\libs\magicanimate\pipelines\pipeline_animation.py:623: FutureWarning: Accessing config attribute `in_channels` directly via 'UNet3DConditionModel' object attribute is deprecated. Please access 'in_channels' over 'UNet3DConditionModel's config object instead, e.g. 'unet.config.in_channels'. num_channels_latents = self.unet.in_channels 0%|

  • @JanRTstudio

    @JanRTstudio

    5 ай бұрын

    Warning is fine, did you get other errors that doesn't work?

  • @kleber1983

    @kleber1983

    5 ай бұрын

    @@JanRTstudio not really, but I get stuck at 4% for a really long time, like 10, 15 minutes so I assume something went wrong, should I wait more? Thx.

  • @kleber1983

    @kleber1983

    5 ай бұрын

    @@JanRTstudio I have a rtx 3600 with 12Gb of ram

  • @JanRTstudio

    @JanRTstudio

    5 ай бұрын

    That's very long, your VRAM should be enough, open the task manager and monitor the "Dedicated GPU memory", make sure no other apps using the VRAM, before loading models GPU usage should be low. Btw the example video is only 1-3s and 512 x 512, longer and higher res video needs more rendering time @@kleber1983

  • @kleber1983

    @kleber1983

    5 ай бұрын

    you were right, the message I was receiving didn´t stop me to render a video but it only took me 15 hours to do so! lol! There must be a parameter or a at least a reason for that, right? Any thoughts? thank u. @@JanRTstudio

Келесі