No video

Use PIFuHD to Create a 3D Model of Anyone from a Single Photo

March 24, 2023: Fixed! This Colab is old and was giving errors, I have updated it to import the correct libraries. Had good results with a standard stock photo of a person standing. Updated Colab Notebook: colab.research...
Result from my tests of the fixed colab here: • Result from PIFuHD, Ma...
April 24, 2022: Google just released PHORHUM phorhum.github..., which can not only create 3d models from a single photo of a person, but also animate them! Also FaceBuilder for Blender can create detailed faces with just a couple photos: keentools.io/p...
February 22, 2022 NOTE: I got a few comments that the colab wasn't working. I just verified that it does still work. I tried the default image, then tried again with an image I uploaded of Keanu Reeves. The result is here: • Result from PIFuHD, Fe... Please make sure you follow the instructions exactly. If you get errors when uploading your own image, make sure that it does not exceed 60kb in size and that you go through each step after upload.
ANOTHER NOTE: Machine Learning progresses very quickly. The PIFuHD paper, code, and this colab are already quite "old". Newer tools now exist for transforming images (not just people) into 3d meshes, for example NVIDIA Omniverse/Kaolin. If you want to generate face meshes, StyleSDF (github.com/roy...) has a colab that is very easy to use. I hope you will explore those other tools. Good luck!
Original Paper: shunsukesaito....

Пікірлер: 110

  • @SuperMassman
    @SuperMassman3 жыл бұрын

    Thank you,,, one more tool for my new hobby playing with Blender

  • @jareddinwiddie2332

    @jareddinwiddie2332

    2 жыл бұрын

    So these can be used in blender?

  • @montymole297

    @montymole297

    2 жыл бұрын

    @@jareddinwiddie2332 Yes, they can be downloaded as OBJ, which are files that Blender can import.

  • @jackson501100
    @jackson5011003 жыл бұрын

    Ran into an issue w/ rendering. Was able to download the object, so that is exciting!!!! Thank you for this tutorial. It really helped. I went step by step pausing where needed. Thank you again sir! I appreciate you!

  • @Raksasa187
    @Raksasa187 Жыл бұрын

    amazing and super handy for background characters!! Thank you so much for the clear tutorial

  • @RiverReeves23
    @RiverReeves232 жыл бұрын

    Thanks man, that is the most clear tutorial on how to do this. Someone else had a vid and it came up with errors. Your's worked perfectly!

  • @belkaosef7298
    @belkaosef7298 Жыл бұрын

    getting to the point direcly ! thanks a lot man !

  • @PambanSwamigalArul
    @PambanSwamigalArul Жыл бұрын

    Thanks a lot for the detailed tutorial

  • @shadow_dancer
    @shadow_dancer2 жыл бұрын

    Interesting... One question - is it possible to use several pictures of the same person to get better mesh result at the end? Or this only works with single picture?

  • @brushrunner

    @brushrunner

    2 жыл бұрын

    anyone?

  • @panman69420

    @panman69420

    2 жыл бұрын

    no.

  • @jamesdutoit
    @jamesdutoit2 жыл бұрын

    Absolutely fantastic! Thank you, Sir.

  • @vvortex157
    @vvortex157 Жыл бұрын

    damn, that statue can become a creepy monster for a game

  • @wendeng6279
    @wendeng6279 Жыл бұрын

    At the last step, I got error message: valueerror not enough values to unpack( expected 4, got 0), anybody have the same problem? thanks.

  • @muhammadmudasar1866
    @muhammadmudasar18668 күн бұрын

    i have rtx 3060 GPU, which supports cuda 11.x , i am currently facing issue relating to compatibility imports . (i.e Pytorch3d (from versions : None ; cuda version & AttributeError: module 'numpy' has no attribute 'int'.) how to resolve it ?

  • @butterflystudio606
    @butterflystudio6062 жыл бұрын

    Hello sir ! I faced some difficulties downloading this part net = PoseEstimationWithMobileNet() checkpoint = torch.load('checkpoint_iter_370000.pth', map_location='cpu') load_state(net, checkpoint) get_rect(net.cuda(), [image_path], 512) and I couldn't fin d any files in recon how can I FIX THAT

  • @exogendesign4582

    @exogendesign4582

    4 ай бұрын

    have you found fix? I also got this error. I wanted to turn a figure into 3d for trophy design.

  • @moses5407
    @moses5407 Жыл бұрын

    Can circumferential and other measures be pulled from this directly ... Or is it via blender in some way?

  • @user-vl8qg1vj8l
    @user-vl8qg1vj8l2 жыл бұрын

    This is amazing!! Thank you!

  • @koushikvallam9277
    @koushikvallam92779 ай бұрын

    I'm getting an error as "No distributions found for pytorch3d" after running pytorch3d line

  • @johndavis1079
    @johndavis10792 жыл бұрын

    I'm doing it but it's not doing the image

  • @snippetshub
    @snippetshub2 жыл бұрын

    This isn't working, as the latest commenters also stated. As for me, the error is when running the "from google collab import files" cell. No upload button is enabled AFTER CLICKING THE START BUTTON, and I got this message: "Upload widget is only available when the cell has been executed in the current browser session. Please rerun this cell to enable." Seriously??

  • @alizee3687
    @alizee3687 Жыл бұрын

    Wao... fantastic I even run into one issue. Part of my image exploded in 3D transformation but everything was available in one frame i.e. leg was few cm away from main body and stomach was ripped open. I think it's because I choose low resolution image. Other then that all went fine

  • @T1mothyTee
    @T1mothyTee2 жыл бұрын

    Hello is there a way to process a bunch of images as a batch? I want to upload about 100 images of people at once and have it generate a mesh for each of them. Thanks!

  • @SkyShazad
    @SkyShazad Жыл бұрын

    This is an Awesome Video my Dude.. My question is, When its done , and ive downloaded my model etc , and now i want to try the Process again do i need to start the whole process again??? as thats what im doing

  • @user-kz5pz2zi3q
    @user-kz5pz2zi3q7 ай бұрын

    I need to know how to add movement to the 3d model .. i need it for sign language project

  • @badcapybara
    @badcapybara2 жыл бұрын

    Hey, great tut, thanks a lot for the effort! Does it also generate missing textures?

  • @montymole297

    @montymole297

    2 жыл бұрын

    This tutorial shows how to add textures: kzread.info/dash/bejne/nXmG3MqDe7zcd9I.html

  • @ttv_sigmajestic
    @ttv_sigmajestic3 жыл бұрын

    Darn impressive

  • @justicemagagane5737

    @justicemagagane5737

    3 жыл бұрын

    its ok bro you can say 'damn'

  • @ttv_sigmajestic

    @ttv_sigmajestic

    3 жыл бұрын

    @Justice Magagane d*mn 😯

  • @justicemagagane5737

    @justicemagagane5737

    3 жыл бұрын

    @@ttv_sigmajestic lol wtf

  • @amankhan6552
    @amankhan65522 жыл бұрын

    I get this error when i run pifuhd ValueError: not enough values to unpack (expected 4, got 0)

  • @hiksms

    @hiksms

    Жыл бұрын

    same

  • @sairajshinde5269
    @sairajshinde5269 Жыл бұрын

    it is not able to create obj file ,it is showing only the image .can someone help me with the issue plzz

  • @derekau533

    @derekau533

    Жыл бұрын

    Just put in a fix in the colab, thanks for letting me know!

  • @Rain0015
    @Rain00153 жыл бұрын

    Thanks

  • @tabz4040
    @tabz40402 жыл бұрын

    Error while finding module specification for 'apps.simple_test' (ModuleNotFoundError: No module named 'apps')

  • @tabz4040

    @tabz4040

    2 жыл бұрын

    any fix?

  • @ramgladore
    @ramgladore Жыл бұрын

    Kinda sorta worked for me but it still looked janky. Maybe the image I used too low rez.

  • @amattomy
    @amattomy3 жыл бұрын

    here all the way from corridor crew

  • @jcbyy

    @jcbyy

    3 жыл бұрын

    haha same

  • @jonasloekke7696

    @jonasloekke7696

    3 жыл бұрын

    Yep me too

  • @3dgiftz

    @3dgiftz

    2 жыл бұрын

    😔

  • @crider9260
    @crider92602 жыл бұрын

    Can you use multiple images to improve quality?

  • @gustavodegrossi4708
    @gustavodegrossi47083 жыл бұрын

    Excelent video ! Do yo know any easy way to put the texture back of the person? Or I have to do it on cinema 4D? Thanks!!!!!

  • @TheAgentMeme

    @TheAgentMeme

    3 жыл бұрын

    the tutorial to put the textures back on kzread.info/dash/bejne/nXmG3MqDe7zcd9I.html&ab_channel=FreedomArts-3DAnimation%26GameDeveloper

  • @Justkev______

    @Justkev______

    3 жыл бұрын

    that's the same thing i want to know

  • @Padma226
    @Padma226 Жыл бұрын

    i am receiving NameError: name 'image_path' is not defined

  • @daiesison
    @daiesison Жыл бұрын

    How do you run StyleSDF with your own images? On the collab it just runs with its own images.

  • @karubrandao
    @karubrandao Жыл бұрын

    I'm trying to learn about ICON (implicit clothed humans obtained from normals) and Nvidia's nerf. Could you please try to do a tutorial (with texture) about these 2 because it seems they are the best till now for this purpose. Thank you!

  • @samchaw7837
    @samchaw78372 жыл бұрын

    i couldnt figure out , i am following all the instructions as you mentioned but my object files comes in sharttered pieces, not as one invidiual object, can you tell why its happening like that, thanks in advance

  • @DanFrederiksen
    @DanFrederiksen11 ай бұрын

    it does make sense that a human shape is a fairly narrow expression space so it should actually be a fairly easy task. I would think it's vastly simpler than what midjourney does for instance. it should be quite possible to make 3D models with as good fidelity as our minds can. essentially perfect

  • @noodlesmarsden
    @noodlesmarsden7 ай бұрын

    I'm slightly late to the party but what happens when I have no files in results but followed every step you did?

  • @wgalloPT
    @wgalloPT3 жыл бұрын

    Question....how do i go by outputting multiple frames of a small animation? do i have to run it all over everytime?

  • @ginnieware1633
    @ginnieware1633 Жыл бұрын

    3 times I have tried this and 3 times failed apparently the link above gives me a figure that is already in the system and no instructions on how to clear the field.

  • @darkfantom5757
    @darkfantom5757 Жыл бұрын

    ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. torchvision 0.14.0+cu116 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. torchtext 0.14.0 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. torchaudio 0.13.0+cu116 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. fastai 2.7.10 requires torch=1.7, but you have torch 1.6.0+cu101 which is incompatible.

  • @darkfantom5757

    @darkfantom5757

    Жыл бұрын

    i do all by guide and model is broken

  • @ruchalian
    @ruchalian2 жыл бұрын

    creepy AI can make in a second at the same time if this helpful in the future for medical it would be great overall what i think today was very interesting i wanna try this.

  • @moesaadi4601
    @moesaadi46012 жыл бұрын

    So I saw another video where the guy used the original photo and pretty much stuck it to the final result model to give it color and texture, would that work if the model is missing some of the areas?

  • @huytruong31127
    @huytruong311272 жыл бұрын

    If i want create table or chair 3D, can I do with this model?

  • @user-kz5pz2zi3q
    @user-kz5pz2zi3q7 ай бұрын

    How to add movements to the 3d model

  • @johanneszwilling
    @johanneszwilling5 ай бұрын

    Works now IF you fix the numpy issues. I had two with np.int and np.bool (/lib/sdf.py)

  • @destroyer7827

    @destroyer7827

    Ай бұрын

    what did u change exactly?

  • @RuubRoyce
    @RuubRoyce Жыл бұрын

    You only have a front faced picture to work with, yet this "AI" protocol struggled to determine which way was front?!

  • @MrNutmegdesigns
    @MrNutmegdesigns Жыл бұрын

    Is this only for people or can it be of object as well?

  • @CyberPodMark2
    @CyberPodMark2 Жыл бұрын

    Will it work for 3d cartoon characters model from the picture?

  • @tomasalmiron1487
    @tomasalmiron1487 Жыл бұрын

    "recon" is empty. :(

  • @Vishulash

    @Vishulash

    11 ай бұрын

    Same problem bro... Did you find solution???

  • @pabloa.colchadop.7409
    @pabloa.colchadop.74092 жыл бұрын

    Hi. How can I unistall or remove the pytorch 3d??

  • @user-vl8qg1vj8l
    @user-vl8qg1vj8l2 жыл бұрын

    I have one question! Is it possible with luggage?

  • @velsein
    @velsein Жыл бұрын

    doesn't work :/

  • @chemonized
    @chemonized Жыл бұрын

    this doesn't work anymore, getting errors in your rendering section "could not find a version that satisfies the requirement" and on the Run PiFuHD section it gives this error: error cannot marching cubes cannot unpack non-iterable int object

  • @derekau533

    @derekau533

    Жыл бұрын

    I have just updated the colab with fixes. Some libraries needed to be updated. Thanks for letting me know!

  • @chemonized

    @chemonized

    Жыл бұрын

    @@derekau533 man that's amazing so fast you updated it! Works great now! Thank you! Side question, it says maximum 60kb image, but can you run a higher resolution if you are making it use your own machine ?

  • @derekau533

    @derekau533

    Жыл бұрын

    @@chemonized Yes, I think so.. bigger images just require more memory. You can try, then scale down if out of memory error occurs. Please remember this software is three years old now, which is ancient! The models are not super detailed. I'm sure there are better alternatives available now.

  • @sajithavijay6686
    @sajithavijay66864 ай бұрын

    We can rige this ?

  • @user-ks9hb2zw3t
    @user-ks9hb2zw3t10 ай бұрын

    not enough values to unpack

  • @larrylurex86
    @larrylurex862 жыл бұрын

    Tip: Instead of posting only how it works and how it looks the whole process it would be much more usefull to show what requirements are needed and how to set all the dependencies required by colab or to get the process working at least! If you don't do that it's just a random video about something that probably it works only for you and few other users but if you want to get much more attention you should add all the settings that make this process working! Cheers.

  • @rajeevprabhu6722
    @rajeevprabhu67222 жыл бұрын

    You made a mistake by uploading a jpg pic. Process and upload a png or psd one with a trasperant background.

  • @tiberiusgrozav1438
    @tiberiusgrozav1438 Жыл бұрын

    Hi there. Cool video but i get following error when running PIFuHD: "error cannot marching cubes cannot unpack non-iterable int object" As output in results/recon i only have the .png file and not the .obj file. The input file was under 60Kb as you said. What am I doing wrong?

  • @DR-to5hb

    @DR-to5hb

    Жыл бұрын

    I also am only getting the png in output. Errors began in the render cell, and the two suggested options in that cell do not work for me.

  • @derekau533

    @derekau533

    Жыл бұрын

    I just updated the colab with a fix, thanks for letting me know!

  • @PalKellyMedia
    @PalKellyMedia2 жыл бұрын

    Please I need link to the website

  • @brushrunner
    @brushrunner2 жыл бұрын

    Is there any version of this for the textures?

  • @C0smic_Star
    @C0smic_Star2 жыл бұрын

    Can this work with animated characters?

  • @DanFrederiksen
    @DanFrederiksen11 ай бұрын

    doesn't it include textures?

  • @dayonmohler5893
    @dayonmohler58933 жыл бұрын

    Can you do this if computer doesn’t have gpu?

  • @randomplayer6461

    @randomplayer6461

    2 жыл бұрын

    how do you use a pc if it doesn't have a gpu. (every pc has a gpu)

  • @seekerandroses
    @seekerandroses Жыл бұрын

    hey is this no longer working?

  • @loscorralesdelasplazasdeto3586
    @loscorralesdelasplazasdeto35863 жыл бұрын

    For animls??

  • @avantgaarden
    @avantgaarden7 ай бұрын

    how does it work with non-human figures?

  • @derekau533

    @derekau533

    7 ай бұрын

    this model is specifically for images of people. you can try another model like ZoeDepth huggingface.co/spaces/shariqfarooq/ZoeDepth

  • @avantgaarden

    @avantgaarden

    7 ай бұрын

    thanks a ton this is helpful@@derekau533

  • @JohnPaulBuce
    @JohnPaulBuce Жыл бұрын

    ded link bro

  • @johndavis1079
    @johndavis10792 жыл бұрын

    It doesn't work

  • @tronyxwall6378
    @tronyxwall63782 жыл бұрын

    its not working another useless thing

  • @derekau533

    @derekau533

    2 жыл бұрын

    I just tested it today and can prove that the colab is working, please see the video description for updates.

  • @youtubedeletesmychannels2329

    @youtubedeletesmychannels2329

    2 жыл бұрын

    @@derekau533 it’s not working he’s right I got a error about a sample test idk wtf that means😂

  • @youtubedeletesmychannels2329

    @youtubedeletesmychannels2329

    2 жыл бұрын

    @@derekau533 eh idk care no more it’s too annoying how do I even reverse all the downloads and just uninstall the whole time waste all together

  • @vinayrana6632

    @vinayrana6632

    2 жыл бұрын

    @@derekau533 not working for me as well - facing this issue : ValueError: not enough values to unpack (expected 4, got 0)

  • @ChrisWeider

    @ChrisWeider

    2 жыл бұрын

    @@vinayrana6632 same here...

  • @Encumberedemotions
    @Encumberedemotions5 ай бұрын

    This shit is slow and didn't work

  • @jcoast1
    @jcoast1 Жыл бұрын

    ERROR: Could not find a version that satisfies the requirement pytorch3d (from versions: none) ERROR: No matching distribution found for pytorch3d crap...dislike