Turn any image into 3d animation using AI generated depth map!

The AI tool MiDaS which takes in a single image for computing relative depth:
huggingface.co/spaces/pytorch...
The original quote of Zdzisław Beksiński:
"Zapewne istnieją doskonałe programy, ale na o wiele mocniejsze komputery niż mają do dyspozycji zwykli śmiertelnicy. Zresztą nie wiem. Te programy, które umożliwiają 3D i są dostępne dla amatorów, budzą jak najdalej idące podejrzenia, że ktoś już wymyślił tą całą bibliotekę zadziałań, bo np. w takim programie jak Bryce 3D, a to jest taki popularny program właśnie do grafiki 3D, pstryka się tylko "zrób mi skałę" i on "pyk" wypluwa już taką skałę gotową, oczywiście w formie schematu. Można ją potem rozciągnąć wzdłuż, można rozciągnąć wszerz, obrócić, pochylić i tak dalej, można żądać żeby była bardziej obła lub bardziej kanciasta i renderować ją nawet portretem cioci ale kto mi ją podsunął na samym początku? Czy to jest kwestia przypadku? Czy ona znajduje się w jakiejś bibliotece? Kto jest twórcą? (...)"
(source: www.charlie.pl/index.php?pg=b... )
Equipment I use and recommend:
(affiliate links - you help me by clicking)
==============================
Mic:
MAONO AU-PM461
amzn.to/3RX9Sf6
WebCam:
Elgato Facecam - 1080p60:
amzn.to/3H3W5gp
+
GoPro Hero4 Black:
amzn.to/3RVFzFz
PC:
ASRock Z390 Pro4:
amzn.to/48f0Tfc
Intel Core i5-9400F:
amzn.to/48rwTw0
ASUS RTX 3060 V2 12GB:
amzn.to/3TKeuXv
NVMe M.2 SSD PNY 500GB CS1030
amzn.to/3to41Gp
750W Power Supply 80 Plus Gold:
amzn.to/3RY4p7G
Fractal Design Case (I have an older model):
amzn.to/3txOiEE
Sound system:
AIYIMA A07 TPA3255 Power Amplifier
amzn.to/41AAcyK

Пікірлер: 97

  • @booyaskooya
    @booyaskooya Жыл бұрын

    Your teaching method is the absolute best!

  • @kinotto8811
    @kinotto8811 Жыл бұрын

    I had been looking for such a tutorial for weeks but not really knowing what I should be looking for, I was going by trial and error with the classic keywords: 2d to 3d, 3d effect on 2d image, etc. etc., then I find you on the home page and what can I say.... AMAZING, you made me discover a world today with this video, I thank you tremendously, I am happy to be one of your 70 followers and look forward to your further growth. You probably think I am exaggerating, but I am not, you have taken a huge weight off my shoulders!

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    I'm happy for you! I have exactly the same feeling when I discover such new tools. That's why I recently started this channel, and your comment made my day :) It's motivating to keep recording and sharing what interests me! Good luck with your projects, post a link when you're done :)

  • @j_shelby_damnwird

    @j_shelby_damnwird

    Жыл бұрын

    This will be such fun to use with my 3D printer, thanks 🙏🏼

  • @Alanwking
    @Alanwking Жыл бұрын

    Thank you so much for this tutorial! I've been using the depth map in the Fusion tab of Davinci Resolve. Now that I know how to apply depth maps in Blender, I might use it more here to quickly create 3d scenes.

  • @DanVogt
    @DanVogt Жыл бұрын

    This is great. Thanks for this tutorial. I have done this before and found that incorporating a few bones parented to some parts of the geometry (or shape keys) means you can add additional, very slight but very interesting animation which creates visual interest and a dynamic quality

  • @EuroDJ
    @EuroDJ Жыл бұрын

    Cool work! Looks wonderful! :)

  • @igorhikka
    @igorhikka Жыл бұрын

    Your channel is so asmr I can't

  • @vadimkozlov3228
    @vadimkozlov3228 Жыл бұрын

    thank you this was exactly what i needed i was looking for a video like this.

  • @PP3D
    @PP3D Жыл бұрын

    This is GREAT, thank you 👍

  • @erandonandied
    @erandonandied9 ай бұрын

    You are my hero! Thank you!

  • @Tremori_A
    @Tremori_A Жыл бұрын

    If I knew more about setting up a scene for my renders this will be immense in adding detail

  • @matthallett4126
    @matthallett4126 Жыл бұрын

    Good find! Very useful thanks

  • @pookienumnums
    @pookienumnums11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.

  • @Claudio.D.G.
    @Claudio.D.G.10 ай бұрын

    TOP! Thanks Blender Smoothie!!! 😘

  • @OriBengal
    @OriBengal10 ай бұрын

    Very easy and well explained. Thanks

  • @Nick_N00B
    @Nick_N00B Жыл бұрын

    Nieźle 👍

  • @PRODUCT5
    @PRODUCT5 Жыл бұрын

    It's pretty cool.😎

  • @clkndggr
    @clkndggr Жыл бұрын

    If anyone has the issue where the texture is much smaller than the image shader, I discovered that if I changed the coordinates under the "Modifier Properties" tab to UV, then the texture matched the shader.

  • @denislenoiraristocrat4751
    @denislenoiraristocrat4751 Жыл бұрын

    Thank you so much ♥ This video makes me subscribe you :D happy to find your channel finally .♥

  • @kadabra8
    @kadabra8 Жыл бұрын

    Цікава річ, треба спробувати)👍

  • @blendersmoothie
    @blendersmoothie Жыл бұрын

    Please write in the comments and show off your own animations made with this technique!

  • @zephilde
    @zephilde Жыл бұрын

    Hi! I'm trying this technique with other images, especially some with a higher contrast depthmap (aka more detached foreground objects with a far away background, imagine a plain white circle on back bg without gradient pixels) and so there are some trifaces really stretched between foreground and background... Do you have an idea/technique to avoid that? (something not involving byhand edit, cause I'm cooking several episodes with potentailly several picture scenes) (more subdiv smoothing is not ideal because it make the foreground object more distorded) Thx btw!

  • @JasonMitchellofcompsci
    @JasonMitchellofcompsci Жыл бұрын

    I saw someone do something very similar in davinci for video. I'd really like to see if this could be done in video on blender. You'd probably have to pick an easier scene and only view it from much more conservative angles to make each frame less labor intensive / automatable. But I'm definitely going to play with that hugging face model at least. Very cool.

  • @ExVatic
    @ExVatic Жыл бұрын

    Have you thought about how you could do this to a series of images to make an animation? I'm just wondering if you had any hints for that as there is the option to import the texture as an image sequence?

  • @jameskelly8620
    @jameskelly86205 ай бұрын

    Gu Job man!

  • @ValeGoG
    @ValeGoG Жыл бұрын

    10/10

  • @thevibe2985
    @thevibe2985 Жыл бұрын

    how do i use proportional editing? what are the key binds ive tried a lot of keys?

  • @digitalphanes206
    @digitalphanes206 Жыл бұрын

    Doesn anyone know if there’s a way in c4d to do this? I can only think of displacement, I use arnold. But displacement is not the same I couldn’t modify the geometry right? This in blender looks awesome

  • @fracturedinfinities
    @fracturedinfinities Жыл бұрын

    I am also getting a flat plane when adding the texture in the modeling tab. I have all subdivisions selected. Yours goes to selecting the outer rim when you (i assume) click off of it. When I click off I see all the subdivision edges. I tried without subdiving and that did not work either Any thoughts? I was able to get it in the shading tab

  • @jstiller30

    @jstiller30

    Жыл бұрын

    im having the same problem.

  • @worldofmyth4053

    @worldofmyth4053

    Жыл бұрын

    @@jstiller30 take it slowly, after adding the subdivision, switch back to object mode and then add the displace modifier and the texture

  • @lt.slayer3468

    @lt.slayer3468

    Жыл бұрын

    @@worldofmyth4053 DUDE I FUCKING LOVE U...this is why youtube is so powerful thankyou wise one

  • @mauakatakla

    @mauakatakla

    Жыл бұрын

    @@worldofmyth4053 did not work for me neither

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    @@mauakatakla you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.

  • @giokaios
    @giokaios Жыл бұрын

    How to add camera movement? Like exploring the map ?

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    Check out View -> Navigation -> Walk navigation . Then move using WSAD keys and mouse :)

  • @gryphonsegg
    @gryphonsegg Жыл бұрын

    add the subD surface before the displace!

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    The surface is already subdivided. if you divide the surface into even smaller pieces than the resolution of the depth map, then it becomes staggered. the subdiv added after the displace modifier is for extra smoothing.

  • @olivierduveau1518
    @olivierduveau15187 ай бұрын

    Hello, can it be installed on a laptop with an Nvidia Geforce GTX 1050 card? Thank you for your reply

  • @delycan4912
    @delycan4912 Жыл бұрын

    Site didn't work so had to find a new one. Can't get the depth map to do anything. Plan stays flat.

  • @mikamikowsky4183
    @mikamikowsky4183 Жыл бұрын

    Czołem. Robię wszystko tak jak w Twoim filmie. Jednak gdy dodaję depth map w zakładce "texture properties" to nic na tej płaskiej powierzchni się nie dzieje. Dalej jest płaska. Co robić? Pozdrowionka.

  • @mikamikowsky4183

    @mikamikowsky4183

    Жыл бұрын

    Ok, nie było tematu, mam ;)

  • @opoetapensador
    @opoetapensador Жыл бұрын

    I do everything in the beggining, since subdividing and add the modifier displace, but when i download the depht map of the photo, nothing happens in the plane. Why could that be?

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    You have to create new textures inside displacement modifier and then assign downloaded image file to the texture in the textures tab. Also make sure that the strength of three modifier is not zero, and check if you have applied subdivision to the plane.

  • @RonnieMirands
    @RonnieMirands Жыл бұрын

    Is still working the link? I clicked and got an error

  • @demitrisabian5656
    @demitrisabian5656 Жыл бұрын

    Get Runtime error when going to the Link, is it just down rn?

  • @EasyED1992
    @EasyED19924 ай бұрын

    How can i make any image into grayscale/depth map??

  • @thevibe2985
    @thevibe2985 Жыл бұрын

    seems like a lot of people are having the same issue as when adding the depth map to the plane its still flat? Has anyone found a solution?

  • @fracturedinfinities

    @fracturedinfinities

    Жыл бұрын

    I looked it up elsewhere and saw that you can do it in the shading tab. Trying to get that over to sculpting

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.

  • @edgarprotsko1558
    @edgarprotsko1558 Жыл бұрын

    If press link i see "Runtime error Space failed to start. Exit code: 1" - please help!

  • @robsn20k
    @robsn20k Жыл бұрын

    The tutorial is really great! Compliments for your work! But: When I apply the depth map as a texture to the plain (~ 2:20 to 2:35) nothing happens. Might the reason be that I have no graphic card? There's no error, there's no loading time. Just nothing happens.

  • @HelloMyFriendz92

    @HelloMyFriendz92

    11 ай бұрын

    Same over here! if anyone found the solution let me know !

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step. @@HelloMyFriendz92

  • @robsn20k

    @robsn20k

    11 ай бұрын

    @@pookienumnums Thank you dear! You made my day!

  • @xFanGame23

    @xFanGame23

    9 ай бұрын

    @@pookienumnums it works when I swap back to object mode, but then when I want to edit the mesh as Lukasz does at 4:40, my mesh is back to being a plane... any idea on how to make it stay shaped ?

  • @camilkuo
    @camilkuo Жыл бұрын

    ouch the huggingface webpage doesn't work..

  • @rowbirdprod.4235
    @rowbirdprod.4235 Жыл бұрын

    When I'm going to the modeling tab (04:38) the edit mode is just flat. Any ideas? 🤔

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    4:30 did you apply the modifier?

  • @SmudgeOfficialUK

    @SmudgeOfficialUK

    Жыл бұрын

    @@blendersmoothie I am having the same problem, which modifier was it?

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.

  • @pookienumnums

    @pookienumnums

    11 ай бұрын

    you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step. @@SmudgeOfficialUK

  • @tamilorejoseph4704
    @tamilorejoseph4704 Жыл бұрын

    hey , great tutorial, the site doesn't work for some reason

  • @somedude5951
    @somedude5951 Жыл бұрын

    This is only a dept map, with no extra vertices or polygons? Made with AI, just from a 2d image? Great for walls of buildings, streets, many objects and 3d shapes 🙂

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    Yes, it's just a depth map made 100% by ai with my little tweak to insert a light source. Good ideas for use :)

  • @99c-innovation
    @99c-innovation Жыл бұрын

    is anyone else getting a runtime error on the link?

  • @demitrisabian5656

    @demitrisabian5656

    Жыл бұрын

    yes me

  • @TheOpasthie
    @TheOpasthie Жыл бұрын

    don't put your face in front of the instructions... other than that amazing tutorial!

  • @jonathanfelso

    @jonathanfelso

    Жыл бұрын

    Don’t put your face in at all! It doesn’t help anything

  • @iamisobe
    @iamisobe Жыл бұрын

    the huggingface link doesnt work

  • @mslmanni
    @mslmanni Жыл бұрын

    Is there any online solution to extract depth displacement map.

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    How would it differ from the tool I just showed in the video?

  • @mslmanni

    @mslmanni

    Жыл бұрын

    @@blendersmoothie Sorry I didn't check the site but assumed that I have to run it on my own computer.

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    @@mslmanni No problem, you can use it both on-line and on your own computer.

  • @noobclown2910
    @noobclown2910 Жыл бұрын

    03:00

  • @TKs3DPrints
    @TKs3DPrints Жыл бұрын

    link not working :)

  • @gamexhibit
    @gamexhibit Жыл бұрын

    Can I do this in free trial blender?

  • @fracturedinfinities

    @fracturedinfinities

    Жыл бұрын

    blender is free

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    What do you mean? Blender is free and open source :)

  • @AbdulAziz-cj4hg
    @AbdulAziz-cj4hg Жыл бұрын

    Do ihave to pay for midas?

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    No, it's free and open source :)

  • @johnsondigitalmedia
    @johnsondigitalmedia Жыл бұрын

    Not 3d zdepth 32 bit. Only 2d approximation.

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    That's true

  • @user-ot1kv6io5y
    @user-ot1kv6io5y Жыл бұрын

    Link DOESN'T WORK

  • @faithrakhajiit9773
    @faithrakhajiit9773 Жыл бұрын

    nothing happens when i add the texture...

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    Is your displacement modifier configured correctly?

  • @rowbirdprod.4235

    @rowbirdprod.4235

    Жыл бұрын

    try go back to the layout mode

  • @rowbirdprod.4235

    @rowbirdprod.4235

    Жыл бұрын

    and watch out for the editing modes in the top left corner .. fixed it for me. @blender Smoothie 3d, thanks a lot for the tutorial, I have never worked with Blender but this is fun! :-)

  • @Relanii
    @Relanii Жыл бұрын

    Link is very broken lol

  • @charlesselrachski34
    @charlesselrachski34 Жыл бұрын

    you could skip the ai step by using blender3d to take the image and make a depth map at this youtube video kzread.info/dash/bejne/qXassduKkpjadqQ.html

  • @blendersmoothie

    @blendersmoothie

    Жыл бұрын

    It uses a different depth map tool, but it's still an AI tool.

  • @beatsbywoods8388
    @beatsbywoods8388 Жыл бұрын

    Dude I shouldn’t have to blast my speakers just to hear you, its like your talking in your sleep,, WAKE UP!! Now I think your mumbling, cant hear or understand, another example Not everyone should have a channel

  • @mixchief

    @mixchief

    Жыл бұрын

    Your writing suggests you have obvious problems speaking intelligible yourself. Fix your own shortcomings before jumping on someone else’s. On a friendlier note: You could’ve stopped after the first sentence. Instead you implied he shouldn’t do KZread videos, rather than saying his work is very interesting - which is what you think, since you’re trying to say it’s a pity you can’t hear. Since you’re a young person, take it to heart and check your language before posting in the future. Good luck!

  • @JasonMitchellofcompsci
    @JasonMitchellofcompsci Жыл бұрын

    I saw someone do something very similar in davinci for video. I'd really like to see if this could be done in video on blender. You'd probably have to pick an easier scene and only view it from much more conservative angles to make each frame less labor intensive / automatable. But I'm definitely going to play with that hugging face model at least. Very cool.