Turn any image into 3d animation using AI generated depth map!
The AI tool MiDaS which takes in a single image for computing relative depth:
huggingface.co/spaces/pytorch...
The original quote of Zdzisław Beksiński:
"Zapewne istnieją doskonałe programy, ale na o wiele mocniejsze komputery niż mają do dyspozycji zwykli śmiertelnicy. Zresztą nie wiem. Te programy, które umożliwiają 3D i są dostępne dla amatorów, budzą jak najdalej idące podejrzenia, że ktoś już wymyślił tą całą bibliotekę zadziałań, bo np. w takim programie jak Bryce 3D, a to jest taki popularny program właśnie do grafiki 3D, pstryka się tylko "zrób mi skałę" i on "pyk" wypluwa już taką skałę gotową, oczywiście w formie schematu. Można ją potem rozciągnąć wzdłuż, można rozciągnąć wszerz, obrócić, pochylić i tak dalej, można żądać żeby była bardziej obła lub bardziej kanciasta i renderować ją nawet portretem cioci ale kto mi ją podsunął na samym początku? Czy to jest kwestia przypadku? Czy ona znajduje się w jakiejś bibliotece? Kto jest twórcą? (...)"
(source: www.charlie.pl/index.php?pg=b... )
Equipment I use and recommend:
(affiliate links - you help me by clicking)
==============================
Mic:
MAONO AU-PM461
amzn.to/3RX9Sf6
WebCam:
Elgato Facecam - 1080p60:
amzn.to/3H3W5gp
+
GoPro Hero4 Black:
amzn.to/3RVFzFz
PC:
ASRock Z390 Pro4:
amzn.to/48f0Tfc
Intel Core i5-9400F:
amzn.to/48rwTw0
ASUS RTX 3060 V2 12GB:
amzn.to/3TKeuXv
NVMe M.2 SSD PNY 500GB CS1030
amzn.to/3to41Gp
750W Power Supply 80 Plus Gold:
amzn.to/3RY4p7G
Fractal Design Case (I have an older model):
amzn.to/3txOiEE
Sound system:
AIYIMA A07 TPA3255 Power Amplifier
amzn.to/41AAcyK
Пікірлер: 97
Your teaching method is the absolute best!
I had been looking for such a tutorial for weeks but not really knowing what I should be looking for, I was going by trial and error with the classic keywords: 2d to 3d, 3d effect on 2d image, etc. etc., then I find you on the home page and what can I say.... AMAZING, you made me discover a world today with this video, I thank you tremendously, I am happy to be one of your 70 followers and look forward to your further growth. You probably think I am exaggerating, but I am not, you have taken a huge weight off my shoulders!
@blendersmoothie
Жыл бұрын
I'm happy for you! I have exactly the same feeling when I discover such new tools. That's why I recently started this channel, and your comment made my day :) It's motivating to keep recording and sharing what interests me! Good luck with your projects, post a link when you're done :)
@j_shelby_damnwird
Жыл бұрын
This will be such fun to use with my 3D printer, thanks 🙏🏼
Thank you so much for this tutorial! I've been using the depth map in the Fusion tab of Davinci Resolve. Now that I know how to apply depth maps in Blender, I might use it more here to quickly create 3d scenes.
This is great. Thanks for this tutorial. I have done this before and found that incorporating a few bones parented to some parts of the geometry (or shape keys) means you can add additional, very slight but very interesting animation which creates visual interest and a dynamic quality
Cool work! Looks wonderful! :)
Your channel is so asmr I can't
thank you this was exactly what i needed i was looking for a video like this.
This is GREAT, thank you 👍
You are my hero! Thank you!
If I knew more about setting up a scene for my renders this will be immense in adding detail
Good find! Very useful thanks
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.
TOP! Thanks Blender Smoothie!!! 😘
Very easy and well explained. Thanks
Nieźle 👍
It's pretty cool.😎
If anyone has the issue where the texture is much smaller than the image shader, I discovered that if I changed the coordinates under the "Modifier Properties" tab to UV, then the texture matched the shader.
Thank you so much ♥ This video makes me subscribe you :D happy to find your channel finally .♥
Цікава річ, треба спробувати)👍
Please write in the comments and show off your own animations made with this technique!
Hi! I'm trying this technique with other images, especially some with a higher contrast depthmap (aka more detached foreground objects with a far away background, imagine a plain white circle on back bg without gradient pixels) and so there are some trifaces really stretched between foreground and background... Do you have an idea/technique to avoid that? (something not involving byhand edit, cause I'm cooking several episodes with potentailly several picture scenes) (more subdiv smoothing is not ideal because it make the foreground object more distorded) Thx btw!
I saw someone do something very similar in davinci for video. I'd really like to see if this could be done in video on blender. You'd probably have to pick an easier scene and only view it from much more conservative angles to make each frame less labor intensive / automatable. But I'm definitely going to play with that hugging face model at least. Very cool.
Have you thought about how you could do this to a series of images to make an animation? I'm just wondering if you had any hints for that as there is the option to import the texture as an image sequence?
Gu Job man!
10/10
how do i use proportional editing? what are the key binds ive tried a lot of keys?
Doesn anyone know if there’s a way in c4d to do this? I can only think of displacement, I use arnold. But displacement is not the same I couldn’t modify the geometry right? This in blender looks awesome
I am also getting a flat plane when adding the texture in the modeling tab. I have all subdivisions selected. Yours goes to selecting the outer rim when you (i assume) click off of it. When I click off I see all the subdivision edges. I tried without subdiving and that did not work either Any thoughts? I was able to get it in the shading tab
@jstiller30
Жыл бұрын
im having the same problem.
@worldofmyth4053
Жыл бұрын
@@jstiller30 take it slowly, after adding the subdivision, switch back to object mode and then add the displace modifier and the texture
@lt.slayer3468
Жыл бұрын
@@worldofmyth4053 DUDE I FUCKING LOVE U...this is why youtube is so powerful thankyou wise one
@mauakatakla
Жыл бұрын
@@worldofmyth4053 did not work for me neither
@pookienumnums
11 ай бұрын
@@mauakatakla you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.
How to add camera movement? Like exploring the map ?
@blendersmoothie
Жыл бұрын
Check out View -> Navigation -> Walk navigation . Then move using WSAD keys and mouse :)
add the subD surface before the displace!
@blendersmoothie
Жыл бұрын
The surface is already subdivided. if you divide the surface into even smaller pieces than the resolution of the depth map, then it becomes staggered. the subdiv added after the displace modifier is for extra smoothing.
Hello, can it be installed on a laptop with an Nvidia Geforce GTX 1050 card? Thank you for your reply
Site didn't work so had to find a new one. Can't get the depth map to do anything. Plan stays flat.
Czołem. Robię wszystko tak jak w Twoim filmie. Jednak gdy dodaję depth map w zakładce "texture properties" to nic na tej płaskiej powierzchni się nie dzieje. Dalej jest płaska. Co robić? Pozdrowionka.
@mikamikowsky4183
Жыл бұрын
Ok, nie było tematu, mam ;)
I do everything in the beggining, since subdividing and add the modifier displace, but when i download the depht map of the photo, nothing happens in the plane. Why could that be?
@blendersmoothie
Жыл бұрын
You have to create new textures inside displacement modifier and then assign downloaded image file to the texture in the textures tab. Also make sure that the strength of three modifier is not zero, and check if you have applied subdivision to the plane.
Is still working the link? I clicked and got an error
Get Runtime error when going to the Link, is it just down rn?
How can i make any image into grayscale/depth map??
seems like a lot of people are having the same issue as when adding the depth map to the plane its still flat? Has anyone found a solution?
@fracturedinfinities
Жыл бұрын
I looked it up elsewhere and saw that you can do it in the shading tab. Trying to get that over to sculpting
@pookienumnums
11 ай бұрын
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.
If press link i see "Runtime error Space failed to start. Exit code: 1" - please help!
The tutorial is really great! Compliments for your work! But: When I apply the depth map as a texture to the plain (~ 2:20 to 2:35) nothing happens. Might the reason be that I have no graphic card? There's no error, there's no loading time. Just nothing happens.
@HelloMyFriendz92
11 ай бұрын
Same over here! if anyone found the solution let me know !
@pookienumnums
11 ай бұрын
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.
@pookienumnums
11 ай бұрын
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step. @@HelloMyFriendz92
@robsn20k
11 ай бұрын
@@pookienumnums Thank you dear! You made my day!
@xFanGame23
9 ай бұрын
@@pookienumnums it works when I swap back to object mode, but then when I want to edit the mesh as Lukasz does at 4:40, my mesh is back to being a plane... any idea on how to make it stay shaped ?
ouch the huggingface webpage doesn't work..
When I'm going to the modeling tab (04:38) the edit mode is just flat. Any ideas? 🤔
@blendersmoothie
Жыл бұрын
4:30 did you apply the modifier?
@SmudgeOfficialUK
Жыл бұрын
@@blendersmoothie I am having the same problem, which modifier was it?
@pookienumnums
11 ай бұрын
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step.
@pookienumnums
11 ай бұрын
you have to swap back and forth between edit mode and object mode in the drop down menu at the top left of the main window (below the file edit render menus etc etc etc). when you swap back to object you can see the depth map applied. there are a few times where he swaps back and forth from edit to object and he does not verbally or visually indicate that step for the viewers so throughout the video just check what is showing in that box for each step. @@SmudgeOfficialUK
hey , great tutorial, the site doesn't work for some reason
This is only a dept map, with no extra vertices or polygons? Made with AI, just from a 2d image? Great for walls of buildings, streets, many objects and 3d shapes 🙂
@blendersmoothie
Жыл бұрын
Yes, it's just a depth map made 100% by ai with my little tweak to insert a light source. Good ideas for use :)
is anyone else getting a runtime error on the link?
@demitrisabian5656
Жыл бұрын
yes me
don't put your face in front of the instructions... other than that amazing tutorial!
@jonathanfelso
Жыл бұрын
Don’t put your face in at all! It doesn’t help anything
the huggingface link doesnt work
Is there any online solution to extract depth displacement map.
@blendersmoothie
Жыл бұрын
How would it differ from the tool I just showed in the video?
@mslmanni
Жыл бұрын
@@blendersmoothie Sorry I didn't check the site but assumed that I have to run it on my own computer.
@blendersmoothie
Жыл бұрын
@@mslmanni No problem, you can use it both on-line and on your own computer.
03:00
link not working :)
Can I do this in free trial blender?
@fracturedinfinities
Жыл бұрын
blender is free
@blendersmoothie
Жыл бұрын
What do you mean? Blender is free and open source :)
Do ihave to pay for midas?
@blendersmoothie
Жыл бұрын
No, it's free and open source :)
Not 3d zdepth 32 bit. Only 2d approximation.
@blendersmoothie
Жыл бұрын
That's true
Link DOESN'T WORK
nothing happens when i add the texture...
@blendersmoothie
Жыл бұрын
Is your displacement modifier configured correctly?
@rowbirdprod.4235
Жыл бұрын
try go back to the layout mode
@rowbirdprod.4235
Жыл бұрын
and watch out for the editing modes in the top left corner .. fixed it for me. @blender Smoothie 3d, thanks a lot for the tutorial, I have never worked with Blender but this is fun! :-)
Link is very broken lol
you could skip the ai step by using blender3d to take the image and make a depth map at this youtube video kzread.info/dash/bejne/qXassduKkpjadqQ.html
@blendersmoothie
Жыл бұрын
It uses a different depth map tool, but it's still an AI tool.
Dude I shouldn’t have to blast my speakers just to hear you, its like your talking in your sleep,, WAKE UP!! Now I think your mumbling, cant hear or understand, another example Not everyone should have a channel
@mixchief
Жыл бұрын
Your writing suggests you have obvious problems speaking intelligible yourself. Fix your own shortcomings before jumping on someone else’s. On a friendlier note: You could’ve stopped after the first sentence. Instead you implied he shouldn’t do KZread videos, rather than saying his work is very interesting - which is what you think, since you’re trying to say it’s a pity you can’t hear. Since you’re a young person, take it to heart and check your language before posting in the future. Good luck!
I saw someone do something very similar in davinci for video. I'd really like to see if this could be done in video on blender. You'd probably have to pick an easier scene and only view it from much more conservative angles to make each frame less labor intensive / automatable. But I'm definitely going to play with that hugging face model at least. Very cool.