Create Better Quality Depth Maps From 2D Images With New AI Tools

Find out more about AI Animation, and register as an AI creative for free at aianimation.com
This video is a quick tutorial that covers creating depth maps with Midas 3.1. via a Google Colab project as well as Photoshop Beta 25.0. Plus it includes a quick run-through on how to use depth maps in After Effects to add a 3D depth effect to 2D images, including linking a virtual camera.
------------------- -------------------- ---------------------
Times
0:00 - Intro
1:02 - Midas 3.1 Google Colab
4:23 - Photoshop Depth Pass
5:19 - Compare Results
7:35 - Depth Pass use in After Effects
10:20 - Outro
------------------- -------------------- ---------------------
Tools Used in this Tutorial:
- MidJourney (To create the dystopian cityscape scene with the tree)
www.midjourney.com/
- Midas 3.1 via Google Colab:
colab.research.google.com/dri...
- Adobe Photoshop & After Effects
www.adobe.com/uk/creativeclou...

Пікірлер: 52

  • @syntheticfauna
    @syntheticfauna11 ай бұрын

    Excellent content! Keep it coming!❤

  • @WolfgangScheidle
    @WolfgangScheidle11 ай бұрын

    Your tutorials are great. Thank you!

  • @MobitellSaams-fn9vq

    @MobitellSaams-fn9vq

    8 ай бұрын

    Siikoako

  • @user-eb8td1qh4o
    @user-eb8td1qh4oАй бұрын

    great ! quick and simple !

  • @schmip
    @schmip4 ай бұрын

    INCREDIBLY INFORMATIVE EXPLANATION. THANK YOU

  • @schmip

    @schmip

    4 ай бұрын

    BTW MIDAS 3.1 LOOKS BETTER BY A LONGSHOT. PS FANBOYS COPING HARD!

  • @Doctor_Random
    @Doctor_Random10 ай бұрын

    This is great cheers! I had been using Collab to make AI voice models ... I feel the need to move into ai animation:)

  • @saemranian
    @saemranian8 ай бұрын

    Awesome Thanks for sharing

  • @tanyasubaBg
    @tanyasubaBg11 ай бұрын

    Absolutely brilliant. I like AE. You just got new sub.

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Awesome, thanks so much for subscribing.

  • @tanyasubaBg

    @tanyasubaBg

    11 ай бұрын

    @@AIAnimationStudio you are welcome. But I have one question. I have just tried everything that you showed us here with AE and my camera doesn't work. Actually, orbit-around option doesn't work. thanks in advance.

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    @@tanyasubaBg . Hey, it should work as expected. Feel free to email via the aianimation.com website and I'll try and quickly help. It may be the 'constantly rasterise' button needs pressing or unpressing. I think (🤞) all the steps and button presses should be covered in the video. (Also the setup in this particular video needs the camera to use the pan tool not orbit)

  • @tanyasubaBg

    @tanyasubaBg

    11 ай бұрын

    @@AIAnimationStudio thank you

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Hey@@tanyasubaBg , just looking back at this, I think it might be a simple case of you're using the incorrect camera tool. When pressing 'c' to cycle through the camera move tools, you'd want to use the 'pan' tool in this instance, not the 'orbit' tool, as the displacement map is connected to the position of the camera and not the orientation. Hope that helps.

  • @estudiolateral
    @estudiolateral7 ай бұрын

    BRAVOOOO!!!!

  • @bongomatteo5224
    @bongomatteo52246 ай бұрын

    Super Cool! Thanks for this great info. I noticed that it was saved in PNG format, is EXR available? Thanks

  • @welsonfy5246
    @welsonfy52469 ай бұрын

    Thanks for the video. Can you please post an image transformed into a depth map for download so that I can see the quality of the effect? thanks in advance

  • @MediaOnoff
    @MediaOnoff6 ай бұрын

    Sir, can you tell how the zoom animation will be done in this?

  • @cactusface23
    @cactusface2311 ай бұрын

    Would love to see results using ae plugin "depth scanner", although it comes with an extra cost. Thanks for the videos!

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Yeah, that's on the list to do a video with, but wanted to take a non paid plugin approach. I'm interested to see if their 'accurate' and 'highest quality' settings compare.

  • @Sketching4Sanity
    @Sketching4Sanity5 ай бұрын

    Love ✊🏿

  • @isaiahrobinson100
    @isaiahrobinson1009 ай бұрын

    does increasing the contrast on the images before inputing them into midas get a sharper or cleaner depth map generation?

  • @generaljackson1741

    @generaljackson1741

    8 ай бұрын

    sometime

  • @aa-xn5hc
    @aa-xn5hc10 ай бұрын

    Thank you, also video is not too long

  • @rene.rodriguez
    @rene.rodriguez11 ай бұрын

    Excellent tutorial. Where the depth map gets wonky when panning a camera, can you paint the depth map to adjust the results?

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Thank you, glad you liked the tut. Unfortunately can't paint the depth map to fix the wonky parts, as it's more just a limitation of the effect. I've been trying out different approaches, i.e. with the more advanced (but free) Displacer Pro plugin for After Effects to see if better results can be obtained. Plus some other ideas, which I'll share if they show decent results. Plus you could make a 3D mesh of the displacement via Blender and bring that into After Effects (potentially via the new 3D file support in After Effects Beta, or use Element 3D) but that still has similar distortion and adds more steps to the workflow.

  • @rene.rodriguez

    @rene.rodriguez

    11 ай бұрын

    @@AIAnimationStudio okay, bummer. I thought you could since the depth map appears to be differing values of black and white, but I guess there’s more to it. Thanks for the quick response and keep up the good work!

  • @rkgibbons

    @rkgibbons

    7 ай бұрын

    @@AIAnimationStudio Curious what your results were with Displacer Pro. Any improvement? Or have you tried AE Depth Scanner? OH....and GREAT tutorial videos dude. Love your stuff!! ...and I'm not gonna be lazy. I'll try the Displacer Pro myself and see.

  • @rkgibbons

    @rkgibbons

    7 ай бұрын

    @@AIAnimationStudio As a follow-up (to my trial with Displacer Pro), I found the camera movements to be WAY too sensitive. The slightest mouse movement made the effect distort completely. So I wrapped each of the two Camera scripts in brackets and divided the total by 50 (or 100 for even smoother control). So, this is what changed: thisComp.layer("Camera 1").transform. Position[0]-2000 --> thisComp.layer("Camera 1").transform. Position[0]-2000 The 2000 is just my particular X positional value so will vary for anyone trying this themselves. Then repeated for vertical script. Works like a charm!

  • @AIAnimationStudio

    @AIAnimationStudio

    7 ай бұрын

    Nice, thanks for sharing that. @@rkgibbons. I got distracted by some other parts of production but will no doubt revisit depth maps again soon as it's such a useful approach. Have you tried out the 3D format import into the After Effects Beta, that adds another alternative approach for add depth to scenes, with a 3D mesh made via somethinglike Zoe Depth. kzread.info/dash/bejne/aalkqLuPgLSbosY.htmlsi=KOL3yREamqGeAmKf&t=771

  • @borarealtech
    @borarealtech10 ай бұрын

    Cool

  • @harricoentertainment
    @harricoentertainment11 ай бұрын

    🙌🏾

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    🤟

  • @changtc8873
    @changtc88739 ай бұрын

    Hello, I have a question. Does Midas only accept image size with 512 x 512? or it can be any sizes? Thank you

  • @RamonValdez2014

    @RamonValdez2014

    9 ай бұрын

    Colab 3.1 version accepted my 3K input image and produced a fine quality output, without downsizing.

  • @jordanlotus188
    @jordanlotus1885 ай бұрын

    nice

  • @armondtanz
    @armondtanz11 ай бұрын

    I wanted to do a shoutout for a tutorial/hacks. I like your workflow ;). 1. What about PNG sequence? I remember years ago andrew kramer placing smoke/fire effects in and around a scene using depth maps. It was about 6-7 years ago. Example: take your scene, create a png sequence video of it in gen2. Then create png seq of depth maps. Then have ability to add smoke in distance , fire in foreground. Im sure its possible, but again was a while back . Thanks.

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Yeah, you can definitely do stuff like that. (Good old Andrew Kramer Tutorials... 🙌.. I might have to see if I can find his old tutorial to see exactly what you mean). I assume it'll be a similar approach to dropping the character into the 3D space in this video. kzread.info/dash/bejne/pmmK05aamNDUZ5c.html

  • @armondtanz

    @armondtanz

    11 ай бұрын

    @@AIAnimationStudio ive seen others do it. Basically imagine a cube in an empty room. Now you wanna create realism by having bursts of flames and smoke. In real life the flames & smoke would be infront and behind the cube. I think you would use levels / curve sliders on the depth map and this would cut out the foreground - mid - background areas. In this video in the photoshop AI filters, im sure its using this technique to generate the depth of field . Its applying a mask to the blur in foreground - mid - background.

  • @armondtanz

    @armondtanz

    11 ай бұрын

    @@AIAnimationStudio ah. Could it be gradient wipe. Great example here of the masking. kzread.info/dash/bejne/iH5-zaWLeNTfntI.html Ffw to first layer chapter at 2:34

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    ​@@armondtanz .. Cool!!.. I know exactly what you mean. Great idea for a future tutorial, it's going on the list. I've actually got it going on in an AI short film I'm 'slooowly' making at the mo, with robots in amongst jungle leaves. It's a really useful technique and great way to relatively easily create something that looks a lot more complex.👍

  • @CanalBigMaqui
    @CanalBigMaqui2 ай бұрын

    Have a Question!, Does midas leaves some files on your pc?. Cause after I used it i have half space on my C: disk and now I only have left 80gb of space, an I dont know where it came from!! HELP

  • @AIAnimationStudio

    @AIAnimationStudio

    2 ай бұрын

    If installed locally, It really should not have taken any where near that amount of space on your C:: disk. I can only assume something else unrelated happened. Good luck finding the cause. (But you could use Midas via hugging face, or Colab without filling up space on your harddrive (bar the small file you download at the end). Also I'd now recommend checking out ZoeDepth which you'll find on Hugging Face as well.

  • @izabotin
    @izabotin11 ай бұрын

    Please share the dystopian cityscape scene too. So we can observe the development of diffrent systems in the future and try on other computers

  • @AIAnimationStudio

    @AIAnimationStudio

    11 ай бұрын

    Great idea. I've added the dystopian cityscape, plus another image to download for free via this link aianimation.com/tutorial-06-create-higher-quality-depth-maps-with-ai/

  • @Worldize
    @WorldizeАй бұрын

    Can you edit depth maps?

  • @clamojoat8543
    @clamojoat85434 ай бұрын

    right now nothing compares to depth scanner maps

  • @redman458

    @redman458

    4 ай бұрын

    Considering Depth Scanner includes MiDaS, ZoeDepth, and now Depth Anything builds in their models, I find that notion kinda silly. What Depth Scanner does provide is a better post processing pipeline for editing and 3D conversion.

  • @derekhaller1835
    @derekhaller18358 ай бұрын

    Unfortunately there seems to be a TypeError on the Midas server.

  • @JJUmusic

    @JJUmusic

    8 ай бұрын

    same here! not sure what the error means TypeError: expected size to be one of int or Tuple[int] or Tuple[int, int] or Tuple[int, int, int], but got size with types [, ]

  • @yechanjung3626

    @yechanjung3626

    8 ай бұрын

    same here..

  • @BarneyLikesBeer

    @BarneyLikesBeer

    7 ай бұрын

    Does anyone know if there is a fix for this? are there any good alternative collabs that can be used instead?