It's Time To Put Open Source Photogrammetry In Your Toolbox

Ғылым және технология

superfastmatt's video • It’s Time To Put A 3D ...
Add camera to database guide github.com/alicevision/meshro...
Software
Meshroom alicevision.org/#meshroom
Meshlab www.meshlab.net/
Freecad www.freecad.org/
This video was created using
Shotcut
OBS Studio
Gimp
Inkscape
00:00 Intro
00:20 Surface Prep
01:12 Pictures
01:47 Meshroom
02:51 Meshlab
03:45 Scaling
04:31 Orient
05:22 Trim
06:06 Repair
06:29 Simplify
07:19 Freecad

Пікірлер: 132

  • @thecasualgerman8031
    @thecasualgerman8031 Жыл бұрын

    I recommend using your smartphone for taking photos. Like the S22 for example. But before you start, turn on any metadata options you can find. It will write every sensorvalue including tilt, position, roll etc etc into the image metadata and photogrammetry tools can use those very efficiently!

  • @justinlabarge8178

    @justinlabarge8178

    Жыл бұрын

    @@UCKY5 it's likely on by default, and unable to be disabled

  • @pratikkore7947

    @pratikkore7947

    Жыл бұрын

    @@justinlabarge8178 how do I check that my files have them?

  • @annekedebruyn7797

    @annekedebruyn7797

    Жыл бұрын

    @@UCKY5 The majority of smart phones don't allow you to turn it off besides GPS which is a good thing in this case.

  • @rafiffadhil5872

    @rafiffadhil5872

    Жыл бұрын

    How to record orientation of each photo? Idont get it. if it's drone, it separated to different file

  • @annekedebruyn7797

    @annekedebruyn7797

    Жыл бұрын

    @@rafiffadhil5872 It doesn't NEED the orientation as meta data. It just speeds up the calculation if it does. You can throw different cameras in the software (like mixing drone shots with regular shots) and the software will do just fine.

  • @tristanscott4118
    @tristanscott4118 Жыл бұрын

    I used a similar workflow years ago to create some custom spring seat adapters for my Volvo. You have shown me a lot of little tips and tricks that would’ve made the process go A LOT more smoothly. Nice work!

  • @squareoctopus
    @squareoctopus Жыл бұрын

    Wow, this process has not improved at all in like 10 years. The results are way better now, tho. Thanks for the video, very clear instructions and tips!

  • @horrorhotel1999

    @horrorhotel1999

    11 ай бұрын

    This is a contradictory statement

  • @Muftobration

    @Muftobration

    11 ай бұрын

    @@horrorhotel1999 I think he means the laborious steps involved are the same as ever (no advances in automation), but the 3D reconstruction you get at the end is better. I don’t know whether that’s true, but it’s not contradictory.

  • @LuxGamer16
    @LuxGamer16 Жыл бұрын

    Bro came back after 9years and just posted a super useful video. Very appreciated, thank you😁

  • @heatshield

    @heatshield

    Жыл бұрын

    hahah That’s pretty wild. I did that on one of my other channels. Just had some mobile game footage from years ago and posted a flight training video. (with a real airplane, not a video game) Just wanted to backup the files somewhere else besides the phone because it was overheating and the battery was expanding in thickness. Didn’t want to have to wait until I could order a new battery to get to the video files, in case the battery completely failed or even burst open. Ended up uploading public by accident and didn’t realize it till I got home hours later. Some of my old game buddys saw it along with a “face reveal” lol

  • @phildavis1723
    @phildavis1723 Жыл бұрын

    You've made me very, VERY happy!! A nice concise way to do what I figured was possible but had no idea how!

  • @chrstphrr
    @chrstphrr Жыл бұрын

    Thank you for starting me down the path. I already have a 3d scanner, to use in a hobby / part reconstruction / replication of "antique" or out of production auto parts. For the last while I've had the scanner, I've been seeking an open-source focus on the toolchain and workflow. Thus, for me, I get to sidestep Meshroom for the moment, but everything in the MeshLab and FreeCAD portions still applies.

  • @chrismofer

    @chrismofer

    Жыл бұрын

    Meshroom is free and open source

  • @pgknippel

    @pgknippel

    11 ай бұрын

    I imagine he’s talking about time, not money

  • @Fury9er
    @Fury9er Жыл бұрын

    Cornflour mixed with IPA in a sprayer is another alternative to scanning spray.

  • @scottwallace1689
    @scottwallace16892 ай бұрын

    Good video thanks. I had tried Meshroom before but struggled with it. This is a really concise and clear path through it. Good work!

  • @marcfruchtman9473
    @marcfruchtman9473 Жыл бұрын

    Thank you for a great walk-thru of the process.

  • @FilterYT
    @FilterYT Жыл бұрын

    This was so great, took about 10 seconds to know I was going to subscribe! Thanks

  • @Lawdog388
    @Lawdog388 Жыл бұрын

    Wow thanks. Scaling in MeshLab is so much easier

  • @jvljn8903
    @jvljn8903 Жыл бұрын

    Thanks for your time and trouble making this, much appreciated!

  • @apaskiewicz
    @apaskiewicz Жыл бұрын

    This is really well explained. Thank you! ❤‍🔥❤‍🔥

  • @goigle
    @goigle Жыл бұрын

    great video, thanks for sharing your workflow in such detail

  • @deluxeddelirium
    @deluxeddelirium Жыл бұрын

    fascinating and concise, very well put together video

  • @alun7006
    @alun7006 Жыл бұрын

    This is EXACTLY what I need. Thank you!

  • @JamieBainbridge
    @JamieBainbridge11 ай бұрын

    So, there is at least one person who knows how to use Meshlab. Impressive!

  • @Build_the_Future
    @Build_the_Future Жыл бұрын

    I'm waiting for NeRF to get better. I think that will replace Photogrammetry and hopefully LIDAR also

  • @TheJcman72
    @TheJcman7211 ай бұрын

    Great video with a lot of tips. Thanks!

  • @divyajnana
    @divyajnana Жыл бұрын

    Great video, slick system, very informative, Thank You!!!

  • @tinkerman1790
    @tinkerman1790 Жыл бұрын

    Very useful tutorial video made! Thx a lot 👍🏻

  • @dlclz
    @dlclz Жыл бұрын

    Great Video, concise and really informative. Danke :)

  • @TheShanehiltonward
    @TheShanehiltonwardАй бұрын

    Absolutely excellent video. I run the same software on Linux. Thank you for the video.

  • @mahakrandomusername2672
    @mahakrandomusername267211 ай бұрын

    wow the scanning resoult is so good even without a 3d scanner crazy

  • @menchelke
    @menchelke Жыл бұрын

    Ahh, I was trying to do this photogrammetry using screenshots. Haha. Thank you for the video.

  • @geenes4120
    @geenes4120 Жыл бұрын

    11/10 explaination !

  • @mikesportsman1811
    @mikesportsman181111 ай бұрын

    Thank you, This helped me very much.

  • @BHBalast
    @BHBalast Жыл бұрын

    Thanks, very comprehensive

  • @amp08021
    @amp08021 Жыл бұрын

    Sadly the Cuda requirement is a dealbreaker :( Also, from an open source standpoint a solution for AMD cards would be lovely

  • @shubinternet

    @shubinternet

    Жыл бұрын

    Solutions for macOS would also be very welcome. Thanks!

  • @amzp_dat
    @amzp_dat Жыл бұрын

    Thats great, im planning on scanning all items in a computer museum to make a virtual tour

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    That sounds quite ambitious. Best of luck!

  • @Liberty4Ever
    @Liberty4Ever11 ай бұрын

    I've been looking for an open source 3D scanning tool to add to my FreeCAD and 3D printing tool chain. I need to make some parts that mate to someone else's fairly complex parts and I don't have their models. I'm a bit put off by the CUDA and nVidia requirements, but photogrammetry is definitely getting better.

  • @Ritefita
    @Ritefita Жыл бұрын

    I widh I could subscribe the second time just for mentioning our bro Matt =)

  • @faultboy
    @faultboy Жыл бұрын

    Sehr gutes Video!

  • @dwylhq874
    @dwylhq874 Жыл бұрын

    Awesome! Instant sub. ❤️

  • @alejandrominder2097
    @alejandrominder2097 Жыл бұрын

    Thanks for sharing! 🙂

  • @Teh-Penguin
    @Teh-Penguin Жыл бұрын

    Fascinating!

  • @kiplinght
    @kiplinght Жыл бұрын

    Using FOSS: Yay! And an Nvidia card.......... Oh.... Us FOSS users own ATI graphics cards since Nvidia refused to participate in FOSS for so long. Pity, was very interested in this video.

  • @pmcquay1
    @pmcquay1 Жыл бұрын

    is it possible to use this process to scan the inside of something? I want to scan the inside of my truck, so that I can get some dimensions for fabricating a headliner. There are curves there that would be difficult to model in a traditional way.

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Yes, it should work. Make sure to get photos from different positions in you truck.

  • @randyc750
    @randyc750 Жыл бұрын

    Blender can take a video and turn it into individual images in a folder, FYI.

  • @TheBarretNL
    @TheBarretNL10 ай бұрын

    Wouldn't it be easier when you start aligning meshes, to use a mirror-build from the middle, for certain shapes?

  • @VAS.T
    @VAS.T11 ай бұрын

    now this is a interesting topic... you could basically steal the blueprint of anything worth getting machined for example premium bike-frames or other stuff you can 3d-print or CNC it

  • @user-uo2ph3ul3d
    @user-uo2ph3ul3dАй бұрын

    Thanks for amazing tutorial! Question: I have a drone and want ro reconstruct a church, using this approach? Would it be possible?

  • @DanielJutz

    @DanielJutz

    Ай бұрын

    From a technical standpoint it should work. Results will depend on your drone's camera. Always make sure you have permission to fly! ;)

  • @Racing2Learn
    @Racing2Learn Жыл бұрын

    Excellent video! What RC truck is that?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Thanks! An old nitro rc car converted to electric with a drill motor.

  • @DerkvanL
    @DerkvanL Жыл бұрын

    Nice video. Will this work if I record a full 360 video in 4K and export that as single images?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Maybe, Meshroom might not like it if you are in the frame. This discussion might be able to help you github.com/alicevision/meshroom/issues/526 .

  • @DerkvanL

    @DerkvanL

    Жыл бұрын

    @@DanielJutz thx.

  • @GregoryCarnegie
    @GregoryCarnegie Жыл бұрын

    For reflective surfaces you could creating a NERF rather than using photogrammetry.

  • @kiiyll
    @kiiyll11 ай бұрын

    I hope something like this eventually comes to AMD GPUs. Haven't had an NVIDIA card since the 1050ti.

  • @zmeygavrilych

    @zmeygavrilych

    11 ай бұрын

    It will come to Intel GPUs.

  • @chikokishi7030

    @chikokishi7030

    11 ай бұрын

    time to join the winning side

  • @JGnLAU8OAWF6

    @JGnLAU8OAWF6

    2 ай бұрын

    1050ti is capable enough to run Meshroom

  • @kettch42
    @kettch42 Жыл бұрын

    How would you change this workflow to make a 3D model of something big like a house or garden?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Not much. You'll still want to get pictures evenly around the object. Professionals use a drone for that. If that's not an option, take pictures close and further away from the house. Then, depending on your roof you might not get good reconstruction there. For scaling you could use the length of a wall for example.

  • @axcelleria
    @axcelleria Жыл бұрын

    We can't use Radeon Graphic?

  • @KanzakiZD
    @KanzakiZD Жыл бұрын

    can we use photogrammetry with turntables instead of us rounding the object?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Yes that is possible. For it to work I had to set "Minimal 2D Motion" in the "FeatureMatching" Node. I used a value of 5 but you might have to experiment.

  • @rsstnnr76
    @rsstnnr763 ай бұрын

    How do you take pictures of the bottom of the subject? There's a lot of detail underneath.

  • @DanielJutz

    @DanielJutz

    3 ай бұрын

    I know two ways around that issue. Option A: Mount your object on a pole at a height that allows you to take pictures from above and below. Option B: Perform two scans, one with the object flipped upside down, and merge them digitally. Meshlab has the Alignment tool for that purpose.

  • @phildavis1723
    @phildavis1723 Жыл бұрын

    I was watching the video you referred to at the beginning when I saw yours. I clicked your video at the moment the same scene was showing in his, so I thought I was still on his! Very weird.

  • @wekkimeif7720
    @wekkimeif772011 ай бұрын

    The main idea of 3D scanning is that you don't need to do yourself 3D modelling. As long as it requires doing Topology manually after scanning it's not working as intended. You could 3D model this RC-Car by hand faster than you 3D scan it and then model manually

  • @gadoyw9283
    @gadoyw9283 Жыл бұрын

    A very fascinating thing. Tried myself 30 hrs ago. My thing is still rendering. I guess 70 photos with 108mp is overkill. Has Ryzen 5 1600x, 16gb of DDR4 RAM and Gtx 1060 6 gb to process it.

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    The number of pictures is good but 108mp is a lot ;) Are you stuck at the depth map node? That one took the longest for me. In the depth map node you can set a downscale factor. Try 8/16, the default is 2. On my system 100 images at 18mp took 80 minutes (ryzen 3800xt, 32gb ddr4, 1080TI).

  • @gadoyw9283

    @gadoyw9283

    Жыл бұрын

    @@DanielJutz It was just the first step. It took approx. 65 minutes to process one photo. So at 35 hrs it was around 30 photos out of 68. So i went to make another set of photos xD

  • @robertsimmons9563

    @robertsimmons9563

    Жыл бұрын

    108mp?!? What are you shooting with?

  • @yosyp5905

    @yosyp5905

    Жыл бұрын

    maybe try using a better camera. Picture resolution isn't a good value to judge camera quality, usually they aren't good sensors if they need to market them with 108mp

  • @Tom-ku8bu

    @Tom-ku8bu

    Жыл бұрын

    Algorithmen often work better with less megapixels. Tesla's FSD example work I believe with a 3 or 5 Megapixel cameras. But sure it's not the same for fast real time 3d Images or high quality 3d files

  • @lohikarhu734
    @lohikarhu734 Жыл бұрын

    Any way to do this without a monster graphics accelerator?

  • @janeblogs324

    @janeblogs324

    Жыл бұрын

    Yes, the exact same way with a cheaper GPU

  • @legendboyAni
    @legendboyAni Жыл бұрын

    Try nerf it even work on reflective surface as well

  • @Maisonier
    @Maisonier Жыл бұрын

    I'm still waiting for a good OCR AI that can read old math books and transcribe all the formulas without any issues

  • @oliverer3

    @oliverer3

    Жыл бұрын

    Like handwritten or printed? I feel like tesseract should be able to do it if it's printed. If memory serves there is a language pack for math symbols.

  • @Maisonier

    @Maisonier

    Жыл бұрын

    @@oliverer3 Yes, I have tried Tesseract as well as numerous open-source tools and private software like PDF elements. I have some old scanned books that are no longer available in my country, but they are low-quality images in the form of old PDFs. Unfortunately, I haven't come across a single AI tool that can accurately recognize the text and transcribe it directly into a format like Markdown or LaTeX, especially when it comes to mathematical formulas and other symbols.

  • @oliverer3

    @oliverer3

    Жыл бұрын

    @@Maisonier You could probably use a combination of tesseract and OpenCV to do it then but it would take a decent amount of manual effort to tune it. Plug and play tools are probably not there yet.

  • @Magnymbus
    @Magnymbus11 ай бұрын

    Blender can replace meshlab, and will give you undo support, just gotta use a different workflow.

  • @weirdnewworld1736
    @weirdnewworld1736 Жыл бұрын

    What about taking a video and then splitting it up into a series of still images? Seems like one could get thousands of pics that way?

  • @JGnLAU8OAWF6

    @JGnLAU8OAWF6

    2 ай бұрын

    Photos have higher resolution

  • @notmadeofpeople4935
    @notmadeofpeople493511 ай бұрын

    Any options for AMD cards?

  • @sebastianosewolf2367
    @sebastianosewolf23679 ай бұрын

    Before I use something like meshlab I use blender which is way better for cleaning and also retopo

  • @logicalfundy
    @logicalfundy Жыл бұрын

    Is nVidia strictly required?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Draft Meshing is available which does not need a Nvidia GPU. While it computes faster, the results will always be worse. You can access that Pipeline from File > New Pipeline > Photogrammetry Draft. You will probably want to increase Describer Density and Quality to high or ultra in the Feature Extraction Node.

  • @fontende

    @fontende

    Жыл бұрын

    These days of Ai you can't even test any LLM without Nvidia, forget about cheap notebooks with Intel graphics or AMD trash (their chips are cheap but very bad in support and unreliable, Amd was found in planned obsolescence in graphics chips, so designed defects in Macbooks which massively dying after certain years, I have one of whose).

  • @fxarts9755
    @fxarts9755 Жыл бұрын

    why not just scan with an iphone with the lidar. does all the computing on the phone in the app and puts in scale and even color pretty accurately.

  • @thisisus.504
    @thisisus.50411 ай бұрын

    I got an error message for even thinking about doing this.

  • @kingmasterlord
    @kingmasterlord11 ай бұрын

    take a shot every time he says 'mesh'

  • @Todestelzer
    @Todestelzer Жыл бұрын

    I recommend 3DF Zephyr (there is a free version to try it out) or better buy a good 3D Scanner such as Einscan SP or Einstar from Shining for slightly bigger parts.

  • @Probber

    @Probber

    Жыл бұрын

    I also prefer 3df zephyr, is much much faster imo. Free version used.

  • @theneonbop

    @theneonbop

    Жыл бұрын

    the free version has a limit on the number of images you can use

  • @Todestelzer

    @Todestelzer

    Жыл бұрын

    @@theneonbop yeah but it’s around 70 pictures. Try it out. It’s enough for most projects. I bought the version for 300 pictures in the end because it works.

  • @_specialneeds
    @_specialneeds11 ай бұрын

    What is a much more powerful device. Calipers.

  • @jothain
    @jothain Жыл бұрын

    Seems way too much of a hassle compared to taking couple pictures from different axis and scaling picture to sketchplane and using that and simple measuring of target.

  • @MrRobot-lm2lo
    @MrRobot-lm2lo11 ай бұрын

    AMD 6900xt?

  • @janeblogs324
    @janeblogs324 Жыл бұрын

    4:13 you mean use a decimal as a decimal? Why do Europeans use commas for decimal points?

  • @chrstphrr

    @chrstphrr

    Жыл бұрын

    Why do they use a comma in that case? Because they were already using the period as a thousands separator, of course! :) This sort of thing is quite like the idea of having traffic drive on the left or right hand side of the road as a convention. To be pedantic, it's called a radix point in general, in case you're not using a period, or a comma ... or not using a decimal number system. This issue is a problem of bad localization in MeshLab, and it ought to be raised as a bug with that project so this sort of advice to use a foreign choice of radix point symbol isn't needed anymore.

  • @forbiddenera
    @forbiddenera Жыл бұрын

    "An nvidia gpu" *pulls out a decidedly red card* 😂😂😂

  • @3d_dean975
    @3d_dean975 Жыл бұрын

    0:20 isn't that an AMD Gpu?

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    It's a Nvidia 1080 Ti.

  • @fontende

    @fontende

    Жыл бұрын

    I don't know even any LLM project using anything other than Nvidia, so forget about Amd and never buy their trash - after they deliberately engineering the death of graphics chips in all Macbooks Pro from 2011, which I have, moreover I have two similar models Macbooks, one Nvidia, other Amd and last one died as predicted on forums, a mass time bomb. It's really hard to resurrect macbook after, you're left only with Intel graphics and half power slower notebook. Their chips dying because of overheating, ridiculous.

  • 11 ай бұрын

    Photogrametry sux!

  • @Gromic2k
    @Gromic2k11 ай бұрын

    Danke, aber es wirkt jetzt nicht besser als noch vor ~4 Jahren

  • @did3d523
    @did3d523 Жыл бұрын

    scan with iphone 11 is better

  • @PaulG.x
    @PaulG.x11 ай бұрын

    You don't do your computer any favours including all that paving in the images

  • @DanielJutz

    @DanielJutz

    11 ай бұрын

    I'd say it depends. While it does increase processing time, in my experience it also increases the likelihood of all camera positions being reconstructed successfully.

  • @anzdes219
    @anzdes219 Жыл бұрын

    i love the vid but the result is poor

  • @DanielJutz

    @DanielJutz

    Жыл бұрын

    Better results are possible. Either by taking more pictures or by tweaking pipeline settings. You can find more information here: meshroom-manual.readthedocs.io/en/latest/faq/reconstruction-parameters/reconstruction-parameters.html . For those improvements you will have to accept longer processing times.

  • @anzdes219

    @anzdes219

    Жыл бұрын

    @@DanielJutz but is it better than a manual topo ?

  • @menkiboj
    @menkiboj Жыл бұрын

    i used to do this for fun a long time ago using "123d catch" and later "3DF Zephyr" 😅

  • @mrle0719
    @mrle0719 Жыл бұрын

    Ok I dont want to sound like a dick but how is requiring cuda open source ^^

  • @michaelhicks8603
    @michaelhicks860311 ай бұрын

    I need LiDAR. I need to scan medium to large spaced and retain a high level of detail at mm or sub mm precision. And I need to be able to scan past 20 meters. The issue I have is that everything on the market that can do this starts at $50,000 usd. And goes well north of that. The fact that they can get away with charging this much money in 2023 is a joke. I’m can’t believe that someone hasn’t made something in the $1000-4000 range. And for the love of got please don’t say iPhones or iPads. I’m talking about real scanners.

  • @Max24871
    @Max24871 Жыл бұрын

    > Open Source Photogrammetry > Uses an nvidia only tool on windows. Yeah, right...

  • @JGnLAU8OAWF6

    @JGnLAU8OAWF6

    2 ай бұрын

    And on proprietary CPU, shame on him should be all open source to count!

  • @ronliebermann
    @ronliebermann11 ай бұрын

    This is a research tool, not a production tool. So the guy spends a whole day making just one part. Big deal.

  • @Vaasref
    @Vaasref Жыл бұрын

    Maybe open source but still proprietary thanks to CUDA so unavailable for anyone not wanting to support the contender for the worst tech company.

  • @SLPCaires
    @SLPCaires Жыл бұрын

    but meshlab sucks soooo bad, sooooooo bad....

Келесі