Converting reality to racing game track, tutorial
Ойындар
In this tutorial I am showing how you can create 3d model of a real world road. For reconstruction I am using photogrammetry software Reality Capture.
second part of the tutorial: • Photogrammetry to Asse...
Background music by: / velizarpetrovic
00:00 Intro
00:21 Taking photos
02:43 Extracting frames from a video
08:08 Downscaling images
09:15 Masking in Photoshop
11:48 Beginning with reconstruction in Reality Capture
14:15 Control points
18:20 Reconstructing in segments
21:15 Merging components
25:00 Reconstructing
27:55 Cleaning the mesh
28:58 Smoothing road polygons
30:51 Texturing
31:54 Exporting completed reconstruction
Пікірлер: 400
Gents, we've just witnessed the birth of a new age of modding in sim racing.
@KingENDLESS
2 жыл бұрын
Finna go do donuts at an intersection in my town 😂😂😂
@jandersen6802
2 жыл бұрын
We could crowdsource 3d scans to build the entire Earth in 3d and make games like GTA, Forza or Flight simulator. It could be a combination of dashcams, drones or smartphones.
@jandersen6802
2 жыл бұрын
And lots of the detailing/cleaning up could be done by AI.
@DoctorTauri
2 жыл бұрын
@@KingENDLESS FACTSSSSSS HAHAHAHA
@lauroneto3360
2 жыл бұрын
Or any game actually
as a 3d artist and a petrol guy i can say one thing : you have all my respect for the job, that's crazy and pretty cool.
@MetallicaDamnRocks
2 жыл бұрын
This is awesome. I worked with photogrammetry everyday to reconstruct buildings on sub millimeter levels. Be it in dense clouds or textured mesh. I know the insane amount of troubles you always run into. That said, while the detail and accuracy is quite low, this still is an amazing reconstruction of a huge area. Well done, my respect. Imagine doing this with a drone like the skydio (x)2. It flies autonomous and specialises in photogrammetry.
Damn. Because of your dream to have a sim track in your city and your work, everyone can fulfill the same dream now with their city. You're a legend.
you're doing this all manually, but I can imagine in maybe 3 years there being a program where you could give it a source video and it will make the track for you. you're pioneering something amazing
@dany080
2 жыл бұрын
There is already a software that does that :D Not as good as he did it manually, but it does it with only a front view video and all by itself. So, maybe with a 360 cam and a few years it will be easy to recreate any location.
@abdullahgun
2 жыл бұрын
@@dany080 which software is that bro?
@ExcaliburGamingYT
2 жыл бұрын
@@dany080 That sounds interesting, what is the software called?
@gologlaser5946
2 жыл бұрын
@@dany080 what is the software called?
@FabMeca
2 жыл бұрын
What's the software
You are definately on the forefront of making childhood(and racers) dreams possible in the sims... wow, just wow. That's A LOT of work and love! Did you use a gimbal for steady picture on the bike?
@lipsach
2 жыл бұрын
It is hard mounted to the handlebar.
@DoctorTauri
2 жыл бұрын
@@lipsach I love your money saving approach!
@thecompanioncube4211
2 жыл бұрын
@@DoctorTauri software stabilization works much more cost effectively and well enough nowadays to buy gimbals. Of course gimbals would give better results but... Eh? This is good enough!
@MOOOHA
2 жыл бұрын
@@thecompanioncube4211 nobody asked
@0divide136
2 жыл бұрын
@@MOOOHA what
Shit, I had never thought of the importance of masking in this process. I've been doing some amateur work with Metashape and RealityCapture, and never gave that much thought (or the required time, which is quite significant). Thanks for the detailed breakdown, I ended up learning a couple of tips.
@banaana1234
2 жыл бұрын
I immediately thought that the masking process could be automated with a rather simple image recognition program. I have a bit of basic programming knowledge and could probably do it with some time and thought, but someone who knows what they are doing could would be done in a day. You basically need to go through all images and recognize all the cars, which is pretty trivial, there is plenty of free solutions for that. After that you just need to mask the area of said cars, which is again simple. You wouldnt even need to be too precise with it, even though that is also completely possible.
@coffee2862
2 жыл бұрын
@@banaana1234 are you currently planning on working on a program like that ?
@banaana1234
2 жыл бұрын
@@coffee2862 Not really planning, but it has been on my mind from time to time. I threw the comment out there to see if someone with more skill would do it so I wouldn't have to :D I guess that I'll eventually get tired of waiting.
I didn't expect a new video from this channel but i'm very happy it happened. Thanks, i always wanted to recreate parts of my city to implement in a game and this video will greatly help :D
@MOOOHA
2 жыл бұрын
Post it if u make something even if it turns out to be completely garbage
I think this technique is the most accurate one to reproduce real track, it recreate the track with every single detail of road curvature and beside of that it reproduce all the elements of the environement with their texture, after that you can do retopology for every model in 3d software to make them look better and clean, it will take too much time of course but it's worth it ! Thank you for this video you are a true genius !
@gekfurian
2 жыл бұрын
There are no efficient retopolgy algorithms to this day, not that I know. I have had this discussion with many clients over the years.
@alexsib444
2 жыл бұрын
nope laser scanning will always be more accurate than this
@voke4553
2 жыл бұрын
Laser scanned race tracks will be 10x more accurate
@pancake5830
2 жыл бұрын
def not, this has none of the road detail that laser scans have, i think it might be good for texturing though.
@H3llHoundd
2 жыл бұрын
For texturing yes it would be amazing. But in regards to the topology it will not be accurate.
I'm going ti make a lot of mountain roads with this big help, THANKS!!
@Snakeplayerp
2 жыл бұрын
I’ll drive them! 😄
I'm sure you should be able to make a good living from offering your services to private individuals, or crowd funded groups, who want to play race games in their home towns. Local councils and cities would also love to be able to have virtual tours of their cities. It is incredible what you have achieved, I am stunned...
I loved the Lada spotting montage at the end, ngl 😂
It should be known as the "ISavic Technique". You are on your way to becoming a sim racing legend.
the road will still not be down to the millimeter like with laser scanning but then imagine these two technologies in their peak. exciting times to be alive. thank you for your work brother!
This is extremely cool, thank you for giving such a detailed explanation of how you do this. This is the stuff of childhood dreams
You are a Genius! This will revolution the racing games! Congrats!
That's insane! The process is surely very hard. Me a person without this knowledges, seeing this feels so complicated but i enjoy watching you go through the process of creating it!
Amazing job. My wife thought I was too nerd, so I showed her this video.
There are some clips on KZread that deserve 1000 likes, this is one of them
ah yes, a follow up! That's some real work you're pulling here, keep it up! And thanks for sharing :)
I have never done anything related to that, but that was truly fascinating and interesting. Very well explained and structured video. Thank you for sharing and keep up the great work!
You are a wizard
Thanks for sharing / documenting the workflow so everyone can recreate it.
Magnificent work! Thank you so such for sharing your process and best practices
Legenda, sva čast! A najbolji je kraj sa kompilacijom svih Lada Niva :D
What an awesome work, man! Congratulations for the talent, dedication and the sharing
Amazing work, bravo!
So much stuff you needed to figure out to do this! WoW! Just wodnloading your track to test it! Amazing! You should definitely open a patreon page and let people fuel your passion!
Im pretty sure if I ever made this in my hometown I just modell all the shit. This amount of work is not human. Congratulation.
Your an actual genius dude, this is so sick!
Amazing effort! Inspiring, now I want to try it my self 😀
Hvala ti puno na ovom videu! Svaka čast!
Oh man, really impressive! Thank you very much, this will help me a lot! Cheers!
Thank for the detailed explanation, seriously committed effort.
Very cool video, a pretty in depth tutorial for free. Also your English is pretty clear even without subtitles, so good job!
That's tremendous amount of work. Take my respect
Thank you for your effort, I know this is so hard to do, but I really appreciate your passion and your job! Blessings for you from Mexico!
YOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO thank you, legend. Photogrammetry is the future of sim racing.
I have no words, this is simply amazing, might have to buy the game just to test your track lol.
i hope you are doing good in these crazy times! stay strong.. wish u all the best
You sir have a lot of patience to go through all this. That's also a great result
This is what I wanted for so long thanks man
Wow amazing! I only hope that one day I stop feeling stressed out from every day things that I take the time and try this for my own area. Thank you so much for this detailed explanation!
@Inexpressable
2 жыл бұрын
hey man, i'm hoping that things become more relaxed for you, best of luck
Fantastic work. The effort, time, research, self-education and dedication by driving and flight sim modders is incredible. All that work for little-to-no monetary gain.
Great workflow. I have a fun your track :)
Incredible, congratulations on this job!
So cool, thanks for the tutorial!
thank you for the comprehesive tutorial!
Excellent work!
Hats off to you matey for all the work
Man! amazing work. Congrats :)
appreciate the Lada compilation on the end 👍
I love you, been waiting for this
omg this is crazy amount of effort, you are a madman
Bravo. Fantastičan posao si odradio.
Ivčo, kidaš, jako iz sve snage! 👏👏👏
Holy shit this is insane! Amazing job !
A Genius at work !👍🏼
This video is very important, really. We could create a race track for every place in the world we know. It's like a dream come true, always dream to ay GTA on my city and now is possible. Very good explained. I am suscribing to your channel just because you deserve it. Thanks!!
Subscribed instantly after watching this, THIS IS INSANE! CONGRATZ BRO! > Show us more
We are gonna get some crazy games in the future, it's no time yet to quit being a gamer
oh god the masking of 10000 images , you are crazy:D
simply amazing. bravo !
loving the videos please keep uploading your job is superb!
bravo genie,ovo je odlicno,samo napred
Amazing work my friend!
Ty for the tutorial!!!!
@Machacador1996
2 жыл бұрын
I'm waiting the Next tutorial to continue my proyect!! See u soon!!
Incredible work man. Respect..
Just outstanding!
this is really cool!
Respect bro for all the hard work💪
You sir, are a wizard!
Brate znam da ti često govore "svaka čast" ali šta ću. 😁 Svaka čast. Ovo je ludilo. Mogući početak nove foto realističke ere.
thx for this tutorial i'm gonna try it :)
Svaka cast za trud, rad i tutorial! Poz iz Krusevca
Just discovered that you were the creator of the first photo-scanned map in BeamNG! Congrats! The result looks really good!
Vrlo zanimljivo, svaka cast!
I subscribed and liked the video. I love Assetto and sim racing.
Svaka čast, ovo je čudo !!!
Wow great work man
WOW! This is so dope!
he simply explains us how all the programmers do the work... id say from now on its just a matter of time that we see lots of so called "amateur" games and stuff...
This is incredible!
I can make race track with blender for asseto corsa... but this us just next level! Great work,
This is amazing. There are companies that would pay STONKS for you to do this for them.
@MetallicaDamnRocks
2 жыл бұрын
Lots of game Developers already use photogrammetry and laserscanning techniques. I think the Notre Dame in Assassins Creed is a great example. The model was even used for reconstruction after de fire i believe.
man this looks soo cool but i didnt have da patience to do this :D hopefully were getting now more assetto corsa tracks :D
You should be getting paid for this. Amazing work
Istripovah se kad videh Knjazevac u 3d-u. Nice job mate :D
Pretty rough mesh but I'm sure it can be fixed with lot of work and knowledge. PERFECT JOB anyway!!!
Almost sure you can program something to automate the masking of non-stationary objects with OpenCV and optical flow. I think it's called motion segmentation. Also there are parts of object recognition algorithms that could be used to find and match better control points automatically.
@lipsach
2 жыл бұрын
Well, I expect RC to implement some of the methods for better matching points. I'll check some of those methods for automated masking, never programmed something similar before.
This is really cool thx
Epic channel!
Brate svaka ti cast ⚡👊⚡
Druže, svaka ti čast
Thanks you for explaining!
Great work! A huge amount of time was spent but it worth.
Very interesting, I had the same idea, but more in a laser scanning way. Maybe you can use the data for a laser scanned version? I mean you should now have a very detailed road mesh. Great work overall! You could record racetracks with the same method. And lada niva is a cool car hehe
Nice CR tutorial!!!
Insane!
Nice now I can create a Pancevo track :D
This is such a great video..