how can we create 3d asset from a product image? and insert that to an existing video?
@wintorartour3 ай бұрын
Creating a 3D model from a single image is really experimental. There are different tools for that, but I haven't found anything that I really like.
@FlockofSmeagles7 ай бұрын
CombineRealities Northstar. Buy and build those. They are the only XR HMD worth using.
@wintorartour3 ай бұрын
We'll keep it in mind ;)
@frankrooij578210 ай бұрын
Cool!
@wintorartour9 ай бұрын
Thank you!
@UgurEnginDeniz10 ай бұрын
Both nerf and photogrammetry starts from a point cloud. Both can be meshed.
@wintorartour9 ай бұрын
But still very different technologies!
@UgurEnginDeniz9 ай бұрын
Yes. Photogrammetry is like a brute force approach and has been around for quite a while. It will stay so, because NERF's data augmentation is not desired and can be against accuracy in some cases. Both are brilliant technical ideas and implementations@@wintorartour
@longhi817510 ай бұрын
Besides Windor is there another app to an easyer way?
@wintorartour10 ай бұрын
If you don’t need the functionality to create AR tours, you can use any other AR platform basically.
@nandingpanelo11 ай бұрын
Is this free to explore use?
@wintorartour11 ай бұрын
Yes, you can start with a 14-day free trial at web.wintor.com
@nandingpanelo11 ай бұрын
Nice. I Learn a lot plus I subscribe like and follow you
@wintorartour9 ай бұрын
Thank you! We appreciate that!
@RR-gx4ec11 ай бұрын
The main interesting thing about NeRFs is the ability to capture view-dependent lighting (reflections). And then Luma Labs goes "look, you can export NeRFs to your favorite 3D software like Blender and Unreal!" The trick? They never mention that all reflection information is gone once you do that. A waste of time.
@wintorartour11 ай бұрын
But after seeing the video, you know why the reflection is gone!
@juanestrella6975 Жыл бұрын
Thanks!
@wintorartour Жыл бұрын
You're welcome!
@JasonSipe16 Жыл бұрын
Thanks for this video. It has come a long way in less than a year! Also, Luma Ai has a new UE5 Plugin!
@wintorartour Жыл бұрын
Indeed that looks very interesting. Lots has happened since we shot this video
@mario_vasquez_ Жыл бұрын
after watching a few videos I think I am finally understanding what NeRFs are. from the videos I have seen it is within Luma where it is real-time "3D models" like Unreal, with lighting and reflections
@wintorartour Жыл бұрын
It has gotten a lot better since this video!
@SuperAnirock Жыл бұрын
NeRF scans also convert into 3D model and work in AR/VR applications........with better output :)
@wintorartour Жыл бұрын
It is getting better, but those models cannot be called NeRF anymore. It uses nerf to get there and indeed, with better results nowadays!
@bensmirmusic Жыл бұрын
will NeRF be able to generate a 3D environment from a midjourney 2d art ?
@wintorartour Жыл бұрын
I am not sure about that. Probably not.
@eriksteinmeyer Жыл бұрын
Fantastic!
@wintorartour Жыл бұрын
Great to hear Erik! Are you going to try it?
@robindelange Жыл бұрын
Great work guys!
@wintorartour Жыл бұрын
Thanks Robin!
@VirtualshopX Жыл бұрын
En weer kom ik Nijmegen tegen…
@wintorartour Жыл бұрын
Leuk toch? Binnenkort zal daar een tour zijn!
@utsanda Жыл бұрын
thanks for the explanation
@wintorartour Жыл бұрын
You’re welcome! Make sure to subscribe of course!
@iamvartist Жыл бұрын
LUMA is not on Android yet right?
@wintorartour Жыл бұрын
I don’t think so :(
@googleyoutubechannel8554 Жыл бұрын
It's sort of surprising how far behind real 3d geometry generation is compared with raster generation from diffusion models. As this doesn't feel like a particularly hard problem compared with say MJ 5, I sort of suspect the lack of performance in 3d generation is because most AI researchers do not understand 3d geometry well enough to have smart ideas for an approach to ml model design, and I would guess specifically struggle for smart ideas for a loss function framework (probably the most critical), so they've probably only tried a million or so model ideas, rather than the billions of attempts at 2d that have led to modern diffusion techniques through much more trial/error.
@wintorartour Жыл бұрын
I am also surprised it doesn’t to better. But of course we should not compare 2D generation with 3D generation: it’s much more complicated
@vincentchambin48926 ай бұрын
true
@benarmony1532 Жыл бұрын
Short and informative. Thank you! Great video👍
@wintorartour Жыл бұрын
Thank you! Keep an eye out for new videos and subscribed to not miss anything :)
@hardikadoshi3568 Жыл бұрын
which one can we use for scanning environments like office or home interior for using in VR?
@wintorartour Жыл бұрын
Both actually nowadays. But Polycam would be a little easier to light and change later. But luma recently announced a new version which makes it easier to include in VR projects.
@nightmisterio Жыл бұрын
I wish to get good 3D models with these...
@wintorartour Жыл бұрын
You should try, they might have become better now!
@Gerhard_Schroeder Жыл бұрын
Have you tried the zapbox or Holokit X? :) Regards from a German AR-Channel :)
@wintorartour Жыл бұрын
Not yet! Should we try it?
@Gerhard_Schroeder Жыл бұрын
@@wintorartour Have both here... Holokit X is ok. No API....
@Gerhard_Schroeder Жыл бұрын
I wait for... Apple. ;)
@wintorartour Жыл бұрын
Us too, that will get exciting!
@nickhockings443 Жыл бұрын
Err, no. "photogrammetry" means _any_ method that measures things light. NeRF is a new technique of photogrammetry.
@wintorartour Жыл бұрын
Thanks for the comment. With NeRF you actually don't measure anything. It's basically a trained AI model with the aim to show a 3D representation based in an image sequence as input. As the video tells.
@nickhockings443 Жыл бұрын
@@wintorartour what NeRF measures is the radiance field, which is a continuous model of what parts of the volume emit or absorb light. The MLP acts as a fuction approximator, i.e. a convenient way to represent and fit the model, by measuring the photometric error between the observed training images and the predicted images generated by the radiance field that the MLP represents. NB 1) a voxel grid, a depth map, a radiance field, or a collection of smoothed particles are all models, which measure the geometry and properties of a space. NB 2) AI is an application of mathematics. There is no magic (even if it may feel otherwise ; ) .
@bgirvine1234 Жыл бұрын
The meta quest pro, pico and vive headsets are virtual reality headsets and DO NOT have any Augmented reality features Augmented reality devices are devices in which you can see and interact with the real world in such a way that if you where to be walking around your home you could look at a cupbord or fridge and see what you have in them or in the case of the MINI Ar glasses they are linked to cameras around the car so that you can see through your blind spots and can also be used in navigation when driving, Virtual reality headsets on the other hand are enclosed with no access to the real world you cannot see anything of the real world around you and have to interact within a virtual space as such you could not walk around (except in a virtual space) with these on as you wouldn't be able to see stairs or anything that is on the floor which could cause you to have an accident and I am sure if you where driving around with these on you wouldn't get anywhere with with a court as you wouldn't be able to see anything around you to look out for dangers
@wintorartour Жыл бұрын
Hey Barry thanks for the comment. Actually, these devices do have AR functionalities and are also used for the cases you mention. Indeed VR is enclosed, but these devices now also use the camera for AR functionalities.
@alansalamm7739 Жыл бұрын
seems kinda fishy to meeee
@wintorartour Жыл бұрын
🐟 Does it?
@shaahkars Жыл бұрын
Hi , so the user can access this particular interaction over a web page on the mobile ? Or do they need to download an app ? Thanks ...great demo btw.
@wintorartour Жыл бұрын
In order to create an AR tour, you use the website web.wintor.com to upload your content and manage tours. You use the app 'Wintor AR tours' from the stores to create the actual tour at a location! Hope it helps and thanks for the comment. There is a free trial if you want to try (just go to web.wintor.com)
@mkfremkglmfekwgnkr1727 Жыл бұрын
+1 for the duck ,we knew you could do it buddy
@wintorartour Жыл бұрын
The duck says QUANCK YOU!
@sockmonkeymovie Жыл бұрын
Wat leuk! Ik ga binnenkort zeker kijken.
@wintorartour Жыл бұрын
Laat ons zeker weten wat je ervan vond!
@sockmonkeymovie Жыл бұрын
very nice
@wintorartour Жыл бұрын
A fun way to onboard new employees :D
@NijelHunt1200 Жыл бұрын
How long did it take to generate the model? A few minutes?
@wintorartour Жыл бұрын
Too long ;) No just kidding, but about 30 - 40 minutes :o
@RpgBlasterRpg Жыл бұрын
I'm curious what it could do with a (Image reference to 3D Model)
@wintorartour Жыл бұрын
Currently it only supports text prompts. However another startup kaedim3D does this!
@RpgBlasterRpg Жыл бұрын
@@wintorartour I think that kaedim3D is a scam, kzread.info/dash/bejne/qXaTsNedd66xqKw.html kzread.info/dash/bejne/lqKrprKFfN3gdbg.html
@wintorartour Жыл бұрын
A scam! 😅😅 oh noooo haha.
@ezearo Жыл бұрын
How long did you have to wait for your invite? I've been on the imagine waiting list for nearly a month now
@wintorartour Жыл бұрын
The waiting list can take a long time, but I am not sure what you should expect. Sorry!
@wintorartour Жыл бұрын
Ga jij binnenkort ook naar het Nationaal Militair Museum om de AR-tour te volgen?
@ozibuyensin Жыл бұрын
i am sorry if this is dumb but does this means we can use nerf created images and volumes to create a more detailed 3d model using the classic photogrammetry method? I am sure we will see more creative uses of it once its open for people to use but other that and potential social media usage, nerf's area of utilization seems pretty narrow compared to photogrammetry.
@wintorartour Жыл бұрын
I was thinking that too and I believe the exporting tools to get a GLB for example is already doing that. However, photogrammetry algorithms don't work nicely with reflections and such. Therefore, it might not work as expected. One great use case is using Nerfs to create video shots!
@xtraeone59477 ай бұрын
@@wintorartour I think work is already going on with Nerf for video shots .
@podermanifiesto18 Жыл бұрын
What’s the name of the app and If I can find this in the IOS App Store.
@wintorartour Жыл бұрын
I used the following apps: Polycam, LUMA (only on invite) and Wintor AR tours. Polycam and LUMA are only available on iPhone maybe, not sure. Wintor AR Tours is available on any device. Have a great day!
@lexdebullet Жыл бұрын
Damn the green screen looks surprisingly easy, gotta try that some time
@wintorartour Жыл бұрын
You should do that! Canva + Wintor AR, you can find it in de stores already.
@JG-vl4ig Жыл бұрын
Great content. Thanks for sharing!
@wintorartour Жыл бұрын
Sure thing! Make sure to be subscribed too :)
@musabkara1684 Жыл бұрын
Really nice. Where can I download the app :)
@wintorartour Жыл бұрын
You can download our app via the stores and the examples in the video by searching for them. They do mostly work on iphone I presume :o
@werser2222 Жыл бұрын
Really awesome!
@wintorartour Жыл бұрын
Thanks!
@leongroothaar9137 Жыл бұрын
Nice!
@wintorartour Жыл бұрын
We like nice :)
@MojiOstad Жыл бұрын
That looks cool! Thanks for great videeo
@wintorartour Жыл бұрын
Thank you Mojtaba! Which avatar did you like most?
@Draconic404 Жыл бұрын
Those two apps seem to not be available on android, what are some alternatives for both types of 3d scanning?
@wintorartour Жыл бұрын
Interesting that they are not available on Android. I found this online, maybe that will help you: all3dp.com/2/best-3d-scanner-app-iphone-android-photogrammetry/
@Draconic404 Жыл бұрын
@@wintorartour luma ai is not on android but polycam is, my phone seems to not support it that's why it wasnt on the play store for me
@Draconic404 Жыл бұрын
@@wintorartour luma ai is not on android but polycam is, my phone seems to not support it that's why it wasnt on the play store for me
@dietrichdietrich7763 Жыл бұрын
Thank You! 3D career 😁 Here I come! #Ikuzo #Yoshi
@levexisАй бұрын
woof
@pixperfect5834 Жыл бұрын
What's that app you used for AR
@wintorartour Жыл бұрын
To view the AR content we used our own app Wintor. It'll launch in three weeks, but you can get the bèta already by going to wintor.app/
@mrspazzout1 Жыл бұрын
Nerf was new to me but looks like it has a lot of room to grow as the ML models get better over time. Very clear explanation, thanks!
@wintorartour Жыл бұрын
Great to hear Merijn. It’s definitely worth checking out and might be of huge help in some projects. Glad you liked the explanation. Definitely subscribe if you don’t want to miss other topics about AR and VR.
@jimj2683 Жыл бұрын
One day machine learning will become so good that you could feed it all the photos on the internet and you would get an accurate 3d model of the entire planet with all the people on it (at least those with facebook/instagram images..)
@JG-vl4ig Жыл бұрын
Wow great video!
@wintorartour Жыл бұрын
Glad you enjoyed it. Have you subscribed also for our future content?
@jussik1011 Жыл бұрын
You make high quality content yet you still dont get many views and stuff like that. Good Luck!
@wintorartour Жыл бұрын
Not yet, but we are growing. Thanks for the support! Have you subscribed already?
@jussik1011 Жыл бұрын
@@wintorartour Now I have!
@wintorartour Жыл бұрын
What are your thoughts? Let us know in the comments.
Пікірлер
how can we create 3d asset from a product image? and insert that to an existing video?
Creating a 3D model from a single image is really experimental. There are different tools for that, but I haven't found anything that I really like.
CombineRealities Northstar. Buy and build those. They are the only XR HMD worth using.
We'll keep it in mind ;)
Cool!
Thank you!
Both nerf and photogrammetry starts from a point cloud. Both can be meshed.
But still very different technologies!
Yes. Photogrammetry is like a brute force approach and has been around for quite a while. It will stay so, because NERF's data augmentation is not desired and can be against accuracy in some cases. Both are brilliant technical ideas and implementations@@wintorartour
Besides Windor is there another app to an easyer way?
If you don’t need the functionality to create AR tours, you can use any other AR platform basically.
Is this free to explore use?
Yes, you can start with a 14-day free trial at web.wintor.com
Nice. I Learn a lot plus I subscribe like and follow you
Thank you! We appreciate that!
The main interesting thing about NeRFs is the ability to capture view-dependent lighting (reflections). And then Luma Labs goes "look, you can export NeRFs to your favorite 3D software like Blender and Unreal!" The trick? They never mention that all reflection information is gone once you do that. A waste of time.
But after seeing the video, you know why the reflection is gone!
Thanks!
You're welcome!
Thanks for this video. It has come a long way in less than a year! Also, Luma Ai has a new UE5 Plugin!
Indeed that looks very interesting. Lots has happened since we shot this video
after watching a few videos I think I am finally understanding what NeRFs are. from the videos I have seen it is within Luma where it is real-time "3D models" like Unreal, with lighting and reflections
It has gotten a lot better since this video!
NeRF scans also convert into 3D model and work in AR/VR applications........with better output :)
It is getting better, but those models cannot be called NeRF anymore. It uses nerf to get there and indeed, with better results nowadays!
will NeRF be able to generate a 3D environment from a midjourney 2d art ?
I am not sure about that. Probably not.
Fantastic!
Great to hear Erik! Are you going to try it?
Great work guys!
Thanks Robin!
En weer kom ik Nijmegen tegen…
Leuk toch? Binnenkort zal daar een tour zijn!
thanks for the explanation
You’re welcome! Make sure to subscribe of course!
LUMA is not on Android yet right?
I don’t think so :(
It's sort of surprising how far behind real 3d geometry generation is compared with raster generation from diffusion models. As this doesn't feel like a particularly hard problem compared with say MJ 5, I sort of suspect the lack of performance in 3d generation is because most AI researchers do not understand 3d geometry well enough to have smart ideas for an approach to ml model design, and I would guess specifically struggle for smart ideas for a loss function framework (probably the most critical), so they've probably only tried a million or so model ideas, rather than the billions of attempts at 2d that have led to modern diffusion techniques through much more trial/error.
I am also surprised it doesn’t to better. But of course we should not compare 2D generation with 3D generation: it’s much more complicated
true
Short and informative. Thank you! Great video👍
Thank you! Keep an eye out for new videos and subscribed to not miss anything :)
which one can we use for scanning environments like office or home interior for using in VR?
Both actually nowadays. But Polycam would be a little easier to light and change later. But luma recently announced a new version which makes it easier to include in VR projects.
I wish to get good 3D models with these...
You should try, they might have become better now!
Have you tried the zapbox or Holokit X? :) Regards from a German AR-Channel :)
Not yet! Should we try it?
@@wintorartour Have both here... Holokit X is ok. No API....
I wait for... Apple. ;)
Us too, that will get exciting!
Err, no. "photogrammetry" means _any_ method that measures things light. NeRF is a new technique of photogrammetry.
Thanks for the comment. With NeRF you actually don't measure anything. It's basically a trained AI model with the aim to show a 3D representation based in an image sequence as input. As the video tells.
@@wintorartour what NeRF measures is the radiance field, which is a continuous model of what parts of the volume emit or absorb light. The MLP acts as a fuction approximator, i.e. a convenient way to represent and fit the model, by measuring the photometric error between the observed training images and the predicted images generated by the radiance field that the MLP represents. NB 1) a voxel grid, a depth map, a radiance field, or a collection of smoothed particles are all models, which measure the geometry and properties of a space. NB 2) AI is an application of mathematics. There is no magic (even if it may feel otherwise ; ) .
The meta quest pro, pico and vive headsets are virtual reality headsets and DO NOT have any Augmented reality features Augmented reality devices are devices in which you can see and interact with the real world in such a way that if you where to be walking around your home you could look at a cupbord or fridge and see what you have in them or in the case of the MINI Ar glasses they are linked to cameras around the car so that you can see through your blind spots and can also be used in navigation when driving, Virtual reality headsets on the other hand are enclosed with no access to the real world you cannot see anything of the real world around you and have to interact within a virtual space as such you could not walk around (except in a virtual space) with these on as you wouldn't be able to see stairs or anything that is on the floor which could cause you to have an accident and I am sure if you where driving around with these on you wouldn't get anywhere with with a court as you wouldn't be able to see anything around you to look out for dangers
Hey Barry thanks for the comment. Actually, these devices do have AR functionalities and are also used for the cases you mention. Indeed VR is enclosed, but these devices now also use the camera for AR functionalities.
seems kinda fishy to meeee
🐟 Does it?
Hi , so the user can access this particular interaction over a web page on the mobile ? Or do they need to download an app ? Thanks ...great demo btw.
In order to create an AR tour, you use the website web.wintor.com to upload your content and manage tours. You use the app 'Wintor AR tours' from the stores to create the actual tour at a location! Hope it helps and thanks for the comment. There is a free trial if you want to try (just go to web.wintor.com)
+1 for the duck ,we knew you could do it buddy
The duck says QUANCK YOU!
Wat leuk! Ik ga binnenkort zeker kijken.
Laat ons zeker weten wat je ervan vond!
very nice
A fun way to onboard new employees :D
How long did it take to generate the model? A few minutes?
Too long ;) No just kidding, but about 30 - 40 minutes :o
I'm curious what it could do with a (Image reference to 3D Model)
Currently it only supports text prompts. However another startup kaedim3D does this!
@@wintorartour I think that kaedim3D is a scam, kzread.info/dash/bejne/qXaTsNedd66xqKw.html kzread.info/dash/bejne/lqKrprKFfN3gdbg.html
A scam! 😅😅 oh noooo haha.
How long did you have to wait for your invite? I've been on the imagine waiting list for nearly a month now
The waiting list can take a long time, but I am not sure what you should expect. Sorry!
Ga jij binnenkort ook naar het Nationaal Militair Museum om de AR-tour te volgen?
i am sorry if this is dumb but does this means we can use nerf created images and volumes to create a more detailed 3d model using the classic photogrammetry method? I am sure we will see more creative uses of it once its open for people to use but other that and potential social media usage, nerf's area of utilization seems pretty narrow compared to photogrammetry.
I was thinking that too and I believe the exporting tools to get a GLB for example is already doing that. However, photogrammetry algorithms don't work nicely with reflections and such. Therefore, it might not work as expected. One great use case is using Nerfs to create video shots!
@@wintorartour I think work is already going on with Nerf for video shots .
What’s the name of the app and If I can find this in the IOS App Store.
I used the following apps: Polycam, LUMA (only on invite) and Wintor AR tours. Polycam and LUMA are only available on iPhone maybe, not sure. Wintor AR Tours is available on any device. Have a great day!
Damn the green screen looks surprisingly easy, gotta try that some time
You should do that! Canva + Wintor AR, you can find it in de stores already.
Great content. Thanks for sharing!
Sure thing! Make sure to be subscribed too :)
Really nice. Where can I download the app :)
You can download our app via the stores and the examples in the video by searching for them. They do mostly work on iphone I presume :o
Really awesome!
Thanks!
Nice!
We like nice :)
That looks cool! Thanks for great videeo
Thank you Mojtaba! Which avatar did you like most?
Those two apps seem to not be available on android, what are some alternatives for both types of 3d scanning?
Interesting that they are not available on Android. I found this online, maybe that will help you: all3dp.com/2/best-3d-scanner-app-iphone-android-photogrammetry/
@@wintorartour luma ai is not on android but polycam is, my phone seems to not support it that's why it wasnt on the play store for me
@@wintorartour luma ai is not on android but polycam is, my phone seems to not support it that's why it wasnt on the play store for me
Thank You! 3D career 😁 Here I come! #Ikuzo #Yoshi
woof
What's that app you used for AR
To view the AR content we used our own app Wintor. It'll launch in three weeks, but you can get the bèta already by going to wintor.app/
Nerf was new to me but looks like it has a lot of room to grow as the ML models get better over time. Very clear explanation, thanks!
Great to hear Merijn. It’s definitely worth checking out and might be of huge help in some projects. Glad you liked the explanation. Definitely subscribe if you don’t want to miss other topics about AR and VR.
One day machine learning will become so good that you could feed it all the photos on the internet and you would get an accurate 3d model of the entire planet with all the people on it (at least those with facebook/instagram images..)
Wow great video!
Glad you enjoyed it. Have you subscribed also for our future content?
You make high quality content yet you still dont get many views and stuff like that. Good Luck!
Not yet, but we are growing. Thanks for the support! Have you subscribed already?
@@wintorartour Now I have!
What are your thoughts? Let us know in the comments.