Blending realities with the ARCore Depth API - Deep Dive
Ғылым және технология
The new ARCore Depth API allows you to create a depth map with our depth-from-motion algorithms and a single camera. Unlock capabilities like occlusion, realistic physics, particle effects, and more.
Links:
Read more on the blog → goo.gle/ARCore-Depth-API
Find more about ARCore → goo.gle/2PyLEqn
Subscribe to Google Developers → goo.gle/developers
Пікірлер: 301
Yup, this is what everyone wanted. Almost anything interesting requires depth. Without it you're stuck with gimmicks. This looks awesome
@azrael6280
4 жыл бұрын
Imagine Counter Strike
@mihnealazar7039
4 жыл бұрын
Something very similar has been available on the iPhone for more than 6 months.
@matthewhall319
4 жыл бұрын
@@mihnealazar7039 only for people
@azrael6280
4 жыл бұрын
@@mihnealazar7039 game name?
@mihnealazar7039
4 жыл бұрын
Azrael well, if you have an iPhone you can search “AR quick look” in Safari and you will find some models to place in your room with people occlusion. Also, there are some games and apps, like “ARise” but some are free some are not.
So Google finally gets back to the issue of depth for the first time since Project Tango was mothballed.
@yeetusfetus8687
4 жыл бұрын
I think it was a matter of waiting for processing speed to catch up with the other sensors, and have it available to a wide enough audience that developers would come develop for it (which I imagine was a painpoint for tango)
@saulghim2661
4 жыл бұрын
The return to using a dedicated depth sensor seems inevitable eventually, at least for real time occlusion for all types of moving objects.
@yeetusfetus8687
4 жыл бұрын
@@saulghim2661 for now there's an "acceptable" quality of occlusion which is passable for just fun
@nadeemshaikh7863
4 жыл бұрын
@@saulghim2661 I think Google will release a Pixel with Project Tango soon, just like they did Project Soli.
@mechadense
3 жыл бұрын
@@yeetusfetus8687 -- I think it was a matter of ARCore (barely) working with widespread normal hardware instead of rare expensive specialized hardware plus Apple pressing ahead with a system that uses normal hardware. This got Google spooked and motivated to reallocate development resources. -- With tango being closed source this was to the chagrin of all early adopters (me included) and early external enthusiast developers. A painful massive regression.
Interesting choice of chair at 2:21
2:25 I love how they put real Wireframe over the real object haha
@HAWXLEADER
4 жыл бұрын
@nickxxv i guess it's just a decorative chair they have in that lounge
@luchianno
4 жыл бұрын
Hahaaa
I had to double check on the date for making sure that this isn't an April fool prank.😆
@abhishekanshuwali3808
4 жыл бұрын
Exactly same 😂
@SamsonKing9
4 жыл бұрын
April fool? .. Dude it's December 😏😏
@subliminalvibes
2 жыл бұрын
@@SamsonKing9 154 people are idiots.
I'm using ARCore for my uni project and this is exactly what I needed, thank you so much for adding such an important feature.
@asifkaka5052
4 жыл бұрын
i just found this and my fyp is also on AR this is a game changer
@umairyounas7594
2 жыл бұрын
Hey bro brother I need your help for my Uni project
Wait, this is actually awesome :/ I can already imagine what the future will look like with this feature
Great Work!! Really looking forward to use this.
Whoa, This is so AMAZING! You all have done an geat job! This make AR looks so realistic in a better way
This is what i'm looking for!! Thank you
This is simply AMAZING!
seriously awesome. Great era to live. it generates point cloud and stitch it into a mesh and paste it in real environment with a virtual object. 👌
This is awesome, I'm waiting for people occlusion now!
@username4441
4 жыл бұрын
google is always at work trying to occlude humanity.
When Pokemon Go gets AR it'll have a second boom of popularity.
@nashalone
4 жыл бұрын
can do battle against other people with our pokemon and watch it happen right there
Amazing!! I updated my ar core right now!
This is class.
Very glad to see. Good job google!
OMG! IM SO READY!
This is so cool,can't wait to try this 😃
Mind-blowing
This is awesome Google!
Wow, Bravo This is increíble.
Besides, the amazing API is there a software authoring? I would really love to have everything under one roof. Specially for motion body captures (tracking) and transporting it to .fbx or .abc models. Thanks.
They need to update their logo... the top part should now occlude the sphere!
@username4441
4 жыл бұрын
that would probably interfere with whatever occult symbolism they are using.
Incredible work, can't wait to integrate this into DoodleLens
@pradeepbaskaran30
4 жыл бұрын
Is the DoodleLens app yours? I love the concept
If I had the financial resources I'd be heavily investing in AR technology. It has the potential to revolutionise so many aspects of daily life, in both business and personal life. Really hope I see this technology make an accelerated progress. The possibilities of things like hololens and Google glass are massive, they seem to have been almost discarded?
Google Tango is back. Can't wait for more 3d scanning apps I could use on my Asus Zenfone AR.
so exciting!!!
Tango was way ahead of its time but it required a specific depth sensing hardware. Hope this AI is as effective.
Amazing!
It's so great api !!!
Finallllyyyyyy 😍😍😍😍😍
Yes just what I wanted! When is this coming?
Yups....The Depth Occlusion is working but it lack of depth accuracy....rough edge.... still need improvement because this is awesome if everything work nicely....i understand Google are working hard for this....
Awesome~ 👏👏👏👍👍👍
sick!
At 1:15 raindrops are hitting vertical surface and giving effect like it's hitting on horizontal surface.
finally, depth detection. waiting for Unity lib updated with this feature
I hope Minecraft earth team got a sample of this
@lol-de4lo
3 жыл бұрын
It's getting shut down now
how awesome is that
I would like to see an historical event been present to students using it. It's a bit different than what you have here but not that far. Imagine the scenario of the 1st steps on moon. What about the teacher remotely explaining it to the students and they been able to see themselves there.
Amazing
Depth without TOF really great
great potential, keen to participate in collaborators program, but looks like the program is closed now, will there be a second round ?
love it
thank God already!
please let us know if an ARCore based mobile app can be converted for all android devices.. as in if the developer of the software can use any patch or anything to that software to make it enabled for all android devices.. please help.. also how fast the androids are getting updated with AR Core.. once in a yr or twice a yr or more frequently..
Does this work on truedepth or it's only available on TOS sensors?
Hi very nice feature to add to Ar but when it will be released ? I can't wait to try it in my project :D
can we get any documentation onto how exactly this depth api works?
This has waaaayyyy more potential for VFX artists. Definitely VFX... Maybe a camera app that saves the Zdepth separately- So it can be used in composting.
@oby1
4 жыл бұрын
From that, object recognition. And from that you can make a cryptomatte.
@oby1
4 жыл бұрын
So if your device saves the AR camera movement data - (In to an FBX file) You essentially eliminate the need for camera tracking. 3D track+Zdepth + cryptomatte. That's a VFX artist's dream!
@sircher943
4 жыл бұрын
@@oby1 RTabMap app let's me do that on my Asus Zenfone AR.
Dear Google Developers, will it be possible to recognize objects according to their 3D faceted or CAD model? This capability is available in Vuforia Engine, I think if it were possible, ARCore would steamroll it.
My question would be is there a certain type of phone required for this kind of feature or can it be done with any arcore enabled device? Maybe just two cameras are needed? Definitely doesn’t absolutely need a Tof camera, does it?
@davr1
4 жыл бұрын
it's probably going to be the same as with things like night shift and live transcribing that google claimed to be only working on the latest pixels, but instead after just a few weeks it got ported to hundreds of phones
does Google AR Core getting enabled in all the model of each brand available in India?.. need this information as we are going to build an app using Google AR Core..
I am ready to use the api
When are you realising it ? I am waiting for it
Can we use depth api on "AR optional" apps? My device realme 3 pro only supports AR optional apps. Does depth api works only with devices listed by google on their depth api supported arcore supported devices list. My device does have a depth camera. Latest sdk for unity uses depth api and when tried it on my phone it says device not supported although previous versions of sdk supports on my phone.
That is smart invention google. Now we can play games by using our own real-life environments. All we need is 3d models to add
What surprises me the most, is how the pixel didn't run out of juice while shooting this xD
Is this compatible with very good cell phones, or is it compatible with any cell phone that has arcore?
Hey google, can you port this over to your mediapipe github, so we can stand playing around with it on multiple platforms. I assume it's using mediapipe in the background anyway.
Can you make this COMPATIBLE with Samsung Galaxy A40 please Google? That would be great.
Hey. Help me, Xiaomi Mi 9 Lite does not support ARCore. But why? Is the 710 dragon so bad? mi9, 9se (712), 9t (730), 9t Pro Support, even 7 (665) and 7pro (675). Why am I deprived? Can I rely on ARCore support in my device in the future?
There is too many smartphones that didn't have ar core and camera2api. I have Mi A2 the smartphone come under the Android One Program and it didn't have it. Please do something about it.
@davr1
4 жыл бұрын
I have Mi A2 lite and with some tweaks I can now run android Q with gcam 7.2 and arcore apps
I remember when my first time gaming AR is in sony phone, what a good old days 😊
This is available from Android Pie but I installed in it my Oreo smartphone How do I know that it's working ?
hi how can they help us . i want to start but i'm always out of resources .
Will this work on LG g4 ?
Goodbye AR my phone can'tplay "Vivo v9" 😭
Where is the download link of a game please, I cannot find it.
this is just wooowww
This AR program is the strongest in the universe. The whole human race will be used as a smartphone to give humanity tremendous happiness. Thanks to Google programmers for the world. In Germany
Why you are not enabling this feature for #miA2
Can I use ARcore in any programming language..
Google you rock.
Waiting for this in Pokemon Go !!!
Wow that's so cool!!!!!! What's the app
Can we install that robot chef game/toy ourselves?
Ok, this is super cool that you can do it on phone but why? What is the use?
It is to learn Vuforia in Unity or Arcode?
Is this available for developers?
Bro, my phone is compatible with AR but i cant use this feature, i have gyroscope and other stuff, how i use this?
But, what would happen if you scan through a glass in the environment?
@IkKorp
4 жыл бұрын
wont work
@username4441
4 жыл бұрын
your voicemails are uploaded so an analysis of the issue can be surmised.
@tres1576
4 жыл бұрын
Unless the glass opacity is darkened enough for the API to detect it, it will treat glass like air and make AR past it. If your phone has like depth sensors, it should probably be able to detect the glass.
@Ignacio.Romero
4 жыл бұрын
The phone explodes
@sircher943
4 жыл бұрын
I have a Google Tango phone and I can tell you that it won't work, curved glass makes depth data useless. It works with windows and mirrors though.
OK True AR is officially here.
When can I it download on my pixel 3 Xl?
Maybe first start working at making phones like idk Huawei p30 lite, p20 lite work with this Well even if they aren't like basic, they still meet the requirements that are only to have android 7.0 + and being orginally shipped with Google Play Store which they are.
@uwinvidanage2252
4 жыл бұрын
have u tried side loading, it works for some devices
@blacker_9844
4 жыл бұрын
@@uwinvidanage2252 Yes and it doesnt work for both of them. Still even if it would work its pointless because its still not offical google product and some of my friends that have same phones wont bother doing anything to make it work, with this i like to ask again why google wont make them to work ? With those requirements they just lie to us and there isnt any information why they dont support this.
Do I understand correctly that it's still impossible to get the point cloud and generate 3d models? I see iOS apps (like hege.sh) doing it but not Android ones.
Can AR go for e commerce
(Good sound 0:13) (Okay sound 0:45) ( *XBOX* *360* *WEBCAM* *SOUND* 1:23)
Active depth sensor?
Please, I am trying to build an AR app using ARCore in Unity. I have ten images and ten URL links to websites; I need to link the ten images with those ten URL links. Simply, when I scan the image with the phone's camera, I want the URL to open directly. Could you help me by explaining how can I do that?
is there a way to get a rgbd image using only our smartphone and this tech? that'd be awesome!
@sircher943
4 жыл бұрын
Yes
Plz, make this work with Honor 20 Lite!!!
Got a good phone, but ar not supported. Can you help me? Got a blackview BL 6000.
This is it , yeah !!1
Maybe stereoscopic 3D conversion for movies would be so much better with this tech.
Hello. My phone model Huawei Mate is a 10 lite Google Ar Error. How can i do it
when do I get it to NOKIA 7.2?
What with Google Playground ? No update to the ARCore Depth API ?
Why is arcore not available on Samsung m20??? Come on
@xvenom2145
4 жыл бұрын
@Lucas VM lol