Blending realities with the ARCore Depth API - Deep Dive

Ғылым және технология

The new ARCore Depth API allows you to create a depth map with our depth-from-motion algorithms and a single camera. Unlock capabilities like occlusion, realistic physics, particle effects, and more.
Links:
Read more on the blog → goo.gle/ARCore-Depth-API
Find more about ARCore → goo.gle/2PyLEqn
Subscribe to Google Developers → goo.gle/developers

Пікірлер: 301

  • @mattizzle81
    @mattizzle814 жыл бұрын

    Yup, this is what everyone wanted. Almost anything interesting requires depth. Without it you're stuck with gimmicks. This looks awesome

  • @azrael6280

    @azrael6280

    4 жыл бұрын

    Imagine Counter Strike

  • @mihnealazar7039

    @mihnealazar7039

    4 жыл бұрын

    Something very similar has been available on the iPhone for more than 6 months.

  • @matthewhall319

    @matthewhall319

    4 жыл бұрын

    @@mihnealazar7039 only for people

  • @azrael6280

    @azrael6280

    4 жыл бұрын

    @@mihnealazar7039 game name?

  • @mihnealazar7039

    @mihnealazar7039

    4 жыл бұрын

    Azrael well, if you have an iPhone you can search “AR quick look” in Safari and you will find some models to place in your room with people occlusion. Also, there are some games and apps, like “ARise” but some are free some are not.

  • @HarryUnderwoodMedia
    @HarryUnderwoodMedia4 жыл бұрын

    So Google finally gets back to the issue of depth for the first time since Project Tango was mothballed.

  • @yeetusfetus8687

    @yeetusfetus8687

    4 жыл бұрын

    I think it was a matter of waiting for processing speed to catch up with the other sensors, and have it available to a wide enough audience that developers would come develop for it (which I imagine was a painpoint for tango)

  • @saulghim2661

    @saulghim2661

    4 жыл бұрын

    The return to using a dedicated depth sensor seems inevitable eventually, at least for real time occlusion for all types of moving objects.

  • @yeetusfetus8687

    @yeetusfetus8687

    4 жыл бұрын

    @@saulghim2661 for now there's an "acceptable" quality of occlusion which is passable for just fun

  • @nadeemshaikh7863

    @nadeemshaikh7863

    4 жыл бұрын

    @@saulghim2661 I think Google will release a Pixel with Project Tango soon, just like they did Project Soli.

  • @mechadense

    @mechadense

    3 жыл бұрын

    @@yeetusfetus8687 -- I think it was a matter of ARCore (barely) working with widespread normal hardware instead of rare expensive specialized hardware plus Apple pressing ahead with a system that uses normal hardware. This got Google spooked and motivated to reallocate development resources. -- With tango being closed source this was to the chagrin of all early adopters (me included) and early external enthusiast developers. A painful massive regression.

  • @DavidGoodman
    @DavidGoodman4 жыл бұрын

    Interesting choice of chair at 2:21

  • @HAWXLEADER
    @HAWXLEADER4 жыл бұрын

    2:25 I love how they put real Wireframe over the real object haha

  • @HAWXLEADER

    @HAWXLEADER

    4 жыл бұрын

    @nickxxv i guess it's just a decorative chair they have in that lounge

  • @luchianno

    @luchianno

    4 жыл бұрын

    Hahaaa

  • @viswanath7908
    @viswanath79084 жыл бұрын

    I had to double check on the date for making sure that this isn't an April fool prank.😆

  • @abhishekanshuwali3808

    @abhishekanshuwali3808

    4 жыл бұрын

    Exactly same 😂

  • @SamsonKing9

    @SamsonKing9

    4 жыл бұрын

    April fool? .. Dude it's December 😏😏

  • @subliminalvibes

    @subliminalvibes

    2 жыл бұрын

    @@SamsonKing9 154 people are idiots.

  • @cutterchaz
    @cutterchaz4 жыл бұрын

    I'm using ARCore for my uni project and this is exactly what I needed, thank you so much for adding such an important feature.

  • @asifkaka5052

    @asifkaka5052

    4 жыл бұрын

    i just found this and my fyp is also on AR this is a game changer

  • @umairyounas7594

    @umairyounas7594

    2 жыл бұрын

    Hey bro brother I need your help for my Uni project

  • @RajioOn
    @RajioOn4 жыл бұрын

    Wait, this is actually awesome :/ I can already imagine what the future will look like with this feature

  • @gauravbodara
    @gauravbodara4 жыл бұрын

    Great Work!! Really looking forward to use this.

  • @luis96xd
    @luis96xd4 жыл бұрын

    Whoa, This is so AMAZING! You all have done an geat job! This make AR looks so realistic in a better way

  • @adlirifqi
    @adlirifqi4 жыл бұрын

    This is what i'm looking for!! Thank you

  • @leofreitasa9933
    @leofreitasa99334 жыл бұрын

    This is simply AMAZING!

  • @ofsanjay
    @ofsanjay4 жыл бұрын

    seriously awesome. Great era to live. it generates point cloud and stitch it into a mesh and paste it in real environment with a virtual object. 👌

  • @fazil47
    @fazil474 жыл бұрын

    This is awesome, I'm waiting for people occlusion now!

  • @username4441

    @username4441

    4 жыл бұрын

    google is always at work trying to occlude humanity.

  • @pjanoo6973
    @pjanoo69734 жыл бұрын

    When Pokemon Go gets AR it'll have a second boom of popularity.

  • @nashalone

    @nashalone

    4 жыл бұрын

    can do battle against other people with our pokemon and watch it happen right there

  • @lamandigital
    @lamandigital4 жыл бұрын

    Amazing!! I updated my ar core right now!

  • @mohammadrasoulfard-habibi3066
    @mohammadrasoulfard-habibi30664 жыл бұрын

    This is class.

  • @harrymartin4482
    @harrymartin44824 жыл бұрын

    Very glad to see. Good job google!

  • @hotelbackdorr
    @hotelbackdorr4 жыл бұрын

    OMG! IM SO READY!

  • @rutviktak716
    @rutviktak7163 жыл бұрын

    This is so cool,can't wait to try this 😃

  • @maximyarmolik1726
    @maximyarmolik17264 жыл бұрын

    Mind-blowing

  • @khynantoque
    @khynantoque4 жыл бұрын

    This is awesome Google!

  • @antoniobortoni
    @antoniobortoni4 жыл бұрын

    Wow, Bravo This is increíble.

  • @activemotionpictures
    @activemotionpictures4 жыл бұрын

    Besides, the amazing API is there a software authoring? I would really love to have everything under one roof. Specially for motion body captures (tracking) and transporting it to .fbx or .abc models. Thanks.

  • @HAWXLEADER
    @HAWXLEADER4 жыл бұрын

    They need to update their logo... the top part should now occlude the sphere!

  • @username4441

    @username4441

    4 жыл бұрын

    that would probably interfere with whatever occult symbolism they are using.

  • @laxwolf
    @laxwolf4 жыл бұрын

    Incredible work, can't wait to integrate this into DoodleLens

  • @pradeepbaskaran30

    @pradeepbaskaran30

    4 жыл бұрын

    Is the DoodleLens app yours? I love the concept

  • @M05tly
    @M05tly2 жыл бұрын

    If I had the financial resources I'd be heavily investing in AR technology. It has the potential to revolutionise so many aspects of daily life, in both business and personal life. Really hope I see this technology make an accelerated progress. The possibilities of things like hololens and Google glass are massive, they seem to have been almost discarded?

  • @sircher943
    @sircher9434 жыл бұрын

    Google Tango is back. Can't wait for more 3d scanning apps I could use on my Asus Zenfone AR.

  • @ZacharyAghaizu
    @ZacharyAghaizu3 жыл бұрын

    so exciting!!!

  • @doctorpanigrahi9975
    @doctorpanigrahi99754 жыл бұрын

    Tango was way ahead of its time but it required a specific depth sensing hardware. Hope this AI is as effective.

  • @nicolasalvarado6678
    @nicolasalvarado66784 жыл бұрын

    Amazing!

  • @mikeshin77
    @mikeshin774 жыл бұрын

    It's so great api !!!

  • @jeeteshsingh209
    @jeeteshsingh2094 жыл бұрын

    Finallllyyyyyy 😍😍😍😍😍

  • @spoofymcspoof1
    @spoofymcspoof14 жыл бұрын

    Yes just what I wanted! When is this coming?

  • @TarantulaDigitalStudio
    @TarantulaDigitalStudio3 жыл бұрын

    Yups....The Depth Occlusion is working but it lack of depth accuracy....rough edge.... still need improvement because this is awesome if everything work nicely....i understand Google are working hard for this....

  • @keehoonahn
    @keehoonahn3 жыл бұрын

    Awesome~ 👏👏👏👍👍👍

  • @bokbokeh
    @bokbokeh4 жыл бұрын

    sick!

  • @notdisguised8
    @notdisguised84 жыл бұрын

    At 1:15 raindrops are hitting vertical surface and giving effect like it's hitting on horizontal surface.

  • @Dream99Zz
    @Dream99Zz4 жыл бұрын

    finally, depth detection. waiting for Unity lib updated with this feature

  • @CartManBrahhhhh
    @CartManBrahhhhh4 жыл бұрын

    I hope Minecraft earth team got a sample of this

  • @lol-de4lo

    @lol-de4lo

    3 жыл бұрын

    It's getting shut down now

  • @Arjun8BPCracker
    @Arjun8BPCracker4 жыл бұрын

    how awesome is that

  • @mvgiugni65
    @mvgiugni653 жыл бұрын

    I would like to see an historical event been present to students using it. It's a bit different than what you have here but not that far. Imagine the scenario of the 1st steps on moon. What about the teacher remotely explaining it to the students and they been able to see themselves there.

  • @brenoitalodasilvafonseca5747
    @brenoitalodasilvafonseca57474 жыл бұрын

    Amazing

  • @samipega8662
    @samipega86624 жыл бұрын

    Depth without TOF really great

  • @zyonwong
    @zyonwong3 жыл бұрын

    great potential, keen to participate in collaborators program, but looks like the program is closed now, will there be a second round ?

  • @daksmemes7428
    @daksmemes74284 жыл бұрын

    love it

  • @shehryarmahmood5020
    @shehryarmahmood50204 жыл бұрын

    thank God already!

  • @SRMBSteelOfficial
    @SRMBSteelOfficial3 жыл бұрын

    please let us know if an ARCore based mobile app can be converted for all android devices.. as in if the developer of the software can use any patch or anything to that software to make it enabled for all android devices.. please help.. also how fast the androids are getting updated with AR Core.. once in a yr or twice a yr or more frequently..

  • @ludologian
    @ludologian4 жыл бұрын

    Does this work on truedepth or it's only available on TOS sensors?

  • @ahmedajmii6054
    @ahmedajmii60544 жыл бұрын

    Hi very nice feature to add to Ar but when it will be released ? I can't wait to try it in my project :D

  • @soumyajahagirdar6708
    @soumyajahagirdar67084 жыл бұрын

    can we get any documentation onto how exactly this depth api works?

  • @oby1
    @oby14 жыл бұрын

    This has waaaayyyy more potential for VFX artists. Definitely VFX... Maybe a camera app that saves the Zdepth separately- So it can be used in composting.

  • @oby1

    @oby1

    4 жыл бұрын

    From that, object recognition. And from that you can make a cryptomatte.

  • @oby1

    @oby1

    4 жыл бұрын

    So if your device saves the AR camera movement data - (In to an FBX file) You essentially eliminate the need for camera tracking. 3D track+Zdepth + cryptomatte. That's a VFX artist's dream!

  • @sircher943

    @sircher943

    4 жыл бұрын

    @@oby1 RTabMap app let's me do that on my Asus Zenfone AR.

  • @tomasprejda4165
    @tomasprejda41652 жыл бұрын

    Dear Google Developers, will it be possible to recognize objects according to their 3D faceted or CAD model? This capability is available in Vuforia Engine, I think if it were possible, ARCore would steamroll it.

  • @guythatmakessense2033
    @guythatmakessense20334 жыл бұрын

    My question would be is there a certain type of phone required for this kind of feature or can it be done with any arcore enabled device? Maybe just two cameras are needed? Definitely doesn’t absolutely need a Tof camera, does it?

  • @davr1

    @davr1

    4 жыл бұрын

    it's probably going to be the same as with things like night shift and live transcribing that google claimed to be only working on the latest pixels, but instead after just a few weeks it got ported to hundreds of phones

  • @MadForMarketing
    @MadForMarketing3 жыл бұрын

    does Google AR Core getting enabled in all the model of each brand available in India?.. need this information as we are going to build an app using Google AR Core..

  • @socialgamergang4474
    @socialgamergang44744 жыл бұрын

    I am ready to use the api

  • @Embuer
    @Embuer4 жыл бұрын

    When are you realising it ? I am waiting for it

  • @jobinjeeji3502
    @jobinjeeji35023 жыл бұрын

    Can we use depth api on "AR optional" apps? My device realme 3 pro only supports AR optional apps. Does depth api works only with devices listed by google on their depth api supported arcore supported devices list. My device does have a depth camera. Latest sdk for unity uses depth api and when tried it on my phone it says device not supported although previous versions of sdk supports on my phone.

  • @alexandermin2109
    @alexandermin21093 жыл бұрын

    That is smart invention google. Now we can play games by using our own real-life environments. All we need is 3d models to add

  • @austincower778
    @austincower7784 жыл бұрын

    What surprises me the most, is how the pixel didn't run out of juice while shooting this xD

  • @krabogms5954
    @krabogms59544 жыл бұрын

    Is this compatible with very good cell phones, or is it compatible with any cell phone that has arcore?

  • @sheepyuea
    @sheepyuea3 жыл бұрын

    Hey google, can you port this over to your mediapipe github, so we can stand playing around with it on multiple platforms. I assume it's using mediapipe in the background anyway.

  • @zenosfm7020
    @zenosfm70203 жыл бұрын

    Can you make this COMPATIBLE with Samsung Galaxy A40 please Google? That would be great.

  • @PaltuRurikovich
    @PaltuRurikovich4 жыл бұрын

    Hey. Help me, Xiaomi Mi 9 Lite does not support ARCore. But why? Is the 710 dragon so bad? mi9, 9se (712), 9t (730), 9t Pro Support, even 7 (665) and 7pro (675). Why am I deprived? Can I rely on ARCore support in my device in the future?

  • @darshitpantrawala
    @darshitpantrawala4 жыл бұрын

    There is too many smartphones that didn't have ar core and camera2api. I have Mi A2 the smartphone come under the Android One Program and it didn't have it. Please do something about it.

  • @davr1

    @davr1

    4 жыл бұрын

    I have Mi A2 lite and with some tweaks I can now run android Q with gcam 7.2 and arcore apps

  • @_.neero24
    @_.neero244 жыл бұрын

    I remember when my first time gaming AR is in sony phone, what a good old days 😊

  • @disatpathy
    @disatpathy4 жыл бұрын

    This is available from Android Pie but I installed in it my Oreo smartphone How do I know that it's working ?

  • @programmingparty
    @programmingparty4 жыл бұрын

    hi how can they help us . i want to start but i'm always out of resources .

  • @arifulakash6239
    @arifulakash62394 жыл бұрын

    Will this work on LG g4 ?

  • @AkeMCGamingTH
    @AkeMCGamingTH4 жыл бұрын

    Goodbye AR my phone can'tplay "Vivo v9" 😭

  • @manda3dprojects966
    @manda3dprojects9664 жыл бұрын

    Where is the download link of a game please, I cannot find it.

  • @paragjyotideka1246
    @paragjyotideka12464 жыл бұрын

    this is just wooowww

  • @ffmkim
    @ffmkim4 жыл бұрын

    This AR program is the strongest in the universe. The whole human race will be used as a smartphone to give humanity tremendous happiness. Thanks to Google programmers for the world. In Germany

  • @Shubhamkumar-mn8em
    @Shubhamkumar-mn8em4 жыл бұрын

    Why you are not enabling this feature for #miA2

  • @bikaymeisnam3024
    @bikaymeisnam30244 жыл бұрын

    Can I use ARcore in any programming language..

  • @AkhilRajaTMG
    @AkhilRajaTMG4 жыл бұрын

    Google you rock.

  • @ravitejagantyada2702
    @ravitejagantyada27024 жыл бұрын

    Waiting for this in Pokemon Go !!!

  • @yasseralsheri8271
    @yasseralsheri82713 жыл бұрын

    Wow that's so cool!!!!!! What's the app

  • @Scio_
    @Scio_4 жыл бұрын

    Can we install that robot chef game/toy ourselves?

  • @shpluk
    @shpluk4 жыл бұрын

    Ok, this is super cool that you can do it on phone but why? What is the use?

  • @dimitrisfloroskoufis_9866
    @dimitrisfloroskoufis_98662 жыл бұрын

    It is to learn Vuforia in Unity or Arcode?

  • @sanchitgngplays
    @sanchitgngplays4 жыл бұрын

    Is this available for developers?

  • @Abex29
    @Abex293 жыл бұрын

    Bro, my phone is compatible with AR but i cant use this feature, i have gyroscope and other stuff, how i use this?

  • @coonskinniggs
    @coonskinniggs4 жыл бұрын

    But, what would happen if you scan through a glass in the environment?

  • @IkKorp

    @IkKorp

    4 жыл бұрын

    wont work

  • @username4441

    @username4441

    4 жыл бұрын

    your voicemails are uploaded so an analysis of the issue can be surmised.

  • @tres1576

    @tres1576

    4 жыл бұрын

    Unless the glass opacity is darkened enough for the API to detect it, it will treat glass like air and make AR past it. If your phone has like depth sensors, it should probably be able to detect the glass.

  • @Ignacio.Romero

    @Ignacio.Romero

    4 жыл бұрын

    The phone explodes

  • @sircher943

    @sircher943

    4 жыл бұрын

    I have a Google Tango phone and I can tell you that it won't work, curved glass makes depth data useless. It works with windows and mirrors though.

  • @animakuz
    @animakuz4 жыл бұрын

    OK True AR is officially here.

  • @jdmnissan
    @jdmnissan4 жыл бұрын

    When can I it download on my pixel 3 Xl?

  • @blacker_9844
    @blacker_98444 жыл бұрын

    Maybe first start working at making phones like idk Huawei p30 lite, p20 lite work with this Well even if they aren't like basic, they still meet the requirements that are only to have android 7.0 + and being orginally shipped with Google Play Store which they are.

  • @uwinvidanage2252

    @uwinvidanage2252

    4 жыл бұрын

    have u tried side loading, it works for some devices

  • @blacker_9844

    @blacker_9844

    4 жыл бұрын

    @@uwinvidanage2252 Yes and it doesnt work for both of them. Still even if it would work its pointless because its still not offical google product and some of my friends that have same phones wont bother doing anything to make it work, with this i like to ask again why google wont make them to work ? With those requirements they just lie to us and there isnt any information why they dont support this.

  • @pramuseq
    @pramuseq3 жыл бұрын

    Do I understand correctly that it's still impossible to get the point cloud and generate 3d models? I see iOS apps (like hege.sh) doing it but not Android ones.

  • @aadarshroy2000
    @aadarshroy20004 жыл бұрын

    Can AR go for e commerce

  • @iiiabe
    @iiiabe4 жыл бұрын

    (Good sound 0:13) (Okay sound 0:45) ( *XBOX* *360* *WEBCAM* *SOUND* 1:23)

  • @Jone952
    @Jone9524 жыл бұрын

    Active depth sensor?

  • @GeospatialTechnologies
    @GeospatialTechnologies3 жыл бұрын

    Please, I am trying to build an AR app using ARCore in Unity. I have ten images and ten URL links to websites; I need to link the ten images with those ten URL links. Simply, when I scan the image with the phone's camera, I want the URL to open directly. Could you help me by explaining how can I do that?

  • @luisalvear3859
    @luisalvear38594 жыл бұрын

    is there a way to get a rgbd image using only our smartphone and this tech? that'd be awesome!

  • @sircher943

    @sircher943

    4 жыл бұрын

    Yes

  • @aleksitapanila8706
    @aleksitapanila87064 жыл бұрын

    Plz, make this work with Honor 20 Lite!!!

  • @jens589
    @jens5895 ай бұрын

    Got a good phone, but ar not supported. Can you help me? Got a blackview BL 6000.

  • @AswinRamadasindian
    @AswinRamadasindian4 жыл бұрын

    This is it , yeah !!1

  • @sandeepsv9804
    @sandeepsv98044 жыл бұрын

    Maybe stereoscopic 3D conversion for movies would be so much better with this tech.

  • @iamvahitkeskin
    @iamvahitkeskin4 жыл бұрын

    Hello. My phone model Huawei Mate is a 10 lite Google Ar Error. How can i do it

  • @SCIENindustries
    @SCIENindustries4 жыл бұрын

    when do I get it to NOKIA 7.2?

  • @MatthewPirszel
    @MatthewPirszel3 жыл бұрын

    What with Google Playground ? No update to the ARCore Depth API ?

  • @garole
    @garole4 жыл бұрын

    Why is arcore not available on Samsung m20??? Come on

  • @xvenom2145

    @xvenom2145

    4 жыл бұрын

    @Lucas VM lol

Келесі