imagine the autopilot team trying to understand what's going on after receiving feedback from the car lol

@ivanfenis1221

3 жыл бұрын

LOL XD

@adithyagolwalkar7896

3 жыл бұрын

I think the edge cases are uploaded to the cloud only if driver presses a button on screen when something happens.

@danmuji7585

3 жыл бұрын

@@adithyagolwalkar7896 all disengagements are sent

@sad_x_love1178

3 жыл бұрын

LMFAO

@DerKatzeSonne

3 жыл бұрын

@@adithyagolwalkar7896 Nah, they have certain "triggers" of all kind. Could also be something like "something seems to be wrong with a camera".

This video really demonstrates advanced sensor fusion and AI where the trained neural network is very adaptive and can work robustly in various sensor configurations. This is perhaps the single most impressive video on autonomous driving that I have seen, ever.

@dada373678229

3 жыл бұрын

or just using map data + gps

@Explow23

3 жыл бұрын

@@dada373678229 Stop being so naive. :) Cameras still manages to pick up standing person on the roadside. Map data and gps doesnt show people. ;)

@dada373678229

3 жыл бұрын

@@Explow23 I meant, when all cameras and radar were blocked, it still kinda "saw" the road, that's likely from map data and gps.

@DerKatzeSonne

3 жыл бұрын

Definitely. I am really surprised about these results. That's some next-level sensor-fusion and everyone who has done anything with robotics will know how impressive this is. This is mind-blowing! Some people might have fear about a leaf blocking a camera or something but seems like Tesla already solved this. Wow.

@JK-ku2mj

3 жыл бұрын

@@dada373678229 and who change the maps - in a big City it change almost dayly. Bad idea and will not work

*Leaves wife on side of the road* "No yeah, honey, it's for my youtube channel"

@danijelandroid

3 жыл бұрын

"Run over my wife."

@Joshuaxiong2

3 жыл бұрын

Is his wife single?

@uriahrobinson9185

3 жыл бұрын

Lmfaoaoaoo

@nonameB6919

3 жыл бұрын

@@Joshuaxiong2 bruh

@dekhijabas5676

3 жыл бұрын

@@Joshuaxiong2 100% use of brain or what!?

4:55 I'd by twitchy too if someone covered up my ears and eyes and told me to drive.

@mymanager3662

3 жыл бұрын

The right response from both human and FSD should be to say hell no I'm not driving like that. I think it should not let you engage it if it clearly notices several sensors don't work

@Kayshots

3 жыл бұрын

4:48 *

This is why hardware upgrades are needed. The cameras should be able to laser off anything covering them. #KeepSummerSafe

@AllYouWantAndMore

3 жыл бұрын

Looks like the radar being covered makes the FSD think another car is right in front of you, or on the side of you cause you covered the side. Anyways, when the other car came by the FSD thinks it hit the ghost car, which then would have hit you. FSD thinks you were just in an accident, which is why it won't let you reengage. My best guess.

@zubinkynto

3 жыл бұрын

Keep. Summer. Safe.

Man these are awesome tests! I think this confirmed: 1) FSD is indeed relying on 4D to create a space time model; 2) FSD is robust enough to function even when individual components fail; 3) when unsafe to do so, FSD will not engage or disengage immediately, which is great! My guess is those 3 front facing cameras will produce images that vary in brightness, contrast, resolution, and most importantly distortions resulted from different focal lengths. How they overlay and stitch up the images from multiple cameras to create that 4D model is where the magic happens!

There surely are many subscribers below the age of 18, including myself. I guess we all just set our ages higher so we don't get restricted by youtube on viewing any content. :D Not to mention all the family settings that we would have to mess with if we set our real age 5 years ago when creating an account. So don't worry, there are at least some young people watching!

@spinyoblock2024

3 жыл бұрын

Same I'm 13 but on KZread in like 80 lol.

Man there is so much good stuff here I don't even know where to begin. One of the tings I love about Tesla though is these little details that make such a big impact on the actual product; where any other lame company would just make the autopilot disable at the hint of any camera issues causing a nuisance often, Tesla's actually keep working with it even ridiculously handicapped, and work well. That is on a completely different level then other companies attention to product value. I'm thinking the tin foil over the radar maybe bugged out because it's probably not just blocking it but reflecting it, making it think there is an object on it. Probably only activated once that car passed from the camera seeing it because maybe its off when camera deems it unnecessary to save power.

I imagine how funny it would if the FSD could talk. "You are taping down my eyes? What the heck? Why are you doing this?"

@DBLewisOrlando

3 жыл бұрын

"I'm sorry, Dave. I'm afraid I can't do that....I know that you and Frank were planning to disconnect me, and I'm afraid that's something I cannot allow to happen."

@PanDiaxik

3 жыл бұрын

Technically it could be done by software update

@thunderbolt_blitz

3 жыл бұрын

"It's for a KZread video!" Oh ok fine

The visualizations are fascinating. I love that you get a visual representation of the degradation of vision with each blocked camera via the shaky, tweaky read dots. So cool to see how it tries to keep going even as you crush FSD's hopes and dreams ;)

I love your video's. They give us an enormous amount of confidence in Autopilot driving. Never thought the car was able to see that much with so many cameras blinded. Thank you ??

I wanna see Waymo do this.

@DerKatzeSonne

3 жыл бұрын

ROFL.

I'm 15 and I love Tesla and im super interested in our future Transportation method. Your videos are crazy educational and funny. I might be 20+ years old on my account (for legal reasons i now have to cut the comme-

@yndeloos

3 жыл бұрын

A bit late but I'm 17 and also watching :)

@littlejack8092

3 жыл бұрын

I am now 18, but I have watched this channel for a while. I think there is more people under 18 watching than the statistic shows. Most people under 18 sets their age on KZread/google to over 18 ;))

I usually don’t comment on videos that much, so this will be my first comment on your channel, but I subscribed a while ago. I‘ve been watching your videos for a few weeks now and I personally think you are one of the best channels to watch when it comes to FSD Beta videos. I‘m 19 years old, so I‘m likely one of the youngest people here (at least according to the statistic you showed at the beginning of the video). I‘ve always been interested in AI, self driving cars and Computer stuff in general so I think this is how I ended up on your channel. There are a few friends of mine who are already holding off on getting their drivers license because they think that it‘s not worth it when they see how far we already are with FSD technology. One of the reasons they think so might be because I took them along for a ride in my Tesla Model 3 SR+. That being said, I would like to add that my car is financed and I am paying the financing rates myself, I have a job and can ‚afford it‘. I know that many people disagree with my decision of getting a new Model 3 as my first car at this young age, but I‘ve made my decision and am totally satisfied with it! I don’t want anyone trying to make me feel bad or anything just because they would have done it differently, that’s why I felt the need of pointing that out, since I’ve gotten some comments on how that’s a ‚bad decision‘ in the past. If this is going to be the case this time around, I’m immediately going to delete this comment because I don’t need anyone to tell me how to spend my money or which way to live my life.

@AIDRIVR

3 жыл бұрын

A lot of people told me the same thing when I bought my Model S. Teslas are more than getting you from point A to point B, they bring enjoyment. I commute a lot and spend 3+ hours in my car every day, the Tesla has paid itself off by giving me my "time" back, if that makes sense. Thank you for watching my videos, and don't let people's opinion affect your decisions too much. Enjoy your Model 3 :]

@lmckrosen123

3 жыл бұрын

Those who have something negative to say to you are probably only envious.

@martinoconnor1268

3 жыл бұрын

If you purchased full self driving and it continues to improve as quickly as shown in this video, then it might well end up being one of your best financial decisions. I hope so for you and the future of FSD 👍🏻

@prestleynelly

3 жыл бұрын

I did the same thing at age 20. (I got the car a month and a half ago)

@macario6867

3 жыл бұрын

@@prestleynelly congrats to your new car then! Enjoy it!

creative thinking + scientific approach = good stuff

Might be the best FSD Beta video so far on KZread !

Just amazing. Your work as well as the FSD. Please keep making those videos!

@AIDRIVR

3 жыл бұрын

Definitely will do! Thanks for watching

Must say I trust FSD more after watching this!

These are great tests. And because things still work it’s obvious that all the cameras sensors and radar work together to give you the smooth finish FSD. That’s how your brain and neural networks work. They are interconnected but they also have many alternate paths allowing them to function even when many of the paths are blocked. Thank you for taking the time to do this.

Oh I'm under 18 and I love watching your little self-driving experiments.

One of the best videos I've seen all day. Keep up the good work!!

You must be an engineer like myself. Love the sense of humor added. Laughed when you started with the comment about in your previous video you tested the cars ability to run over your wife and the comment about how none of us are under the age of 18. Thanks for doing these tests. Nice to know when my wife gets her Model Y it will still be able to pull over if any part of the system fails.

The B pillar cameras can probably see forward some to see the curbs. From there the neural net could be predicting that the curbs continue.

@kylecoolky1189

3 жыл бұрын

He covered the B pillars in almost the entire video

@SkepticalCaveman

3 жыл бұрын

It must be the radar. It gives some redundancy.

Your thorough testing and FSD performance even when blinded are both very impressive, thanks for sharing 👍

I rarely comment on videos, but being a fan of cars, especially high tech EVs, Tesla’s are my favourite. This is how, I came across your channel. I believe your videos are one of the best display of how to get answers to curious questions for FSD. A lot of efforts goes into making such kind of Videos and hats off to your efforts. It’s a real treat to watch these. Just subscribed your channel. I wish a growing success to your channel. Love from India.

@AIDRIVR

3 жыл бұрын

Thank you so much for the comment and kind words! These videos have been a lot of fun to make

Simply fascinating! Based on my experiences with FSD in my Model 3 I thought that level five autonomy might be a decade away despite my desire to see it much sooner. These FSD beta videos are now making me rethink things. As evidenced by your very interesting tests Tesla has done a fantastic job putting together a robust auto pilot and I am shocked to see how well it does with all of the basics after just one month. Imagine where it will be starting in a few weeks when a very large number of people in the US contribute to billions of miles over the next year or so of FSD Beta (as its currently named) driving. Thanks for the videos and please keep all of this top-notch footage and experimentation coming!

Im 19, and I really enjoy your content :) Keep up the great work, you have a great potential! I think your testing videos are the best you can find.

That was a very interesting set of tests. To be honest, I think you've just proved the the Tesla FSD is much better then folk think it is...it is a very safe system! Many Thanks for taking the time to do these tests.

This is great and I’m sure many people will be surprised of what the current sensor suite is capable. Thank you! 🙏

Wow! this gave me more insight on autopilot than watching countless videos in last few months! I hope sure TSLA QA folks does all these kind of testing.

Liked and subscribed for that metric system! Very intersting video, love the format!

The first constructive test I have seen on FSD great job

Being in Southern Ontario my GolfR shuts down all cruise control, active steering every time it snows. Interesting to see what happens to FSD during inclement weather or white outs. Throw black ice in there as well. Great job on the testing!

Fantastic! So informative thank you. Joining your Patreon. You speak of the autopilot like you would of a human. This is excellent, just watching these videos I get a sense of the autopilots human qualities I think that is the miracle of AI it has a behaviour, a personality,. It hesitates , it rolls forward to peak gets “scared” , confused. Very advanced. Thank you for letting us see the future.

@AIDRIVR

3 жыл бұрын

Absolutely, I love making these videos. And thank you so much for joining, it is so appreciated!! Autopilot definitely has some human feeling traits. Sometimes there's moments where it leaves me in disbelief of how good it handled a particular situation, and there's those moments going the opposite way as well. It's just like a student driver. It's been a joy driving this car for the past couple years and seeing the progression happen right in front of my eyes. Can't wait to get the Thanksgiving update Elon tweeted about. Thank you again Who Why, you are awesome!!!!

I think it was a pretty good test. It's nice to see that if it loses a sensor or two it doesn't halt and catch fire.

Super interesting. The camera sensors might be sensitive to wavelengths outside the visible spectrum, and your tape is not opaque to those wavelengths.

@cooldudept

3 жыл бұрын

A very good point. Still blocking visible wavelengths,throwing that curveball at the system and having it performing the way it did is awesome.

@SkepticalCaveman

3 жыл бұрын

I think it's the Radar. Great to have redundancy.

@cooldudept

3 жыл бұрын

@@SkepticalCaveman I actually thought about this in the shower haha :D yes, NN is trained to recognize radar's input. It knows it should be in a road so when proper radar bounces from kerbs come in it can interpret them as such, even poorly. Makes sense!

Tesla should pay you for that work. Incredible.

Never give up your passion for experimentation! Great video, thx.

Yo, I'm 14 and I live in a country where the majority of the population can't afford a 3000$ car, still love your videos.

Congratulations. I appreciate your curiosity and clear testing methodology. You are a men of science, I guess...

so cool being a person who builds tesla’s and seeing people so excited over them, 25% chance I played a role in building a lot of you Model 3 (and even some S & X models) owners cars :)

Congratulations for the meticulous job that you have done with this and the rest of the videos! 👏👏👏😉😉😉😉

Im 16 and I enjoy your vids!! Keep up the good work, your channel will grow trust me :))

Fantastic video! It looks like fsd has a lot of redundancy. Perhaps bad weather etc will not "blind" autopilot as much as I would have expected. PLEASE do some more testing. Thank you.

The vision system doesn't have any IR filters. Your tape doesn't block IR fully. The radar is probably just an addition to the vision and not required for it.

@thomasreese2816

3 жыл бұрын

That makes me curious how the IR affects the image sent to the AI model. Would be super interesting to see a detailed look at what parts if the image the AI 'focuses' on

@luleier

3 жыл бұрын

Can you share where is the source of this? I tried to google it but find nothing. And Elon explained in the past that it is not normal rgb camera twitter.com/elonmusk/status/798886670468644865 and somebody said the new cars use new camera which is rgb.

@EllsworthC

3 жыл бұрын

I also logged in to comment that I suspect infrared (IR) imaging through the tape. Try taping a layer of aluminum foil over the three forward cameras and see if that blinds forward vision. The amount of IR spectrum that typical video cameras can detect is impressive, especially when they do not incorporate an infrared cutoff filter typical of cameras intended for visible-spectrum photography. And materials like plastics and paper can be impressively transparent to IR spectra.

@Muonium1

3 жыл бұрын

There is absolutely no way it's using IR in this situation. I work in optics, the amount of near IR that a simple CMOS is sensitive to which could potentially get through a piece of tape like that is minuscule and would suffer from huge amounts of scatter. Even if significant amounts of light were getting through it would look like looking through a heavily etched and stained piece of glass. There's simply no way it would be able to form an image from the tiny amount of IR coming through a slightly translucent at best material like that. Additionally.....HE WAS DOING THE TEST IN THE DARK! And the car has LED headlights, not incandescent, so there was no near IR present at all in those scenarios. Further, there's no real evidence the cameras DON'T have IR filters and after watching what must be thousands of hours of video I've never seen any evidence the cameras are seeing any significant IR in any situation.

@manurao9965

3 жыл бұрын

Google HD maps

I'm 4 years old, and i love what you did, when i learn how to read, i want to learn more about tesla

@robertyu7341

3 жыл бұрын

Viral Gamer you can aim to be the you

"I'm sorry, Dave. I'm afraid I can't do that....I know that you and Frank were planning to disconnect me, and I'm afraid that's something I cannot allow to happen."

16 and watchin btw! if you see this, im about to watch all of your beta drives from start to finish :)

you now have a viewer under 18. subscribed.

This is insanely impressive. Looks like its capable of using GPS positioning and the sensors and essential manually slowly driving and reacting to the changing environment as it slowly drives. This is very good news knowing if a couple cameras get compromised it can it has a higher rate of navigating safely or pulling over.

This is amazing. However, I'm easy to impress as I was already blown away by the fact that the basic lane keeping works in extreme down pours, complete darkness and other low-visibility situations where I barely trust my own driving! Can't wait for FSD to reach my corner of the world =)

Thanks for such a great video. It answers my long term doubt about sensor reliability of autopilot. It would be interesting to see how the autopilot works on Indian roads though😂

Great testing. Perhaps do tape tests in different road and light conditions, might give different results, such as straight into the sun or on a tight bend for example? Very interesting results

Very interesting to see how the numerous sensors and inputs act as redundancy for the others

I am under 18 I'm subscribed and I'm so excited to get a car I'm so glad you make these videos because I love them it really feeds into my nerdiness lol anyways I love your channel

@AIDRIVR

3 жыл бұрын

Thank you for this wonderful comment :] I'm so glad you enjoy the videos!

Great to see its resilience.

I love the math/uncertainty behind all of this.

wow fantastic cameras, cant believe they could see her from that far back

This was awsome. Good to know and amazing! I wonder if maybe it was relying on previous visualizations and the GPS to see the road.

Auto steer is working most likely based off its predecessor AP1s neural learnings as it only had the main forward facing camera as well. Although it wasn’t as capable at making turns so it’s interesting how it’s able to make the decision on whether or not it has a clear passage to turn.

I'm 17, happy now? Greetings from Spain.

Interesting tests, something I was curious about

I'm 17 and watched your Channel since being 16 so, kids under 18 do watch your channel :)

My first impression is: 1. FSD uses multi cameras to cooperate, in order to make extremely robust estimation of "free space", i.e. those red boundaries, but it is still unknown to me if it constructs a 3D or 2D free space. 2. Detection of cars is pretty reliable, regardless of how many cameras are left, so I believe FSD detects cars based on 3D bounding-box detection mainly on images of only one front camera, possibly with multi cameras and radar to cross check, so as to eliminate those "ghost cars". The "cross check" explains why you get a disengagement at 12:17, and FSD possibly senses some inconsistency between result from images and radar at this moment. 3. Pedestrians' and dogs' location is detected using 2D images, assuming they are on the same plane with Tesla car, since absence of radar have no impact at all. Technically, cross check could be done using multi cameras, but not necessary. 4. Localization of traffic signs is similar to that of pedestrians. No that the 3D location of traffic signs is clear only when Tesla car is very close to them, before which the traffic sign is only a 2D marker. It is interesting how FSD will behave if the ground (road) is not that flat, e.g. on a steep rampway, with car and pedestrian on the road side. So could you please try that while driving really really slowly, let us see will the detection of road and cars become much more jumpy. Furthermore, I am curious what the detection of "free space" would be like when FSD drives in an open terrain, where it is difficult or even impossible to define where the road is.

I would assume the center camera to be wideangle? And then the left and right either narrow and “normal” angle view. The shape just seems to be too narrow, for the wide angle camera to be at either left or right position.

I think the reason the wide angle saw her from further away in the dark is because a wider angle lens generally has a lower aperture so it can let in more light. In other words it can see better in low light situations than the more zoomed in lens.

Best video about FSD so far

Very impressing, gives me a lot more confidence into Robotaxi. Ty for your work. (and oc thanks to your wife)

You can save and watch the footage of the Tesla cam. They probably have really high light sensitivity (ISO), so they can see better in the dark. If you do check it out, please show us as well how the footage during night looks.

Awesome vid I love the intellectual curiosity.

first of all thanks for the videos you are doing but you have to admit that Tesla is doing an impressive work with the auto pilot and it's extremely reassuring that even with multiple camera malfunctions the car still finds it's way around

Aye man I just wanted to let you know I’m 16 bro and I want a Tesla so bad bc it’s advanced for a car it blows my mind that I want one so I watch your channel too see bro never lose hope keep doing what your doing bc if you never made your channel I would’ve never came across this

I’m 17 and I love your videos so that’s very untrue

Interesting tests and video. I wonder how the results would be different if you were able to actually disconnect a camera or the radar.

That's absolutely insane that fsd still functions pretty well while blind aside from only one camera and radar. And this is only a very early iteration as well. Even if the cameras weren't completely blocked I doubt anything that naturally occurs on the road would be able to block the cameras as much as layers of duct tape could. This video should help dispel any notion of fsd not working in bad weather conditions

Way to torture test your rig. Good stuff.

Wide angle lenses let in more light. Thus the dark parts can be clearer on em.

Autopilot hardware version 1.0 used a sole camera in the front and its radar to operate (plus some weaker ultrasonics). It seems from your testing that its functionality is still fundamentally built upon that main front camera

You should try this test again with the latest changes in removal of radar and ultrasonics

Great effort for this video, thank you

@AIDRIVR

3 жыл бұрын

My pleasure!

Thank you , you do us all a great service .

I’m 14 and i watch you every day :)

Your humor is great 😂😂running over your wife comment is gold

Great video. For Science!

Very interesting video! I'm surprised it even lets you engage FSD with blocked cameras. Seems like an oversight they'll probably fix at some point.

It's amazing how it can keep working like that with so many cameras covered. I do wonder about the safety of taking those left and right turns without clear view in both directions.

It could be that the cameras are capible of picking up wider bands of light such such as infrared. That could explain how it could see through the tape.

What is that camera on the rear mirror used for? Does it use it for auto pilot or what? 6:37

Nice experiments, thanks for sharing them :) I think I have some explanations for your questions :) You are confusing the wide and the main camera though... The one in the middle is the wide camera and the one on the left side of the car is the main. Just think about it - the wide is about 150° FOV so it needs lots of space on the sides so it can an unobstructed view on the road. This will also explain why the pedestrian was detected so well. About the narrow not detecting it early enough - at night one important thing is the exposure control. It could be that the narrow has a shorter exposure to allow better detection of traffic lights, while the main has a higher exposure to better detect lanes and objects. This will explain that as well. One explanation why Autopilot disengaged after you passed a car with the blocked radar. Tesla is probably comparing the detections from the camera and the radar and when they see that the camera detects a car reliably and the radar not, they know that the radar is blocked and turn off autopilot completely. The most interesting is your experiment with all the cameras blocked and I don't have a very good explanation... Maybe they are also using the parking cameras for that - maybe you can try blocking them as well. Another thing could be that they have a RNN that has a kind of a history and predicts the road based on the vehicle movement. You can test this by driving a longer with all cameras blocked. The stop sign wasn't detected, though.

I guess the narrow/zoom cam has more glass in front of the sensor, so it cannot handle as well in low light. The wide angle cam might get more incoming light and thus see better in the dark, even if the resolution of the object in the image is lower.

I'm really impressed with how much redundancy there is in the visual system of FSD. I also understand, that Elon said, "we don't need Lidar" But I think, it would add another level of redundancy, if thre car had ears, simular to animal ears. Many animal navigate on their ears, and human as well. Especialy blind people can learn to navigate only on sound. I have tested it on my own in the cellar of the house , I lived in. Just from the sound of my steps I could find the distance to the walls and where I can walk in total darkness. Extremely increased this by a klicking sound I made with a clicker, That gave me the feeling to really see in the dark

Interesting! Maby some materials that absorb the radar signals instead of aluminum foil?

AIDRIVR: My Alien car has 15 eyes. I wonder what happens if I cover up the eyes and force it to drive. Alien car: Just two more months...two more months before wide-release and my fleet can take over the world! LOL

I am confused about the thing working with all cameras covered. confusing but shows that it is a resilient and effective sensor suite

Impressive. My guess is that the cameras are spotting the objects at any given time, the NN computer is recognizing and identifying those objects and the radar is estimating the distance to the objects (critical especially for moving objects). Eventually at some point in the future even the estimation of distance will be done visually by the cameras + NN computer and radar as well as ultra sonic sensors will become redundant.

Great work, thanks!

not sure this is the kind of test allowed under beta testing agreement

@RealNameNeverUsed

3 жыл бұрын

Yeah I wonder if these tests mess up the database since it supossed to be trained correctly , not the other way round.

Super interesting. So it drives on cameras but must need radar for visualizing obstacles. I was under the understanding that it would be camera only system. Do you know if the radar is going to get phased out eventually or is it a permanent thing? Or maybe I’m getting lidar and radar mixed up, I thought they were the same thing. 🤷🏼‍♂️ I still have some learning to do.

When I use black electrician's tape (even multiple layers) to block a photocell, I think that plenty of Infrared gets through, because the photocell still worked pretty well. Until I used thick cardboard, I was still getting signals. I have never tried this trick with a camera, so it may be different.

Always wondered what would happen when driving in snow and the cameras got covered.