Why you shouldn’t trust computers | Automation Bias
Ғылым және технология
You should never ever rely on computers! Why? Simply because they have been made by humans who also tend to make a lot of mistakes.
How many times have you been trying to do some calculations, but every time you came up with a different number? Maybe it was that time you went out for sushi with a friend and decided to split the bill. Or maybe it was when you were trying to take stock of your expenses for the month. Well, it’s a good job we have computers to do the difficult calculations for us… isn’t it?
In this video, we discuss examples of how automation bias, that is, when we subconsciously trust machines more than ourselves can lead to serious calculation errors and even costs lives. We will talk about the most interesting and famous cases when computer miscalculation can cause a car accident because of people's unconditional trust in Tesla or even a tragedy like that which took place in Saudi Arabia after the Saddam Hussein missile attack in 1991.
It seems that sometimes our biggest mistake is not human error, but our blind trust in our computers to do the job better than us...
Tony's new video • Yiannos Ashiotis - reg...
Titlecard artwork by Cláudio Silva, ArtStation
Timecodes
00:00 You should never ever rely on computers!
01:34 - Blind drivers
07:45 - The Nationalist Computer
12:16 - System errors
16:42 - Automation bias
Sumsub - empowering compliance and anti-fraud teams to fight money laundering, terrorist financing, and online fraud.
More about us:
sumsub.com
/ sumsubcom
/ sumsubcom
/ admin
#AutomationBias #miscalculation #sumsub
Пікірлер: 175
We’ve given some more large scale and serious examples of automation bias in this video. But we want to know, have you got any examples of a time you relied on computers without thinking which resulted in a mistake or a mishap? Your comment could save others from the same fate 😉
@uirwi9142
Жыл бұрын
We put far too much faith into antivirus. Not sure if you mention it at all, am still watching. So far, great video!
@djoakeydoakey1076
Жыл бұрын
There's also cosmic rays which sound sci fi but is a real problem. They can travel through a transistor which changes its value from a 0 to a 1. This has happened to miscalculate votes in an election for a candidate, they had a super high vote count which seemed implausible. It also happened during a Super Mario 64 speedrun where Mario mysteriously teleported upwards. There is a KZread video that covers all this.
Really cool to see that Sumsub gave Emily a job after crippling her life by doxing her and publishing everything on youtube, actually wholesome!
@Wulfieman
Жыл бұрын
What do you mean? What happened?
@nooanykanen5864
Жыл бұрын
@@Wulfieman kzread.info/dash/bejne/nnpn27N_pLy4crw.html
@sdjmixom
Жыл бұрын
@@Wulfieman There's a video about OSINT on this channel where she was silent like 90% of the video, staring at the camera and at the speaker. It was kinda uncomfortable
@davidkaye8712
Жыл бұрын
Hahahaha
@ianthehunter3532
Жыл бұрын
@@sdjmixom I got that recommended as a first video as well, seemed like a good introduction to her becoming a host now.
Emily is such a great addition to the team!
@eugenef0zzy
Жыл бұрын
Straight up!
@dimitrischristou
Жыл бұрын
Yes!!
@Morso8
Жыл бұрын
Simp
As a developer it frightens me as well. People think it’s weird that I give so much about privacy over cool new tech but I know exactly how flawed most systems are because they got made by people like me who don’t have a clue about what they are doing and need to google of trial and error my way into working code.
@fallenaspie
Жыл бұрын
yea. that meme about programmers hating technology and sticking to as many analog systems as possible in their personal lives is true: i've stuck to a flip phone and a 1970s car because i'm so distrustful of modern technology: i know how many programming errors i make on a daily basis, and don't trust other things either
@semtex2987
Жыл бұрын
well said, feel you bro
I do undergrad research on GPS fallback systems and it’s worryingly easy to spoof GPS. One of the problems that I have to solve is detecting a spoof which is a little harder.
12:43 "This is elementary math for a human, but extremely difficult for a computer." It's also elementary math for a computer, and IEEE 754 includes decimal formats too besides the binary ones. The binary formats are just used way more often because of the performance boost, but the latter format is not hard to implement, and most programming languages support larger and more accurate formats outside the primitive data types - no rounding needed. Awareness of them is important though, as developers may just pick the default data types without considering the necessary precision of their application.
@bruhdabones
Жыл бұрын
Yup. I think Java has the Decimal data type, and if you’re feeling really bold they also have BigInt. 754 is just taught as being the float spec in universities, ignoring whatever else is in it.
@zippy-zappa-zeppo-zorba-etc
Жыл бұрын
I remember a few BCD commands in Intel assembly language class. Yeah, it took a few more clock cycles on 386 computers, but well worth the accuracy.
If you’re feeling unsafe with your phone after this, move to Germany. The internet is so bad here nothing will be able to track you. And if it does the authorities won’t be able to use their own pc getting your data.
@ornessarhithfaeron3576
Жыл бұрын
Haha, same here in Greece. Like 99% of us have a 1.5MB/s down | 100kB/s up connection...
@sidhantseth007
Жыл бұрын
I am moving to germany. I am worried now.
@meow_meow_J
Жыл бұрын
@@ornessarhithfaeron3576 1.5 MB/S? Your Internet is amazing, I can barely get 500 kB per second, also, our upload speed is a bit better, at around 500 to 750 kB, but that’s still really really bad
@khiemk9962
Жыл бұрын
How can that happen I live in a SEA country down and speed is like 5Mb/s down. Why is europe biggest economy that slow?
@Frostbite1003
Жыл бұрын
@@khiemk9962 It's not that bad everywhere in Germany. The bigger cities have 1 Gb/s in most places. But the more rural areas are still horribly underprovided. They are working on it but not remotely as fast as they should.
As a software developer I find it so strange that people blindly trust computers but as I watched this video, I think I've come to realise that people forget that a person made the software the computer is running and people make mistakes.
3:40 Couldn't stop thinking about that scene in The Office, and you put it in the video. People of culture.
Excellent presentation by Emily. While there are multiple threats, Emily nailed it by putting it first- almost everybody puts their lives and personal information, including banking, on their "smart" phones.
I'm so glad you used P-Body from Portal 2 as an example of computer in that 0.1+0.2=0.3 example ! BTW instead of pronouncing each individual letter of IEEE, the general pronunciation is "I, triple E". Great video overall.
@ornessarhithfaeron3576
Жыл бұрын
Or be like caveman me and call IEEE "Yeeeee"
I absolutely love the concept of this channel. And Emily is positively fantastic!
3:40 “ the machine knows !!! “ what a great illustration 😆
Finding this channel feels the same way as when I found early Vsauce. At times like these I am thankful for automation, but this video has definitely made me more skeptical to the digital things in life I take for granted.
I am SO HAPPY to hear about the 'robodebt' problem that Australia just went through/is still combatting from outside of our country! Great work shining a light on the discriminatory nature of these software's!
It also applies to thinking that if you want something to be done right, you have to do it yourself 🙂
This channel keeps surpising me with the quality it offers
I programmed in assembly in the 80s. Total control of the machine and the program but difficult to build complex systems. Today speed is preferred over perfection in computer products. Frameworks are used today (bit like building with lego...someone already made the bricks/windows/etc you can use in your building, you just assemble them). They enable rapid development of complex systems but the programmers have little idea of what is actually going on. They must 'trust' the framework. Then the business only permits limited testing time as they know that a product that is 80-90% correct will still sell and they can fix the other stuff later.
Emily adds a touch of class to the videos. Keep up the good work SumSub.
I find it deeply worrying that we have become so reliant on electronic assistance. I quite often ride a 1950's motorcycle which obviously has no electronic assistance, so, I have to plot a route and memorise it before setting out. Unfortunately maps aren't always up to date or accurate, but this does mean that I have to be alert all the time. I do hope this keeps my brain exercised. As for mobile phones, mine is turned off until I need it for my advantage. I've never trusted the technology and you have convinced me that I have to treat it as potentially hostile. I await the cataclysm that will wake ordinary people up to the potential risks. I cannot, no matter how hard I try, bring myself to trust computers given their intrinsic complexity and experience. I'd love to hear whether my suspicion that satnavs become more and more irrational and erratic as they age and are updated.
The thing with adding decimal numbers is not matter of representation but rather of precision. There are data types that support precise decimal values representations and then others that do not. It is up to programmer to choose the correct data type. What you are saying is: What happens if I try *0.1 + 0.2* but the data types that i choose to store these values with support only integral (whole) numbers? 0.1 would be rounded to 0 and 0.2 as well. the result would be 0. This is not a computer but human error.
I just found this chanel today, with a video of OSINT, I just subscribed, very interesting!
Love this channel
Thanks for an eye opening video.
Really interesting to have Emily helping with these videos now. Great to have more faces on Sumsub! Really enjoy this channel.
Great content!! I love this channel ❤️
I started driving as a courier in 2006 and learned fast that GPS wasn't trustworthy most of the times. Since then and since Google Maps it changed drastically. BUT, recently, just this summer in fact Google Maps have shown me the wrong place 9 out of 10 times, at least! I am not kidding! I don't know what they are doing. Another hilarious thing about a.i. is how they so called are "hallucinating" stuff and right out make stuff up. I haven't tried this myself but have read a lot of articles about it, obviously not articles written by a.i. 🤣
@thahrimdon
3 ай бұрын
Yep, spot on. I’m a bit younger (22) and GPS became more reliable around early 2010’s - from what I remember. I regularly have commuted 300,000+ miles since 2018 and GPS has been mostly reliable getting me where I need perfectly. But as you’ve mentioned, there’s been a few times, especially more recently using Googles services (Waze) where it’s just been dead wrong. Taking me to places that don’t exist, taking me in the opposite direction, etc. One of my friends had it do the same to them roughly 2 weeks ago. Thankfully, I haven’t had any problems like that recently but it does put it into perspective.
Computers do as they are told, but sometimes they are affected by outside things, or have some bugs written into them, and those things can lead to things not going as they should.
Emily is a class act!
@existensistrubczthentruscatt
Жыл бұрын
Is it a ai model person??
Computers do not make mistakes. They do what we TELL them to do, not what we WANT them to do. That's the problem.
As someone with back pain, I mentally hurted every time I saw you sitting on that chair this way
You know what's funny? I just typed 0.2+0.1 into my calculator and it gave me the answer 0.3. Computers must have gotten better at counting since this video came out.
@luna010
Жыл бұрын
Yeah, most dedicated calculators will do fine with 0.1+0.2 There are a lot of different ways to avoid floating point errors like this, sometimes by rounding the result before showing it to you so you can't see the tiny errors, or by just using something other than floating point.
Where’s Bradley?? 😅😂
It's nice to see you as the main host Emily!!
We create hardware, firmware and software for prototype up to industriell produced products. The question rarely is if there are bugs but how present and how much of an impact these bugs make. With increasing complexity the numbers of error increase like crazy. The errors do not have to be firm or softwareside. Calculations in wiring, issues with different fields, parts that are faulty. Programms work but they rarely are perfect.
Yoooo, emily, you rock!! Love your british accent. Also lukas and bradleys❤️
The systems are not what is of issue but rather the information the systems I fed with. It can’t give you or make up stuff what’s in it has been inputed and there for makes the entry point very important
as a programmer and seeing how other programmers code causes me to trust a todler more than a computer
"Why you shouldn’t trust computers" to read that from a technocrat makes me keep believing in humanity.
the subject has become the host!
Love how Brad changed his gender!
6:40 Even in aviation, in a emergency situation we have this rule: aviate, navigate, communicate. So whether is true that in afl conditions we learn to trust the avionics over the our human perception, when something doesn't go well "aviate" comes before "navigate"
Wow she is gorgeous. Really loved the way she narrates everything. Good job team.
Emily is a great host!
The android in the thumbnail looks nice. Hope she won't get into a family with a depressed, addicted father and have to take a little girl to escape from the advanced but chaotic society.
@avaaa112
Жыл бұрын
maybe she will meet another android that was really tall and strong that would protect her and the little girl and maybe she will found out the little girl is also a android
0:16 About the numbers thing. I have a hypnotizes that we didn't actually remember all those numbers. but the button press combination on the phone. Now we have touchphones where there are no buttons(you cant text blind on a touch) Like some dont remember what their credit card code is, but where one presses.
@fsandaksuensilelnjis
Жыл бұрын
Nah man, I remember growing up when we still used landlines and I had memorised different towns area codes and my friend and family's numbers. It was really easy to remember when you understood how they were formatted. You just break larger numbers up into sets of smaller numbers.
I trust computers, What I don't trust are humans
@MrMich1lol
Жыл бұрын
Who makes the computers? 🤔
ah yes my favorite detroit become human character emily
the sets are getting wicked sick
"smartphones quickly removed the need to remember strings of digits" the quick dial of your old landline phone 🤨 plus cellphones before smartphones were also capable of that..
@ss_avsmt
Жыл бұрын
I think she made her point very well. 🤫
@fetchstixRHD
Жыл бұрын
Not to mention the slightly less convenient method of having them written down somewhere 😂
another example is drawing software adding auto colour and rendering features, Ibis Paint famously struggles with darker skin tones due to a lack of dark skin in the training data, this is one of the many reasons I prefer hand rendering.
Emily is a great replacement and a perfect presenter for this program, well done you've took and introduced the perfect human being for this channel. And p.s. she is cute and I'm already in love with her (Fictionally, and maybe a bit for real) haha
@stux1904
Жыл бұрын
SiMp
@thahrimdon
3 ай бұрын
@@stux1904little late but holy shit OC made me cringe. Major “send a random ‘girl’ your entire bank account” vibes lmfao
Talented programmar is crucial.
I can't wait for Emily's next appearance!
Richard Stallman was right!
Is it me or all the host on this channel looks classy?!
Emily is now working in sumsub? 🤔
I used to remember 17 phone number of my family when I was a kid during 2000. It's was like a game to me that time how many number u can remember. But not I can remember only mine and my Mon lol
Once a time when Emily was a kid, she is a great toys owner after Andy. Now, she abandoned those toys to be youtuber for living
I have my own story to tell i was looking to go for a college which is in out skirts of a city i trusted Google maps recommendation so much that i drive into a rough road only to find out it leads to a feild behind the college but now maps has gotten better
R.I.P.
That Detroit: Become Human thumbnail caught me off guard.
Any episode with Emily is better than one with Bradley. I could listen to her read her grocery list.
I find it kind of ironic that the videos of F/A-18 Hornets are from a simulator and are not even real aircraft. I am not 100% sure but 99% that at least some of it are from the "Digital Combat Simulator" or as it is more often referred to "DCS". The mistake is easy to make and in fact much of the aircraft footage from the war in Ukraine where actually pulled from this simulator in the beginning of the war. Don't want to be a vice guy here, its incredibly realistic (fooled the entire world recently as said above). Love your channel welcome Emely!
@georgeu6994
Жыл бұрын
Yep, all around 4:30 and 4:51. The rest appear to be genuine. At least it isn't being claimed to be true F/A-18 Hornet's.
@horntx
Жыл бұрын
I am a bit confused, why does it matter if the footage is from simulators? You can't expect the news to have real footage from inside the cockpit of military aircraft actively attacking another country. If it is just footage to illustrate the aircraft which was involved (which it almost always is) then who cares if it is real or computer generated and why should the news not use it?
@georgeu6994
Жыл бұрын
@@horntx If footage from simulators is used to spread fake news, then it can be very bad (it has been used to spread fake news already). Fully realistic aircraft wouldn't be necessary for news anyways. A simple, Tacview-like visualisation would be all that's needed.
I miss Bradley
Why doesn't my mind believe that Emily is a real human.
Sunsub gave sharigan to Emily 😮
i dont have a smartphone and live in a small cabin in the woods.
The gym, Emily. Hit it.
@dewok2706
Жыл бұрын
"2/10 would not bang"
Well yes but there is one thing missing here: The computers are not perfect at what they do. But humans are orders of magnitude worse. You can't get the consistency of a computer from a human and yes, they kinda suck at identifying cats or doing floating point math but no human could fly a modern fighter jet without the flight stabilization assistant that inputs dozens of minute corrections per second just to keep the plane stable. Even the 80% hit rate of the defect missile defense system is better than anything a human in control of similar armament could achieve. And even in the cases where they aren't perfect they perform operations thousands of times faster than a human. Should they be trusted with matters of law and medicine? Depends. But everyday life? Idk my calculator is still better at math than me and I definitely can't remember when all the shops in my area open and close.
I don't remember my number off of the top of my head. I've never had to call it.
@themacbookgamer
Жыл бұрын
Its strange that more of my friends have my phone number than I do.
@emmaisalone
Жыл бұрын
I know my mom's
sumsub: don't trust computers Me who uses cobol: what are computers, you mean punch cards
Bias in, bias out
GPS tried to drive me of a cliff. Thankfully it was daytime, so I didn't drive of it.
@kiv0x
Жыл бұрын
I honestly wonder how that route was learnt.
@discorduser3197
Жыл бұрын
@@kiv0x some programmer's bad joke?
@kiv0x
Жыл бұрын
@@discorduser3197 AI doesn't learn from programmers, it learns from actions done by other users, watch the video.
@discorduser3197
Жыл бұрын
@@kiv0x bro don't take my joke literally Also, I watched the video, in no way does it talk about people influencing navigation. Google Maps uses... MAPS, I know, shocking. And those maps can easily be manipulated to have fake paths...
@discorduser3197
Жыл бұрын
@@kiv0x and do you actually believe navigation services use "AI"?! It's just a bunch of algorithms going through the map, it has nothing to do with any kind of intelligence!
I rely on my Apple Watch a lot. And my iPhone is often with me.
I trust Emily 😃
It's pronounced I triple E 🤗
Emily is gorgeous and nice to listen to
As far as know Tesla is not close to autopilot. To the point where it should be a crime for them to term it as such
I want Bradleyyyyyy
now binance has office in cyprus
How tall is emily?
@yonathanraviv1063
Жыл бұрын
yes
@israil674
Жыл бұрын
6''7'
@yonathanraviv1063
Жыл бұрын
@@israil674 she is not 2 meters.tall
@reggiedixon2
Жыл бұрын
And has she been a fashion model?
@israil674
Жыл бұрын
@@yonathanraviv1063 your parents misspelt jonathan
no car gps company has ever claimed that if you have no visibility that you should follow the gps blindly ... that woman drove into a lake because of human error . if you cannot see do not drive . dont blame the technology blame the human stupidity for asking too much of it
3… 3 Numbers, lol rip
Bred
thumbnail is weird
Slide over Bradley.
Emily your videos and those of your colleague are really great. On an unrelated note, you are such an attractive, elegant, lovely young lady
I don't know but she looks different person every time
Giggidy
God damn make this woman the queen of England
Asimov would be proud.
I hope you bring the old host back
bring emily back!
This is kinda why at a very young age (programming since age 5) I vowed to not code anything where a humans life could be at risk
Is she a real person or just a deepfake?she seems unusually tall or is it just me?
@titfortat6534
Жыл бұрын
i felt the same
@je6874
Жыл бұрын
She feels very rigid but I think that’s because she’s probably new to acting or this type of acting…
This is why a total breakdown of the system is imminent. Now compound that with a world economic crisis and a world immigration problem and it won't be long before all the money in the world won't help those with all the money in the world ¿`_
emily does a great job and all of that stuff but while watching the video it came to my attention HOW FREAKING LONG her legs look
Hey I know my mother's phone number by heart since I was 5 years old! Mainly cuz it's 666666(xx) :P
I think she needs a better chair!
@6bim4uYGfeGSM4jdEm9g2
Жыл бұрын
consoom chair 🤡