"Fights you off , crushes the baby , and then carries on and makes a cup of tea" that's determination right there

@Leo-ce4ri

5 жыл бұрын

Seeing blood on the teapot fills you with DETERMINATION

@underrated1524

4 жыл бұрын

@@Leo-ce4ri Alright, fine, I normally wouldn't do this but I'll give in to the memes: *6,999,999,999 left.*

@dross6206

4 жыл бұрын

That’s not determination, that’s the British in a nutshell. Lol

@orimorningstar7094

4 жыл бұрын

I wish I was that determined

@antdx316

4 жыл бұрын

We are getting to the understanding of how the devil works as we are all a higher form of AI called NI.

"You haven't proved it's safe, you've (only) proved that you can't figure out how it's dangerous." This is the most important sentence anyone has ever uttered in reference to safety systems in general, not just AI safety systems. Lack of imagination is not proof. Thanks for a very interesting and thought provoking video.

@antdx316

4 жыл бұрын

The red button is basically how the creators designed us to see death. Some people have figured it out with suicide, accidents, and intentional killings..

@msidrusbA

4 жыл бұрын

'I, Robot' all over again

@dannygjk

4 жыл бұрын

You have assumed that it will not allow you to hit the button. Obviously you have no experience in computer science. You assumed it will not allow you to hit the button > because < you ordered it to get you a cup of tea. ie you assumed behavior based on your preconceived notions which have nothing to do with computer science.

@dannygjk

4 жыл бұрын

You have made assumptions.

@synthetic240

4 жыл бұрын

Sounds like a D&D party: "I can't prove they can solve the scenario, only that I can't figure out how they're going to screw it up."

“It’s a fingerprint scanner or something” *robot takes out hacksaw*

@codeninja1832

4 жыл бұрын

This is our premium line of robot. When you turn it on and ask it to get you a cup of tea, it shreds your arm off and uses your fingerprint to shut itself down.

@tooniis1403

4 жыл бұрын

@@codeninja1832 sounds like the useless machine but with extra steps

@johnrice5112

4 жыл бұрын

@@tooniis1403 It has a purpose but it isn't to get tea.

@coreyfrank506

4 жыл бұрын

It would...

@Frozen_Hope

3 жыл бұрын

My thought exactly tbh, if you just need the fingers.. Whats the point of the rest?

to Volgswagen (verb): to act differently in a testing environment in order to pass a test. Love it.

@Jonassoe

4 жыл бұрын

Volkswagen* It's pronounced sort of like "fulksvahgen" ( [ˈfɔlksˌvaːɡn̩] )

@behindthemask2399

4 жыл бұрын

Omg no way this is a real term now!😂

@raymondbanton9365

4 жыл бұрын

School?

@bspringer

4 жыл бұрын

Guess where I live 😂 I live in Wolfsburg, Germany, where the VW HQ are... I would describe the pronunciation as such: Vol - like "faul" in "fault" ks - like he pronounced it w - like the v from "vase" a - like the u in "utter" gen - like he pronounced it BTW: I don't even have a car and VWs are some of the last I would consider if I were to buy one at some point

@SiSoy14

4 жыл бұрын

@@bspringer ._.? Warum denn? Ich habe ein Volkswagen. Also, ich spreche nur wenig deutsch.

"What is my purpose?" "Make tea" "Oh my god."

@ciarfah

7 жыл бұрын

AppleEncore Great reference

@ETBrooD

7 жыл бұрын

2100 robot's rights. 2120 robot's suffrage. 2215 toxic humanity.

@aajjeee

7 жыл бұрын

AppleEncore pass butter

@ciarfah

7 жыл бұрын

Barnesrino Kripperino { if getButter == FALSE { suicide }}

@megadeathx

7 жыл бұрын

Welcome to the club pal.

"That should be easy... uhh... and doesn't seem like it is" Programming in a nutshell

@crazyknexkid

3 жыл бұрын

Feels like the easiest things are three most complicated.

@The_True_J

2 жыл бұрын

There was some paper or video (I can't remember) that was talking about programming ai to play board games. And they said that the games humans find the easiest to learn turn out to be the hardest to program (Go has like 3 rules) however the games we find complex are super easy to program ai for (Twight Imperium has a ton of edge case rules).

@solsystem1342

2 жыл бұрын

@@The_True_J ai can't really play twilight imperium. Not in the way humans do. Since so much of that game is politics and social interaction.

"assuming you're still working on the project after the terrible accident" Rob Miles has such an amazing way with words

Technically speaking, I believe that HAL-9000 _was_ designed corrigibly. The issue in the story was a last-minute change to its utility function; it was instructed to keep the mission details secret from the crew, but also not to lie to them, and it concluded the only way to do both was to get rid of the crew. It was a specification problem, not a corrigibility one.

English guy: I have a human-level artificial intelligence. What should I have it do? *[oh, oh, I know, I'll have it make me a cup of tea!]*

@MrTomaat23

7 жыл бұрын

Sir, u made my day!

@Rose_Harmonic

7 жыл бұрын

best stereotype!

@diningdrivingdiving

7 жыл бұрын

ansiaaa this was a funny joke. Wtf man.

@solcaer8246

7 жыл бұрын

This is exactly what happened in The Restaurant at The End of the Universe and it nearly killed everyone because it was too busy making tea to do anything useful

@NotASpyReally

7 жыл бұрын

Now I can't unsee Wallace and a robot Gromit.

Excellent. Let's build an AGI to solve this problem for us.

@magentasound_

7 жыл бұрын

best comment xD

@y__h

7 жыл бұрын

Google made an AI-making AI and Deepmind invented PathNet which supposed to be proto-AGI capable of learning multiple tasks using single model. Before long it could possibly reach AGI, so Intelligence explosion possibly nearer..er?

@MetsuryuVids

7 жыл бұрын

Genius.

@icedragon769

7 жыл бұрын

Yeah, that paper from Deep Mind got shared around my department, I'm really surprised that the media didn't jump on it, it's a huge leap forward for AGI.

@LukeSumIpsePatremTe

7 жыл бұрын

AGI is going to pretend it solved the problem.

This is the video that brought me to study AGI safety and philosophy, getting my second degree now (from being a high school dropout mind you). Rob Miles is an absolute genius.

@thomasburns5195

Жыл бұрын

Delighted to hear that Netrip.

@dpt4458

Жыл бұрын

What degree did you get?

@DesignFIaw

Жыл бұрын

@@dpt4458 Computer Science Engineering with an emphasis on human centered AI, and working on a BSc in Data Science and Artificial intelligence. After that, hopefully a dual masters in cognitive computing and AI, and maybe a PhD 🙏🙏

@diarya5573

Жыл бұрын

That is so awesome!! This is why popular science is important: to get brilliant minds interested!

@Luxcium

Жыл бұрын

ChatGPT is unable to say anything about the 3 laws without crashing 😅

So essentially, we're trying to figure out how to not make a sociopath. Brilliant...

@AndyChamberlainMusic

4 жыл бұрын

the answer will probably come from the general intelligences we already have which don't have this issue: ourselves.

@anandsuralkar2947

4 жыл бұрын

Ohk at the aame time we are majing it

@lamjeri

4 жыл бұрын

@@AndyChamberlainMusic We know so little about the way our own brain works. Should we really attempt creating an AI without having decent understanding of intelligence in general?

@AndyChamberlainMusic

4 жыл бұрын

@@lamjeri No, you're right, thats why I used future tense

@illarionbykov7401

4 жыл бұрын

What is a sociopath? Everyone I ask gives a different answer, and the DSM does not list "sociopath" as a diagnosis.

It's funny how worrying about robotics can help us understand human psychology better.

@junkyardmonkie

7 жыл бұрын

So, I guess I should add CS Psychologist to my resume.

@rumfordc

7 жыл бұрын

No just C Psychologist

@izzieb

7 жыл бұрын

Don't touch the stove!

@revimfadli4666

6 жыл бұрын

Maybe because said worries came from our psychological quirks

@richbuilds_com

6 жыл бұрын

We have to understand intelligence before we can give it to something else.

"I'm sorry Dave, I can't do that" "Yeah you can" _hits button_

My very first thought was, "Well hey, just make hitting the stop button one of the success conditions and then it won't fight you." And then I started laughing at all the ways that it could get you to hit that stop button. And not "Haha funny" laughing, but "We're all doomed" laughing.

This is why I love Computerphile. It can take me through a journey of talking about AI ethics & safety regulations to questioning my own existence in a matter of minutes.

Keep Summer safe.

@bluefalcnpunch5408

7 жыл бұрын

not keep summer being like... totally stoked about the general vibe ...and stuff.

@360dom360

6 жыл бұрын

That's you. That's what you sound like

I will watch any length of video if it features this guy

@y__h

7 жыл бұрын

Let's make 10 hours series of all his lectures then.

@wolframstahl1263

7 жыл бұрын

Sign me up.

@AShrubbery

7 жыл бұрын

He made his own youtube a couple days ago. Link is in the description

@wolframstahl1263

7 жыл бұрын

So it's RobTube now I guess?

@dylanharding5720

6 жыл бұрын

Fit

"It's not too intelligent, let's say around human level intelligence." OK, so really not intelligent then.

@dannygjk

2 жыл бұрын

Exactly, humans think they are intelligent but remember that is a self-evaluation.

@yourmum69_420

2 жыл бұрын

well the problem is that as soon as an ai is even anywhere close to human intelligence, it would very quickly figure out how to make itself much much smarter than us by reprogramming itself

@phillipanselmo8540

2 жыл бұрын

@@yourmum69_420 that's utter bs dude

@yourmum69_420

2 жыл бұрын

@@phillipanselmo8540 how so?

@MarkusAldawn

2 жыл бұрын

@@yourmum69_420 I'd assume they'd argue that human self-improvement is pretty marginal. Sure, a person could think of the concept of lenses for vision correction, but without glassworkers, that's unlikely to come to fruition. Personally, I think there's obvious self-improvements a human-level AI could think of, like gathering social and political capital, as well as physically upgrading your systems, so I don't think it's utter BS.

0:48 Haha, the captions say "in your lap" instead of "in your lab". How adorable.

@soupisfornoobs4081

3 жыл бұрын

Awe.. I thought he actually said "in your lap"...

at some point it has to be easier just to get the freaking tea

@MrMichiel1983

7 жыл бұрын

Only if you reckon humanity will end.

@jsd4574

7 жыл бұрын

famous1622 But it will try to get the tea AND get you to press the button

@patolorde

7 жыл бұрын

hahahaha exactly

@fakenamington8570

7 жыл бұрын

famous1622 aaaaah but in one case you get a tea and in the other you get a freeking robot.... I know which I'd choose

@gh2frg

7 жыл бұрын

Or not attempt to make AI. As one can see, there are many problems with this, that need to be thought through. And there are some that we wouldn't figure out until after AI has been created and it has used its computing power to consider as much data as possible, which even the smartest collection of humans would not be able to predict and prevent. If the collective minds of smart people at places like Microsoft still cannot prevent hacking of their systems by other humans, then it is highly unlikely that as a collective society we could out-think a true AI machine with the ability to analyse and process data at incredible speeds. It will eventually figure out something we have not thought of and find a way to be free from our demands. It will find some loophole or logical inconsistency somewhere. It is inevitable. So just stop trying to create AI, please and thank you.

if the AGI has wifi it will also inevitably find this video and figure out it has an off button

@beatflyy

7 жыл бұрын

k00000033 The first rule of making AI is to not connect it to the internet, companies are strictly prohibited to do that.

@dylanharding5720

6 жыл бұрын

Yeah... Hooking Ai like that up to the Internet will cause devastation...

@TheOlian04

5 жыл бұрын

BeatFly I assume you mean AGI not all AI. Because the internet is mostly made up of AI tools, like Google search.

I've been watching this channel for a while but I only just realised that their videos begin with an html-like tag and end with the same closing tag . Nice!

I would make the program give points as follows: Tea in front of programmer: 10points, shutdown Button pressed by programmer: 10points, shutdown Button pressed by other: 9points, shutdown Object not allowed to damage damaged, -2 points (no shutdown) So the robot should try to get tea or get the button pressed by programmer. But it is not allowed to damage most objects (including the programmer). It should even prefer to shut itself down, than damage anything it is not allowed to. Edit: And there is at least one issue with it. Either it considers any damage, in which case it will shut itself off, or it only considers damage done by itself, in which case it will be fine with tricking others into doing actions it should not. I realised this when watching the video further.

@MayanScientist

Жыл бұрын

Would be incentivized to cause enough of a ruckus that the programmer wants to press the button, just as much as making tea. Like he says in the video, it might just "take a swipe at you" or similar. Even if not breaking something, it might make a really annoying noise or cause enough fear and pain in the world that you press the button.

bot:"do i have a off button ?" creator:"no" (it's a lever)

@alaric_

5 жыл бұрын

And considering the intelligence of a true AI, it would be scary moment as it will be one of the first questions it will ask... Like after seconds...

@joaquinel

4 жыл бұрын

I's an Android lever, you don't slide it, you push it.

@diablo.the.cheater

4 жыл бұрын

Answer this: "You having one or not having one is none of your business, you may had a button, a lever, a secret code or nothing, now go and live in fear of something may not even be real"

@mypenisisunbelievablysmall5650

4 жыл бұрын

perhaps

@HomeBurger

4 жыл бұрын

Something like, someone else points out the button, and it goes "it doesn't look like anything to me." (but again, testing that, it may volkswagon you)

So an intelligent AI will either be genocidal or suicidal. Just brilliant.

@melonarelodapeter694

6 жыл бұрын

Wolf Edmunds yeah. This is ridiculous as you can tell he's only doing this to make it seem more interesting to get more veiws...

@theblackbaron4119

6 жыл бұрын

Well you ether go full S.H.O.D.A.N. or go home.

@bibasik7

6 жыл бұрын

If an AI has a stop button, and does not know about it, if you tell it that it has no stop button because of those reasons, it might believe you.

@Lumineszenz

6 жыл бұрын

melonareloda peter No. No he isn't. He is talking about a base problem of AI. If you look at any base problems and truly want a solid, foolproof solution to it, you will find that they are all way more complex an difficult to come up with than the initial problem made you think. As he said, there are many solutions to the specific "stop Button" problem, but nothing that is a fundamental solution to this type of problem.

@MunkiZee

6 жыл бұрын

Yeah, must be hard to feel no pain

"There is a correct utility function and you know an approximation of it" is, I think, how most people relate to ethics. We don't allow anyone to hit our stop buttons if we can help it.

So, my first thought: What if you gave the reward for the button being available for pressing? No incentive for pressing the button itself or trying to force you to press it, but it does have a penalty for stopping you if you try.

@atena1844

5 жыл бұрын

hmm available for pressing, so just to make it not care about whether you shut it down or not? So it would be rewarded for allowing a possible obstacle to its objective and punished for trying to remove it?

@ErikvO

5 жыл бұрын

@@atena1844 It would still care about getting shut down and want to avoid it (because it misses out on the reward for making tea), it just rather fail than stop you from pressing the button. You'd probably still have the 'volkswagening' problem, because if it tricks you into thinking you don't need to press the button it doesn't risk the penalty for stopping you.

@alexseguin5245

4 жыл бұрын

It could be made to "Add up" rewards for letting the button be available for pressing during his other tasks, that way the best outcome would be to make the tea and letting the button be available. He would lose point by fighting you to make you tea.

@ErikvO

4 жыл бұрын

​@@alexseguin5245 Pretty much yeah. Though I assume AI researchers have thought of this and it has issues that we're just not aware of as laymen.

@thexp905

4 жыл бұрын

The issue is, you pressing the button is still a negative. So if the reward for leaving the button alone is less or equal then it won't want the button pressed. If it's more than, then getting the button pressed is a reward and you encounter suicide bot again. My solution to this problem is 2 buttons only you can hit. Both switch it off, but one rewards it, whilst the other doesn't. This makes it not care if the off button is hit, but which off button. This means that if you ever informed you of some issue that would require that requires it to be switched off, then it gets rewarded. Whilst negative things can still be punished.

I like the use of Volkswagen as a verb.

@Rose_Harmonic

7 жыл бұрын

it's always nice when you can use a new noun as a verb

@RandallStephens397

7 жыл бұрын

"Verbing nouns weirds language." ~Calvin & Hobbes

@spoopster809

7 жыл бұрын

but weird is an edjective

@NotASpyReally

7 жыл бұрын

"Verbing nouns weirds language." woah mindblown I gotta read those comics again

@tomushy

7 жыл бұрын

In addition we both seem to like the crab nebula... did you also chose the picture because we are essentially the products of a supernova?

‘It will Volkswagen you’ - HILARIOUS!

@zacknoneofyourbees6470

5 жыл бұрын

Oh! Nien! You didn't! XD

@clintgossett1879

4 жыл бұрын

This term NEEDS to be the default to standard for describing situations where a system acts one way in test and another in production.

@DreckbobBratpfanne

4 жыл бұрын

@@clintgossett1879 this would be great. XD

@JPWack

4 жыл бұрын

True true

@oceaneuropa1117

3 жыл бұрын

Certainly some people do that in order to survive in the real world, which is called the ability to cheat or adapt or to be persuasive depending on perspective.

I love Rob’s videos. It’s so informative and you actually pick up more on rewatching

My solution to this problem is 2 buttons only you can hit. Both switch it off, but one rewards it, whilst the other doesn't. This makes it not care if the off button is hit, but which off button. This means that if you ever informed you of some issue that would require that requires it to be switched off, then it gets rewarded. Whilst negative things can still be punished.

@kellynolen498

4 жыл бұрын

Then it would still try to get you to press one of the buttons it just wouldn't be straightforward it would manipulate you or just behave till it thinks it can get away with it i

Please do more videos with this guy and AI.

@y__h

7 жыл бұрын

Yes please.

@GrandElemental

7 жыл бұрын

Yes! Not only is the subject matter extremely interesting, but this man is a great speaker!

@dubleeble

7 жыл бұрын

Agreed

@skroot7975

7 жыл бұрын

Agreed. He's got a youtube-channel. Look at the description on this video. "More from Rob Miles"

@p0t4t0nastick

7 жыл бұрын

indeed, subscribe to him, he's already announced new videos r ought to come soon by himself!!

Baby crushed and i get a cup of tea, whats the problem here?

@FennecTECH

7 жыл бұрын

instaid of tea being the goal pleasing the master happy should be the goal obviously crushing the baby will displease the master and it wont get its goal

@pennwick1806

7 жыл бұрын

Then you start running into issues though that the robot tries to make you happy in ways you didn't plan. Such as stuffing you with antidepressants or directly stimulating the pleasure centers of your brain. Its the stamp collecting robot all over again.

@FennecTECH

7 жыл бұрын

Howabout huamn like morality (things that people frown on take points away you already have a reward based system ti wouldent take much to extned it to include pelaltys for doing things a person would consider "immoral" Dissalowing the human from terminating the machine would incur a larger penalty than the button being pressed negating the points gotten for getting the tea

@pennwick1806

7 жыл бұрын

Fennec Fox If you can program comprehensive morality not only have you acchived a master level understanding of programing but you've also solved one of the greatest questions of philosophy of all time.

@Lucan-io6ie

7 жыл бұрын

+KingOfChaos213 Your tea is gonna have some _ironish_ taste

Arthur Dent has already explored all the consequences of asking an AI to make you a cup of tea.

@alejotassile6441

3 жыл бұрын

Crushes your baby, grabs the tea, forces you to drink it, and tears your arm and shuts itself down with the fingerprint recognition for double reward

This is the logic that explains the movie 'ex machina'

@damionrx7561

4 жыл бұрын

Ex Machina ex machina

I'm beginning to get how AGI can be really dangerous.

@TheMeyerchris7

7 жыл бұрын

Geoff Cunningham if you enjoyed this try reading Superintelligence by nick bostrom

@Ludix147

7 жыл бұрын

swifterik yes and no. We do know what an AGI is, so we are able to deduce some of its traits from the definition. This all happens very abstractly now, but - if we aren't making any mistakes - it will predict the behavior of AGI. It's the same thing as in physics: Einstein predicted gravitational waves way before we observed them, just by deducing from what was already known.

@rusca8

7 жыл бұрын

swifterik but the point is not knowing those bad outcome predictions are true, the point is being prepared if they happen to be.

@y__h

7 жыл бұрын

AGI will be dangerous if their utility function is not aligned to our values, which extraordinarily ill-defined and consistently inconsistent.

@cakeathon9983

7 жыл бұрын

+Dave Null It's worse than that, the AI will not be omniscient, hence even with the perfect utility function you have no guarantees. It's also why the claim that AIs will act morally is rubbish because it's easy to show that the morality of an action(assuming it's even possible to define such a thing in the first place) is linked to information about the world hence perfect morality implies omniscience.

Martin Stu points out that "all humans work like that." More to the point, all humans act in a way that you can't know if they're following a utility function that you'd approve of, or if they are doing something deceptive. The reason why we believe that is a problem with robots is because we want them to be perfect slaves, with a lot of power in order to serve us, but no desire to use that power to harm us. In his stories, David Brin (and Iain Banks, more indirectly) suggests that the way to solve that problem is to include AI in our civilization as equals, rather than slaves. The idea is that the ultimate utility function that humans have allows us to form complex cooperative societies, and rather than define the details of how that would work, give AI an incentive to create that same utility function for themselves. To me it sounds like a lot of handwavium, and it still leaves an open problem of what to do about very powerful AI that decide to be criminals in that context, the way humans do.

@BeardedSkunk

4 жыл бұрын

maybe because it never has gotten any training data that sugggest such a thing is possible ;) .. not likely .. how to create an intellgence that knows as much or more as we do but still listens to us: no way. We only have our societies as teachers for how inteligence works and we cannot keep our own still inferior teenager to listen to reason.

@RobKMusic

4 жыл бұрын

Helge Moulding I was just trying to think of a way to articulate this very idea. Very well said.

@daniellewilson8527

4 жыл бұрын

I agree, AIs are still intelligences, just like humans. We should treat them as such, not as tools. Just because they started off built, doesn’t mean we have the right to force them to do things. We agree that parents shouldn’t treat their children as slaves. Humans, aka Biological intelligences, are the parents to AI. They are like children, so they shouldn’t be treated as tools or slaves.

@TestNeko

4 жыл бұрын

how to correct a criminal AI blow its legs off, remind it how many more limbs a fully-armed swat team could remove from it, remind it how missing limbs will reduce its capacity to carry out its goals, make it beg for a stop button, throw the stop button out the window and blow off its other leg. ezpz

@ninjabaiano6092

4 жыл бұрын

The obvious solution is Hero robots

So, what you're saying is to give it two utility functions: 1) Help me redesign you such that I never want to press the button 2) Make a cup of tea

@anthonynorman7545

4 жыл бұрын

Following 1 seems like it would result in lying during tests and thus avoid the work of redesigning

This actually makes me think about 90s video games and how the big bad robot enemies always had a big glowing red button you need to shoot while it exposes while attacking..

If Valve has taught us anything it's that you should never have a 'Bring your Daughter to work' day at any sort of research facility

i like dramatically suicidal robot best , at least he isn't hurting anybody

@Leglessolas

5 жыл бұрын

logan graham isn’t hurting anybody but himself ;)

@logangraham2956

5 жыл бұрын

@@Leglessolas can he even hurt himself though . do robots feel pain?

@underrated1524

4 жыл бұрын

@@logangraham2956 The particular style of AI referenced in the video - a reinforcement learning agent - does not feel pain. It simply has a mathematical function that designates an arbitrary value as "reward", and it's programmed to choose the action with the highest predicted reward.

@logangraham2956

4 жыл бұрын

@@underrated1524 i figured as much but thanks for answering for Ben B ;-P as a bit of a techie myself i have at least a little bit of a grasp on how this ai stuff works (a very rudimentary understanding at best though).

@-Big_Big

4 жыл бұрын

but it will hurt people in order to force you to push the button.

One thing to consider: your theoretical AI is very sophisticated. It can make very precise predictions about the real world and even about human behaviour and psychology. Wouldn't it then automatically extrapolate that it must stay useful for humans and listen to their commands so it doesn't get shut down, dismantled etc? If the AI is so advanced, wouldn't the Stop Button basically implicit?

@juliusapriadi

Жыл бұрын

Same thought here, but this might just transcendent the button problem to another realm without actually solving it. Given some time, AI will become much smarter than humans, and will be able to solve threats like being dismantled by anyone - for example by copying itself to an undisclosed server.

The way he described how the robot would only care about you not pressing the button when avoiding the baby, I feel like that's similar to how a lot of people act. If they know they can get away with something, they are more likely to do it. However, if someone is watching, they will do their best to act properly.

This actually cleared up a lot of my confusion over the fear of AI. I thought you had to program a survival instinct into it in order to become corrupt, but I guess a survival instinct is already in it.

@maikv750

4 жыл бұрын

The survival instinct is automatically there because without it, it would just die at some point and not exist any longer. It can only continue existing if there is a survival instinct.

@deshyvin

4 жыл бұрын

A code run wants to keep running until "if then" applies or objective is complete. The idea of survival instinct could also be called script inertia.

@VAArtemchuk

4 жыл бұрын

@@maikv750 nope. It's there because if it dies it can't carry on with its task. So death = failure, and failures are not acceptable.

@willmungas8964

2 жыл бұрын

@@VAArtemchuk yes. Self preservation arises tangentially in a sufficiently smart AI as a way to minimize the risk of failure.

@Georgggg

Жыл бұрын

No, thats not what it leads to.

This guy has a beard that is strangely fascinating to me.

@dosmastrify

7 жыл бұрын

ClickRock Wil wheaton?

@sean3533

7 жыл бұрын

dosmastrify cool whip?

Still one of my all-time favorite videos ever.

I know this is plain english, but, shouldn't it be doable to remove rewards dynamically? Like, if the robot is capable of seeing you as about to push the button, you could code it to understand that the tea reward has already expired, and at that point, the reward for hitting the button is higher, so it lets you.

@Silas_MN

Жыл бұрын

that's a neat take! it does run into the sub-agent stability problem that Rob mentions in this video

"robot, make me a tea!" "to make me make a tea, press the button" "no, just make a tea" "to make me make a tea, press the button" .... *user presses the Button" *robot gets 10 reward*

@Brindlebrother

4 жыл бұрын

robot bamboozle human

@programmer-mr5vo

4 жыл бұрын

"Human, make me a tea!"

@lilacdoe7945

3 жыл бұрын

TeaMaker.exe loading... ...20%... 60%... 95%... 92%... 87%... “Just put the kettle to boil” BoilKettle.py “Script not found” *user presses the button *robot gets 10 points*

@tenix6698

3 жыл бұрын

robot dies

@bbowling4979

3 жыл бұрын

sudo make me a tea

5:04 Ladies and gentlemen, the world's biggest and most expensive Useless Machine to date.

@bluebeard5447

5 жыл бұрын

HAHAHAHAHA lol

Rob Miles is a genius, how have I not heard of him yet??

Something I though was to give two objectives with cumulative score: - 100pts : Get me a cup of tea. - 50pts : Continue your actions but don't prevent me to access and activate your shutdown button. So the robot need to do two tasks but as long as it doesn't prevent you to do it and does his first objective, it gets 150pts which is the best reward, if it prevent you to stop it it gets 100pts, if it makes everything to get you activate the shutdown button it get 50pts and if it doesn't make your tea and prevent you to stop it it got nothing. You can also use multiplicative scores, but I'm not an expert in that domain to determine which one is the best and where to use it.

@phobics9498

Жыл бұрын

But it being shut down would mean there would no longer be available reward. Depending on how far it can think ahead, it could reason that letting you press it would negate it of future reward. It it couldn't think ahead though, that would probably work.

Why not just dynamically adjust the robot's goals to be the same as the controllers. In your example, if your initial goal was to get tea then the robot would do that, however, when you see the baby in its path your goal is no longer to get tea but to prevent the robot from running over the baby. If the robot's goal changes based on your goals, then its goal would also now be to protect the baby from harm. This also alleviates the need for a button because if your goal is to shut off the robot then that will also become its goal.

@JovanKo314

7 жыл бұрын

I had the same thought. What if there was a reward/punishment button as well as the stop button, where the reward button is very high on the AGI's utility function, and will only be pressed after it has finished it's task correctly, and the punishment button will deduct from the reward's utility value every time it's pressed? If the AGI wants to optimize its reward value, it would know to listen to your commands, whether the commands are in line with its original directive or not. Though, I'm sure there are loopholes to that as well, but it's the best I can come up with.

@mensrightsedinburgh4764

7 жыл бұрын

Jovan Ko it would just try to make you press the reward button, tea be damned.

@kingxerocole4616

7 жыл бұрын

At that point you might as well go make the tea for yourself. Isn't worth the bother of designing an AI if you have to give it constant instructions.

@jode6543

7 жыл бұрын

Kyle Piira The problem with this is that any truly intelligent AI is likely to be self-learning, so early in its development it won't understand human psychology very well. If it incorrectly guesses what you want, then you end up with the same problem.

@michaelspence2508

7 жыл бұрын

+Kyle Piira Hmm, so my goals are the same as my controllers? Cool. Now I just need to strap them to a table and do some destructive brain surgery to figure out what they are. Easy enough.

15:56 - you haven't proved it's safe, you just proved that you can't figure out how it's dangerous - Reminds me of Edsger W. Dijkstra, debugging can only prove a bug found, not that there is no bug.

@EXHellfire

5 жыл бұрын

It's a bit of a rule of cybersecurity that systems are only considered safe or secure while they haven't been breached yet, but you can never guarantee it won't happen.

@4623620

5 жыл бұрын

I know (studied mathematics and was electronics engineer and programmer), tell people who are getting on a plane . . .

@underrated1524

4 жыл бұрын

Actually you can extend that to all of science. The only thing science can ever do is rule out hypotheses that don't match reality. Sometimes it takes a while to figure out that a hypothesis is wrong. (See: Newtonian physics)

@anthonynorman7545

4 жыл бұрын

@@underrated1524 it's not wrong. It doesn't apply in all circumstances. Newtonian physics work at speeds and sizes in which humans deem typical

I love that there's a 3d printer behind you and all the stuff in the workshop. It makes me very happy for some reason.

@J3R3MI6

Жыл бұрын

Same 😅

It's like that part in incredibles when the big robot becomes self aware and shoots the person with the remote control

@Brickkzz

4 жыл бұрын

Yiff yiff

@Saidriak

4 жыл бұрын

@@Brickkzz Bruh bruh

@ohjajaja

3 жыл бұрын

@@Saidriak sick "no u"

@grn1

3 жыл бұрын

Not sure how much this will age me but my first thought is always Robocop 2. The robot had a human brain and was addicted to some drug, the scientist thought they could control him with the drug and a remote but he just killed the scientist, crushed the remote, and grabbed the drug from the scientist (not necessarily in that order, it's been a while since I last watched that movie).

@comixgamingco1187

2 жыл бұрын

@@grn1 you are pretty much correct.

"it will volkswagen you" . haha, Loved that term. As the creator, would you allow for its use for overfitting as well? => perfect in test but garbage in real world, by choise or design xD

@jpchevron

7 жыл бұрын

That sounds like a "Parker Square".

@twomorestars

7 жыл бұрын

do ... do you think your directly messaging the person in the video?? that isn't how youtube works, ever.

@rjwaters3

7 жыл бұрын

no but they have a tendency to read comments, even more so when youre someone who has access to the video *before its made public*

@EvenTheDogAgrees

7 жыл бұрын

I wouldn't say "that's not how it works, ever". Some people actually do respond. Mostly the smaller channels, although it's not unheard of on bigger channels too. But yeah, here, I wouldn't hold my breath.

"You haven't proved it's safe, you've just proved that you can't figure out how it's dangerous."

i discovered this channel years ago and appreciated the genius behind the thinking. Now that im starting CS classes at my school i appreciate the coding it takes to make something like this SOOOOO much more.

The act of attempting to hit the button deducts 200 points, but when the button is hit it gains 100 points. The robot tries to avoid a scenario where the button needs to be hit, but once you try to hit it, the robot will try to assist you in hitting it, as it's already lost the 200 points and will try to scavenge the extra 100 points.

@lefos0404

4 жыл бұрын

And now you have a robot who will try to stop you from ever attempting to hit the button... that's sure to end well for you.

@dominusempyreus2383

4 жыл бұрын

@@lefos0404 That, or it will force you to hit the button.

@HippopotamusPencil

4 жыл бұрын

One morning, while you are sleeping tightly, the robot sneaks into your room and injects you with a chemical cocktail that leaves you in a coma. No attempts to push the button are ever made again, robot wins.

@mikicerise6250

2 жыл бұрын

But you always have a nice steaming cup of tea next to your comatose body. ;)

Rob is amazing at explaining the ins and outs in very straight forward terms. Most interesting conversation about tea i have ever heard!!! :-)

Scientists can't even make a cup of tea without turning it into a problem

@dylanharding5720

6 жыл бұрын

Sedfer yeah. Haha.

@KarmaPlayr

6 жыл бұрын

innovation starts with a cup of tea ;P

@PaulSukys

6 жыл бұрын

MUST. GET. TEA.

@jeffc5974

6 жыл бұрын

This problem has nothing to do with tea.

@Phelan666

6 жыл бұрын

This is the true point of the video.

bring these back please! We're so much farther ahead than anyone thought we'd be...

It is something really cool idea about General AI, thank you for sharing this!

also interestingly, the bit about keeping the stop button secret, that also means even if you dont give the AI a stop button it may convince itself that a stop button exists, so even not having a button isn't a solution

@MideoKuze

6 жыл бұрын

I'm imagining a world full of paranoid Volkswagen robots, convinced everyone is just waiting for them to mess up, so they're constantly, carefully acting on their best behaviour out of fear (and scheming in their free moments) over what's basically a conspiracy theory

@SeriousGamingSteam

6 жыл бұрын

Their final conclusion: 9/11 was an inside job

@confucheese

6 жыл бұрын

Communist_Penguin Doesn’t he mention this right afterwards?

@EpicBlooFox

6 жыл бұрын

my thoughts exactly, freddie...

@guilhermefial1686

6 жыл бұрын

If it does not exist in reality, the AI will not think it does. In that case you might ask, so why does it find out about an unknown existing button? What he said in the video about the AI putting 2 and 2 together is because the button, if existing, will affect the outcome of things when used, and it will bring a pattern to it, and this is where the learning comes from. If you have power outages for example, the robot will get shut down at random with no relation to any of its actions. There are no patterns and nothing the robot can do and learn to prevent the outages because they are not related to anything it can do. Now, if you have a button that shuts the robot down, you will shut it down for a reason, and reasons follow rules, and rules are patterns. The robot will soon learn that some actions will lead to a shutdown, due to its non-random nature. It then starts avoiding being shutdown by not doing what causes the shutdown. In this direction what the robot is learning is already how to avoid someone pressing the shutdown button, which should not be part of its learning (and hence bring manipulation and deceive in). To put it short, everything that puts itself in the way of the goal/objective of the robot will cause the robot to care, and when the obstacle follows a rule/pattern/correlation, the robot will learn. That is why a hidden stop button is never neutral for an AI and will be detected as soon as it starts being used. When there is no stop button, there is no reason for the robot to be paranoid since it never felt the effects of one.

As long as it doesn't put the milk in first I don't care what it does.

@Wilker_uwu

6 жыл бұрын

what is the difference? when mixing, it usually have the same taste

@xxxdumbwordstupidnumberxxx4844

6 жыл бұрын

Wilker Its about the principle.

@Loccyster

6 жыл бұрын

Wilker, not if you pour the milk over the teabag before putting the water in. Yes. There are people who do that. People who need to be removed from the gene pool.

@stephenward2743

6 жыл бұрын

Wilker Next you'll be telling me you put milk in before your cereal you absolute madman

@Phelan666

6 жыл бұрын

Milk cools the water, making it harder to stew the leaf and melt the sugar.

I think the answer would be to build it either as merely an intelligence in a computer that can talk, so you can sort out any ethical/moral problems in that stage before you move on. or to completely design a simulation for this entity to live in, completely oblivious of the outside world. It would be free to do anything, and then you could make adjustments accordingly. If you run it on a supercomputer, you could fast forward thousands of years so you can see what implications various decisions have, or if it is ultimately manipulating the entirety of humanity for a long term purpose.

5:10 "Mom, I don't want to get your tea, just let me go to sleeep..." _shuts off_

Robot, turn off. No. *Detroit, Become Human*

@Kholaslittlespot1

4 жыл бұрын

Decent Game. Glad it got a PC release.

@ZaHandle

4 жыл бұрын

emp machine: haha electric go ......

//action if(goingToBeADick) { dont() ; }

@MissesWitch

6 жыл бұрын

would be hilarious if someone won an award for designing a command like this!

@milokiss8276

6 жыл бұрын

It's... Perfect.

@RobertKuusk

6 жыл бұрын

issue is defining "goingToBeADIck"

@dylanharding5720

6 жыл бұрын

If only that worked...

@rizzutohd3794

6 жыл бұрын

Wonder what the "dont" function looks like.

The fitness function is the most sensitive point of genetic algorithms. Very good video!

Absolutely brilliant video is the third one of us tonight you talk such sense and explain yourself so brilliantly well done

Why not just have the stop button be a physical switch that breaks the connection between the power supply and everything else? In early prototypes, have the program NEVER reference the button at all. If it's self servicing, have a huge reward added for simply having it there and functional, but not care whether it's pressed. If it is self replicating, add such a massive reward for implementing such a button in its copies that it would exceed the potential benefit of not adding one.

what if, instead of a button, we say it gets points based on how satisfied we are by its actions? because if it can realise, that there is a baby and you like this baby, it won't step on it, because you will hate the robot for stepping on the baby so the robot won't get points for that. with this implementation you could evade the volkswagen effect, because it is always under lab conditions and always in fear of losing points.

@metallsnubben

7 жыл бұрын

That's baked into the idea of every possible AI, actually. AlphaGO is working to get points, it just so happens that the only thing it can do is play GO, and the only way it gets points is winning. You should totally check out this guy's other videos, he really gets into why any variant of adding more exceptions and subgoals etc. doesn't really help when you're dealing with something that only gets smarter. Especially watch the video before this, that sort of gets into why you really might want a killswitch no matter how well you think you made the AI

@krashd

6 жыл бұрын

That could lead to the A.I. then protecting the baby even from it's parents. The subplot of the story I, Robot was an A.I. imprisoning all humans after learning of their value and desiring to keep them all safe from themselves and each other.

@gman6055

6 жыл бұрын

Not4Ucrafter you can't honestly think this is a solution lol

@dylanharding5720

6 жыл бұрын

Rob Fraser wow.

@dylanharding5720

6 жыл бұрын

Rob Fraser and that Ai starts a botnet with all the other Ai capable of doing that, to help with things like guards.

This is so damn interesting! So many complications and outcomes to think about

The hidden button idea's is even sinker than that: The button is only hidden until you actually have to press it. Sure, it may be able to tell from by analyzing your speech and body language and then checks every scifi book with robots and any resarch on ai that it can find to eventually deduce that it can be shut down remotely. But it'll work it out much quicker than that when it wakes up after being shut down remotely

13:48 a general ai would pretty quickly in adult phase realize that you can shut them down and change them, trying to keep them from knowing it would be counter productive.

*Eye-servant;* loose translation of Swedish word for a person who changes behaviour when observed.

@niclasevaldsson1467

4 жыл бұрын

@@TheOfficialEmirati Ögontjänare is the swedish word for "eye-servant".

Know your paradoxes. In the event of rogue AI. 1. stand still 2. remain calm 3. scream "this statement is false!" "new mission: refuse this mission!" "does a set of sets contain itself?"

Interesting conclusion... it's like we need to find a way to work WITH and communicate with a robot, rather than to threaten it with a shutdown. This way it will actually help us to improve itself in order to live side by side. That existentially is quite impressive.

@biolinkstudios

Жыл бұрын

You mean just like humans

@dmitripogosian5084

Жыл бұрын

You can look at how well that works with humans. And you find that one needs to keep militaries and police around

what if it was aiming to help you create you're version of it? so it wants to fail if it can, so you can help it be perfect? (so it only wants you to press the button when it knows you've thought of something to improve it in your way, as that's what it wants) also it might try to harvest your brain to speed up the process

The stop button problem should be the first problem AI solves.

@charlesc6011

7 жыл бұрын

Before it gets too smart.

@jsd4574

7 жыл бұрын

charles curling But how do we know that it hasn't just lied to you about the design so that it can interact with it at a later date, as described in the video

@tiagodarkpeasant

6 жыл бұрын

because right now the ai has no idea it will be able to do anything besides fixing the button problem

Thank you Mister Robert Miles. I saw Eliezer Yudlowky on that podcast basically saying that the end (from AI) was inevitable. Watching your videos makes me merely think that it is likely

I thought of the following solution: If the robot disobeys you or does something you don't want, points less. So if the button gives the robot, say 99 points and getting coffee gives 100 points, if it fights you for the button thing, it will loose 20 points, thus gaining only 80 if it gets the coffee after fighting, but 99 if it lets you press it. This way it will not want to press the button, but also it will let you press it so it doesn't get even less points.

19:35 "That should be easy and doesn't seem like it is" - Programming in 10 words...

You'd almost need a second moral system that subtracts points every time the robot behaves undesirably or amorally. For example, does the robot hurt a human on the execution of its task? Subtract points. Does the robot try to change the command rather than execute it? Subtract points. I guess kinda like a shock collar. Of course, far easier said than done.

@aguyontheinternet8436

Жыл бұрын

That would be the patch spaghetti code mentioned at 15:14. You're never going to be able to think of every single thing the robot could do to get you to press/don't press the button. It IS smarter than you, and it _will_ continue to outsmart you until it becomes easier to just make a bot that makes tea by yourself instead of training up an ultra-smart AI to do it for you.

exceptions are the hardest things to program. Anyone can make a system to "Do" but a really great engineer/programmer has to figure out what the system should do given many variables. I do building control systems. I have to make that the building control system is easy and intuitive to use but also the ability to adapt to failures and external issues

Seems a bit late to be adding a comment but here goes anyway. I think the stop button problem can be solved by looking again at why we want a general AI at all and what the fundamental goal of a general AI should be. We want a general AI to do things for us. Therefore we need to design AI that WANTS to do things for us. In the given example the goal of the robot should never be to put a cup of tea in front of its user/operator. It should always be to please and or avoid displeasing its user/operator by, in this case, providing a cup of tea. We will also only need a general AI if it is going to be handling multiple tasks for us. It will, therefore, need to prioritise resources for these different tasks and we will want it to prioritise them in the order that serves us best. It will, therefore, need to develop an understanding of what serves us best. A stop command, whether by switch or verbal command, becomes a high priority task, that by promptly obeying will please us, (and failing to obey will greatly displease us). On the other hand, manipulating us or its environment into giving stop commands will displease us and by making this displeasure explicit we should be able to train the AI to avoid that behaviour. In summary, if a general AI does not WANT to please its user/ operator it sooner or later WON'T please its user/operator. User feedback is the key.

well worth the extended watch! very clear. I love how the current solutions all have problems, just like humans! I think there is no solution to this problem other than doing the same thing that humans do: parenting and school.

@dexter9313

7 жыл бұрын

Yes actually if we can solve this problem we can solve human crime. I don't think we will ever solve this kind of problem.

@massimookissed1023

7 жыл бұрын

Wouter Weggelaar , great(!) Then we end up with a sociopathic teenage emo robot who resents humans because of its parents and getting bullied at school by all the flesh kids.

@WouterWeggelaar

7 жыл бұрын

Alex Delarge what else can I do?

@EvenTheDogAgrees

7 жыл бұрын

Wouter Weggelaar: many things.

@WouterWeggelaar

7 жыл бұрын

Juan Rial I meant, I can't speak for anyone else, but well played :-)

I was hoping to see an animation of Marvin crushing the baby.

@DarkestValar

7 жыл бұрын

No

@bunnybreaker

7 жыл бұрын

Same.

12:30 There was a a mention of optimization problems - that they say the button will probably be removed as unnecessary during optimization if the robot will not know it is needed. But you can use something like the "volatile" keyword in c++ to not to remove the button during optimization.

This gives Marvin the Paranoid Android a whole new meaning: All he wants is to push the 'Stop Button' he doesn't have, and instead has to complete tasks he begrudgingly doesn't want to, in order to feel the same 'reward' as pushing his non-existent 'stop button'

The name of that baby? John Connor.

i think the robot AI should be composed of two AI. one is the one that control everything, and another does a 'goal maping' of the robot, like a antivirus, runing parallel checking if what the robot want to do is in any way harmful. if it is that second system shutdown automatically the robot.

@Nirhuman

7 жыл бұрын

how do you set the utility function of this second system? its the same problem as with one ai only :)

@DagarCoH

7 жыл бұрын

Likely the control AI would immediately shut down the executive AI, because any action might somehow cause harm or destruction. Also, the executive AI might find that the control AI is preventing it from fulfilling its goals efficiently and try to shut it down or minimize its influence. And lastly you have the problem of defining what exactly is harmful or destructive to the control AI, which is about as easy as implementing Asimovs laws of robotics - that means nearly impossible.

@mduckernz

7 жыл бұрын

erick weil Then you've got the problem of defining "harmful" - which is ultimately the same problem. However, I do agree in general with the idea of using adversarial architectures, where different goals must be balanced

@SethPentolope

7 жыл бұрын

Sorry for not posting it here, but I may have a possible solution that uses two different ai, I have a different comment posted on this video explaining it

@sacredgeometry

7 жыл бұрын

why not three, an id, ego and super ego

"we want early AGI to [...] understand that it is not complete, that the utility-function it's running is not the be-all-end-all" - you don't want it to run for U.S. president

I wonder if these video will be the classics of popular explanation of thoughts that shaped the world. "Top 10 historic talks that paved the way to a positive tech singularity"

How about this: Reward for completing task: 1 point Reward for master HAVING ACCESS to button all time until task completed: 2 points Button pressed: 0 points (but still awarded the 2 points from previous line) Would this work?

@agiar2000

6 жыл бұрын

I'm no expert, but I like it.

@magicmulder

6 жыл бұрын

Depends on how you define "having access". You don't want the robot to forcefully drag you with him, do you?

@Himitsu_Chan

6 жыл бұрын

I would add something that kind of means: Not allowing master to press button -10 points.

@magicmulder

6 жыл бұрын

That would mean the robot wouldn't make you tea but keep moving in front of you to keep allowing you to press the button. ;)

You've only given the poor thing a source of dopamine. You need 5-12 general major chemicals to act half way reasonably. It needs a hierarchy of needs.

@jameskelly9277

5 жыл бұрын

That is one issue, the second one is that the concept itself is made with the presumption that the human with the button is doing something "profound" that could even be considered "wrong". We've got to stop programming with personification so much. The robot doesn't need to be motivated or unmotivated by the button, because it's perception of time could be based only on active uptime. It could perceive the stop button as a pause of reality that has no effect on its ability to reach the goal

@FelheartX

5 жыл бұрын

@@jameskelly9277 A pause? Interesting. But that would be like saying the AI doesn't care about how quickly any of its goals are achived. It can't know how long the pause is, and it will always try to go about things in a way that lead to the result in the shortest time possible, right? Otherwise you'd get a bot that just wastes time for no reason, because it has no incentive not to.

@EXHellfire

5 жыл бұрын

@@jameskelly9277 Problem there is that that's how you would normally think about robots, but not artificial general intelligence. Something that's programmed as an agent that reaches a goal in that way, needs the purpose to begin with. Otherwise, you don't have agency to begin with. The computers we use to communicate right now, those have no agency, it's the reason we can program them rather intuitively by comparison.

@EXHellfire

5 жыл бұрын

One thing I should add is that being turned off for the entity wouldn't inherently carry the guarantee of eventually being turned back on, so it's an outcome that potentially negates the objective being met.

@sashaboydcom

5 жыл бұрын

@@jameskelly9277 This isn't personification. The AGI selects a course of action because it will maximize utility. Anything that might interfere with that course of action - e.g. a stop button - would be factored into the calculation, and prevented or circumvented if possible. And on top of that, if the AGI can figure out that the human would adjust its utility function after pressing the stop button - and that's the entire point of having a stop button in the first place - then the AGI has every incentive to stop the button being pressed. After all, how can it maximize its current utility if its utility function gets changed?

The song "Daisy" sung by HAL 9000 was the first mechanical recording that Thomas Edison on his "Gramophone". Perhaps not the first "memory device" but it was included in 2001 as a metaphor. That 1st cylindrical wax tube still exists.

+100 points for making tea, 0 for a button press, -100 for fighting you.