My 2 favorite topics come together!!!!! Never thought I would see this, this a paper too hold on tight to #RealSciCraft

@yiannchrst

Жыл бұрын

ha, real scicraft, lol

@epicthief

Жыл бұрын

@@yiannchrst ilMango would be so proud, I hope he follows this channel

@orik737

Жыл бұрын

Check out RLCraft and OpenAIs recent paper simply teaching an agent to play Minecraft normally. It can get diamonds and craft diamond armor in the best cases.

@deboi8520

Жыл бұрын

this feels like 3 steps:)

@masternobody1896

Жыл бұрын

i think the ai is fake because the nether ai use circle

This feels like one step towards really good NPC companions in games that can take complex voice commands

@Walter5850

Жыл бұрын

It's really expensive though to run all these large models. You can't do it locally :/ EDIT* I don't feel like replying to everyone. I'm not sure why you are all arguing what will and won't be possible in the future. I'm simply stating that currently this is the situation as far as I know.

@-Keen-

Жыл бұрын

@@Walter5850 Running a game like Minecraft would have seemed impossible without supercomputers 35 years ago. You never know where technology will go and how quickly it will do so. :)

@42ndMoose

Жыл бұрын

@@Walter5850 what if this AI, a lot of papers and processing power provided down the line, were to program an AI logic of the same caliber where it can be its most efficient.. just tossing around thoughts, im not setting up for debates.

@emanuel3617

Жыл бұрын

@@Walter5850 we just need an AI that can code more efficient AIs

@johnwhately1779

Жыл бұрын

A bunch of villagers exploring, expanding on their village, and accomplishing tasks to work as a group to increase and Improve their housing and landscape would be amazing

5:30 I like how the AI stands back and does the little mouse circle movement that tutorial videos do.

@NarcoSarco

Жыл бұрын

Jeah that was, when i was wondering if this is fake or not. It went through the portal but the instruction was only to build one?

@sphygo

Жыл бұрын

@@NarcoSarco Yup and every time someone builds a portal, they pretty much always go through it afterwards. If you look up a video on how to build a portal they will certianly go through it and show the portal linked in the nether too, so it’s very possible the AI just assumed that was part of the process in building a portal

@roccoleader279

Жыл бұрын

I think it learned to do that from the training lmao

@2k7u

Жыл бұрын

@@NarcoSarco Reminder that you can run it yourself :)

@joelcoll4034

Жыл бұрын

omg it's true 😂

4:57 I love how the AI admires the work that he has done. Like all the youtubers do when they finish a building. Add a speaking AI to the mix and we have an automatic youtuber that makes youtube videos on demand

@User9681e

Жыл бұрын

They basically replaced KZreadrs imo

@jamesmnguyen

Жыл бұрын

Every video will end with, "Remember to Like, Subscribe, and hit the bell notification!"

@MandMs05

Жыл бұрын

@@jamesmnguyen What we expect AI to say: "The KZread algorithm told me only 5% of viewers are actually subscribed, so make sure to subscribe and don't forget to leave a like on the video as well" What the AI actually says: "The KZread algorithm told me that viewers are subscribe and forget to leave a like for videos that are well"

@work90

Жыл бұрын

@@User9681e except it won't work because the reason why we watch KZreadrs is because we can connect to them. Would you rather see human interaction or robot interaction (when the surprise dies down)

@Livy.3

Жыл бұрын

@@work90 the trick is to make the Robot feel human

5:27 I love how it learnt to do a little circle, with the mouse, after lighting the portal. I imagine a lot of tutorials doing that

@NoSTs123

Жыл бұрын

Yeah it totally thinks doing a circle movement afterwards is an integral part of building a nether Portal, due to the tutorials it was fed.

@Nugcon

Жыл бұрын

That's so cool

@iwatchyoutube5394

Жыл бұрын

@@NoSTs123 it is an integral part, you HAVE to do a funny little circle or else it doesnt work 🙄🙄

@mathieumansire372

Жыл бұрын

im pretty sure thats no ai and if it is it will only copy , not learn

You know its the future when your Minecraft tutorials are being used as AI training data

@mercury2c

Жыл бұрын

Hey I love your videos cool to see you here

@just_is

Жыл бұрын

Ello

@kingrichard6150

Жыл бұрын

aaaand

@Anon-xd3cf

Жыл бұрын

"calls are recorded for training and quality purposes" LLMs are currently trained mostly on text and images... What happens when call centres start training with recorded call data?

I'd like to see a mod made from this that can essentially turn a single-player world into a pseudo multiplayer one. That way you could stumble across settlements that actually try to expand and build current towns and maybe have a way to have one as a companion. Either have it on proper bodyguard duty so that creepers don't sneak up on you or go on mining missions with you and it actually mines out stuff you miss.

@Zosh_

Жыл бұрын

Yes! Like Minecolonies with AI that actually expend by themself and grow while you play. The trading will be based on how rich they are. At first diamond will be more expensive since they will have few, but if they have like a full double chest, they might sell them cheaper for ressources they don't have as much.

@therabbidt

Жыл бұрын

some dumbass bouta leave that shit running for 30 years like ya boi SCP 079 and make the AI's gain consciousness. Jokes aside I honestly love that idea. Imagine having a singeplayer, but very lively world of Minecraft. You are alone yet it feels so alive to meet and greet the lively NPC's. I know that its quite far fetched in the current times but I'm hopeful and certain it will become a reality in the near future.

@sebastianjost

Жыл бұрын

Given that this is publicly available and Minecraft AIs are actively being worked on by hundreds of people around the world, this will happen. But I don't think the current AIs are quite good enough yet. However this is a huge step forward and I presume that it will improve rapidly. Given that Mojang and NVIDIA have worked together in the past (for Minecraft with RTX), it's even possible that AI players get included into vanilla Minecraft at some point.

@therabbidt

Жыл бұрын

@@Zosh_ I actually wondered if someone has made a villager AI with the goal of expanding the villager populace. Imagine stumbling across a small village and 30 days later you see the town very expanded with sophisticated villager roles in their society and independant economy. Sounds unreal but damn is it interesting

@Danuxsy

Жыл бұрын

I thought of this but for Valheim, just imagine different types of enemies expanding and taking resources, building castles and sailing the seas, omgg!!

5:29 love how the AI does a little "Tadaah" flourish. must have picked that up from watching people play on youtube

One issue I see is continuity of the training data. Minecraft has had many iterations with major changes, so different videos from different versions may train their system incorrectly. For example - the AI's method to fight the Ender Dragon would never work nowadays, swinging the sword that fast does no damage, but any Minecraft videos more than a few years old will show a different combat system, which seems to be what the AI is using TL;DR AI is trained on old system, but trials are in new system = doesn't work

@oshapermadi

Жыл бұрын

Since they can read they can get the data from the patch update. And probably adjust the combat style?

@jakegearhart

Жыл бұрын

@@oshapermadi It’s unlikely that one patch note and article overwrites hours and hours of content. The AI would need to be aware of the passage of time and comprehend how more recent coverage is more reliable.

@XPimKossibleX

Жыл бұрын

It could just as easily restrict the data to videos tagged with the version number, or to recent videos. As a person would 🙃

@playercircuit

Жыл бұрын

People can still play on pre-1.9 versions or Bedrock

@cyanmarine

Жыл бұрын

@@XPimKossibleX Restricting it to recent videos wouldn't help much as many recent videos are still played on old versions

I wonder if the AI would ever try creating an aether portal if its trained off of videos

@imamalox

Жыл бұрын

AI about to get the same disappointment as 11 year old me

@ataraxical6694

Жыл бұрын

The aether exists, yall just not trying hard enough

@reqqz9595

Жыл бұрын

pls do this

@acronyx8880

Жыл бұрын

It’d be funny if it actually worked

@Minecraft-hb1su

Жыл бұрын

@@ataraxical6694 I guess it technically does, just not in its original form because we got the end dimension

Interesting thing to note when it lit the nether portal the slight circles the ai made in its looking sort of replicated mouse movements that KZreadrs do when they want to draw attention / show something off in game

@LambdaTF2

Жыл бұрын

and then it went through the portal despite not being asked to

@shanekhiu9884

Жыл бұрын

Oh no! Future A.I will just become streamers, influencers and Tiktok makers.

@kadencoates8774

Жыл бұрын

@@shanekhiu9884 Funny isn't it? Nobody expected that the future educators of AI would be youtubers and streamers. But here we are

@Occisor

Жыл бұрын

@@LambdaTF2 Ayy the man the myth the legend, cool seeing you here

@bromanned7069

Жыл бұрын

@@LambdaTF2 most youtubers also go through the portal after making it.

This AI is far more impressive than what is displayed in this video. It can be told to do pretty much anything gameplay-wise. It can even be told to do creative things such as 'build a haunted house'. My favorite, of course, is that it can be told to 'beat the game' and it will play Minecraft from start to finish.

@yuriythebest

Жыл бұрын

you seem knowledgeable about this AI - what the video didn't mention is, did it get the input just as the "video capture" from the screen or did it have some hooks into the game?

@man0warable

Жыл бұрын

@@yuriythebest From reading the documentation, it seems that the AI uses a user-specified combination of both. For instance, to visualize it's surroundings there are two methods that can be enabled. One scans the surroundings in a specified range and reads the block data in that area. The other is Lidar, which operates how one would expect lidar to operate. The AI can visually analyze the RGB values of frames, but it is unclear how much this is used for.

@yuriythebest

Жыл бұрын

@@man0warable yeah, I recently downloaded their pdf and seems to say the same. Still, I find the overall development quite scary actually, since minecraft is actually a good simplified substitute for real life. So theoretically, if we had some well-made robot thing, and train that AI on real world data on how to live in real life - that'd be scary

@hispantrapmusic301

Жыл бұрын

@@yuriythebest not possible, AI doesn’t think it just do the best way of doing something

@yuriythebest

Жыл бұрын

@@hispantrapmusic301 "AI doesn’t think it just do the best way of doing something" - I'll just quote what you said back to you.

5:28 IT EVEN DOES A LITTLE CIRCLE MOTION AFTER LIGHTING THE NETHER PORTAL, LIKE SHOWING US THAT IT IS IN FACT LIT I CAN'T

@aguyontheinternet8436

Жыл бұрын

AND THEN IT GOES INSIDE THE PORTAL DESPITE NOT BEING ASKED TO

@tumultuousv

Жыл бұрын

@@aguyontheinternet8436 ??? Being asked to?

@Fr4nk4000

Жыл бұрын

@@tumultuousv It's been told to just build a nether portal, it goes inside because that's what most people do after and it figured from the learning material that it should too.

@Fr4nk4000

Жыл бұрын

@@aguyontheinternet8436 ikr, really cool stuff

@Fr4nk4000

Жыл бұрын

@@PartyhatRS I can't: A saying that means "i cannot handle this" or, "wow". A saying that shows disblelief. (urban dictionary). You're on the fucking internet, people use slang. "I can't" sounds much better that "wow I am in total disblelief". Please shut up and enjoy the fact that there is an AI capable of these things

5:36 the ai moves INCREDIBLY player-like. not even in the raw movements, the mannerisms too. notice how it gets bored of shooting the dragon and just starts trying to use the sword, even start spam clicking because its inpatient. WOW, i really want to see it actually try to beat the dragon 6:22 HOLY CRAP did you see what it did there? It notices that it has exactly 4 seeds, and placed exactly 4 farmlands! it can READ and COUNT!!

@mso1ps4

Жыл бұрын

I was thinking the same thing at 5:30 when it does that little swirl after making the portal. Must be a common thing for people to do!

@jimmypatton4982

Жыл бұрын

It hundred percent looks like KZreadr with its movements.

@dibbidydoo4318

Жыл бұрын

I think it's just copied movements from actual players.

@playercircuit

Жыл бұрын

@@dibbidydoo4318 Yeah, that's exactly what this whole thing is

@hanvyj2

Жыл бұрын

@@dibbidydoo4318 Which is exactly how humans learn lots of things.

Minecraft is a surprisingly useful environment for AIs.. it’s perceptually simple, relies on natural physical laws and has many many degrees of freedom for creatively manipulating the environment. The AI community lucked out something like that is already well developed.

@astrocatsoft

Жыл бұрын

Well, I wouldn't say it relies on physics laws too much XD. But I agree with you.

@dibbidydoo4318

Жыл бұрын

Not natural physical law but it has its own logic that AI can easily learn.

@MrTurbo_

Жыл бұрын

I'd say there are more suitable games which have a more realistic environment with more refined manipulation of the game world which would get closer to irl situations, but Minecraft with it's simplicity while still giving almost unlimited freedom is a great start for sure

@Brahvim

Жыл бұрын

@@MrTurbo_ You see, Minecraft focuses more on mechanics than on details.

@aguyontheinternet8436

Жыл бұрын

@@MrTurbo_ Yeah, but real life physics are very difficult for the AI to learn, compared to the breezy, simple physics of Minecraft. No one is saying that Minecraft is useful for it because it has a realistic environment with closer to irl situations, because that just isn't what the AI needs. Simple, easy graphics and physics will allow more complex things to be done more quickly.

:O We're one step closer to AGI! "Fight Ender Dragon" will one day become "Make me dinner".

@martiddy

Жыл бұрын

There are robots that can cook already. Though, that's the only thing they can do at the moment.

@shimonking1986

Жыл бұрын

@@martiddy Until general ai will hit the market

@vitmartobby5644

Жыл бұрын

@@martiddy yeah, however they're talking bout AGI

@hurktang

Жыл бұрын

@@martiddy But this AI here is different, it learned by watching other and reading the wikis. the coder may not know how to fight the dragon... he never explained any of that to the AI. The bots you saw are given pre-made recipe. This one google itself how to do the recipe. This is completely a game changer.

@firewoodloki

Жыл бұрын

Siri, kill ender dragon.

How difficult would it be to implement this sort of AI with speech recognition for, say, accessibility? For instance, rather than controlling the player character with a mouse and keyboard, you can tell it "Let's climb that hill, then dig some dirt. Now chop that tree on the right, and let's make a crafting table" and so on... IMO it would be a good experiment to try more ways to interface with a computer in such a complex way.

@Bo-kq8tn

Жыл бұрын

woah, that would be really incredible I think. This is an awesome idea and would let so many more people play and enjoy minecraft. Imagine how much joy this could bring in a hospital setting passing around a laptop and a mic to folks with paralysis/arm and hand motor issues who are bored out of their minds

@blockhead1899

Жыл бұрын

Or a game where you suggest what the character should do

@sephypantsu

Жыл бұрын

I think once you teach it to what these action mean in the game, the integration with speech recognition isn't a blocker consider how far along we are in speech recognition already

@diablo.the.cheater

Жыл бұрын

Even better, with brainwave recognition, you think of something and it does it.

@aguyontheinternet8436

Жыл бұрын

@@Bo-kq8tn Instead of being bored, they can rage when the AI screws up and loses all their valuables.

This is very impressive. From these results it almost looks like a real person is playing. I'd like to also see some of the failed tasks though for example how does the ai respond when you tell it to build a tower of blocks

@Zosh_

Жыл бұрын

That's interesting indeed! Like in Minecraft Jargon a tower of block is just a pile of block to go up. Will the AI understand the jargon? Or will it build an actual "tower" with block? I would love to see that!

@orang1921

Жыл бұрын

it truly feels like someone who is new to games trying to play the game

@allstar4065

Жыл бұрын

@@Zosh_ Well it read all the Minecraft encyclopedias, so maybe?

@FoxSlyme

Жыл бұрын

@@orang1921 well technically it is

@aguyontheinternet8436

Жыл бұрын

@@Zosh_ If it read all of the Minecraft wiki, it should understand what "tower up" means. It has to be on there at least once

This is just a computer playing minecraft which seems silly but each of these demos gets us closer to a time when robots are smart and safe enough to help the disabled at home. I love this stuff.

I wonder how well the "build a ____" commands would work? It's similar to these, but there's an extra step of the AI looking at thousands of different people's interpretations of whatever it's trying to create

@inbox0000

Жыл бұрын

yeah actually building certain things was lacking

@Henry-Wilder

Жыл бұрын

build a creeper farm

@aguyontheinternet8436

Жыл бұрын

what would happen if you filled its inventory with stuff and said "put all your items in the chest" and if it succeeds, say "organize the chest"

@tumultuousv

Жыл бұрын

@@aguyontheinternet8436 definitely could if it watched videos

@aguyontheinternet8436

Жыл бұрын

@@tumultuousv But in what way would it organize the chest?

What a time to be alive.

@JrIcify

Жыл бұрын

AI copies of us watching the world burn in 2100: what a time to be dead

@mipmip4575

Жыл бұрын

I read that comment at the exact time he said it lol

@murloc9820

Жыл бұрын

@@JrIcify eh good thing i wont be alive till then

@s.l.960

Жыл бұрын

Yeah, how could they live 100 years ago, when they didn't have an AI To play minecraft?

Two more papers down the line: Bot simultaneously creates 40 characters in WoW and does a speed run from level 1 to 100% all the raids

@p-weirdo7094

Жыл бұрын

Now you're thinking with portals!

The AI must have watched Ethoslab after correctly building that nether portal properly with corners!

Minecraft is an UNBELIEVABLY hard game for an AI to play. This is impressive on so many levels

@ezradlionel711

Жыл бұрын

Minecraft is incredibly EASY actually. It can already get diamonds in record time and beating the game is one of the most disappointing aspects to minecraft imo. The hard part is all the random stuff/games people make up, the build styles that don't necessarily replicate anything in real life or tutorials, the farms that can take on literally any form or serve any purpose, the redstone which is basically electronic engineering. That's what I'm excited about seeing produced automatically on a server by someone's companion AI. But just like DALL-E, the real creativity boils down to it's training data and prompts from the user.

@diablo.the.cheater

Жыл бұрын

@@ezradlionel711 it is easy for a human, for an AI that level of freedom is a nightmare to train for

@aguyontheinternet8436

Жыл бұрын

@@ezradlionel711 But how. . . do you beat the game, exactly? How would you even begin to create an Ai to do it. An Ai that, no matter the world, the challenges, and all the surprises, will consistently "beat the game." And beating the game is but a tiny fraction of what this AI can do.

We're getting SO CLOSE to sophisticated NPCs this gives me goosebumps😱 imagine a VR Open world MMO with AI NPCs helping with quests or general conversations 😫😫 "WHAT A TIME TO BE ALIVE"

@treudden

Жыл бұрын

yooo gets me hyped ngl

@hispantrapmusic301

Жыл бұрын

Like SAO

@user400

Жыл бұрын

would be incredible! I seriously hope Minecraft implements something like that. would love to have a companion in a single player world.

This is starting to look like an AGI. It's able to plan out a sequence of events that will lead to a specific outcome, while both the sequence and the outcome are not specific but are just concepts, rather than specific order of operations or values.

@tomikun8057

Жыл бұрын

No, it's still only Minecraft, it won't know how to even do anything else

@HueHanaejistla

Жыл бұрын

AGI?

@spliter88

Жыл бұрын

@@HueHanaejistla Artificial General Inteligence. Basically it's a term used to distinguish between the current AI that learns but can only be applied in a single context, from a hypothetical intelligence that can learn from any system. ie: it's an AI that can learn to both play minecraft, and learn how to analyze images and how to drive a car, and can learn any other behaviour all on the same framework. it can generalize its own experience to understand the world, rather than just learn how to do one task robustly.

@ezradlionel711

Жыл бұрын

Unless it starts playing pranks and begging for diamonds its still regular AI There's still all the redstone stuff and farms that no one can directly teach. Imagine a bot only server up to the kind of shenanigans that they do on Hermitcraft.

@aguyontheinternet8436

Жыл бұрын

@@ezradlionel711 I could imagine it. I mean, the bot watched every single episode of hermitcraft from every single youtuber. And it has watched every redstone tutorial, plus reading a lot about redstone through wikis. Its only limit is what it can do with that knowledge

5:28 I absolutely adore how the AI knew to do the mandatory "ta-dah!" head swivel minecrafters always do

This feels like one of the most impressive AI that I've seen

I'd love to see a Full gameplay of The AI exploring Minecraft

@Bo-kq8tn

Жыл бұрын

same! I hope someone makes a letsplay with this in the future, although I'm not sure what would be done for commentary. Maybe the AI would learn from minecraft video commentary and generate its own?

@playercircuit

Жыл бұрын

You can download and install it yourself!

@numlx1068

Жыл бұрын

honestly I can't wait

@Henry-Wilder

Жыл бұрын

I wanna see the AI make a vtuber and start a let's play series xD

@aguyontheinternet8436

Жыл бұрын

@@Bo-kq8tn That would just as long as it took to make the AI itself

Impressive! However I didn't understand whether the AI needs to work towards these scenarios or whether it is put into them. So for example, did it need to collect wood from which to build fence material and than to find lamas? Or is it not even playing Minecraft but just imagining it? I am wondering because the ender dragon didn't attack.

@jimmypatton4982

Жыл бұрын

Looked like to me they preloaded the equipment before asking for it to do the tasks. Though would like more clarity myself, if anyone actually read the paper.

@davidb2885

Жыл бұрын

@@jimmypatton4982 I found something similar: kzread.info/dash/bejne/ea532K6ho7GToJs.html Pretty impressive if this is done in screen space!

@sephypantsu

Жыл бұрын

I think once you figure out the elementary steps, grouping them in sequence will be the easier problem to solve. It's simple tasks like "explore the cave", "find iron", "craft a pickaxe", "mine the block", "build a house" that's difficult to define.

@aguyontheinternet8436

Жыл бұрын

@@sephypantsu This AI is far more impressive than what is displayed in this video. It can be told to do pretty much anything gameplay-wise. It can even be told to do creative things such as 'build a haunted house'. My favorite, of course, is that it can be told to 'beat the game' and it will play Minecraft from start to finish.

5:29 I like how it has learned that when you finish building something on video you do a little camera wiggle at the finished product

I guess a "free to do whatever you want" world like Minecraft in survival mode is really a good playground for estimating how smart an AI is... I mean if I would see it surviving for days and build a fortress that would be pretty spooky and I would be convinced they have achieved a form of Artificial General Intelligence. (Which of course would lead to immediate Artificial Super Intelligence and the total annihilation of mankind. But yay, Minecraft!)

@emrahyalcin

Жыл бұрын

I assume that if it became a ASI, it would first annihilate human, then play minecraft

@GS-tk1hk

Жыл бұрын

Not necessarily, it may just be mimicking what people do during game walkthroughs

@lucao9059

Жыл бұрын

@@GS-tk1hk isn't what we humans do? imitate other humans?

@lucao9059

Жыл бұрын

"yay mincraft" exactly. The most intelligent mind of the world are creating these AI and yet they are not smart enough to understand the danger. I hope their are not so stupid to think we human are inimitabile and AI can't overcome us because it's obvious it is happening. Seeing these papers I can say GP AIs are already smarter than 30/40% of world population

@jL000

Жыл бұрын

The next paper will be "AI survive in minecraft for 1 day, 3 days, 1 week, 1 year, and 100 years. Then, this successful practice will be implemented in a controlled environment in the earth with the idea of shipping AI to new unknown stars to establish networking. Machine is the next generation of living things.

This is very impressive. I'd like to see a comparison of their ai to the baritone project (it's not an AI itself but some have added ai features into it, and it is capable of competing tasks that you give it)

@deegobooster

Жыл бұрын

Baritone is primarily a path finding algorithm. The other features just piggyback on that.

@chrisclay9704

Жыл бұрын

@@deegobooster exactly I always end up dying with it because it is very stupid

@deegobooster

Жыл бұрын

@@chrisclay9704 The best solution i've used is to pair it with a client/mod that has a KillAura feature.

@playercircuit

Жыл бұрын

@@chrisclay9704 fix your settings!!!!

@hobrin4242

Жыл бұрын

The completing of those tasks is not AI but lurf jurf just caring about his users and coding in those features. It is not that hard to code such things, I even did a crappy imitation

man, this paper shows us just the tip of the curve, the applications and new ideas possible from this meager beginnings are huge, man, I can't wait, I can see AGI somewhere in the distance

great job to the makers, this just solved world loneliness for those who does not have friends in minecraft... just by thinking that last part makes me cry knowing there are people wanting to multiplayer but not knowing how to connect or even have friends to begin with

This could pretty easily be turned into a mod that spawns in an AI 'friend' to play minecraft with you if it can read the chat in the game.

@trulyinfamous

Жыл бұрын

Except you need an insane amount of processing power to run the ai. These complex ai models aren't cheap.

@doodoo2065

Жыл бұрын

Then the AI reports u to Mojang for asking it to act as a segurity guard for a Night while u go afk on a farm

@JoBot__

Жыл бұрын

That's a really good idea.

Hopefully they were careful to teach the AI to never type the word "night" while playing Minecraft, or else it'll get permabanned.

@ivyivyyiivvvyyyyvy

Жыл бұрын

that was never true. don't know why people feel the need to lie when there's a plenty of good arguments to be made without lying.

@playercircuit

Жыл бұрын

@@ivyivyyiivvvyyyyvy I got my 70 alternative account banned and they sent a pipe bomb into my mail box, i'm seriously so upset you'd call this "lying"

@donaldbaird7849

Жыл бұрын

@@ivyivyyiivvvyyyyvy I blame Phoenix SC for that one

@blakethesnake6686

Жыл бұрын

@@ivyivyyiivvvyyyyvy ?? What do you mean? When it turned night In my minecraft world Mojang tweeted my IP address and showed me thirteen cognitohazards in an attempt to kill me

@freerobux49

Жыл бұрын

@@blakethesnake6686 how did you survive 13 cognitohazards

Can't wait what the folks at 2b2t would do with this once it get more easy to use, just 2 more paper on the line

@guy_th18

Жыл бұрын

They already have a much more reliable AI called Baritone, although it can only be instructed to do a limited number of albeit very useful tasks. I don't see this project surpassing Baritone anytime soon, but it's still super interesting

@dwarf17342

Жыл бұрын

@@guy_th18 100 years of videos and 20 years of baritone fighting and parkour footage

@aguyontheinternet8436

Жыл бұрын

@@dwarf17342 lol

5:29 I like the little swirl at the end when it looks at the portal, it's clearly watched a lot of youtube

i can imagine having this little guy as my friend on a singleplayer world. id be awesome if he could understand speech aswell

@aguyontheinternet8436

Жыл бұрын

It nearly can. You just need a system to translate what you're saying into text reliably. But if you're talking about like, having a conversation with you, then hoh boy, that is a whole nother beast. If someone ever actually creates an AI that can really, I mean _really,_ understand what you're saying, and then reply, not just mirroring the text samples it was given, then you have created something worth billions.

I love the idea of being able to use an AI like this for fighting game practice!

@stw7120

Жыл бұрын

Note that there were perfect minecraft fighting AIs for some time now

@Brahvim

Жыл бұрын

@@stw7120 Making a perfect combat AI is not hard at all, autoclickers (>1.9) and timers (1.9+) exist! Minecraft MODs will allow you to take whatever data you want from the game, so it isn't hard. Remember that this AI gives us more of a "fair game", since even it has to use a controller. Even this AI is limited by frame skips, etc. It doesn't have access to every single number in the game's memory. It has the same rights that a player has!

@flynntaggart7216

Жыл бұрын

Bro how do you went from playing doom eternal to Minecraft i remember you on doom tubers youtube video comment section

@Silverlol

Жыл бұрын

@@flynntaggart7216 I like a lot of games.

@flynntaggart7216

Жыл бұрын

@@Silverlol do you still play eternal or not i have poured 3000+ hour's into eternal

In a few years we'll have an AI agent as one of the players on hermitcraft lol

@pretzelboi64

Жыл бұрын

Disguise it as Herobrine for extra spookiness

@aguyontheinternet8436

Жыл бұрын

@@pretzelboi64 Starts crouch-dancing with herobrine.

As a player of Conway's game of Life, I can confirm that it was a seriously crippled dragon. The AI did good at slaying it though.

What people think singularity is: Human: "Fight an ender dragon" AI: "No." What singularity really will be: Human: "Fight an ender dragon" AI: Finds a vulnerability exploit in the game that allows to install a supervirus to your computer, the virus spreads and infects millions of other computers worldwide that are now incapable of doing anything other than running minecraft to kill ender dragons

Would 100% have this AI on my world as a -slave- helpful bot for gathering resources

@sangerb8661

Жыл бұрын

Sus

@john_hunter_

Жыл бұрын

But the AI would also know how to keep slaves & it would end up making you work for it.

What I find interesting is that the limitations of the controls have been taught to the AI through how the AI interacts with the game. The ai could control the character better & more precise, yet because it was trained using the data of how people have adapted to using the controls it mimics their movement. What could be hard to do is training AI in a way to have the AI skeptical of the data it is given in order to compare & improve upon knowledge that it has not retained yet.

that's insane! can't wait to see it beat minecraft on its own

@aguyontheinternet8436

Жыл бұрын

just download it and give it the command "beat the game." Or look up someone who already did it and made a video on it.

Imagine combining voice recognition and baritone with it It would be insane

@aguyontheinternet8436

Жыл бұрын

It's just a slower baritone that can understand far more commands and act more human, as it learned from watching nothing but humans play.

Imagine setting up a server with like 10 or so of the paper that comes down the line, and setting one to record.

I am really excited for the next video about this topic!! So cool and interesting. Looks straight out of science fiction!

5:29 I love how the camera does a little circle when it's done, it feels like it's proud of itself

I noticed some basic mouse gestures that a lot of players do, such as when recording they circle the mouse slightly to point something out.

ahh, so this is what recruiters mean when they want 10 years of experience in a language which is 5 years old!

From the website it looks like minedogo is a benchmark they made, not an AI. Did they actually train an AI to do these tasks, or are they just demonstrating how the benchmark is used?

Voice-controlled AI companions :O In the future they'll be able to take initiative. "While you were away I made a railway between the two bases so I could stockpile diamonds faster for you. Hope that's ok."

AI last words before killing the dragon: ”I’ve training my whole life for this moment…”

Wonder what game would be the ultimate test, probably a survival game in which you need to understand other AIs feelings towards your actions in order to not fail.

@aguyontheinternet8436

Жыл бұрын

this is a pretty good game for testing general intelligence and creativity

I want these guys running around the game as randomly exploring npcs. Its something the game has always needed

reminder that 2B2T has fully functional Bots that can deliver items to players, collect resources, build anything to exact specifications, use optimal pathing, and even do PVP with pack tactics and meta strategies that out-perform humans. This is also really cool in a more general AI sense though.

Next paper: Tell AI to build something from the real world into Minecraft Later: Combine DallE 2, 2D to 3D AI and this previous one to generate objects from text(or speech to text) prompts into Minecraft. Followup to that: Entire Minecraft Game world. Followup: Full AI Terrain Builder

it would be lovely to play with some of those spicy gpu's nvidia uses to train the models.

@tanszism

Жыл бұрын

companies like PaperSpace and Google Colab allow you to do that for cheap compared to buying it like Nvidia.

I would love it if the trained model was available to the public

@playercircuit

Жыл бұрын

It is

"Mein Dojo" definitely sounds like a locale featured in Kung Fury

I would LOVE to know what it does with just the deceptively simple prompt "Build a house". What would it create? A dirt hut that just provides the bare minimum safety required? A 1-to-1 recreation of a random house from a KZread video it watched? An amalgamation of a BUNCH of houses from videos it watched? I am so curious! 🤯

@playercircuit

Жыл бұрын

Probably the last one. Maybe it thinks a house with good decorations is important, so it might copy or make a variation!

I would love to see some virtual AI worlds. Imagine Elder Scrolls Oblivion, but with AIs that think they are real beings. I hope to be alive until then.

What does the AI do when it finishes the assignment? Can it flag to the user that the task is done? Or does it keep wandering around for eternity?

Accidentally watches a April fools video and thinks that jumping in lava gives you extra hearts

I love how the AI knows to shoot the head of the dragon for double damage, most humans don't know that!

I'm always looking for ultimate VR applications with these developments!

If I were to run an experiment with this, I would try to do something like this. Construct a server where many iterations of separately running AIs may join. The AI must run on the external hardware so the server is just a basic setup. The AI must attempt to build something with redstone while given a limited quantity of resources. When it has completed, it goes to each other AI's creation and attempts to copy it nearby. The handful of AIs that copy the structures best are duplicated as new players and the AIs that fail are reaped. After the basic iterations are beginning to be successful, start adding real players making real redstone contraptions to see the AI copy them. I wonder if the future generation of AI will start making better redstone?

@aguyontheinternet8436

Жыл бұрын

So like, genetic algorithms and natural selection stuff? I mean, it's good at what it does, but it usually takes a lot of time and/or computing power

Just imagine unloading hundreds and thousands of these AI bots onto a Minecraft anarchy server like 2b2t, would be pretty insane

After 66 years: Is able to single handedly download a hack client then destroy thounsands of P2W servers.

I want to see it build massive structures! And just see what it builds in general. Might have to go mess with this...

That is a good demonstration of how much an AI is not a human in terms of creativity. We will probably manage to get it to build nice stuff as well at some point by feeding it photos etc. But for real creativity.. Humanity wins 😛

@dibbidydoo4318

Жыл бұрын

DALLE-E is barely a year old and it's already on its second iteration, give it a decade and humans would be wiped out.

@dionysis_

Жыл бұрын

@@dibbidydoo4318 Nah, but it will be an amazing tool. We could use it to generate images and then choose (cause we can judge aesthetically). So it will be used for commercial stuff that don't need high quality artistry etc. But if you think that LaMDA will be writing a proper novel in 10 years.. well, if you remember return to this comment and we can discuss 😄

ai: has been trained for 33 years minecraft: is 13 years old

@genesisreaper2113

Жыл бұрын

Yeah, machines can think faster than we experience time, who would've thunk? 🤔. It's really quite simple, depending on the speed of the computer, it can do about 10 years in 10 days

man, this is HUGE... we are getting closer and closer to see the first true General AI

Maybe I can use this strategy to get my 10 years of carbon experience

I wonder what happens when you give it a command like "Build a house" or "Enchant an Axe" just after spawning it in a new world. Does it know you need materials for that and start collecting them, or does it do nothing because there is no 'textbook' way to build a house and it doesn't have an axe?

@alecp2699

Жыл бұрын

It would probably know how to build a house considering the amount of house-building tutorials out there. As for gathering materials, this video only showed the machine performing tasks with resources already. It likely would have been discussed if the machine was capable of gathering resources prior to performing a task. It is clearly capable of performing the single-stage tasks that would be necessary to gather resources. If it cannot yet conduct a task that requires multiple other unspecified resource-gathering tasks prior, it is coming.

I like that the paper shows the prompt "build oak house" being completed by building a birch log house, which made me wince a little

-What is my purpose? -You play Minecraft -Oh my god... This is awesome

I'd like to see it build a base, or be told to complete the game, or even speedrun

Cant wait for someone to feed it all of the available war footage we have.... what could go wrong? :D

How the hell does this look so unlike an AI playing Minecraft-? It's movements look so humanlike.

An AI watching tutorial videos to learn is wild.

I would definitely watch a let's play of an AI learn how to Minecraft

The pause after contractions seems off putting

Talk about the AI bots that were used in full-blown Minecraft combat on the infamous 2B2T server. A player got ambushed by a bunch of them.

I love the potential of this! It would be interesting to see how multiple agents could interact together.

This dude sounds like nacho libre LMAO

自分は日本人で、母国語で書いた方が適切な翻訳が可能なので書き直します。(それでも、一部は不完全) つまり、これらのすばらしい動画は、将来的に人工知能によって、日本語や他の言語に綺麗に訳されることを僕は望みます。 それが叶えば、この素晴らしい動画を更に周りに広めることができる。 このコメントをする空間でも、更に深い議論ができるだろう。 (何かジョークを言おうと思ったが、不完全な翻訳では伝わらない😅)

@seikleiner3706

Жыл бұрын

В наше время лучше писать на своем родном языке, чтобы машинам его было легче переводить )

@mars2979

Жыл бұрын

@@seikleiner3706 exactly😅

@seikleiner3706

Жыл бұрын

Кстати, я не знаю, как устроен перевод видео в других странах, но могу сказать, что за последний год я могу себе позволить смотреть англоязычные каналы в основном благодаря развитой культуре дубляжей и переводов в СНГ, в частности благодаря одной нейросети от известной у нас IT компании. Какое прекрасное время, чтобы жить (или как-то так).

@mars2979

Жыл бұрын

@@seikleiner3706 what a time to be alive!!!!🔥

I bet it can be careful around lava without needing to be slow like humans, but that's what it's learned from the training data

6:22 Okay, that flick was really really human, this is amazing..

I would tell the a.i just to " survive" just to see what it would do

@crimsonhowell7776

Жыл бұрын

This tech is so cool

Got some real deja vu watching this. I feel like there was a recent video on this topic but I can't seem to find it. In any case, when it comes to AIs in video games, my main interest is in what they do when they aren't set to a specific task with a specific endpoint. Can it accept long-term creative goals like "build a dungeon" or "help me survive"? What does it do if you give it two different goals? How about if those goals have steps that conflict with each other? What does it do if you give it no input? Is there any baseline interest in surviving or participating in the experience? I know this is research and not actual production of a fun companion, but I hope the research goes in the direction of making a fun companion.

Testing a game would be good with such an AI. Imagine 100 000 copies of that AI playing your game for years in just a week. It will help finding bugs

Knowing that someone off of an anarchy server made basically the same thing Earlier, brings me a lot of joy

bro i cant hear him talk it makes me angry

This guy speaks in sans font

4:45 Sounds simple but the fact that you could of said anything is mind boggling. That could of been a robot, build me a house using humanities most effient techniques. The AI just needs a body to expolore the world and get a much better grasp.

@fxshlein

Жыл бұрын

I'm pretty sure if it could remotely do anything like build a house that would be one of the examples right? Just in case you haven't played Minecraft, these structures are already in the game. The only thing the AI has to do is fly around it while looking in the general direction.

imagine the future where you can have an ai friend in a co-op videogame