NVIDIA’s New AI Trained For 5,000,000,000 Steps!
Ғылым және технология
❤️ Check out Lambda here and sign up for their GPU Cloud: lambdalabs.com/papers
📝 The paper "CALM: Conditional Adversarial Latent Models for Directable Virtual Characters" is available here:
research.nvidia.com/labs/par/...
My latest paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bret Brizzee, Bryan Learn, B Shang, Christian Ahlin, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Kenneth Davis, Klaus Busse, Kyle Davis, Lukas Biewald, Martin, Matthew Valle, Michael Albrecht, Michael Tedder, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's links:
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/
#nvidia
Пікірлер: 593
so COOL! Incredibly excited to apply this towards game development some day
@crazytiger6
10 ай бұрын
I’m excited to play a game with this some day!
@ggsap
10 ай бұрын
Didnt expect you to be here
@atomictraveller
10 ай бұрын
it sucks. force uses momentum. you don't run up and stop then swing. it's completely open. you swing from the waist. so many style issues. of course, culture is memetically inbred for generations, so who'd know? just send out the right hollywood signals.
@not888f9
10 ай бұрын
the ultimate crossover
@henrytep8884
10 ай бұрын
Screw the game, we're going to fight these things IRL and they seem like they have martial arts mastered.
The fact that he staggered a bit while celebrating added so much personality to the motion. While not ideal for genres that require perfect control, I'd love to see this in some kind of experimental gladiator management type game.
@altsak840
10 ай бұрын
Perfect for NPCs.
@CalebTerryRED
10 ай бұрын
Just responses to attacks in general. In most current games characters are either controlled perfectly by an animation, or completely rag doll, with no in between. The interpolation here means that you can have anything in between, medium attacks can stagger and heavy attacks can stagger more. You can have a whole range of realistic responses to arbitrary input in a way that just hasn't been possible
@lightswitch2622
10 ай бұрын
@@CalebTerryREDa lot of games have an in between
@CalebTerryRED
10 ай бұрын
@@lightswitch2622 ok... Name one? One that isn't already a ragdoll game that is
@redryder3721
10 ай бұрын
@@CalebTerryRED Sekiro, but I get your point.
Everyone: “Wow this will be amazing for video games” Military industrial complex: “yeah… video games…”
@thechickenwitch4769
10 ай бұрын
NVIDIA abouta be hired by the US military
@tomodoros6846
10 ай бұрын
I was hoping there would be 10v10 battles between AIs trained between different time frames.
@alansmithee419
10 ай бұрын
@@tomodoros6846 They haven't been taught to strategise or to adapt to the conditions of a fight from what I can tell. It's basically just physics-based animation at this point.
@tobirivera-garcia1692
10 ай бұрын
Then have seperate AI’s for commanding. An AI can control the positions (go here, go here) another can tell the AI controlling animations which animations to do to get to a certain place or to fight a certain way.
@uku4171
10 ай бұрын
I think this would be a lot more doable for stuff like police house raids than actual battlefield action. Kind of like in the movie "Chappie"
Now imagine you incorporate a stamina meter which causes your movements to get sloppier the more you push your character. Like spamming a sword swing would get weaker and slower.
@Real_MisterSir
10 ай бұрын
Every game that takes itself a bit seriously really needs this
@birdbeakbeardneck3617
9 ай бұрын
Or damage which will make ai try and maybe fail or succeed in making n3w mouvement patterns
To be fair, if you are wearing like 80lbs of armor and tried to celebrate, you would probably have the exact same problem with losing your balance.
@little_lord_tam
9 ай бұрын
Nope. Only if its realy realy bad armor
This would be so fun to fight in a VR battling game.
@notuxnobux
10 ай бұрын
I wonder how well it would play with the environment. Like if there was a sword fighting vr game, could you put a shield behind the enemy and walk toward it and it would trip over everytime or would it be able to be aware of the environment before it hits the environment object?
@uku4171
10 ай бұрын
@@notuxnobuxI assume it would maintain balance while bumping into a wall or something, but wouldn't get over obstacles very well unless trained for it.
@uku4171
10 ай бұрын
Yup. Both Boneworks and B&S style enemies are very unnatural. A good enemy would move with purpose but would still appropriately react to the player, so no pre-made animations. I feel like this is the best way to do that.
@Metapharsical
10 ай бұрын
Gorn VR has 'ai' driven ragdoll enemies that make for dynamic and hilarious brawls, but it's still just puppeteering a set animation and crude in that it basically just throws haymakers at you 😂
@MaxLoh2
9 ай бұрын
Good luck designing a system that gracefully simulates physics in VR by making you fall down on your face if your takedown got countered by someone who's better than you at wrestling. I've thought about this for years with no good solution. You basically have to announce there's a "de-sync", wait for the player to assume their avatar's actual position, and resume the game every time it happens.
it would be cool to have preset data trained for different levels of efficiency for action/rpg games. so low level skill, you're still wobbly but still functional, then towards the higher levels, you're clean and crisp fluid movements. AI being able to actually dodge/parry.
@uebyCyka
8 ай бұрын
It's actually great idea! Level difference that will be logically explained! Not just with numbers. It would be so cool! It's a shame big companies will implement completed technology only if some indi game blow up with this.
The AI animation is picking up subtle corrections the body does when out of balance, truly fascinating!
Born too late to explore Earth, born too early to explore space but born just in time to see these ridiculous AI advancements.
@jurajchobot
10 ай бұрын
Possibly born just in time for space exploration. Imagine we will be able to restore your biological age to early twenties just two decades from now. Even if we start exploring the space in early 2100s, you will still be able to travel past our solar system, no matter if you are 20 or 120.
@jurajchobot
10 ай бұрын
@@duduvenom Come on, you might learn to love it.
@MVS0N_
10 ай бұрын
@@jurajchobot if we actually managed to stop aging the world would end in less than 100 years for sure lmao
@jurajchobot
10 ай бұрын
@@MVS0N_ Not if we solved fusion first. You would be able to turn all the deserts into greenery and you would be able to comfortably scale any area into population density of New York while building separate sky-scrapers full of interior food farms. Earth is easily capable of sustaining 30 billion people with fusion energy technology and at that time we will be able to colonize different planets. Gravity is still not solved, so if we managed to find a way to manipulate it, we would be able to completely terraform Mars, possibly even Venus. Humanity has potential to grow into trillions. We just need to work on our technology as when the time comes we are no longer able to increase our numbers due to technological limitations, we will probably self destruct as a species as I think technology that infinitely extends our lifespan is within our reach. And with it a hunger for more life. Take it away from people and they will riot. Give it to them and you will have to work on technology for the rest of your existence. The only way to stop the lifespan increasing technology is to move back into 19th century. I don't think this can ever happen and as such we are already in a death race for more energy and physical resources. Luckily for us, with enough Genius, they are almost infinite.
@atomictraveller
10 ай бұрын
you have decades and decades of porn to go through!
I mean, I would love to see a hero almost lose balance during a victory stance.
"From sorry little recruits to battle-ready soldiers..." I hope A.I. also change my life like that... in just 10 days 😅
HOnestly, I'd be super happy to see such ''mistakes '' in my characters movement in a game.. if i'm wearing heavy equipment, and swing my arms up in the air for a cheer - it'd be hilarious to see my character almost falling over due to balance issues haha
RIP stuntmen and extras
@Ruzzky_Bly4t
10 ай бұрын
Slowly but surely, humans are becoming redundant.
The movement is pretty incredible. As a sidenote, it isn't realistic for a human to keep running around with a sword and multiple times almost clipping the own face. Maybe, the should add a cost to keeping it near the face. Also a cost for each muscle contraction would be cool.-Realistic to try safe effort. Cool to glimpse into the future of gaming with this channel. A back to the future delorean in video format.
Guarantee Boston Dynamics and other robotics companies are going to use these techniques for their physical machines. Just seeing the Atlas simulation in the video, exactly what I’m saying. It will allow the physical robots to dynamically and intuitively accomplish tasks. I can’t wait to see it.
@AGMI9
10 ай бұрын
Elysium getting closer and closer each day
@Andytlp
10 ай бұрын
Some researchers already did that. Small humanoid robobots trained on playing football and the real world counterparts are like 90% as good as their digital ones.
the most intriguing about this is to implant one of these movement AI's into a robot after they are trained! would be an awesome "plug&play" control unit!
@SVGc1993
10 ай бұрын
You're right! Though its a little bit frightening too!
@Fermion.
10 ай бұрын
I think I read somewhere about how that's a long term plan. To have the AI train on a GPU, then upload it into a robot. That's kind of terrifying, as you could dispatch a unit of bots, and upload like 100 years of advanced tactical training into them, en route. They would be an unstoppable force.
@alansmithee419
10 ай бұрын
@@Fermion. Deploy 6 bulletresistant robots in the middle of a millitary installation.
@Fermion.
10 ай бұрын
@@alansmithee419 They could definitely cause a ton of damage to a military base, but they'd eventually be blown up.
@uku4171
10 ай бұрын
@@alansmithee419all fun and games till some Taliban guy with a jammer he made from a microwave and a car battery destroys your 8-billion dollar robot squad.
Ok, this is incredible, and I can see its applications in video games, and maybe even in robotics. BUT, I am also amazed by how OFTEN amazing news like this come out in almost a weekly basis. It used to take YEARS for something significant to come out. This is both exciting and scary at the same time. None of this was possible before AI became practical. I wonder if there will be ANY technological advancement that won't rely on AI from now on?
3:31 When you managed to slam the bottle of 160 proof at the frat party
When you cross blades with a Saurdukar... You know it
guy. actually. recorded. every. single. word. and. cut. them. together. to. form. sentences.
I like the chap who decided he wanted to leave. "Sod this for a game of soldiers, I'm outta here." Now that's what I call intelligence.
I don't know why but that little stumble while celebrating was so adorable
Every video: 📰 *New Paper!* 📰 Dr.: "What a time to be alive!" 😮😃😁😎 Me: "It's pretty cool.. I guess.." 🤨
I really like the stagger. Like he is so tired he is stumbling
Why is the voice feeling a.i generated as well lmao. Especially on 2times speed
2022: we are going to be murdered by robots. 😢 2023: we are going to be murdered by robot Jet Li 🥳
"Imagine a video game where you press a button on the controller and nothing happens" You just described my video game development journey perfectly!
Can't wait for this tech to have Metahumans do things based on text to actor.
@armondtanz
9 ай бұрын
Damn i just bought a $450 sony mocopi mocap suit, be great to see companies take this up for use in cinematics. Tweaking poor mocopi is a nightmare, this looks next best thing ;). Just a pity its just an ongoing training program and not ---> 'is coming out very soon'!!!!
@tombittikoffer412
9 ай бұрын
@@armondtanz the suit is still going to be perfect for some subtle close up moves. Keep it and use it. They don’t do hip movement well but arms and hands, most do excellent. So use it for fine tuning.
Imagine the epic battlefields we will get in movies. 20k Romans vs 20k Gauls but every character is actually engaged in an individual fight. I’m drooling…
@Multiv3rs
9 ай бұрын
We live in an exhilarating time!
@little_lord_tam
9 ай бұрын
The possibilities for Strategy games and combat simulators are imo higher than for other genres. Imagine how much of an impact different skill levels can have. Finally not balanced only by more life/dmg but actual skill
@Giuachino
9 ай бұрын
@@little_lord_tam so true
what is this mans voice it sounds ai generated
Watching these guys maneuver around gives me the same delight back when Euphoria was game changing
Just to clarify: A A100 GPU is a GPU for about 200 Grand that is optimised for AI training. So no you couldn't do this at home
@xXMsCarlyXx
10 ай бұрын
wasn't it 10k?
@julianoberhofer3550
10 ай бұрын
@@xXMsCarlyXx Yeah you are right. The price I had was DGX A100, so a fully fledged system.
@user-qjvqfjv
9 ай бұрын
@@julianoberhofer3550 No, it's $7,000.
I really hope to see these advancements implemented in soon to come game's. Imagine how a game would feel if the enemy ai would be this adaptive and interactive to the environment around it. Also if they can make a 3rd person perspective game where your own player could have really responsive movement to the world around you. Think of how adventure game's could be? Sport's games? Etc. Parkour physics movement, stealth abilities, climbing, how people react to getting hit or damaged, the list is endless.
exciting that we are getting closer and closer to more controllable characters. pity that so often the characters are fighting rather than collaborating, which is surely what the world needs more of!
@mho...
10 ай бұрын
true,that its "unfortunate" if our AI's minds are based on "predators"! but nothing trains "solid movement" more, then having an opponent who constantly trys to knock you off your feet!
@Dr.Trustmeonthisone
10 ай бұрын
In order to effectively fight you probably need more collaboration between agents than any other action imaginable so don't be sad. Please dont be sad please dont cry its going to be ok please
Oh man, your intonations always kill me 😂😂
imagine these guys fighting eachother... that would literally be the best clash we have ever seen
Awesome no more Repeated animations or repetitive AI tactics. This would be awesome in a VR combat game.
An annual gladiator battle between agents created by different researchers would be so good.
AI Avatars that have life like voice, movement and can react directly to what you are saying and doing. Games are about to get absolutely wild.
i always come back to thinking that the better way to make robots its to make them in humanoid shape and proportions, because then we will have millions of hours of footage of humans doing all sorts of things to train the robot with
@thomas.thomas
9 ай бұрын
most robot use cases are on flat ground or stationary not needing legs. ehrrls suffice in many applications
@LankyMF
9 ай бұрын
That's how you get an uprising
I promise you I have nearly fallen trying to celebrate exactly like that.
"Hold on to your papers while your new robot overlords escort you to the gray zone for further processing, no really don't lose those papers!"
is the narration computer generated?
Thank you for this video, and the passion and appreciation you bring in general! What a time to be alive! This is so good to see. I'm a big fan of ASE, this advancement is really exciting, especially the controllability.
How long have you been trained to talk?
10 years in the training made you a battle ready soldier!
Even if this ends up being too clunky to control as a player in some situations, this could be great for enemies (assuming the performance isn't awful)
I can't wait until we are two more papers down the line!
So we have finished the programming for the terminators. That's great. Just great.
Why does his voice sound like an AI this episode
They SHOULD put this in a game tomorrow, where an AI war against humans began too early when the AI robots where still in their infancy and aren't quite 100% efficient using their new bodies yet. That would make for some funny, dumb battles to be had.
"Imagine a video game where you press a button on the controller aaand... nothing happens" I absolutely love this. Bravo! What a time to be alive!
@1:50 “Imagine that you press a button on a controller and nothing happens”. Well, I don’t have to imagine that because practically every game I try to build is like that.
really cool, I do hope when this gets used for real they use the weapons believably without clipping and also aligning the edge of the weapon (if bladed) so that it may actually cut.
"What a time to be alive?" How about send the boy outside to play- now THAT's alive!
Imagine a Total War title with these!
The AI almost falling over trying to ‘celebrate’ is actually really charming.
"While you held on to your papers, I studied the blade"
5:36 props to the scientists
I like how its learned to style on its opponents before and after it slays them. Its like its mandatory after a point.
I would love a game where you go to celebrate and the little dude almost falls over.
Teach them to fight against eachother! It would be cool to watch!
Theres so much possible with this technology. Imagine an RPG, where if your character doesnt have enough strength to wield some 2h sword, instead of just flat out not being able to equip it, your character drags it behind you and cant swing it hard enough to do any damage. The realism and immersion... wow
We should have an esports where teams make an AI fighter and they verse another teams AI
This video would be really interesting if it was presented differently
Hey I remember this, upsetting they didn't have them fight each other, but now I can at least do it myself.
This was a joyful surprise.
We need this in a video game!
i want something like this in video games at some point, itd be so cool
Run two of these against each other, incorporate parrying and self hurting on accident(via blade edge). Assign body part damage multipliers, have 2 of the best generation fight each other for 5 bil steps, behold, a new combat god.
I wonder if we'll ever get the weights for these
they should release a short game with these clumsy guys, I would love to play a fighting game like that, love the celebration move ahah.
I noticed the model is heel striking. I believe the training would be better if the floor was a soft surface (maybe by simulating some elastic deformation) because this would force the model (and humans athletes) to use their toes more.
@harmless6813
10 ай бұрын
When you look at the stick figures, they don't even have feet. I think they should add foot simulation - including at least one joint for the front foot.
@submijiru
10 ай бұрын
@@harmless6813 stick figures just show connected joints. other overlay appears to have a pointy limb sticking out for the surface and angle of the foot (but it's not 100% clear so I'm not sure). but yeah, it should still have an extra joint for the front of the foot anyway and a big toe
So damn hyped to see games in the coming years.
So is the interpretation that this is an encoder model of motion capture data so that you could auto generate smooth movements for an agent without needing a reference in the future?
I saw some clipping of the sword I to the body. Decently need some more work
Imagine trying to fight robots that have had 200 years worth of training.
Ez a hang😅 meglepő, ennek ellenére mennyien nézik
I HAVE BEEN FALLING FOR THIRTY MINUTES. wait, no that't the wrong one I HAVE BEEN TRAINING FOR TEN YEARS
@user-qjvqfjv
9 ай бұрын
You aren't funny.
I hope they start making this simulation with two team fighting with formation order and differents weapon, adding an ai commander with personality like agressive, defensive, cautious, ambush ect.. strategy game would enter a new phase that i m dreaming about, with adaptible ai that can ambush you and takr advantage of the field, units specs and formation buff/debuff
Would be interesting to see how this will be if they added a programmed npc that acts as their rival (they react to the AI according to a detailed list of what it should do if the AI do something)
Great stuff! 🎉 👍👍
I remember when GTA4 came out and the physics based movement blew my mind. I can not wait until this kind of AI-driven physics based character movement is implemented into games and especially VR, it is just so much more convincing than traditional animation.
"WOW, Careful!" hahahahha
That was such a cool authentic stumble when celebrating!
It would be cool if this could respond to another agent. That would be pretty awesome. But even better, it could then likely respond to a player. One could create a game around it, made for VR arcades, where the user is given a weighted remote control sword to fight an AI. Such arcade could have tons of stuff like this, perhaps even making it educational, or exercise-driven to some degree.
yes, now we need ai gladiator matches. Where different teams compete given set of rules.
How can we access this
Imagine as treet fighter game who learns your movements and develop a new technique in the background, and at next round it kicks your ass.
how long did that gpu run for, that's what I'm curious about
Imagine applying this to like total war it would make the armies you control have so many different personalities
It is crazy to see how these developments will change game development and also simulation development in the future!
This... was GrEat,... but whAt... the hEll... is Up... with Your. Cadence!
I wonder if we could teach the AI to interact with each other, in competition or in collaboration, we could probably start small with teaching them to shake hands or something.
Amazing , training the future robot soldiers it's going to be really fun !
4:07 so increased Diversity and Controllability are good, but what about Encoder quality? Is it good that that went down? It doesn't sound like it, but it wasn't mentioned.
Please please please I want this level of procedural animation in games
I need this for Blade and Sorcery
Just a few questions: What is the concrete difference between this technique and pre-recorded animations with interpolations in-between? What is "controllability"? What was achieved with the use of AI? Was the AI used to keep the character in balance against gravity? It seems that the animations actually are pre-recorded, and not generated by AI, am I correct? Does the AI affect the interpolation, perhaps with the balancing? Many thing a bit unclear, perhaps in the beginning of the video you could list out the specific advancements as compared to what capabilities are currently known. 1:44 is this actually just for creating random movements, based on given motion patterns? I don't see usefulness in that, if it is so, but perhaps I have misunderstood. 2:00 If this is not NPC, but player-controlled character, then shouldn't it just be doing the kinematic run animation if we want to run, and not mix some odd pattern into it? 2:19 is some new advancement achieved in interpolating animations? I think we've had pretty good techniques for at least 10 years for that. Not trying to discourage, just slightly critical this time, having some knowledge on game dev. Keep doing your inspiring videos!
they should add some collision to the sword