AI Learns To Swing Like Spiderman

J Jonah Jellynose suspects Spiderman is an AI. Captain Blubber is arrested twice. A phone screen is smashed. What is happening
0:00 Intro
0:30 Basics
1:30 States, Actions and Rewards
2:45 Discount Factor
4:09 Neural Networks
5:59 PPO
7:03 Policy Gradient
9:54 Clamping the Policy
10:34 What the AI Learned
13:05 Just Swinging
White paper on how to create an AI like this from scratch:
docs.google.com/document/d/1F...
Download this AI: github.com/b2developer/Spider...
Discord: / discord
Reddit: / b2studios
Twitch: / b2studios
Useful Links:
huggingface.co/blog/deep-rl-p...
fse.studenttheses.ub.rug.nl/2...
iclr-blog-track.github.io/202...

Пікірлер: 2 600

  • @pittabread9861
    @pittabread9861 Жыл бұрын

    Spiderman: homeschooled

  • @youtubeuniversity3638

    @youtubeuniversity3638

    Жыл бұрын

    Iron Spider: Retaught.

  • @dandabossthesecond3599

    @dandabossthesecond3599

    Жыл бұрын

    Spiderman: Learning from zero

  • @aahilmemon

    @aahilmemon

    Жыл бұрын

    @@dandabossthesecond3599 no he said homeschooled because of the theme of “home” coming in Spider-Man titles

  • @dandabossthesecond3599

    @dandabossthesecond3599

    Жыл бұрын

    @@aahilmemon ik

  • @8jof544

    @8jof544

    Жыл бұрын

    The A-lazy-ing SpAIderman (the next new one in the spiderverse?)

  • @skycloud4802
    @skycloud4802 Жыл бұрын

    I love how chill and lazy the AI Spiderman seems. It's like Spiderman putting the least effort into moving about with his webs, whilst allowing his body to just ragdoll with it all.

  • @par6749

    @par6749

    11 ай бұрын

    damn 69 likes i feel bad for u

  • @miikavihersaari3104

    @miikavihersaari3104

    11 ай бұрын

    He's napping while swingin'

  • @Dionyzos

    @Dionyzos

    11 ай бұрын

    Why look cool when it gets the job done?

  • @miikavihersaari3104

    @miikavihersaari3104

    11 ай бұрын

    @@Dionyzos Asleep is the new cool.

  • @Pupalah

    @Pupalah

    11 ай бұрын

    this is what happens when peter is knocked out and the spidersense is keeping him safe

  • @thatflatdude4451
    @thatflatdude4451 Жыл бұрын

    "With great distance, comes great rewards" - Piderman

  • @youngmister3042

    @youngmister3042

    11 ай бұрын

    sπderman

  • @Complete_Stranger7050

    @Complete_Stranger7050

    11 ай бұрын

    Siperman

  • @ruddy2009

    @ruddy2009

    11 ай бұрын

    Der-Man

  • @WelshTommyTrolls2

    @WelshTommyTrolls2

    11 ай бұрын

    spooder man

  • @davidbratland9754

    @davidbratland9754

    11 ай бұрын

    Sperman

  • @Music-nn9mi
    @Music-nn9mi11 ай бұрын

    I think the reason the ai moved to using only one hand was to minimize the randomness that happens to its decisions. Since half the time they don't affect the outcome if you don't use one of them.

  • @BusinessWolf1

    @BusinessWolf1

    11 ай бұрын

    could have been solved if the webs toggled hands

  • @Music-nn9mi

    @Music-nn9mi

    11 ай бұрын

    @@BusinessWolf1 you about to toggle these hand lmao

  • @robonator2945

    @robonator2945

    10 ай бұрын

    oh yeah, this is big brain "You can't screw with my movements if I just don't move!"

  • @arremm4978

    @arremm4978

    8 ай бұрын

    I wondered if dropping 1 of the inputs (the left hand) allowed it to use more of the hidden layers to improve it's performance with the right hand. I'm not a doctor but that might be analogous to right/ left-handedness in humans.

  • @smike_mike
    @smike_mike10 ай бұрын

    because of the spiderverse this is a canon spiderman

  • @Schnort

    @Schnort

    16 күн бұрын

    I love this. This was the same with Sonic for a while, too.

  • @sarafroats2935

    @sarafroats2935

    14 күн бұрын

    Makes sense

  • @AlliSinned
    @AlliSinned Жыл бұрын

    I like how the AI just resorts to using one hand form web shooting once it gets going. It’s like “why do I need two hands to shoot seems like a waste”

  • @maxiliarydendrite8926

    @maxiliarydendrite8926

    Жыл бұрын

    The real Spider-Man should take notes, obviously the way he’s been doing it is less efficient

  • @shytendeakatamanoir9740

    @shytendeakatamanoir9740

    11 ай бұрын

    ​@@maxiliarydendrite8926 Sacrificing Efficiency for Style is something Spiderman would do, though

  • @Gore_Whvre

    @Gore_Whvre

    11 ай бұрын

    Yes

  • @lolshark33

    @lolshark33

    11 ай бұрын

    It's also better for a living being to use both arms bc it would even out the amount of strain. Plus the arm that's used all the time would probably be more muscular than the unused arm and I think we all know what that typically implies lol

  • @michaelpacinus242

    @michaelpacinus242

    11 ай бұрын

    @@shytendeakatamanoir9740 Spider-Man. Quite the beautiful word.

  • @mitrikgaduk347
    @mitrikgaduk34711 ай бұрын

    It's ironic because in most spider-man games, quick "thwips" are usually faster than using full swings, as you keep momentum better. Long swings have a curve to them and usually take a bit longer than just jumping off at the apex, which essentially looks like you are only swinging half way before thwipping again. It seems the AI has learned this.

  • @p-name1858

    @p-name1858

    10 ай бұрын

    Hope to god insomniac adds thwips to spiderman 2💀

  • @bscutajar

    @bscutajar

    8 ай бұрын

    Mathemattically, the fastest way to move would be to have a constant force in a constant direction balancing out drag and gravity. The way to approximate constant force and direction is ro constantly reshoot in the same direction.

  • @DracoHandsome

    @DracoHandsome

    8 ай бұрын

    @@bscutajar Well, almost the same direction. There would need to be constant angular adjustments to maintain the optimum elevation

  • @yesno1085

    @yesno1085

    7 ай бұрын

    The Grappendix

  • @jonaut5705

    @jonaut5705

    Ай бұрын

    @@yesno1085 cruelty squad reference?

  • @ironicanimations
    @ironicanimations Жыл бұрын

    Let’s just sit and applaud the fact this man can code this stuff, animate fun stuff, and WRITE what happens in a coherent way for new people Holy crap 👏👏👏👏👏👏👏

  • @Wizzkidwas

    @Wizzkidwas

    11 ай бұрын

    Even more He composes the music that he uses for his videos

  • @ironicanimations

    @ironicanimations

    10 ай бұрын

    @@Wizzkidwas no way what?? Even better!

  • @crylune

    @crylune

    8 ай бұрын

    yeop i sure love seeing how everyone and their dog is smarter and more successful than me

  • @yudoball
    @yudoball Жыл бұрын

    13:06 - he almost fell done - saved himself in the last second - celebration backflip

  • @b2stud

    @b2stud

    Жыл бұрын

    I don't think it could've been more perfectly timed with the commentary ending

  • @J0rdan_S

    @J0rdan_S

    Жыл бұрын

    He also kicked the guy in the face 😂

  • @Mordecai02

    @Mordecai02

    11 ай бұрын

    And showed us a couple of the cute fishie pedestrians :)

  • @thebeanqueen

    @thebeanqueen

    9 ай бұрын

    that part is so smooth

  • @ireallycantthinkofaname4726

    @ireallycantthinkofaname4726

    8 ай бұрын

    Yes

  • @Teslijah
    @Teslijah Жыл бұрын

    5:54 Does this mean you could teach a jellyfish to be SpiderMan 10 times faster than this computer?

  • @ogluqqychess4452

    @ogluqqychess4452

    Жыл бұрын

    If the neurons were stripped blank without being damaged Id say why not

  • @talison718

    @talison718

    Жыл бұрын

    ​@@ogluqqychess4452this reminds me of a project by some science youtuber to use human neurons to pilot a drone

  • @moritzkramer355

    @moritzkramer355

    Жыл бұрын

    ​@@talison718isnt nearly every drone piloted by human neurons?

  • @talison718

    @talison718

    Жыл бұрын

    @@moritzkramer355 yup, but i am talking about put neurons in a plate an connect then to wires and then use a simulator to train them to fly a drone

  • @moritzkramer355

    @moritzkramer355

    Жыл бұрын

    @@talison718 quite unnecessary if you already have a brain but cool i guess

  • @Amyrose13lee
    @Amyrose13lee10 ай бұрын

    12:48 “It’s so good in fact, that it doesn’t need to look where it’s going” It developed Spidey sense without any programming lmao 😂

  • @GGCannon
    @GGCannon Жыл бұрын

    You should make it consider hitting walls a bad thing (to train it to stick closer to the middle) and consider one of the rewards to keep the body facing forward, while facing back would be a discount. That way, it will probably give favor to alternating which arm it uses, to keep facing forward and to stay at the center of the road.

  • @roscoe5427
    @roscoe5427 Жыл бұрын

    ten years ago i would not imagine myself sitting here eating my food while watching an AI grow up to be spiderman

  • @ifly-fsx

    @ifly-fsx

    Жыл бұрын

    It's all fun and games until it becomes self-aware and launches the nuclear missiles.

  • @puplos125

    @puplos125

    Жыл бұрын

    ​@@ifly-fsx so true i hate when it happens ong

  • @BritishBoy

    @BritishBoy

    11 ай бұрын

    ​@@puplos125ruins a perfectly good Tuesday like nothing else

  • @pleasejustletmebeanonymous6510

    @pleasejustletmebeanonymous6510

    11 ай бұрын

    Videos like this have been around for a lot of years though. I'm not sure if it would have been 10 years ago, but I remember watching an AI play Super Mario quite a long time ago. (Looks like it was only 7 years ago: kzread.info/dash/bejne/o6pqt7iIgZOsZJc.html )

  • @lord_gyver

    @lord_gyver

    11 ай бұрын

    Everyone can wear the mask

  • @TheActualAnthonino
    @TheActualAnthonino Жыл бұрын

    I love how the web-slinging sound is just you going _"chu" "shue" & "shu"_

  • @the_germanempire

    @the_germanempire

    13 күн бұрын

    Don't forget "shuye"

  • @wolfgaming2757

    @wolfgaming2757

    21 сағат бұрын

    I lowkey hear the words "chew" "chewy"

  • @drphalanges1520
    @drphalanges15206 ай бұрын

    I like how it uses little micro-adjustments like you would do with thrusters in space. It's cool to see it so casually correct its course.

  • @TheFrozenFlame05
    @TheFrozenFlame056 ай бұрын

    I love how occasionally it does a spider-man like trick or flip, but for the most part it just like flails around and lets gravity have its way.

  • @shufflecat3334
    @shufflecat3334 Жыл бұрын

    A thousand times, thank you for the segment at the end following the trained model! It is SO frustrating when a channel explains something for ten minutes, and then instead of giving you the gratification of a finished product (something I'm sure the creator enjoyed plenty of) they just end off with "whelp thanks for watching! byeeeee!"

  • @pinkie723

    @pinkie723

    Жыл бұрын

    Yessssss!!!!! For real!!!!!

  • @whannabi

    @whannabi

    Жыл бұрын

    @@pinkie723 foshooooo

  • @R0TEK

    @R0TEK

    Жыл бұрын

    @@pinkie723 Based pfp

  • @pinkie723

    @pinkie723

    Жыл бұрын

    @@R0TEK Thanks lol

  • @FatalShotGG

    @FatalShotGG

    Жыл бұрын

    That's why I just skip to the end. I have a brain. Be like me.

  • @0PercentImagination
    @0PercentImagination Жыл бұрын

    I'd love to see a part 2 to this that attempts to make variants by adding silly additional rewards (aka reinforcement learning) to the current spiderman, like a version that tries to do as many backflips as possible whilst also going fast in a forwards direction.

  • @MudakTheMultiplier

    @MudakTheMultiplier

    Жыл бұрын

    I think specifying that the left arm must fire webs at the left wall and the right arm must fire webs at the right wall would be a good option for this.

  • @markellii3093

    @markellii3093

    Жыл бұрын

    Keeping the face forward would be fun, but could cancel out backflips. Avoiding hitting buildings would probably be for the best.

  • @SnrubSource

    @SnrubSource

    Жыл бұрын

    @@markellii3093 Well, they could attach Unity's equivalent of a scene component to the ragdoll's pelvis, and only check its yaw to make sure it remains looking forward while still allowing it to do flips

  • @Bruva_Ayamhyt

    @Bruva_Ayamhyt

    Жыл бұрын

    Sounds cool but first I want to see it learn not to hit the walls or ground, and to only use the web up to 1x/second. I think it would feel more natural. Maybe also keeping the head upright and the face forward too.

  • @MudakTheMultiplier

    @MudakTheMultiplier

    Жыл бұрын

    @@Bruva_Ayamhyt typically you don't want to be to restrictive because typically with an AI like this it will either cheat your restrictions or will be locked out of potentially required steps of learning. Not to mention the interesting or groundbreaking solutions it could come up with outside of your parameters. That's why is said left for left, and so on. After thinking on it a while longer I think breaking it down even further into "reducing the amount of points earned for every successive use of the same arm in a row". Mostly because as long as the AI hasn't totally given up on ever using its other arm then the point adjustment should be able to just be made and then the ai should be able to successfully continue training without regressing too far.

  • @RapidFireToaster
    @RapidFireToaster10 ай бұрын

    What's his canon event

  • @comissiongfamily799

    @comissiongfamily799

    29 күн бұрын

    Tax evasion

  • @DaBrotfel

    @DaBrotfel

    18 күн бұрын

    Falling flat on the ground for the first time

  • @JWillyP

    @JWillyP

    14 күн бұрын

    Uncle yen died in a car crash rite after Aiter Airker was dropped off at school by him

  • @Sazz909

    @Sazz909

    9 күн бұрын

    His canon event is the code breaking

  • @moralniy
    @moralniy Жыл бұрын

    "Roman Sakutin" passed off your work as his own, and also inserted an advertisement in the video. You can try throwing a strike on his video.

  • @Kaylakaze
    @Kaylakaze Жыл бұрын

    I'd like to see this with more constraints added (such as web cooldown, web transit time, Spider-man needing to see where he's going instead of flopping around, how body position effects momentum, etc).

  • @PuppyHugs

    @PuppyHugs

    Жыл бұрын

    and how long the pizza can stay hot mhmhm

  • @megatroneata9911

    @megatroneata9911

    Жыл бұрын

    doable but if this took 11 hours that might take a few days

  • @Crazyates11

    @Crazyates11

    Жыл бұрын

    Yeah I like this idea as well. Maybe each arm can only do one web every 1-2 seconds, or the right arm can only hit the right wall and the left arm can only hit the left wall.

  • @yammyyuri9331

    @yammyyuri9331

    Жыл бұрын

    @@megatroneata9911 yes but if he adds more artificial neurons then that can shorten the time needed

  • @victoryerz2030

    @victoryerz2030

    Жыл бұрын

    @@megatroneata9911 As long as no new inputs are added, the constraints will actually increase the training speed by reducing the search space. However, things like adding vision for the actor or adding additional factors to the environment like more physics can make things exponentially more difficult.

  • @Kodiakhunter
    @Kodiakhunter Жыл бұрын

    14:50 looks like a trick that spider-man would actually do while swinging😂

  • @Izo_Risu

    @Izo_Risu

    9 ай бұрын

    Yeah, especially miles morales Spiderman, he's just going for style above all else

  • @grimsladeleviathan3958

    @grimsladeleviathan3958

    Ай бұрын

    I thought the AI was just trained to swing like Spider-man, not actually become Spider-man

  • @tonuahmed4227

    @tonuahmed4227

    7 күн бұрын

    This is not show-off it necessity to swing properly...

  • @DarkTakanuva
    @DarkTakanuva Жыл бұрын

    This is very good appreciate the swinging bit at the end, but also for providing a full explanation a bunch of youtubers I've watched will start out explaining something then blur all the words together to make it seem uber complex, and then skip right to the final product without actually explaining the steps they took to get there

  • @Longcat_1

    @Longcat_1

    10 ай бұрын

    *cough cough* Dani

  • @MegaChickenfish
    @MegaChickenfish11 ай бұрын

    I love that this both contains some of the most down-to-earth explanations of how AI works which were really informative, and also this: 10:34

  • @Blizzard4242
    @Blizzard4242 Жыл бұрын

    You explained all of the concepts really well for someone who doesn't know anything about AI, but as someone who does know one part I was curious about which you didn't go into would be how you defined the reward. For example, did you want it to simply never fall to the ground, or were there other things you punished / rewarded apart from the general things you mentioned? I would be more interested in the process as well, which changes you made along the way etc. Maybe a separate video that is tailored to an audience that knows a bit about AI and go more into depth would be interesting!

  • @b2stud

    @b2stud

    Жыл бұрын

    I am going to write a small paper explaining the details that I didn't cover in the video as well as uploading code

  • @Blizzard4242

    @Blizzard4242

    Жыл бұрын

    @@b2stud cool, thanks!

  • @Carhill

    @Carhill

    Жыл бұрын

    @@b2stud You're an amazing web developer.

  • @davidp2537

    @davidp2537

    Жыл бұрын

    @@b2stud very excited for that!

  • @michaeldemartino1204

    @michaeldemartino1204

    Жыл бұрын

    :)

  • @BenSuzuki
    @BenSuzuki Жыл бұрын

    I learned more in 15 mins here than I did in a semester of Reinforcement Learning. Maybe not, but this one is a lot simpler and visually statisfying

  • @Dice-Z
    @Dice-Z11 ай бұрын

    Very well explained, i salute you man. Also, i love how rewards system in AI/Machine learning are basically dopamine hits for the AI in the form of code. Not that they are advanced enough to "feel it" mind you. They also kind of have similar capabilities to "job experience", neuroplasticity and muscle memory, though more so simulated, which is just an amusing thought to think about.

  • @ObviouslyASMR
    @ObviouslyASMR6 ай бұрын

    Damn I think this is the best explanation of PPO (and perhaps even RL as a whole) that I've ever seen, including my Master's course in RL lol (obviously a bit less detailed but really intuitive)

  • @luckyluc9972
    @luckyluc9972 Жыл бұрын

    They need to teach ai to value literal style points as well as their primary goal.

  • @therealhussein

    @therealhussein

    Жыл бұрын

    YES PLEASE

  • @symbiote1982pk

    @symbiote1982pk

    Жыл бұрын

    Literal style points as opposed to figurative style points?

  • @luckyluc9972

    @luckyluc9972

    Жыл бұрын

    @@symbiote1982pk yes. Style points in normal conversation is typically just a way to tell somebody they did something cool. Style points in the example I posted would be another goal the AI could track and would be an actual score system to improve learning. Hope this helps

  • @Evan-ru6ro

    @Evan-ru6ro

    Жыл бұрын

    The exaggerated swagger

  • @Fermion.

    @Fermion.

    Жыл бұрын

    Hmm, how would you quantify style in the reward system? Backflips, using two hands, and facing forward are worth more points or something?

  • @Nightstick24
    @Nightstick24 Жыл бұрын

    It's always fascinating to watch how quickly an AI can go from absolute failure to quite competent at a task. Thanks for breaking it all down, it's a very complex topic that makes my head spin - but you explained it very well, in simple enough terms and with fantastic visual aids, that I was able to follow along very easily and feel like I understand the general process much, much better than I did before!

  • @meaton3805
    @meaton38058 ай бұрын

    I'd love to see what adding a limit to the number of webs would do. If it's only got a certain amount per arm, would it alternate arms? Would it swing further before using the next web? I wonder if it would look more like the Spider-Man we're familiar with or if it would come up with some crazy nonsense 😅

  • @onemannation8116
    @onemannation8116 Жыл бұрын

    12:02 Exaggerated Swagger

  • @dumflame

    @dumflame

    10 ай бұрын

    Of a White Guy

  • @Bendilin
    @Bendilin Жыл бұрын

    @1:30 Liked just for the gargling

  • @Gloves-T-Catzero

    @Gloves-T-Catzero

    8 ай бұрын

    I got an as there LOL

  • @romanbundy921

    @romanbundy921

    3 ай бұрын

    😂😂😂

  • @symynn2734
    @symynn2734 Жыл бұрын

    the sound at 0:18 jumpscared me

  • @Puppetjerry18429

    @Puppetjerry18429

    6 ай бұрын

    Lol it was funny tho

  • @michael80126
    @michael80126 Жыл бұрын

    This is by far the easiest to understand explanation how AI works I've ever heard, thank you!

  • @souza9369
    @souza936910 ай бұрын

    6:44 that twist was fire tho

  • @aguyontheinternet8436
    @aguyontheinternet8436 Жыл бұрын

    This was awesome, you explained it in greater detail than any other programming youtuber I've watched. I noticed that the Ai is still very jumpy, shooting unnecessary webs out. I wonder if including the number of webs shot in the reward system would incentivize the long and wide swings we see spiderman usually do, as opposed to the short spastic swings the AI is currently doing.

  • @b2stud

    @b2stud

    Жыл бұрын

    I did play around with penalizing the AI for casting too many webs, but I think it's very hard to get right. If you penalize it too much (which honestly wasn't even that much) then the AI becomes hesitant to shoot webs and it stops learning.

  • @arpita1shrivas

    @arpita1shrivas

    Жыл бұрын

    @@b2stud what if you rewarded it for longer webs instead of penalizing casting too many webs, set a small incode timer to measure web time? or set a ingame timer which makes the AI only able to cast webs after a certain time period after the last one. if you're rewarding speed it's kind of incentive for the AI to spew more webs in order to get less pendulum type motion and more linear like motion, i suggest only a combination of that reward

  • @arpita1shrivas

    @arpita1shrivas

    Жыл бұрын

    @@b2stud actually i just realised you can reward the AI for longer web distances, and more altitude of the web, do that in combination with speed and distance rewards

  • @paulinxm8201

    @paulinxm8201

    Жыл бұрын

    @@arpita1shrivas All of those are good ideas, but the last one is very smart. Definitely easy to mess up, but if implemented right would make beautiful swings.

  • @RalorPenwat

    @RalorPenwat

    Жыл бұрын

    I think the most effective way to do might be to have him track his multiple directional velocities and diminish rewards for losing too much velocity at once, though you might need to also track directional acceleration to keep track of the changes in velocity so it could be a pain. Distance and speed are also good, but to maximize returns I feel multiple velocity and acceleration recognitions would better modify behavior because they'll allow for shorter web swings if they're warranted, IE, if you'd lose velocity by hitting something or accidentally exchange too much directionally from long webs, without creating many incentives for short high speed sling-shot webs, as those will almost always lose you a lot of velocity in some axis. Maybe overthinking though.

  • @XNaos
    @XNaos Жыл бұрын

    I wasn't here for learning AI, but this is probably the most motivating video I've ever seen. You explained like everything necessary, so it gives the feeling that it is so easy

  • @dtracers

    @dtracers

    Жыл бұрын

    That is because he skipped the 4 hardest parts. Choosing the right algorithm to train with (in this case PPO) Choosing the right state to learn from Choosing the right reward to learn with Choosing the right actions for the model to take Those 4 parts are the parts where it goes from "science" to "art/intuition" But you should try it!!! And by hard I mean it is the equivalent of choosing what color to paint a painting. Picking a paint is not a difficult process. Picking a paint that will mesh well with all the other paints and end up with a really good painting is much more difficult.

  • @blablasalsa3020

    @blablasalsa3020

    Жыл бұрын

    @@dtracers do you work on this field ?

  • @lenivik
    @lenivik8 ай бұрын

    This is the most easy to understand description of RL that I've come across! They should play this video for first year students. Funny and informative, keep it up!

  • @powerofanime1
    @powerofanime111 ай бұрын

    Your sense of humor is stellar man. You definitely deserve more subs.

  • @b2stud

    @b2stud

    11 ай бұрын

    tyty

  • @sethcushman5454
    @sethcushman5454 Жыл бұрын

    Really interesting how it ended up just using one arm. I wonder if that was just easier for it to randomly learn, where the AI only had to learn to control 1 arm rather than 2, or if it is actually somehow more efficient than 2 armed.

  • @tylerherr4288

    @tylerherr4288

    Жыл бұрын

    id guess its because it wasnt incentivized to learn to use both if one works why try learning that the other works too? could fix that by giving each arm a strength value the value drops when webbed onto something but increases when not used

  • @DrMonty-ng5fo

    @DrMonty-ng5fo

    Жыл бұрын

    Makes sense to me, using two arms requires coordination between the two, whereas using one arm only means that the AI can just shoot a web upward on one side, then the same for the other side, with no chance of one arm fucking up the other.

  • @Ett.Gammalt.Bergtroll

    @Ett.Gammalt.Bergtroll

    Жыл бұрын

    It isn’t concerned with style points after all. 😅

  • @josechomali
    @josechomali Жыл бұрын

    Strangly pleasant to watch him just swing for 2 minutes straight

  • @bimasatria7915
    @bimasatria7915 Жыл бұрын

    Wow, didnt expect it's gonna be a whole deep learning 101. Nice summary and introduction Man!!

  • @aswd1979
    @aswd1979 Жыл бұрын

    this is a great vid I dont know much about ai and stuff like this but I thinks it is all very interesting

  • @dtracers
    @dtracers Жыл бұрын

    I normally do not write comments but as someone who knows a lot about AI this was the best video I have ever seen explain the concepts. A "part 2" explaining the couple of concepts glossed over would be super interesting in a "fine tuning the spiderman" I wish we had AI interfaces that were as easy as you made them seem and if they get to that point then your video is the perfect "here is what you need to know to make your own AI" starter video.

  • @MightyFartBomber1
    @MightyFartBomber1 Жыл бұрын

    I'm clueless about AI, programming, and code but dude you explained the concept and theory so well that I was able to understand why it does what it does and also, because of this newfound knowledge on AI learning, I cant help but think of the AI as a cute little toddler trying to learn stuff lmao

  • @kyanbogard2993
    @kyanbogard2993Ай бұрын

    Please make 10 hour loops of ai swinging, this helped me sleep so well

  • @TayoEXE
    @TayoEXE4 ай бұрын

    You taught me more about Deep Reinforcement Learning and Neural Networks in 10 minutes that the two semesters I wasted in a "capstone" class in college.

  • @joshuapianoman55
    @joshuapianoman55 Жыл бұрын

    This was such a well detailed video! I love learning the more technical side of these AI endeavors. Great video!

  • @davidblackshear4349
    @davidblackshear4349 Жыл бұрын

    12:29 "overall, it just seems more confident with its actions." *slams into a wall*

  • @HotFootBunny

    @HotFootBunny

    8 ай бұрын

    Wdym bro is wall running like you do in the PS4 games, actually he's better at wall running that every single spider man to exist

  • @Nunya111
    @Nunya1115 ай бұрын

    This has gotta be the first video that actually explains it beyond putting it in the simplest possible terms pretty cool

  • @eaoke3383
    @eaoke33835 ай бұрын

    Amazing video! Thank you for such an elaborate explanation of everything!

  • @reqqz9595
    @reqqz9595 Жыл бұрын

    Amazing video, just as your content always is! I'd like to see the AI being more rewarded for speed, so it goes flying trough the city. Thanks for always making these topics (which require a lot of effort to comprehend) into something simple.

  • @J0nnyTheJ3w
    @J0nnyTheJ3w Жыл бұрын

    Watching it catch itself at 14:20 was really cool

  • @grumpyowlstudios7023
    @grumpyowlstudios702311 ай бұрын

    This is like a fever dream. Love the format.

  • @sebastian.h3003
    @sebastian.h30034 ай бұрын

    Why did i found the ''Just Swinging'' part so relaxing 😭

  • @hdcafssd
    @hdcafssd Жыл бұрын

    love the little mid-air pose at 13:11

  • @joaozin003
    @joaozin003 Жыл бұрын

    0:39 that house makes me go brrrrrrr 🎈

  • @Galaticknight
    @Galaticknight13 күн бұрын

    Good stuff my guy you did amazing with the ai

  • @EirTheGhost
    @EirTheGhost Жыл бұрын

    As someone who is majoring in CS and enjoys the idea of AI and it solving problems your videos are amazing and hilarious.

  • @misspotato813
    @misspotato813 Жыл бұрын

    I think you did a very good job explaining a lot of this, as someone who knows little about machine learning. However, there was one part I was really lost. I was hoping you could clarify: how do the "hidden nodes" work / what do they do? I assume they're the actual math that lets the AI decide what to do, but I don't really get how.

  • @b2stud

    @b2stud

    Жыл бұрын

    Each time information flows through the neural network all the connections between the nodes alter it. Having hidden nodes drastically increases the amount of connections, which gives the AI more control over how it filters / transforms that information. There isn't any difference between input / hidden / output nodes besides their location in the network. Essentially the more hidden nodes you have, the more the AI can alter the information it receives = the more intelligence it can have

  • @AnaseSkyrider

    @AnaseSkyrider

    11 ай бұрын

    Another way of looking at it is that more nodes means for more ways for information to "weigh" against each other. Each node essentially has a value and a weight for how much that node influences its connection. It's all basically percents. You want lots and lots of connections because it leads to a more in depth and nuanced way for information to relate. The relative angles of the arms and each joint should relate to how the web is fired, and if caring about efficient motion through air resistance, then it will also want to factor in the other body parts too. The more connections, the more complex and nuanced relationships you can factor into the system.

  • @beast-chan
    @beast-chan Жыл бұрын

    This guy is really producing the high quality content out there. Love the videos so keep it up💯

  • @iXSIKOBOIXi
    @iXSIKOBOIXi10 ай бұрын

    It's very interesting that it uses one hand to swing. I would presume it thinks that due to the elements of Randomness such as the ragdolling, it can better adapt to things by reducing the variables. It's probably easier to adjust 1 arm when your body is being flung every which way than to use both

  • @Kykaii
    @Kykaii10 ай бұрын

    5:48 had me DYING for some reason 😂

  • @Canard3D
    @Canard3D Жыл бұрын

    It's not everyday you find someone who backflips and someone who explains AI... It's even rarer to find a channel that does both. Backflip you magnificent AI

  • @whannabi

    @whannabi

    Жыл бұрын

    The chances are millions to one

  • @rehaan8

    @rehaan8

    Жыл бұрын

    The ai backflips he explains neither does both

  • @kevintyrrell7409
    @kevintyrrell7409 Жыл бұрын

    I think it would have been a good idea to reward the AI for using both of its hands, possibly alternating or swinging with both.

  • @aguyontheinternet8436

    @aguyontheinternet8436

    Жыл бұрын

    @Erinç Argımak fair, but we want style darnit

  • @SgtSupaman

    @SgtSupaman

    Жыл бұрын

    The problem lies in allowing it to be able to optimize with just one. A sufficient cooldown should be part of each web shooter to better imitate how Spider-Man can't make webs just instantly appear like laser beams. Once it loses efficiency with one arm, it should start trying to go faster with both.

  • @jasonruff1270

    @jasonruff1270

    Жыл бұрын

    yeah style points

  • @keianrobinson4712
    @keianrobinson471211 ай бұрын

    I'm really digging the dedicated bus lanes and wide sidewalks!

  • @rhyrhy69
    @rhyrhy69 Жыл бұрын

    the animations were so good aswell as the entire video

  • @fondir3626
    @fondir3626 Жыл бұрын

    I rarely write comments and only got here through the youtube-algorythm. But MAN i really enjoyed this video. Not too technical and not too basic. I rarely watch a recommended video more than 2-3 minutes but i HAD to watch this all the way through. You explained it very entertaining and i understand AI MUCH better than before. Thank you!

  • @b2stud

    @b2stud

    Жыл бұрын

    Np. I'm very happy to hear that!

  • @janewan1196
    @janewan1196 Жыл бұрын

    At first I thought this video would just be another neural-network-plays-a-game video and that I wouldn't learn anything new from it, but I am so glad that I was wrong! You presented these complicated topics so well, along with some comedy along the way! I wonder how advanced the AI could get given more inputs and outputs to control the other parts of the body, more time, and a more advanced reward function to encourage spiderman to stay up straight, move fluidly, avoid walls, and perhaps add in some acrobatic flair

  • @StrangerOnHere
    @StrangerOnHere Жыл бұрын

    1:36 “Saudi arabia riyals”

  • @Objectshowfan190

    @Objectshowfan190

    6 ай бұрын

    Yes ﷼

  • @shawbaby234
    @shawbaby2348 ай бұрын

    This is a real representation of how it feels to swing in that spider-man 2 movie tie-in game for me

  • @DMMDestroyer
    @DMMDestroyer Жыл бұрын

    Appreciate the breakdown in the entire video, but 14:04 onward is a vibe that needs to be made into a short. "AI Spooderman webslinging at Sunset" You'll get 1 million views easy 🤣

  • @CoraCD
    @CoraCD Жыл бұрын

    That sound when it hit the ground😂 0:19

  • @markus_seitz
    @markus_seitz11 ай бұрын

    Mate that thumbnail is actually mindboggling good. Never tapped on a video that frekin quick!😂

  • @user-ws8bb8ii4n
    @user-ws8bb8ii4n9 ай бұрын

    You have just explained ppo in 10 minutes better than what I've learned in two weeks trying to code it

  • @N0ahFence
    @N0ahFence Жыл бұрын

    I learnt so much from this video... You are fantastic and so clear with your explanations. Subbed for sure!

  • @kingd413
    @kingd413 Жыл бұрын

    10:49 - "Yo Spiderman, you good bro?" But in all seriousness, this was a really good video - explained all the concerts in a concise and easy to follow way (even if some of them went past my head lol). Looking forward to more content bro!

  • @psychoticsy6350
    @psychoticsy63507 ай бұрын

    It’s learning. It’s evolving. It finally understands that we want to watch the ai do the thing it was made to do.

  • @Just.some_guy
    @Just.some_guy6 ай бұрын

    14:30. YOOO A.I Spider-Man has some moves

  • @Hpmanenz
    @Hpmanenz Жыл бұрын

    I've been interested in AI/ML for a while now, more specifically Reinforcement Learning which is the one described in the video. I already knew the general idea of what it is and how it works but I must say, your description was the most clear one I've heard so far.

  • @michaelren9771

    @michaelren9771

    8 ай бұрын

    Actually there's a course on coursera by Stanford Professor Andrew Ng, who's one of the founder of deep learning methods that's pretty easy and good for an introduction, I know a lot of people and friends of mine recommended it, and I'd definitely recommend it.

  • @Wizzkidwas
    @Wizzkidwas Жыл бұрын

    Brilliantly explained video, I absolutely love your visual style as well as the little ball mascots, they got a name?

  • @b2stud

    @b2stud

    Жыл бұрын

    Thank you! They do have a name, I just call them fish

  • @Wizzkidwas

    @Wizzkidwas

    Жыл бұрын

    @@b2stud FIIIISH

  • @Diego91940
    @Diego919407 ай бұрын

    This is SO GOOD content, keep up with it

  • @mysticalduck7287
    @mysticalduck728710 ай бұрын

    My gosh this is a useful and extremely well done video!

  • @alansmithee419
    @alansmithee419 Жыл бұрын

    7:30 For some reason saying "it will become slightly less wrong" instead of "slightly more correct/slightly better" gave me a chuckle.

  • @gnomge
    @gnomge Жыл бұрын

    Been there since piderman was just a skydiver occasionally smacking it's face against a wall But seriously you explained the algorithm really well and I'm just surprised how it went from a broken atari session to... this.

  • @ML_Lab
    @ML_Lab Жыл бұрын

    Amazing! I've been experimenting with flying like Iron Man and never thought I'd find something like this!👍👍👍

  • @sullivandeffinger4970
    @sullivandeffinger497011 ай бұрын

    Insane production value here

  • @itsonlyagame4033
    @itsonlyagame4033 Жыл бұрын

    I want this as my wallpaper engine background, just endless swinging

  • @garethfuller2700
    @garethfuller2700 Жыл бұрын

    3:05 *Oh no, it's Chairman Drek- HE'S BACK, and this time he's HIGH RISEN!*

  • @cosmicdive
    @cosmicdive7 сағат бұрын

    The movement at 14:46 was ACTUALLY really cool!!

  • @retroarcadefan
    @retroarcadefan8 ай бұрын

    It seems like you would want to add a rule that a web cannot be created by an arm behind the orientation of the head (which could be considered locked in place). I think the performance would improve drastically. Very cool sim!

  • @polpus5214
    @polpus5214 Жыл бұрын

    I'm going to start my master degree in September in AI, and now I'm more excited to start thanks to this video. Thank you!

  • @valovanonym

    @valovanonym

    Жыл бұрын

    Good luck! It's a very fun field :)

  • @fredtrunce5931
    @fredtrunce5931 Жыл бұрын

    That was great! I love it when you upload! (Could you maybe slap some royalty free music over the AI doing its thing at the end next time tho? It doesn’t have to be super loud or nothin, just something nice)

  • @calamaloo6592
    @calamaloo65926 ай бұрын

    As a suggestion on this one - You could perhaps train an AI on moving like Hulk - As in using muscles to jump / propel itself through the air, and learning to accurately land roughly where it wants to in order to then jump again, aiming for a specific destination (and maybe also avoiding landing on buildings / cars or something?)

  • @zined128
    @zined128 Жыл бұрын

    you just taught me about neurons and i am so insanly interested in the topic now

  • @GsQDoom
    @GsQDoom Жыл бұрын

    2:46 "..we don't really consider the value of time." I have all videos at 1.5x speed by default.

  • @dumb_spy_main
    @dumb_spy_main Жыл бұрын

    4:10 *Throws phone happily*

  • @alexnord5274
    @alexnord52746 ай бұрын

    This is a very well made video!❤

  • @marijnpelkmans1338
    @marijnpelkmans133811 ай бұрын

    What i find extremely interesting is how humans basically work the same, with the 'critic' perhaps being the kind of "über-ich" or superego that Freud introduced, the system that internally judges our every action. So to me it seems, if all these systems become complex enough, AI can simulate a consciousness for itself just like our brains do for us