Idea: Use the new tool to extract inputs from replays, and use wr runs as input for your AI. You could possibly set new TAS wr's

@yoshtm

3 жыл бұрын

It would be intersting to try !

@TEC_Sage

3 жыл бұрын

@@yoshtm i’d genuinely love to see how this would turn out

@lucasfourneret58

3 жыл бұрын

That would be interesting indeed

@ventilo1825

2 жыл бұрын

other idea : use TAS imputs to train the AI

@boerhenkcb

2 жыл бұрын

Can someone translate to analoge language? What are WR runs and TAS? Thank you!

I love these. Seeing all the generations of the AI is so visually interesting and you've got a great eye for cinematic shots.

@yoshtm

3 жыл бұрын

Thanks :D

@Wilker_uwu

2 жыл бұрын

@@yoshtm i agree too. i also like how the information on screen is easy to spot and see too. ^^ being a bit nitpicky, if you have anything to improve, is just a bit of the color scheme on the cars, specifically in the comparison, just to improve the accessiblity a bit. you could try blue-orange for contrast, maybe change the wheel colors a bit, or maybe use the car model without the spoilers to highlight one with the spoilers so it's easier to spot. other than that, you did a nice job with the visuals :3

@yoshtm

2 жыл бұрын

@@Wilker_uwu Thanks, noted ;)

@enaftenvedsvanefossen6102

2 жыл бұрын

@@yoshtm same

*The entirety of the video:* How to make a fluid simulation with cars

@DigitalJedi

2 жыл бұрын

There have actually been studies that show that traffic flows can be modeled by fluid dynamics equations.

@kgaming7599

2 жыл бұрын

@@DigitalJedi Wow lol

@JorisKeijser

2 жыл бұрын

Except that fluid can't change direction on its own and is purely subject to laws of physics like gravity. Water will ram into a corner, a car will turn with it.

@kgaming7599

2 жыл бұрын

@@JorisKeijser Well, now we know who's poopin' the party

@JorisKeijser

2 жыл бұрын

@@kgaming7599 Now we know who has nothing of value to say.

We need a series called "Can A.I. finish Trackmania Nations Forever"!

@akatsukilevi

2 жыл бұрын

With enough data, yes

@furkoq

2 жыл бұрын

@@akatsukilevi It will be fun to watch

@t34d1um

2 жыл бұрын

i wonder how much generations it would take haha

@akatsukilevi

2 жыл бұрын

@@t34d1um Thousands and thousands....

@abebuenodemesquita8111

2 жыл бұрын

@@akatsukilevi and time

When I did a machine learning project for a fighting game, I realised that 'memory' or familiarity with a scenario played a big role in my AI's learning ability. In your case I would add another input for non-supervised runs: how far along the track they are. While this (on the face of it) defeats some of the point of a generalised learning algorithm, humans do a similar thing to get over difficult hurdles themselves. When a human plays a track 100 times, they're not just learning how to respond to what's in front of them, they're memorising what's coming next and preparing for that too. Furthermore, we utilise a kind of deja vu effect where if a particular encounter reminds us of a previously experienced encounter, we react the same way. We also chain together groups of inputs, like a combo or something like what you find in tutorials for solving a rubik's cube; if one block is out of place, it can take a dozen moves to fix it, but it's always the same dozen moves, and we learn to ignore the state (to some extent) when we're in the middle of the combo.

Awesome video yet again. Explained in an easy way with not too many details and entertaining as well. Shows the process one has to go through to train even a simple model, but it's also interesting the genetic algorithm found different strategies to pass the same track and that the final network is able to generalize to other pipe tracks. Excited for what the future holds.

@yoshtm

3 жыл бұрын

Hey donadigo, thanks !! And congrats for everything you've brought to the game lately, I've become addicted to TAS world record videos ahah ! Yeah even a simple model requires more work than one might imagine ! What I think is very interesting with the pipe map is that it shows that in some cases, trackmania environment can be described with a very limited number of inputs, so it shows potentiel for fast learning with genetic algorithm / reinforcement learning methods. And the supervised learning part also shows that a neural network can really immitate well the decision process of a human for trackmania driving : the A.I. really plays the same way I do in the end. So maybe A.I. could be an alternative to TAS in the future, even if I think it will take a long time :)

Great video!! Those shots of thousands falling and hundreds running are incredible. What a work of art!

@yoshtm

3 жыл бұрын

Thanks a lot !

seeing thousands of cars falling down the pipe was nice to watch, a good old reference to those k-projects. :)

Let this ai try the patience map "calm down"

@Extramrdo

2 жыл бұрын

Yeah, that's where I thought this was going, esp. after seeing Wirtual deal with it.

@klaernie

2 жыл бұрын

@@Extramrdo I had the exact same thought! That would be really fun to see - after all the AI does not know fatigue

@absolutehuman951

2 жыл бұрын

This map has not only turns, but some branchings also though, hasn't it?

@klaernie

2 жыл бұрын

@@absolutehuman951 no, calm down only has a single route - but a couple hundred corners iirc. Essentially it could be optimized to a straight line without branches

@absolutehuman951

2 жыл бұрын

@@klaernie but the network doesn't have a map so it can't choose turns

Tes vidéos sont à la fois hypnotisantes, super intéressantes et très impressionnantes, toujours un plaisir à voir :)

@yoshtm

3 жыл бұрын

Merci beaucoup !!

@an0maly404

3 жыл бұрын

@@yoshtm Ah, je me disais bien que cet accent me disais quelques chose ! Je suis d'accord avec lui, très bonne video ! ^~^

@uvuvwevwevweonyetenyevweug5884

3 жыл бұрын

@@yoshtm Très bon accent ! Je me suis abonné

@psyk00o

3 жыл бұрын

Totalement d'accord.

@kittencorp.3295

3 жыл бұрын

Baguette

Didn't expect that ending, thanks for the shoutout :D such an interesting video and very well made!

@yoshtm

3 жыл бұрын

Oh, hi :D I love this cut ahah, thanks for the comment !

@rxn7

2 жыл бұрын

O kurwa jjayjoker

Honestly, that's nuts! As a CS Student and a huge racing games fan, I definitely enjoyed this video a lot and you motivated me to start working on the concept of AI in Trackmania! Anyway, great video, keep up the good work

@bs_blackscout

2 жыл бұрын

I strongly suggest tackling the basics first to not get frustrated. I talk from experience. Python, then simple machine learning, then some algorithms, then specific algorithms, then learn to integrate the API with Python, then implement your ideas into the game using AI/ML.

@sot8546

2 жыл бұрын

I relate to your comment so much

@neoblackcyptron

2 жыл бұрын

@@bs_blackscout is there an api in trackmania that is open to users. I know Machine Learning, in used it to build a cnn to denoise ecg signals via supervised learning. From this video. 2 things are a challenge. How do I record driving data. To be used for training. How can the ai send inputs into the video game. Does trackmania have api calls for that? Thank you. If you do know any game that has apis exposed to the users. Do let me know. I need to experiment with ML + Reinforcement Learning using genetic algorithms. A video game with visuals like like a good way to see how the algorithms are doing.

always stoked when a new A.I. video of Trackmania comes up

Great video! I really enjoyed it, you explain really well and the cinematic shots are really well done. Keep it up!

I was wondering if you would release another video! Your track mania AI videos are always fascinating, keep up the good work. :)

This is super amazing and satisfying to watch! Thank you lol. Can't wait till AI tos speedruns become more possible.

12:16 that transition!! damn so good!

So much work, so much expertise, so much quality. I am in love

Just so good vid. I hope you'll get much more fans such as me.

just here to say that i think you did a fantastic job on this video mate it was a great watch

Its impressive how you managed all of this programming, graphics, data and still made a video with an amazing dialogue. Maybe your A.I beat you in this game but I doubt there will be an A.I that can beat you in the life-game any time soon. Keep up the good work. Subscribed and impressed.

this is what i go on youtube for, i don’t play trackmania but your dedication and passion about what you are doing really makes the cut for me ! i can feel you worked hard on this vid and it pays off, great content man, keep it up :) btw : ça fait toujours plaisir d’entendre un accent français par-ci par-là, continue à faire ce qui te plaît mec

@yoshtm

2 жыл бұрын

Merci beaucoup ;)

Nice edits ! Super interesting to see what's possible with this :)

Trop cool ! Such a nice video ! I think you deserve a lot more subscribers ! Your content is interesting, your explanations are clear and it is really satisfying and original ! Keep up the good work man :D

@yoshtm

2 жыл бұрын

Merci beaucoup ;)

If you're interacting with the game automatically, you can use a directx interceptor/shim/wrapper to cull calls to the gpu and be only cpu bound. Then you can start more instances of the game.

Yosh today : creating I.A for trackmania Yosh in 2022 : WR with E-sport I.A cars at the Z-events

Great video - good job on sharing progress along the way 🎉

The production quality on this is superb.

I really really love this AI videos in trackmania, genetic algorithms are fun to watch and combined with trackmania, one of my fav games, is such an enjoyable experience. I'll continue to watch all your videos, and i hope one day i'll be able to see some AI generalize all kind of diferent maps

@yoshtm

2 жыл бұрын

Thanks a lot !

Just found this channel and I love it!

Vidéo franchement incroyable, c'est cool a regarder, les plans sont très agréable, et c'est bien expliquer. Les musiques que tu utilise sont franchement très sympa aussi !

@yoshtm

2 жыл бұрын

Merci beaucoup ca fait super plaisir ce genre de commentaire ;)

Is there a way to run multiple instances of the game and feed them into the learning? Also speeding up the game does not affect the physics so assuming the inputs could be entered correctly could this be used to speed up learning? I have some newer hardware and would love to be able to run AI to learn different maps and techniques.

@MrJCraft

2 жыл бұрын

I am wondering the same thing, like a threadripper is what I am thinking, why not just run multiple instances

@Wilker_uwu

2 жыл бұрын

at this point it would be better for the long term to rewrite the game's deterministic physics into another piece of software, so you could simulate multiple instances of the runs at once without actually having to launch the game multiple times (and logging in to let the drm let you play before you can set it up, which would be tedious and time-consuming). if there's any means to get the numbers right (e.g getting block IDs from the tracks' gbx files, and collision boxes geometries), you could, in theory, simulate any track made in the game multiple times at once without having to render any visuals (so lots of memory is saved which means faster simulations), but also, if any people are willing to do this, that means we get a drm-free, Free/libre as in open-source equivalent of Trackmania, which would be neat

@MrJCraft

2 жыл бұрын

@@Wilker_uwu I think it would be easier to just run the game multiple times, I know of a few people that have workstation pcs with 128 gb ram, 32 core thread-ripper cpu, and a 3090 GPU, so it would be possible to run many instances of the same game on the same hardware, but it would really depend on how he is doing it now, in fact if he really wanted to make it faster maybe use cheat engine to run the game at a faster rate so reverse cheating XD making the game do the physics twice the speed or more but you would still run into the issues with not having multiple instances and when you are trying to do thousands of attempts max speed is always best, so of course re making the games simulation might be faster, but it might be the exact same depending on how the API of the game works, there are many unknown factors in how it works because I have never tried to do something along those lines, though I have done some python coding, also there is the a possibility that the API may not allow for multiple games being run at the same time, but that should be able to be circumvented, but it depends on a lot of factors that I and you can only assume but it would be interesting to see what yosh's ideas are to improve the speed

@adamnielson42

2 жыл бұрын

Could you use the same cheat software Riolu used, and speed the game up instead of slowing it down?

@galeniium

2 жыл бұрын

​@@adamnielson42 Speeding up the game would indeed allow you to do more runs. But the problem is that you would need to also increase the frequency at which you call your neural net in order to keep the same number of adjustments by the neural net. This may not be feasible depending on the computation speed of the NN.

You should definitely do more of these a.i things they're so captivating

your videos never dissapoint! very well done

You deserve a lot more subscribers, keep up the good work :)

This looks so sick, keep up the good work

12:15 This moment is so epic, I really appreciate your work

Excellent job, I love your videos. Keep it up, for science !!! :)

You're good at making AIs, and telling an interesting story about it. Keep it up!

Wow, I was loading into Forza Horizon 4 and clicked on this video, as I get distracted by the video a F-Zero X song starts playing @ 16:50 and I come to the comment section to say wow such a throw back! I finally click through the load screen on my Forza and then you start playing the Forza load in music and I was like wait.. what! That absolutely blew my mind. 🤯 Can't wait to see what we can learn from AI in the future, keep it up! ❤️

@ViktorVaughn135

2 жыл бұрын

Bro what that’s sick I wouldn’t of noticed it without you

@sonicschall

2 жыл бұрын

I was like "oh do I have Spotify running?" when the music played LOL

I would love to see the combined approach where you use supervised learning to "seed" the model and then let it evolve from there.

bravo! incroyable travail, je n’y connais rien en programmation mais tu as réussi à me captivé encore une fois avec ton A.I. ! Bonne continuation, j’espère que tu es fier de ce que fais :D

@yoshtm

3 жыл бұрын

Merci beaucoup !!

Great video and amazing visuals!

Great video, as interested as usual !

Super vidéo et très intéressant et agréable à regarder, tout comme les précédentes 👍 Merci pour ton travail 👍

This was very interesting, well done. I was expecting this to end with the Ai clearing the track called Calm Down. I think that was the title. It was designed as a patience endurance test and is a giant Pipe Maze in the sky with no check points.

Man this makes me want to finally start studying machine learning

Une nouvelle vidéo de Yosh ça fait plaisir 🥰

I genuinely loved this content ! 👌

I love watching these videos, and really helps me want to learn how to try making and doing some of this myself, though I haven't gotten to learning the programming from scratch, most Neural network stuff I mess with, has been more learning watching other peoples code, and seeing w hat happens if I change values the few times I get to try, or using the Unity learning stuff. Would you ever consider sharing any of this, if anything to potentially the idea of getting multiple people to run training on a few courses, and sending you the replays, or something back, or seeing how different computer trained AI's might figure out how to solve the same track.

Dude these are amazing!

I also learned a lot about machine learning, thanks!

At 18:50 thats a great example of the 'Butterfly Effect' in chaos theory. Great stuff

Une nouvelle vidéo et toujours le même plaisir À la regarder tu fais vraimment du super boulot

0:38 the most terrifying or maybe coolest clip

combining the two approaches seems like a really potent combo for AI in this game. from your testing, it’s pretty clear that getting it to start in complex scenarios like this is extremely difficult and far too slow, but with a bit of example data it can have a very solid go at maps like this. from there, i’d imagine evolution and mutation would be really strong tools to overcome the fact that the dataset was provided entirely by you

Please continue with this series! This is amazing! If you're up for game suggestions, the Trials series is really good (newest one is called Trials Rising). It is a 2d platformer with a dirtbike and the element of precise balance might be very interesting. Also, trials loads very fast and the relays would be easy to capture!

Just realized that the straight pipe situation is basically just engineering a control system. The better the system is at keeping itself straight on the pipe, the faster it can travel, so the goals are aligned. Not sure how you'd make use of this fact, but its nice.

Super tes vidéos !

J'adore tes vidéos vraiment, WOW ! C'est vraiment génial de voir à quel point la programmation c'est puissant. Tu as déjà pensé à refaire un petit trackmania (genre le recoder) pour pouvoir accélérer le temps et faire plusieurs itérations par minutes ou secondes ? Vraiment gg ;)

@yoshtm

3 жыл бұрын

Merci ;) Trop compliqué, pour moi en tout cas. Mais ca serait très pratique c'est sur !

Bravo pour ton travail ! Ton contenu est très inspirant, continue comme ça *clap clap*

I didn't knew i would be this much interested about IA

Insane stuff!

It is so fun to watch the mass of AIs move almost like some sort of odd flocking behaviour-though I know it is not flocking, it does still look of it!

amazing video! you really hit me with that Forza Horizon soundtrack :D

For something like that I've been thinking supervised learning at first and then using genetic algorithm to finetune and improve, would be interesting to see how much (if at all) better it would get. Also, great videos! Sub!

@meneldal

2 жыл бұрын

Yeah I think that could work too, use supervised to get it started so it doesn't fail entirely at driving then a genetic with slower mutations for improvement.

You're an excellent teacher! 😄

I love your projects

I love hearing you talk

Love your videos 👍

At the start It looks like the car is melting into a million cars and it's so satisfying... Great stuff!

This is so impresive💪

next level stuff mahn

Love the hades soundtrack in the background

I love Ai learning projects. They are always super interesting. A bit of constructive criticism: it would be nice if you put a list of the music you used in the description, along with the times they show up. I hate it when I hear a cool song used in a youtube video, but don't know what it is.

crazy how fast some of these players for example Hazard or BlueFeed are on pipes!

Un réel plaisir ces vidéos

so good idea, well done

Super intéressant pour quelqu’un qui n’y connaît absolument rien en IA ! Très bien expliqué et super niveau d’anglais ( et top l’accent) ! Super taf !

@yoshtm

3 жыл бұрын

Merci beaucoup !

N.E.A.T video as usual! :D Your final step: create an AI to recognize the map style, combined with an AI which finds the route, combined with an AI which recognizes the surface types and finally combined with an AI which drives according to all this data. In a few years maybe haha

The Music in this vid is on point!

@ovrsurge4689

2 жыл бұрын

Just in case you didn't know (he didn't list the music sources in the description) Most of the music I've heard in this video is from the Hades OST. a lot of banger tracks there.

love this content keep it up

super vidéo ! merci !

Looking at the car liquify at the start feel like something new to me :p

Encore une super vidéo ! GG

Impressive stuff , you must have quite a beast as a pc to render all those at the same time

J'aime la musique que tu utilises au moment des premières générations ! (Also, it's "funny" to see every time cars falling down at the start)

Love your accent. It's so fun to listen to.

You are really cool. Thank you.

Dang this is pretty cool

Love the hades music in the background at 1:16

Great video! This is my second time watching this video after about a year, and somehow this idea didn't occur to me the first time: I just wanted to ask if it would be possible to redo this video and maybe also some of your other older Trackmania AI videos with TMInterface like in your newest video, allowing you to do many more iterations than before; maybe then, reinforcement learning will work even with turns! Please consider this if you see this comment, and thank you for your time! Keep making these amazing and also interesting videos!

If you used the supervised neural network as a base for a genetic algorithm, instead of starting from random/scratch, and having the first generation consist of a few of that network along with small variations in that network, you could give the genetic algorithm a good head start and allow the small randomness between generations to slowly optimize the movement to become faster. Switching between supervised and genetic algorithms is a very useful tool that it used quite often when training AI's.

Another thing that might help is value learning. In other words, make a higher level network which only does one thing. It attempts to predict which combination of inputs and outputs will lead to good performance. Then it can use backpropagation to modify the network live depending on whether it thinks the input and output combination is appropriate or not.

@petersmythe6462

2 жыл бұрын

The way the value prediction network learns is by looking at how close it's time-averaged prediction matches reality. If it thought a car was gonna do really well until the moment it dropped off a cliff, then backpropogate a strong punishment. If it thought a network would get 77th percentile and it got 83rd, then that's quite good and the network should be reinforce itself with a reward.

I think taking the replays as a new data set, then using supervised learning to train a few decently good AIs, which you then use the values of to train a generic algorithm instead of seeding with random values might give a pretty good result.

I find it really interesting how they wobbleon a staight pipe, but i guess theyre just constantly correcting thier oversteering

I loved your video! I didn't think an AI could go so fast on pipes (or even finish the map). By the way, I would have uninstalled the game for sure if I got beaten by the AI (: If you look at the human replays, you can see that bluefeed uses another strategy by taking the corners from the outside and making a small jump (I really didn't think it would be faster). It would be interesting to see the AI play with this strategy!

A quand le jour où une des tes IA participeras à la TM Cup de ZeratoR ahah ! Super contenu continue comme ça !

Great video, I really appreciate the tons of work you had to put into it. The results are great. I wonder if you thought about writing some kind of scientific paper about your work? Self driving cars are well research area, but someting like this or setting new TAS wr is truly unique and could make a decent paper.

It would be interesting to use the supervised model as a starting point for a genetic algorithm. That would mean that it starts with the basic ability to complete courses, but it could keep making improvements beyond the initial training data.