It's 4am and I'm watching genetic algorithms......

@monkeywrench677

6 жыл бұрын

me too.

@soundx8015

6 жыл бұрын

Aaron Hinojosa 2.27 right now

@blub5494

6 жыл бұрын

They are actually quite interesting

@aspirine999

6 жыл бұрын

Next step: minimize time to finish. If you use both time and distance and fitness, I wonder what combination of them would make a greater car evolve faster

@arthurgamespixelbr1277

6 жыл бұрын

Me is a 8 of am

>Adds boxes so the cars can't flip. >Best AI proceeds to get rid of the boxes.

@sm4llbit

6 жыл бұрын

The essence of evolution :)

It's like a pro version of Hill Climb Racing

The music helps me appreciate it even more. Awesome.

Human music - I like it

@jdpg7614

6 жыл бұрын

Vinz Gilligan Only those with 900+ IQ will get this joke.

@14031993

5 жыл бұрын

JD PG I only have 899 IQ, what did he mean?

@dogeramsey9154

5 жыл бұрын

*Minimum simulation power

@theternal

5 жыл бұрын

@@14031993 he mean that morty was just a simulation

@EngiNetion

3 жыл бұрын

lmao

It would be interesting to co-evolve the track using a fitness function that selects for tracks that are better at challenging cars. The fitness function for the track could reward tracks that create more complex 'interesting' car movements (flips, backtracks, variations in speed, etc).

@sm4llbit

6 жыл бұрын

Yes, I thought would be very interesting to generate levels for a game using evolution as oppose to hand crafted designs. It would be very tricky to setup though, but very interesting idea.

@Kevinofrepublic

6 жыл бұрын

The terrain needs to remain constant. The AI is learning yes but it is only learning for a specific track. Theres an example of why the track cant change and its from a MarIO video by SethBling. Idk how to spell his name but anyways he makes an AI that can beat a mario level but the AI despite learning enough to beat the first level cannot and will never beat the second level because the AI didnt learn it specifically.

@Kevinofrepublic

6 жыл бұрын

I mean I assume. I have yet to see an AI that can adapt to new tracks, levels, terrains after successfully completing one.

@sm4llbit

6 жыл бұрын

I think he meant, that the car is constant and the track structure is a genotype that evolves.

@AC0KG

6 жыл бұрын

I'd like to see them co-evolving, responding to each other in a coevolutionary configuration. Cooperative coevolution might tend to lead to boring tracks unless the fitness functions were carefully tuned to select for 'interesting' behaviors. The track does not need to remain constant, in general. Most of the examples I've seen of evolving vehicles use randomly generated tracks. A specific implementation might be limited to exactly one terrain, but that is a feature of that specific implementation. My own dabbling in this is on the evolution of computer programs that navigate a maze (a very simple simulated stack machine CPU with port-based IO connected to sensors and actuators on a simulated vehicle in the maze, running assembly language programs that evolve). It does not co-evolve the maze, it just randomly generates them, new for every member of the population. That's an interesting idea though, now that I'm thinking about it. I wonder if I can come up with a way to generate the mazes using an evolvable script. I'll have to think about ways to encode a maze-generating routine in a way that can be evolved. wiki.ece.cmu.edu/ddl/index.php/Coevolutionary_algorithms

That. Was. Intense. The music kept me watching like it was some kind of NASA milestone :P

I like watching these because they demonstrate evolution pretty well

Amazing ! Never saw this type of algorithms, iam very curious about this area now !

@rakdos91

6 жыл бұрын

you're in for a ride, there's quite some videos about this on youtube. try looking for genetic walking algorithms

@The76Malibu

6 жыл бұрын

A youtuber named carykh makes some 'evolution simulator' videos you might like. A really cool type of simulation.

And thats how they created the bots in Hill Climb Racing :D

Very cool! I wonder if you could add to the car algorithm a "passenger" object, and trigger a game over when the passenger "dies." How would the successful evolution look different, if it had to also take into account the "safety" of the "passenger"?

@hybby

6 жыл бұрын

What would constitute a passenger death? A flip? Because none of the cars completed this track without at least 1 flip.

@botondbenyovszky6621

6 жыл бұрын

add a given size square component, and if that ever touches the ground, it's practically dead.

@botondbenyovszky6621

6 жыл бұрын

@Jack Kalish: You could also add "energy" usage (a component left out from these simulations too often), and also weight as "fitness", since if it can carry more, more effectively, then it's a good machine.

@abaundwal

6 жыл бұрын

Basically you want to have an AI that plays the hill climb racing game.

@YashMRSawant

4 жыл бұрын

One thing to note getting a convergence is very tricky.

Очень ждал, что генетический алгоритм в конце концов сгенерирует жигули.

@user-hv1iy9ge9i

4 жыл бұрын

Ахах, убил

Thank u, this video cleared my confusions regarding genetic algorithm

Hey there! Amazing video. I was wondering about a few things: Would it be possible to make the terrain randomly generated? Using some sort of noise, the terrain could be different for each genome. That way the cars will be able to drive in different circumstances. Also, is it theoretically possible to base the fitness on distance traveled in a certain time? Instead of only stopping when the car gets stuck, wait 20 seconds for each car and then go on to the next one. Would this work? Would they "learn" that speed is important as well? Thanks a lot for your time and this video :)

@sm4llbit

7 жыл бұрын

winnie33 Hi. about this randomizing of the terrain, I dont really think this would work. The entire experiment is set to evolve the car to do this particular test (track). Any generation might be proven useless on newly randomly generated track because it was evolving to beat previous one. However due to nature of this experiment latest generations shouldnt have a problem to beat any randomized withing some limits track, but this is not what Genetic Algorithms are for. As for the second question It could work but than again from theoretical stand point the experiment is to evolve the car to beat the track. The track has variety of different obstacles, a successful car should be able to beat. Capping test run to 20 second would result in the cars never get to some parts of the track, hence it would (probably) never evolved to beat the track and be able to pass any obstacle from it.

@winnie3334

7 жыл бұрын

Thanks a lot for the quick and in-detail answer! About the random terrain, why aren't genetic algorithms fit for the job? Are there any other neural networks (if that's how it's called) that could do this? Anyway, your videos are really nice and informative. I wish you all the best with your channel and look forward to seeing more of these videos :)

@sm4llbit

7 жыл бұрын

winnie33 Hi. first to be clear I am not any kind of expert of this matter just a hobbyist so I suggest you read some scientific literature about this topics. With that said, I dont use neural networks here my phenotype just performs a single action driving and fitness evaluates how it did. I am affraid if you want a arbitrary phenotype perform well in any random environment you better call SkyNet. But seriously a neutal net is what you need (I even did one experiment with it and uploaded video). But than agaim neural net is to solve a more complex problem with multiple inputs and outputs (i.e. driving car learns to complete the track). Again any neural net applicatios are very vulnerable to changing environment. There was one example in which net learned to pass level after 2x generation but next level had different kinds of obstacles so the nnet was useless and it needed to learn from start. Finally it all depends what exactly do you mean by random track. In this example as i sad phenotype is simple. Assuming your would have a more complex one with controlles speed breaking and balancing maybe. Than any new random piece of track you generate might constitute new type of obstacle your net is not ready for (but it all depends on how you define it). Than it will need some generations to learn it but it would forget the once you already had because its not testing against them anymore. Again this is just guessing, but I've seen few dozens of nnet examples and in none of them the problem to solve is changing during the experiment.

@sm4llbit

7 жыл бұрын

?

@hamburgerfatso

6 жыл бұрын

How about using something like distance squared or cubed divided by time for the fitness, so that it takes into account now fast it travels, but also favourably weights further distances with larger scores?

one wheel is the best 😌

@truthsmiles

6 жыл бұрын

Right. I was surprised that didn't appear.

@willperplexed9199

6 жыл бұрын

Maybe he set a minimum parts limitation.

@ardiawanbagusharisa7040

6 жыл бұрын

Of course, there will be some constraints

@truthsmiles

6 жыл бұрын

Or maybe just that a wooden block is required.

@RRTVTAMIL

6 жыл бұрын

李锦州 so

Great work!! Such kind of work is what pushes science forward... Kudos to you guys!!!

the music in this video is extremely calming haha

This guy and Carykh would have interesting conversations.

to be honestly it seems randomly generated, it makes its changes so drastically. it had a mostly working formula in 10 then went back about 8 generations and re-cycled through without realizing the wheels being close to the ends makes it more stable

@sm4llbit

6 жыл бұрын

cooldued11 well the initial population is indeed randomly (within bounds) generated.

Sometimes I really feel the urge to help those little cars. "You go, little fellow, theeeeere you go!"

Nice job!

You should make it so that after like 50 generations you press a button to make it give a higher score to heavier cars or something like that just to see how they react. I'm sure after a while it would just make a really big car that flops one inch and gets a really high score but it would be fun to test.

This is amazing especially after seeing a carykh video where it too hundreds of generations to make "walking" creatures that kind of shuffled along the ground

So satisfying

A nice proof of Occam's Razor

This will probably bring back smalltalk and visual based languages back into the limelight. They should try that same model on different tracks see the results

This was cool. Did your algorithm eventually learn not to use non-drive wheels?

Why do I find this so adorable?

well, love the music:)

Hey Tomek S. This is great stuff, I have just started learning about AI myself as a hobby. You got any tips on how I could fast track my progress? Maybe a good online resource of knowledge is out there that I haven't stumbled upon yet...

This is awesome! I've been wanting to get into genetic algorithms and machine learning code.

crazy to think what can be accomplished with brute force, but insight is nice to have

Reminds me of that toy car I had when I was a kid that you could drive into walls and it flip upside down and keep driving.

This was quite interesting and entertaining. Do you share any of the code anywhere so others can build upon it?

Now I feel the urge to play Elastomania

i used to have an app on android that did a similar thing can't remember the name but it helped me sleep

That is fucking awesome.

In the entire video I was like: "he's begining to believe"

beautiful!!!!

And that son, is how cars are made.

Truly Awesome. Can you please tell me how to integrate AI into Unity and what is your GPU configuration?? Your help will be appreciated because I also want to work on a similar project.

woww this is great but it just shows how a machine can only ever be a tool -- what a human can solve with intution and design mindset will take a machine a ton of computing to arrive at by force. But that may not really be a problem with the evolution of computing resources. I don't know, I'm just a chemical engineer but this is real cool! :)

Like the way generation 21 has a "stabilizer tail/front" Like it uses it to defect most of the flips by my calculations. Anyway great video.

Hey this work is amazing! 😂 I wonder what your solution representation looks like. Is it a binary-coded of those 20 decision variables?

@sm4llbit

5 жыл бұрын

The latter 😂

Cool

Wow yaar maza aa g aya

Look at that *_off road all wheel drive!_* Is that the 2019 model?

turn this into a game where you can build a kart, place wheels and make it heavier. there should be a guy on the car and if he falls off, it should be game over. polish up the textures, remove the statistics menu, and get it reviewed so it can be published to the app store or the google play store

So, you basically get a BatBike at the pinnacle of evolution!? DC got surprises!

Very cool. Is the code Open Source available somewhere?

I study and apply this algorithms 10 years ago at university.

Very cool, is there a way to look at unity project ?

Where did the information about the shape of the wheel, the nature of going forward, and the frame of the wheel come from?

I noticed you programmed a sort of "shocks and suspension" system, was that capable of changing as well?

@sm4llbit

6 жыл бұрын

Jones Crimson that's correct

Did you use an existing framework, or did you build your own genetic algorithm? Also, is the car built and controlled by a NN, or is it directly based on the genetics?

@sm4llbit

6 жыл бұрын

Didn't use any frameworks, wrote the code myself. There is no neural network in this example.

В итоге из сложной машинки должно остаться одно колесо, так как ему легче катиться без лишних деталей. То есть отбор ведёт к упрощению. Так же и бенгальскиз тигрон естественный отбор по своему определению должен упрощать и превращать в одноклеточных простейших самых идеальных по выживанию и размножению

Insane

Amazing work there. I am currently experimenting with genetic algorithms and palying with some dump calculations in terminal :) And I wonder, what is different between distance and fitness? Why fitness doesn't have value of distance directly? And how you calculate fitness?

@sm4llbit

6 жыл бұрын

fitness is a value that describes how good the genome is executing a task it was put to. Having distance as a fitness for this experiment is a logical choice, however, from two cars that can finish the track, the faster one is considered better. Hence the fitness is a function of both distance and average speed. I am not sure if i remember well but it was something like this : fitness = distance + sqrt (avgSpeed); So it favors the distance over speed but doesn't neglect the latter. Once could expand this a bit by having fitness being penalized for car flips or getting stuck.

@schovi

6 жыл бұрын

Makes sense! Thank you

That AI be like, "Are you SURE one wheel in back and one in the middle won't work?"

That last one looked like a set of glasses.

its so relaxing to watch machines slowly becoming more and more intelligent than the human race

and now - experiment 2, turn on eurobeat and look what will happen.

Like the last ones wheelie bar

Did the program generate a unicycle with a center of mass inside the wheel?

so this is how the movie cars was made

Imagine tesla using the same code for self driving cars xD

@netcrns

6 жыл бұрын

so the car changes appearance every time it gets stuck?

@Metallijosh100

6 жыл бұрын

"After 300,000 crashes resulting in over a million deaths, our cars have finally learned how to drive on roads with an accident rate of less than 10%" *Audience cheers*

@cezarystasiak9498

6 жыл бұрын

Do you think they don't ? Self taught artificial neural networks are everywhere

just wondering if you're still replying cause I'm interesting by this and might do a similar final project for university, how did you handle the car creation with your genetic algorithm in unity?

Simple is the hardest!

What does ''generation'', ''fitness'', ''mutation rate'' and ''population'' means ? How many time it take to go from one generation to another in general ? I find all those ''genetic algorithms'' scary, but still interesting Thanks.

Hey, im really intrigued by machine learing/AI. I think I already get the concept of machine learing, but dont understand the niddy griddy part of how you actually implement it. could you advise me some good starting point for getting into it? As a CS student i will have the posibility to get into it later down the line, but i really want to start doing some small projects in the near future.

@sm4llbit

6 жыл бұрын

The coding train channel covers quite a lot of this, its very well explained too. Good starting point.

@The76Malibu

6 жыл бұрын

KZreadr carykh has done some 'evolution simulator' videos and his code is open source. It's great fun messing with variables and seeing the effects.

I was really rooting for the car

Could this be evidence that the form of a car would be seen on intelligent alien planets by extraterrestrials? I always wonder how intelligent aliens would progress relative to us. Cool stuff.

Hell Gen 37 drives better than at least half of the people on the street

Geniomes start different, end similar. Convergent evolution.

Holy crap smart kid!

i wanna download this for fun :3

Tomek S Hi! I've been trying to learn how to do similar experiments for a while, but I've been failing to find the right tools to work with if you could give me any tips or guidance I'd be grateful.

Sounds like my alarm went off

I like this music, is it available to the masses?

@sm4llbit

6 жыл бұрын

kzread.info/dash/bejne/dGh_maqqppfcpNY.html

There is no Creator who created this car, as it is improving and evolutionized itself.

00:47 Probably a proto version of a future muscle car

Could this be seen as a proof that for this specific example there are no viable cars that are not able to be turned over?

Would you please share what is the outputs in this algorithm?

Can you Give it data for the distance traveled in the last 5 and 10 seconds(more is better). As well as give it the ability to change its speed at any time. Also, penalize it for flipping the car at any point. Then also give it cargo that it has to carry on the wood/body of the car. Once it is able to do all of that vary well, increase the weight and or size of the cargo. Though, can the AI even 'see' the track? Is it just "going forward" without the ability to sense the environment?

What language you use for developing AI algorithms/models?

@sm4llbit

7 жыл бұрын

Flatron303 it's c# in unity

Hello, I am a beginner in genetic algorithm and recently created one of my first genetic algorithm. Sadly I encountered some problems: Each generations, the agents are supposed to get better and better, also to have a chance to get dumber because of the mutation function, to battle this, I implemented etilism (I believe that's the correct term) which selects the best agent from the previous generation and transfer it into the next generation so as to prevent from the algorithm getting 'dumber' agents than the previous agents. However, the fitness function increases a bit at the start and slowly decrease? For the output of the agents I implemented threshold, if the output is greater than the threshold, the boolean output will mark that as 'true' otherwise 'false'. For the mutation function I also mutated the threshold to be a random number between 0 - 1,

@sm4llbit

Жыл бұрын

It's really hard to say whats the issue in your case, but decreasing fitness sounds like something is off. Usually one spends a lot of time tuning hyperparameters for the model to work. Try different inputs scaling. fitness calculation, mutation algo etc.

That music tho

Maybe the track should slowly change through time too

Up next, genetic algorithms - evolution of Happy Wheels

*leave it running while you get lunch* *comes back and computer steals your car*

Did you constrain the number of wheels to two?

Computer algorithms will help us develop better devices and machines

@Tomek S Is it possible to find your code somewhere in public?

The final design is the first design a toddler would create.

Wie bin ich hier gelandet ?!

Do you have the unity files in public domain to explore..?

Hi, I have a question. What did you use to make the fitness graph?

@sm4llbit

6 жыл бұрын

Unity UI

Can you upload the source to this program? I’m interested in how this works (Ive never made one and want to see how one works before i go in blind creating one)

What are the inputs of such an algorithm?

how did you make this? could you make a video about that?