Quick Tip: In windows explorer, in the folder you want in cmd, just type cmd in the address bar. it will open cmd.exe to that folder

@CodeMonkeyUnity

3 жыл бұрын

Oooh that's an excellent tip, didn't know that! Thanks!

@davidt01

3 жыл бұрын

I always press shift and then right click and select open powershell here. But that won't open cmd if you need that for some reason.

@jamado9067

3 жыл бұрын

if you are having issues with installing ml agents try using the following command: pip3 install mlagents Also make sure Tensorflo supports your python version

@ivandamyanov

3 жыл бұрын

Yeah I found that out a few months back too, the only issue is if you want to use the folder path input field soon after (or you need to copy it), it won’t work until you press back to reset it to the correct path.

@kacpergasior2748

3 жыл бұрын

yo that's so good

💬 Machine Learning AI in Unity! Lots of people requested this topic so here it is. It's a really awesome toolset and learning the basics in this video will enable making some really awesome scenarios. This was a ton of work to make in researching/testing/recording/editing so if you find it helpful please hit the like button!

@mirrorslav5803

3 жыл бұрын

How is it possible that all day I’m trying to install ml agents and now, when I’m still stuck you will provide full tutorial.😂😂 can’t wait to see it.

@TechnicalBurhan

3 жыл бұрын

Thanks code monkey you listened to my comment on your post. I love your explanation thanks. I will be sleeping when this will premeire so I will watch tomorrow morning as I wake up. I huge thank you. I love the simple way you explain. Please keep uploading more videos on AI and various other stuff. Love you 3000

@essentialasa5233

3 жыл бұрын

Thanks for this. I hope to have more time to watch it later. Did you already do one of these for procedural generation?

@skinnyboystudios9722

3 жыл бұрын

Hi, code monkey! I recently bought gtx 1650 super, it has 1280 cuda cores. Is this good for deep reinforcement learning?

@CodeMonkeyUnity

3 жыл бұрын

@@skinnyboystudios9722 Anything nVidia will help but the current Release 10 is not using CUDA, I'm guessing they will add it back in the future

I saw this 2 months ago and finally had the time to not just watch but follow along and can I just say again, this is perfection. MLAgents always seemed to clunky / obtuse to use, but this made it straight forward. This tutorial took me straight through and I am amazed at what I was able to train on and get done. This just opens up a world of possibilities I can't wait to dive into, thanks again for this amazing tutorial!

@CodeMonkeyUnity

3 жыл бұрын

Thanks! I'm glad you found the video useful!

Hi from 2023! I had some trouble instaling the python enviroment but I made it work. Unity: 2022.3.14f1 Python 3.9.13 Before venv: py -3.9 -m venv venv After venv: python -m pip install --upgrade pip pip install mlagents pip3 install torch torchvision torchaudio pip install protobuf==3.20.3 pip install packaging Works fine! Hope so u too :D

@user-ot8ri8sd7s

6 ай бұрын

man i dont know how to thank you...... i was trying to install it from a week or 2 ..... today finally after seeing your comment i was able to install sucessfully without error👍👍👍🙏🙏🙏🙏🙏🙏

@willoh1861

6 ай бұрын

Dios, estuve una hora intentando que funcione hasta que vi tu comentario se agradece mucho

@wantongyao1657

4 ай бұрын

thank you you really saved my life!!

@filipkocic8340

4 ай бұрын

You're a literal angel, thank you so much!

@Anmol-1903

4 ай бұрын

thx man, really helped alot

Concise and straight to the point as always, but at the same time very detailed explanations. Long time patron and a fan.

@CodeMonkeyUnity

3 жыл бұрын

Thanks! Glad you found it helpful!

What an amazing tut bro!, just everything that you need to get started with this demon. As you say barely at the end, when you finally manage to make it work its jus like magic!. Thanks a lot for the effort!. Marvelous man!

So hyped about this video!! Awesome topic and I can't wait to see your project man!

Thanks so much for the tutorial. Iv wanted to dip my toes into Unity's ML-Agents for a while now. And you helped me to do that! I cant help but watch the little move around the screen as he learns :)

This video was so much fun to follow along with!!! Simply awesome

I can't imagine the the work you had to put into this, Really appreciate all your work, Thank you CM!!✨

@subzero4787

2 жыл бұрын

i wish i could appreciate him... I can't download pytorch plz help me

Followed along this tutorial and was able to train my first agent. Great tutorial and attention to details. Thanks!

your manner of speaking is clear, to the point and easy to follow, thank you

Really looking forward!!

Great work Code Monkey! You are pumping out quality content like no one else. This topic is very interestig and not many tutorials on this. Very very good work man.

@CodeMonkeyUnity

3 жыл бұрын

Thanks!

Amazing work. I just watched it all the way through and next time I'm going to step through with you!

It was really good, it seems very interesting! Waiting to see the applications of ML!

This is really cool, I have been trying to train RL agents with AI Gym, but that is not a compelling environment. But I love game development in Unity. So This is awesome stuff. I am just a little worried that this ML-Agents project has not been updated in a while, and maybe it will not be long supported. But I will have a quick play sometime.

I will be waiting for you always, soo thank you sir, for your learning. this means a lot to me.

After a few days of following your tutorial little by little (sorry I'm still a newbie),, finally I can understand what you teach, even though there are many changes to the ML-Agents.. but thank you so much Mr.hugo for the knowledge this is very useful for me curious about machine learning.

LIFE SAVER. this helped me get this running. thank you!

an Immortal Video for a decade .

Yes! I love your videos so much. I recently got your tutorials on steam and Udemy. And I can use them as an reference when I teach my son how to program in C# with Unity.

@CodeMonkeyUnity

3 жыл бұрын

Awesome! That's great to hear!

@edgysphere

3 жыл бұрын

That course is free?

@sundarakrishnann8242

3 жыл бұрын

@@edgysphere He has a free Code Monkey Steam App that teaches some stuff in Game Dev(do check it out) and also he has two Udemy courses, one is a builder defender project course with unity and C# and the other one is a visual scripting course! I have the builder defender course and it is awesome! Naturally the other course must also be good!

@edgysphere

3 жыл бұрын

@@sundarakrishnann8242 links for it pleasee!

@CodeMonkeyUnity

3 жыл бұрын

@@edgysphere The free Code Monkey Steam App is here store.steampowered.com/app/1294220/Learn_Game_Development_Unity_Code_Monkey/ The courses are here unitycodemonkey.com/courses

Best explaination/tutorial so far. Really got me going and hooked.

Thanks a lot Code Monkey. It was fun getting my first ML-Agent to work. I am planning to make the ML-Agent track moving ball and then use ray-casting, instead of passing in the Target location to see, how the neural network will handle that. After that I will implement the Wumpus world example found in most AI text-books. Lots of fun with this API.

How you make so much quality content in so less time? Do you have a very talented team or just you?

@CodeMonkeyUnity

3 жыл бұрын

It's just me, I definitely work way too much heh

@shreyanshsingh999

3 жыл бұрын

@@CodeMonkeyUnity Thanks a lot man. Just wanted you to know that I appreciate every bit of work that you put in your videos.

@CodeMonkeyUnity

3 жыл бұрын

@@shreyanshsingh999 Thanks!

@frogmasto1316

3 жыл бұрын

@@shreyanshsingh999 same

@apersonthatsucksatnames1133

3 жыл бұрын

@@frogmasto1316 same

Amazing video! Perfectly explained, that's obvious the lot of work that are behind this video! I'm impatient so see next videos about ML! One question : with the final brain, you would be able to move manually on runtime the target, and the player would follow that target? Thank you! And as always, good job!

@CodeMonkeyUnity

3 жыл бұрын

Yup, as long as its trained with some randomness it should learn how to go towards the target and not a specific position

@TheScorpionAly

Жыл бұрын

Small note: for that to happen, you need to train almost all possible positions on the board, as the added observations does not mean that the agent is aware of his position and the ball positions and knows what actions to take in order to get there. It only means that you trained for scenario X many times and you know how to get a positive reward, the agent will follow the Y steps as it was trained. And that, with a larger board becomes a pain. To better achieve this desired effect, it will be better to look at the AI vision tutorial, or even at the car ML because those better explain how an agent can be "aware" of its surroundings and targets.

@kevinbennett4518

Жыл бұрын

@@TheScorpionAly I'm not sure that's true... What the AI is learning here is that the relationship between all the vector values contains a pattern, and that its actions can affect the likelihood of a reward based on taking an action related to that observed pattern. The pattern is that when the distance between the objects reduces, the reward is more likely, and it learns how to take actions to reduce that distance on each cycle. I bet the second brain in this example would be able to chase the target reasonably well if you just started moving the target around, even though it wasn't trained in precisely that scenario because the only information it has on each cycle is the two postitions.

My friend thank you very much for this video. I always wanted to dive into ML/RL but I always thought the topic is too big. With this Unity ML Agents library it's really abstracting away a lot of setup and let's you directly dive into training an AI model. Very good explained and introduced!

Thank you for all the great work and tuts.. the least we can do to support you.. keep it up.

I was a little scared when I saw the length of the video (still the same problem with understanding English), but I didn't see the time go by! Superb video, very clear. Thanks for the time spent explaining how to install the various necessary programs, this kind of configuration can sometimes waste a lot of time and motivation. I look forward to the rest. I haven't taken the time to realize your example yet, and I'm wondering what happens if we put several players on the same floor.

@CodeMonkeyUnity

3 жыл бұрын

Yup, the setup is what took me the longest during research and coming up with tons of problems so I really wanted to do it step by step. If more than one player was in the same place going to the same object they would constantly be bumping into each other in order to try to get to the goal

@StellarMirage

2 жыл бұрын

@@CodeMonkeyUnity That would be an amazing thing to watch

Love your course on Udemy - terrific pace and getting lots of insight, looking forward to this too...

Our graduation project is with Unity ML Agents and this video helped me to get the basics. Thank you!

@CodeMonkeyUnity

6 ай бұрын

I'm glad the video helped! Best of luck with that project!

Awesome man, Thanks for creating !

Awesome work, thank you so much man ! For people joining the bandwagon around July/August 2022 : - Take the ML-Agents package manager version 2.2.1-exp.1 (at least) - When launching Tensorboard, don't hesitate to give the folder where the results are in the command you type (ex: logdir=C:/user/MLProject/results), instead of typing "results" - If you know your way around the Python environment, feel free to use Anaconda, works just as good (I'll update this comment if I find any other stuff that changed since)

Very fun video! Thanks! As an AI noob I have a question: Couldn't you also speed up the process if you would have given the AI also a reward if the position is closer to the goal? In that case it wouldn't have start to move in the right direction right from the beginning. So it not only gets points if it touches the goal but also if the new position is in closer proximity to it.

@thijsriezebeek790

Жыл бұрын

I think you could! Perhaps putting a timer in the Agent to check to check the distance to the goal and add a positive/negative reward based on whether or not it got closer to the goal or further away since the last timer. I suggest the timer because doing this continuously would be a bit heavy/overkill on the reward system.

wth This is the video I was looking for!!!! Awesome

Amazing! Thank you so much! happy new year aswell

Learn from my mistake. Don't install Python 3.9 because PyTorch won't install. Use the version shown in the video: Python 3.79

@cmdkaboom

3 жыл бұрын

3.8.1 works too

@seanloughran6714

3 жыл бұрын

Super helpful, thanks!

@itaiyonatankaplan2385

2 жыл бұрын

How do you do that tho? I installed the correct version (3.7.9) but already had a newer version installed so pycharm won't install and I don't know how to run the correct version by default

For everyone who gets this error: Traceback (most recent call last): TypeError: Descriptors cannot not be created directly. If this call came from a _pb2.py file, your generated code is out of date and must be regenerated with protoc >= 3.19.0. If you cannot immediately regenerate your protos, some other possible workarounds are: 1. Downgrade the protobuf package to 3.20.x or lower. 2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use pure-Python parsing and will be much slower). Simple Solution that worked for me is: pip3 install --upgrade protobuf==3.20.0

@nickderskater

2 жыл бұрын

TY!

@user-st1gj3si7x

Жыл бұрын

thanks a bunch!!!Really gratefull

@MrHandsy

Жыл бұрын

I FUCKING love you. This has plagued me for SO long.

you are an amazing person, just amazing... you just saved my final thesis project

Thanks so much for this tutorial! it was the most fun ive had so far in programming, made a working pong game with the agent getting better and better still if i upped the difficulty with smaller bump and balls and speed, really fun to have an own made brain to play with =)

If you are having problems changing directory in the CMD (Command Prompt), it might be because the folder you are trying to locate is not on the C drive. If this is the case simply type: cd /D

@makisuka2043

2 жыл бұрын

Thx man 👍

This channel is no doubt the next Brackeys!

@arcday4281

3 жыл бұрын

Are you straight VANGA or Nostradamus )))

@arcday4281

3 жыл бұрын

@@seb.5053 I'm sorry, but I don't know what you mean. The language barrier in action )))

@seb.5053

3 жыл бұрын

@@arcday4281 I was saying I hope you have a fantastic day today! :D

@arcday4281

3 жыл бұрын

@@seb.5053 I hope you have the same day)

Awesome video. I have seen many videos for MLAgenst but in every video instead of getting solutions, I got more doubts and errors. Thanks for such a nice step-by-step video.

@CodeMonkeyUnity

3 жыл бұрын

Thanks! I'm glad you found the video useful!

Thank you! It took me a few hours, but rlly worth it, thank you so much

Do you ever want a new object to not be on 0,0,0? i see everyone always resetting it manually, but theres an option to just always spawn it on 0,0,0 :P Preferences > Scene View > Create Objects at Origin :)

QuickTip: To easy open cmd in a folder, press shift and right click, then 'Open command line prompt here'

@buckiez

3 жыл бұрын

you can also type cmd into the folder's url bar

Honestly, this is way above my understanding. But I found it interesting nonetheless. Thank you

You are great ! Waiting to more content from you in ML Agents :))

When I started fallowing this tutorial I would get a lot of errors, but I managed to fix those errors, and then I decided to make my own ML-Agents video. It is vary similar to this video but it shows how I fixed all the errors I was getting. For those that want to fallow my tutorial here is a link: kzread.info/dash/bejne/hHWCtNxyn9zgm9I.html. But I just wanted to say thank you code monkey for this awesome video. without it I would not have been able to make my video.

@CodeMonkeyUnity

Жыл бұрын

That's awesome! I definitely need to find the time to look into MLAgents again and see what's changed

@feliperibeirosilva900

Жыл бұрын

@@CodeMonkeyUnity @theashbot4097 I had some problems when I run the test for ml agent and your installation worked =) thanks. will keep looking at the video =)

It would be useful to know how you imported the Github release into your project as I have had nonstop namespace/reference issues trying to import it

@luizfernandonoschang8298

2 жыл бұрын

Check if the path to your project contains spaces and/special characters. Some software are pretty bad on dealing with those, specially when running a from command line like this one If that's the case try to move your project to another folder

This is huge man big thanks ! You are a great teacher

Best tutorial video ever! Thanks for helping me reach enlightenment:)

Hello,I have python 3.10 installed,but I am having trouble in installing pytorch,upon writing everything you wrote at 5:35,by pressing enter,its giving errors"Could not find a version that satisfies the requirement",please help.

can u pls make a new vid.

45min video by Code Monkey, this is better than cinema movies.

Awesome :) My love theme - ML + AI in Game

Amazing. I have a couple questions though: 1. Why was pytorch needed in this case? 2. Is there a way to do this entirely on python?

@drn1850

2 жыл бұрын

yes

@Bamseficationify

2 жыл бұрын

correct

@YodaWasSith

2 жыл бұрын

Okay if the training environment can be set up entirely on python, how? Without pytorch? How do I get rid of pytorch, or whatever it seems to have managed to install before it failed? It threw Error no 2 for seemingly no reason whatsoever and it did take up 2 gb of space on my drive, but it clearly failed to complete whatever task it was trying to perform.

WHEN DOWNLOADING PYTHON, YOU HAVE TO DOWNLOAD THE 64-BIT VERSION!!! I have run into some issues during the installation and it was because of the 32-bit version I have downloaded

@mazdnd

3 жыл бұрын

yeah if you have a 64-bit OS installed you need the 64 bit version of software :) If you have a 32 bit system it's the other way around, although 32 bit is getting less and less common with time.

Thank you mate! Your tutorial helped me a lot!

Excellent tutorial,I learned a lot👍

Is it realistic to use this in a complex procedural 3D scenario? This would really help me validate and spice up my levels, given I could have an agent automatically try to pass each one.

@Stonium

2 жыл бұрын

I am going to try this soon. Did you end up trying it?

@pixboi

2 жыл бұрын

@@Stonium nope, but ill probably have to in the future. having some kind of adversial scenario perhaps with a escaper and a chaser would be cool.

@Stonium

2 жыл бұрын

@@pixboi Yes! I'll post here again if I end up doing it

@pixboi

2 жыл бұрын

@@Stonium hit me up if you figure out something

I Am Having A Lot Of Errors When I Try To Download And Install Everything.

Thank you so much for this excellent tutorial!

Just did it.! my own one. Thank your very much. It is very fun to learn AI thing.

On my side there are no ActionBuffers in the OnActionReceived, but a float array. What difference is there?

@CodeMonkeyUnity

3 жыл бұрын

Make sure you install the latest version of the package, not v1.0

@NevaranUniverse

3 жыл бұрын

@@CodeMonkeyUnity Yup i installed ML 2.0.0 but its pre-3 so im a bit concerned

@plockyable

2 жыл бұрын

Same problem here

If u cant install pytorch because no doctype html Use Python 3.8.10 Dont use 3.9.10!

Thanks Mr. Monkey, I love it man. Keep up the great work.

Thanks for a greate tutorial! I've been playing with DL and RL for the last year or so (though not very intesively), and it's one of my main objects of interest, especially RL. And it's a greate pleasure to me to finally discover such things as ML-Agents in general, and Unity integration in particular (why didn't I find it before?). Can't even express now what a huge window of possibilites I see now for myself. A huge field of experiments I wanted to do for a long time. And what an awesome way to create my own environments! I just saw that I can even simply just create the envs in Unity, but make the rest of learning separately in Python!

@CodeMonkeyUnity

Жыл бұрын

I'm glad you found the video helpful!

Caution !!! Don't create "SKYNET" by accident ! Terminators will destroy humanity )))

@danielmathew4091

3 жыл бұрын

HA HA

Wow what an amazing lesson, ty!

I would love to see some videos showing some projects using ml-agents by you. btw Love your videos

Hoho, thanks for this man, keep it up 💪

Really nice video!

Great video, thank you, I did want to mention I had to downgrade to the python version you were using in order for it to work, I am sure there is an updated way but I could not figure it out. Also for anyone using the sample packs from Unity's github pushblock with input was broken and I had to remove that out of the folder for there to be no complication errors

Best tutorial for beginners on ML :)

@CodeMonkeyUnity

3 жыл бұрын

Thanks! It was a ton of work so I'm glad people find it useful!

As promised, this is the first video I saw this morning as i woke up

i´m excited to use and start train my own agents :D

cool video just what i was looking for

Epic Video. Left my like. Subscribed for more. Thank you! Hope you the best!

very instructive :) thanks a lot

Awesome content, now training my bots! thank you!

Great lesson - really opens up the mind (no pun intended) I went through this for about 2d straight. I learned a lot but so far I ended up failing to install. In order to get the pytorch stack working properly you need a video card supported by the CUDA . There are work arounds but they are not currently working for me. Thank you for this demo.....now I need to upgrade my really really really old computer.

@CodeMonkeyUnity

3 жыл бұрын

It's been a while since I touched MLAgents but I believe CUDA is no longer used in the latest versions so you can skip that step.

@Rekindle1976

3 жыл бұрын

@@CodeMonkeyUnity Hi A follow up - I got the entire stack working (minus needing cuda) as per your demo. I just had to spend a bit of extra time on pytorch and getting the right version to fit my hw. My machine is very old so I went with a cpu-only build and this solved all my problems (even if it meant I could only run half the amount of environments as you). Thanks again - you really opened up a new door for me in a big way.

Thanks for the amazing (and long waited lol) tutorial. Everything was crystal clear to me except that yaml file and why we needed that. You added this file when the model failed to reach the goal when you moved it, but seemingly it didnt solve anything.

@CodeMonkeyUnity

3 жыл бұрын

That file contains all the parameters for the training algorithm, it tells it how fast it learns, how much randomness it adds, how much each reward affects the algorithm and so on It's pretty complex, there's explanations of each parameter in the docs, I'm still trying to understand what they all do. Also if you don't define a specific config file then it simply uses the defaults

Yo my man is back

Wow thanks for this

This thing is awesome

Great! Thanks a lot!

Cool! thank you for the video! It 2 years old but still actual!

@CodeMonkeyUnity

Жыл бұрын

I'm glad it's still helpful! Thanks!

Thanks a lot, this video helps !

great video!

I love how I find a video of yours that explain exactly what I need lol ty ♥

No doubt, cool! This is "CM"! He almost always has the most useful videos. (almost, only because the "inventory system" in my opinion is incomplete, uncritical bugs, and a lot of things need to be completed and added yourself, not even taking into account the graphic part) But all other "systems" are universal and work extremely reliably )))

@CodeMonkeyUnity

3 жыл бұрын

What issues did you have with the Inventory system?

@arcday4281

3 жыл бұрын

@@CodeMonkeyUnity Minor bugs: the disappearance of items in the inventory if they are not exactly thrown over the slot, the disappearance of items in the inventory-crafting when other slots not related to the dictionary are filled at the time of crafting. All this is tested in the original downloaded project. I think I can fix them. Only here it will introduce newcomers to a stupor. It would be nice if all these inventory systems were initially connected to each other with the ability bar and drop-drag-using system. I think I can do that, too. But it would be nice for beginners to make the entire complete system through a scriptable object in the root. Try to make and put up for sale somewhere, I think many will be happy to buy. You can enter a vote on how many people are interested in it to see if it's worth your time spent on the full system. I think it should be easier than creating a course. Well, or make it part of the new course of " RPG " games, but it will be a ton of work. In any case, I like your approach to the code and to systems in General, thank you for the interesting videos )))

Thank you :)

Amazing!

Fantastic tutorial, thank you for all the indepth steps. Quick question as you mentioned not bothering with CUDA if you don't have an NVIDIA graphics card and it'll just utilize the CPU instead. For those of use with AMD cards, do you know if this toolkit integrates with ROCm or OpenCL?

Thank you

thanks for the video...

Thanks ❤️

best video thanks!

I can't see where these dislikes come from, after you commit your time and knowledge to the public for free. I respect your work, please continue sharing your knowledge.

@CodeMonkeyUnity

3 жыл бұрын

As long as the likes overwhelm the dislikes I'm happy!