More about the project: indystry.cc/ml-robot/ Happy making!

@blaircox1589

9 ай бұрын

After years of having the equipment laying around, I've finally begun to dive more into creating robots using lidar. So I'm curious, is there really machine learning involved (required) here? Or is it just saying - here are solid obstacles on either side, I need to stay N distance away from it while I travel forward.

@1islam1

9 ай бұрын

@@blaircox1589 ⚠️ God has said in the Quran: 🔵 { O mankind, worship your Lord, who created you and those before you, that you may become righteous - ( 2:21 ) 🔴 [He] who made for you the earth a bed [spread out] and the sky a ceiling and sent down from the sky, rain and brought forth thereby fruits as provision for you. So do not attribute to Allah equals while you know [that there is nothing similar to Him]. ( 2:22 ) 🔵 And if you are in doubt about what We have sent down upon Our Servant [Muhammad], then produce a surah the like thereof and call upon your witnesses other than Allah, if you should be truthful. ( 2:23 ) 🔴 But if you do not - and you will never be able to - then fear the Fire, whose fuel is men and stones, prepared for the disbelievers.( 2:24 ) 🔵 And give good tidings to those who believe and do righteous deeds that they will have gardens [in Paradise] beneath which rivers flow. Whenever they are provided with a provision of fruit therefrom, they will say, "This is what we were provided with before." And it is given to them in likeness. And they will have therein purified spouses, and they will abide therein eternally. ( 2:25 ) ⚠️ Quran

@jongwonlee4728

6 ай бұрын

can you create Tubercle + Toroidal version fan...?

This is really exceptional work. I love how your thought process is always generating the next possible improvement, and then you just keep pushing to refine your designs.

Haven't been doing robotics for a while and this is one of the coolest videos. I got recommended.

@sorryboss8550

9 ай бұрын

I’m trying to start bro it’s so cool. I just got my learners kit

@bofa722

6 ай бұрын

​@@sorryboss8550 where from

@sorryboss8550

6 ай бұрын

@@bofa722 anywhere, got mine from a store near me👍🏽

The most intriguing thing about this according to me is realisation that you could work leanly with data sets. Yes, within a certain dataset eg. maze (the square one for example) you want as many laps as possible, but for industrial purposes keeping the the amount of mazes down when you know what kind of mazes the robot will encounter should also avoid bloating the Arduino with unnecessary data. Also, truly amazing that you made a robot that could race faster by itself than you could race it manually, just by tweaking the motor speed. That goes to show what machine learning can do in terms of work optimisation, sort of like how the search function on a computer vastly outpaces any human manually searching for a document in an archive room. Thank you for making a video that clarifies so much with so little!

For all Polish people! I started a new polish YT channel: www.youtube.com/@prosteczesci

Great project. The reason it was able to handle the increased speed was twofold: 1) the control dynamics were similar enough at both speeds and 2) the sampling rate was high enough that the time delta didn't have an impact on the stateless prediction model.

On an Arduino! I am grabbing a LIDAR module as soon as possible. Thank you for the videos.

🎯 Key Takeaways for quick navigation: 00:00 🤖 *Introduction to the robot and project setup.* - Introduction to a small robot with machine learning algorithms running on Arduino Uno. - Overview of the project's goal: autonomous navigation on a racetrack. - Mention of the steps to be covered in the video, including building the robot, creating a racetrack, data collection, processing, and a final race. 02:20 🤖 *Building the robot and the racetrack.* - Description of the robot's construction using an open robotic platform. - Explanation of using simple blocks for the robot's chassis and adding necessary components. - Improving traction on robot wheels with TPU tires. - Innovative use of cardboard for creating racetrack walls. 05:01 📊 *Data collection setup.* - Installation of a Bluetooth module and an SD card for data collection. - Explanation of recording lidar measurements and control labels while driving the robot. - Details about the data format and collection process. 07:10 🧠 *Processing and training the machine learning model.* - Discussion of feature selection to reduce data dimensionality. - Overview of experimenting with different machine learning classifiers. - Mention of using Python libraries for processing and training. 09:08 🏁 *Testing the robot's autonomous driving capabilities.* - Introduction to testing the robot's performance on various racetracks, including square and figure-eight. - Highlighting the ability to adapt to new racetracks with additional training. - Preparing for a final test on a complex racetrack. 11:40 🏎️ *Achieving high-speed autonomy.* - Surprising results as the robot successfully handles high-speed autonomous driving. - Discussion of motor speed settings and PWM signals. - Comparison of robot performance between manual control and machine learning algorithms. Made with HARPA AI

Great video and content! Love how you bring us through the journey of your experiments and the tidbits of discoveries that is available oit there. BTW, little editing features like the ghosting effect really elevates your game. I must agree with other commenter, some of your voice recording suffers in quality (when in testing area, hard walls). It does not impact my opinion but, you are competing for attention against others. I hope you continue to push this project further. Maybe like an iRobot that travels throughout the house for guard duties or identify any new objects...

Well done! This was a very satisfying video to watch. Well explained and I totally understand the thrill of building something that actually works in the end!

“I am an algorithm I need more learning and training” ❤ cheers to you!😊

Fascinating! Thanks for posting this video!

Really like the ghost version when comparing the speed. That was nice. Make a other one and see if you can train to pass slow robots.

Very nice robot and video! ❤

Very cool. I've been programming for a little over 40 years but I've never had the time / opportunity to delve into machine learning. Closest I've gotten is using AI services for photo processing. Now that it can drive itself it would be an interesting progression to give it memory of where it's been, building a map of the course it travels and being able to use that to plot improved trajectories for future loops. Just like we're slow when traversing unfamiliar territory but with repeated trips we can anticipate and optimize our course. You should be able to borrow from tech such as CNC path processing which can optimize acceleration / deceleration for curves and apply that to steering. Just an idea.

Great channel, glad I found it.

Super cool. Great job!

Watching this, I was shocked to realise that you don’t have a million subscribers. People are missing out!

Wonderful work!

Interesting and very inspiring! Thanks

Awesome work!

This was awesome, congratulations! I've used o-rings for tires for 3D printed wheels.

@nikodembartnik

9 ай бұрын

Good idea!

Nice Work! It would be interesting to see if one could "simulate" the movements for a rectangular track, instead of training on the actual path. I would guess, it would lead to comparable results. If yes, then the advantage with simulation is that one can design more complex paths without actually building them - making the training process very efficient and robust.

Love that how it performed

Great work. You do already amazing things. And you are young. I wonder what you will do in a year or 5 or 10. Keep going!

Un crack el Niko! Gracias por compartir tus conocimientos!!! 👏👏👏

@nikodembartnik

9 ай бұрын

gracias!

Great job! It would be great to see this robot learning by itself by reinforcement learning

@sumitmamoria

9 ай бұрын

That is doable. But, a more efficient (and less fun) way of doing it would be to build a simulator. Use RL methods in a sandbox, train the model and load it into the robot and that's it!

Super impressive! :o

wonderfull thank you for sharing and good luck

감사합니다. 열심히 공부해 보겠습니다.

Well done. Highly appreciated from Pakistan. Keep it continue.

Yery impressive! A fun project. 👍

Amazing. I like what you're up to. Keep it up!

This awesome. I want to learn machine learning more than every

Good video for robotic knowledge

amazing, very good!!! i like you project.

You could used ordinary tracking a line on the floor or collition detection to teach the LIDAR to track. And you could even use that input while learning. Then you can remove that tracking device. It is not uncommon to use extra input while doing the learning.

You are amazing, keep up

Well done!

In general I just take inspiration on KZread to make my own projects, because it’s not exactly the way I would’ve done it. But for this robot, I would’ve done it exactly the same way if I had the idea, so I’m going to do it anytime soon ! Thank you very much for this cool video, and congratulations, that’s impressive !

@nikodembartnik

9 ай бұрын

Huge thanks for a really nice comment!

Great work, super cool!

Thank you for helping me ❤❤❤

Dude this is so cool!!!

Excellent !

Siemanko. Na wstępie musze powiedziec ze bardzo rzadko pisze komentarze, ale.. Twój filmik a bardziej projekt mnie powalił! =CZAPKI Z GŁÓW= pomyślałem zobacze co to za kolo, bo tak ładnie mówi po angielsku a tu okazuje sie ze jesteś z Polski.. Świetna robota naprawde! Czemu ja nie mam takich właśnie kolegów ;) pozdrawiam Marcin

This is a very cool project! Machine learning on an Arduino! Imagine Teensy or ESP

Nice Work

I wonder if you could set up virtual race tracks in something like Unity to collect training data. The benefits would be that you could control it with an actual controller and from first person ( so better precision ), and you could have much larger and more complicated tracks

@conorstewart2214

9 ай бұрын

Nvidia have created Isaac Sim for that purpose, it can even generate photorealistic images on the environment for training but just using a distance sensor like this should be easy to implement. It is made for training ML algorithms so can generate the training data and train the AI and can even do things like reinforcement learning, genetic algorithms or similar.

@aayush212

9 ай бұрын

​@@conorstewart2214That's really great 👍. Is it open to use for free?

@user-qw1rx1dq6n

9 ай бұрын

At that point it would be possible to run ppo with a neural network instead

Very cool project. Perhaps I would have approach the training of the model via software in a simulated environment as it would be way faster to collect data always in the optimal path.

New subscriber here! This is a fantastic project. I just came to this video from the one where you raced two of them, very cool stuff. I am working on a similar project using an RP1 LiDAR with a differential drive robot as a learning platform for things such as SLAM. I am not too familiar with ML. Do you have any favorite resources or project ideas to get begin learning?

Im going to try this

That's really cool

Loved that you needed algorithm, hehe

zajebist kanał stary, oglądałem aż w końcu mnie uderzyło "chwila chwila...ten akcent brzmi bardzo znajomo...XDD"

Great workfone

Great topic, thanks 👍

I recommend you making it so it will learn while riding by itself.

Very impressive

Can you make the movement using a servo motor like the fire extinguisher robot in the contest on the Trinity University ?

Would it not be easier / faster to generate the features via simulation rather than you driving by hand? That way you can train on way more tracks (as they can be pseudo-randomly generated) and also have the simulation provide feedback on collisions when driven by the AI model.

5:09 "I'm not an expert... I'm just learning and experimenting by implementing some machine learning in my projects."

Very cool. Any thoughts on how youd approach training a model for pan tilt camera object tracking that could out perform standard control algorithms like PID or MPC? I know I could use the data from the PID controller to train a model to do the same thing, but i wany the model to be better and feels like the only solution there is some type of deep reinforcement learning using real world setup

awesome!!!!

ooo where did you buy your cutting mat?

damn that was so cool

Could you have made a synthetic dataset for this using something like ray tracing on a 2d simulated race track instead of manually training it? I don't know much about lidar so maybe not.

Heyyy, This is pretty cool. Wouldn't adding an RL Algorithm(Maybe Q-Table or a Deep-Q) to this solve the problem of manually having to drive this around?

Hi. You can make a smart vacuum cleaner with automatic cartographer on sd card?

What are these kind of breadboards called? the smaller ones he is using in the robot. like shown in 00:49 ?

You have a sensor for penalty in case of the error?

is it possible to replace the track with a room like a warehouse that has several rooms???

the final track should be a combination of circular, sharp edges & cross junction...

hello, can we do it with ultrasonic sensor ?? and if please make video

Is it possible to make the same project with multiple ultrasonic sensors instead of ladar

Can it be made to teach itself? Technically, it has a rangefinder on the top. In the square, for example, it shouldn't be running into the wall, when faced perpendicular to it. Is there a way to have it go through the course at low speed, be aware of when it completes a lap, optimize its path, then gradually increase its speed, as it becomes more confident? That could save a few minutes/hours of manual training, while also making full speed training unnecessary. You could have a routine that varies the amount of left to right distance bias, and after a few runs it could have complete familiarity with the track. Then you might be able to send a command to either hug the inside, outside, or prefer the center, while the robot is moving. Just a thought.

Cool!, you mentioned that this is the first time you have used knowledge from the university. What are you currently studying? What kind of specialization?

Very very cool

I cam make some suggestions as a 5 year in a row roborace winner. Me Personally, i would put a switch on the robot that allows for automatic learning or performing, u can use the distance from the sensor as a valid/invalid logic for keeping the data or trashing it due to a crash (too short of a distance, mean crash), also try to add a preference on the robot as far of lefty or righty robot, doing so in can also navigate maze, and i usually add also a preference for the longer the distance it measure in a direction the bettere it is, but with all of this, to proper race u need to now how to access really low level on arduino or a more powerful mc. Anyway if it's your first time, not bad. Ps. With lidar won't be common but implement a system to detect when the signal is wrong (like wall to far or too close, or a reflective wall, or sometimes also really pointy corner can cause problems, like if u have an Y too narrow. Usually i do like, of i detec for x time too similar data, do a sweep around and check if Im stuck

@EmekaEkawuokwu

8 ай бұрын

Teach me bro pls 😢

nice bro

How can I learn to do what you do?

Hey i am just wondering to work with the same project but i am thinking of a maze solving bot. maybe it is a great idea to work on one using arduino with a lidar sensor but i havent got the materials to do it yet. i think it would be good if you work on a video like that

cool!

How much please. OK to advise what parts to buy or used parts and where please..eg lidar. Have u tried used vacuum cleaner lidar too?

Awesome

Had a look at the RPLidar DataCollector code, what is the purpose of setting the Lidar resolution to 240? Why not set it at 360 degrees?

If you have access to, or can get an Nvidia GPU then you could train it in a virtual environment and use the virtual environment to gather training data, then you only need to implement the ML model on the arduino. Edit: you don’t strictly need an Nvidia GPU and for simple ML like this could probably get away with just using your CPU but Nvidia has a lot of support for ML and robotics. Your best bet for really good results is to train it using reinforcement learning in a virtual environment. That way you can change the track much faster too.

@aayush212

9 ай бұрын

Can you explain little bit more how this can be done?

@conorstewart2214

9 ай бұрын

@@aayush212 your best option is to look at "OpenAI Gym" or Nvidia's "Isaac Sim" and "Isaac Gym".

hello , if I want to measure the density of traffic on a road, what kind of system can I install? i want something low cost and functional. it should be a system that can transmit this density to another device and show the density. i would be very grateful if you help me. lidar sensor is used? which one do you think is advantageous?

Please can you tell me if the Arduino supports the amount of data from the lidar? because the arduino will have to control the motors according to the lidar data,.Really. I would appreciate your response.

I really really REALLY want to know how you are controlling the arduino (I am assuming) with your phone interface

(sorry, I am really interested on what you have used to concert python language to for Arduino and relative description but it is not in your comments, could you please give me a direction, thanks) found it in the link at your comment, thanks

can you create Tubercle + Toroidal version fan...?

Your voice reminded me of dani the game developer

🔥🔥🔥

Try xg boost trees

Hello sir, can you share how to convert Python to Arduino library, and how to apply it?

AWESOME

Since I’m not playing with such things my question is: Why do you have to train it? Since it got a radar just tell it not to come too close to something. 🤔🤷‍♂️ So easy 😜

Oh no, almost same as my graduation thesis😢 But I am using GP algorithm so is it ok..?

How can we use reinforcement learning instead of labelled data set is It possible>>>?

@clamhammer2463

4 ай бұрын

Of coarse. I would opt for software training though while normalizing the data to what the lidar module outputs. then you can do multiple training sessions in parallel then upload the finished modal to the robot for real world testing. If you want to do reinforcement training, you would need in excess of 30,000 - 50,000 revolutions around the track.

Sukses selalu semoga ilmunya berkah pa. Salam kenal Kami mohon izin ikut nyimak videonya...