Advanced auto-targeting stereo vision paintball turret

Ғылым және технология

I used to go nuts building auto-turrets in Garry's mod back in '08.
Now I get to do them in real life.
Check the final tests for more impressive strikes: • Sentinel auto-turret ....
This was for my final year engineering skripsie project at the University of Stellenbosch
These are the initial tests of the system and I'll upload more as I make improvements and iron out the kinks.
FEATURES:
-Custom built belt driven servo mechanisms with an RL78-G14 MCU and PIDN control loops.
-Second order projectile interception gun laying algorithm.
-Kalman filtered position estimation of target using HD stereo vision

Пікірлер: 124

  • @kenneth2519
    @kenneth25194 жыл бұрын

    This is really fascinating indeed. I dont like how games with auto turrets often neglect the mechanism behind these turrets. The targeting system is ingenious

  • @MariusKohsiek
    @MariusKohsiek3 жыл бұрын

    Kalman filters are some advanced chemistry :)

  • @kennyindlu1086
    @kennyindlu10865 жыл бұрын

    You are impressive

  • @DIVERGEsound
    @DIVERGEsound4 жыл бұрын

    Nice build

  • @TheMadManPlace
    @TheMadManPlace10 ай бұрын

    Absolutely brilliant work. 'n Boer maak 'n plan!!! I have a bunch of sterilized cats that go stomping all over my sinkplaat roof in the middle of the night that need to be "taken care of" Paintballs may be a little extreme for them so I would use something like an airsoft.

  • @Zhoul-is-back
    @Zhoul-is-back11 ай бұрын

    When you buy a paintball gun for you, but not a protective mask for her 🤣

  • @fykuro1016
    @fykuro101610 ай бұрын

    "Ex-axis" and "Why-axis" killed me xD

  • @starz879
    @starz8793 жыл бұрын

    Sentry Ahead!

  • @heinrichhelmbold419
    @heinrichhelmbold4194 жыл бұрын

    Wel gedaan!

  • @dukeman5691
    @dukeman56912 жыл бұрын

    Goeie hel!! Hierdie is beyond befok ouens!

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    Dankie mnr

  • @SloGamer750
    @SloGamer750 Жыл бұрын

    Maybe a PID controller would help? It slows the turret a bit but it smooths the movement and precision.

  • @lastking1245
    @lastking12454 жыл бұрын

    This is awesome. Wondering if you sell them??

  • @akshay.kumar.k
    @akshay.kumar.k3 жыл бұрын

    Very impressive..Does it shoot the position on where the target's going to be based on calculations or where it is at the current moment?

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    Yes, it calculates the second order path of the target, and uses a second order approximation of the ball's trajectory to calculate an interception point.

  • @leandromartinjunco8133
    @leandromartinjunco81339 ай бұрын

    can you share the plans? thank you so much!!! excellent work!!

  • @lacucaracha111111
    @lacucaracha111111 Жыл бұрын

    BUILDIN A SENTRY!

  • @bourbonbilis6367
    @bourbonbilis63673 жыл бұрын

    I need 10 of these. Neighbors dogs keep shitting my yard.

  • @user-yq6gl9ih1u

    @user-yq6gl9ih1u

    3 жыл бұрын

    lmao

  • @bryanotero123
    @bryanotero1236 жыл бұрын

    You are brilliant, i wish u was my son

  • @ThoughtinFlight

    @ThoughtinFlight

    6 жыл бұрын

    Bryan Otero aren't we almost the same age hahaha

  • @bryanotero123

    @bryanotero123

    6 жыл бұрын

    Dale Sparrow True dat, i'm 23, xD i just felt dad-like proudness xD

  • @bryanotero123

    @bryanotero123

    6 жыл бұрын

    Dale Sparrow Can i add you on Fb bruh, ask a few stuff of ur invention, merry xmas btw

  • @ThoughtinFlight

    @ThoughtinFlight

    6 жыл бұрын

    yea you can, I thought I replied earlier

  • @really741

    @really741

    5 жыл бұрын

    I am trying to see if you would be willing to sell me the plans so my son and I could build one for his class project. I posted to another video by accident. Where did you get the targeting software and is it expensive?

  • @driesfrankduvenhage3036
    @driesfrankduvenhage30363 жыл бұрын

    Baie indrukwekkend! Wel gedaan! Het jy die in n produk verander wat te koop is? Sou facial recognition vir teikens wat uitgesluit moet word teveel van n sprong wees?

  • @luckydubeinrc5165

    @luckydubeinrc5165

    6 ай бұрын

    fascial tracking werk, maar n helmet of clear skerm meng in met die tracking dan is dit n nuwe blik met wurms :) ek dink wat hy het is die moeite werd om heat en fascial by te sit, soos (if no fascial go2 next ) dink jy verstaan.

  • @driesfrankduvenhage3036

    @driesfrankduvenhage3036

    6 ай бұрын

    @@luckydubeinrc5165 ja dit maak sin! maar my idee met facial recognition was eintlik om n lys van targets te include wat nooit geteiken moet word nie, en enige gesig wat nie op daai lys is nie, moet geteiken word...ek dink plaas aanvalle ens....

  • @garysamons9332
    @garysamons933221 күн бұрын

    This would be great to keep deer out of ones garden.

  • @gerryforce6344
    @gerryforce63444 жыл бұрын

    What for a Paintballmarker is in the Sentury gun?

  • @LPMrec
    @LPMrec2 ай бұрын

    Cool 😮

  • @really741
    @really7415 жыл бұрын

    What is the name of the targeting software? I am working on a nurf gun turret but it is too slow. What operating system are you using as well. Great job! I was a fan of Gary's mod as well.

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    All targeting software was developed by myself. It was built from scratch for this turret

  • @really741

    @really741

    5 жыл бұрын

    Ok I'm sure you want to keep it for your project. Great work!

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    @@really741 Sorry for the late reply. I can share some knowledge of how I went about it with you, but the software itself will be useless since it's heavily coded to work with the microcontroller I chose.

  • @arisantosa1789
    @arisantosa17895 ай бұрын

    Interesting for home application 😅

  • @gerhardtnell5541
    @gerhardtnell5541 Жыл бұрын

    Pragtig

  • @zbyszekpa5254
    @zbyszekpa52542 жыл бұрын

    fajna zabawka

  • @plu_2
    @plu_24 жыл бұрын

    hello, what are the referenc of your paint ball gun? thanks a lot, i'm designing one for drone application to fight asian hornet thanks a lot

  • @bernebk
    @bernebk Жыл бұрын

    Wow. Glad nie sleg nie. Waar in SA bly julle? Ek is in Port Elizabeth en sal graag wil ontmoet.

  • @ThoughtinFlight

    @ThoughtinFlight

    Жыл бұрын

    Eks in Stellenbosch op die oomblik :)

  • @bernebk

    @bernebk

    Жыл бұрын

    @@ThoughtinFlight Beautifull plek. My dogter is in Paarl en coach gimanastiek in Stellies. Ek sal laat weet as ons vir haar gaan kuier. Dalk kan ons ontmoet.

  • @franccescopetrarca5818
    @franccescopetrarca58184 жыл бұрын

    Dear Dale, my name is franccesco Petrarca, i have 5 paintball fields (square shape) the goal is to buy 20 pieces (1 for each corner of the 5 fields). i was wondering if first i can purchase a sample of this work of art ! an according to performance keep going with the business. THx! And congratulations, you are amazing!

  • @ThoughtinFlight

    @ThoughtinFlight

    4 жыл бұрын

    Hi Franccesco, how can I contact you?

  • @friendlyfire3412
    @friendlyfire34124 жыл бұрын

    2:10 *BEEERP* *Shots Minigun bullets with a 4 Missiles*

  • @madzak9847
    @madzak98474 жыл бұрын

    Nice I whant same thing but with 60w co2 laser tube

  • @ThoughtinFlight

    @ThoughtinFlight

    4 жыл бұрын

    For Mosquitoes :P ?

  • @madzak9847

    @madzak9847

    4 жыл бұрын

    @@ThoughtinFlight ахахахаха, how did you know )))) Jokes aside in 90s in Russia was a raptor repellent (mosqito humiliator) commercial and there when they plug it in the socket it started shooting mosqitos with a laser like fallout laser minigun ... that thing got in to my soul back then ))

  • @luisventura5995
    @luisventura59955 жыл бұрын

    Did you build the gun? If not what gun model is it. I'm very interested in this project. Please let me know

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    Are you talking about the marker or the entire system?

  • @luisventura5995

    @luisventura5995

    5 жыл бұрын

    @@ThoughtinFlight the marker. I tried to find a one that is similar to it but found no luck. This marker has a slim and sleek body.

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    @@luisventura5995 I heavily modified the marker only leaving the mechanical inside. Removed the handle, sawed off bits etc... Almost any marker can be made very compact but un-ergonomic.

  • @luisventura5995

    @luisventura5995

    5 жыл бұрын

    @@ThoughtinFlight I see. That's a very cool modification. Im afraid to ask but Is it possible to show those modifications of the marker on KZread in order to learn about how the gun works? I'd like to know

  • @shrinkz804
    @shrinkz8042 жыл бұрын

    0:12 hey could you please show what's hapenning on the other side (insider side) like how the movement of the wheel as shown is affecting the gears on the other side which is hapenning to move the turret

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    I don't know exactly where my hard drive of this footage is, but look on my channel for the mechanical tutorial vid on this thing, maybe you'll see it there :)

  • @shrinkz804

    @shrinkz804

    2 жыл бұрын

    @@ThoughtinFlight alright thanks, btw what if I use Steppers and Raspberry?

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    @@shrinkz804 it's gonna work but steppers are not amazing for rapid random movements with a high load

  • @shrinkz804

    @shrinkz804

    2 жыл бұрын

    @@ThoughtinFlight yeah ur ryt

  • @artashesharutyunyan3693
    @artashesharutyunyan36934 жыл бұрын

    nice can you please shear the 3D CAD drawings ???

  • @FIREMAN-ff3cj
    @FIREMAN-ff3cj2 жыл бұрын

    2.8mm lens or 3.6mm lens to webcams with ir-cut ? What you thinking?

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    You should do the calculations :). What's your design requirements? 2.8 will give you better distance resolution but lower field of view. Are you on a targeting range or a back-yard?

  • @FIREMAN-ff3cj

    @FIREMAN-ff3cj

    2 жыл бұрын

    @@ThoughtinFlight range

  • @hunterpruett5455
    @hunterpruett54553 жыл бұрын

    Could you provide some more detail on how the tracking system worked?

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    I could do that as soon as I have some free time. What particularly would you like to know?

  • @hunterpruett5455

    @hunterpruett5455

    3 жыл бұрын

    Dale Sparrow I was curious about how many cameras you use, and the method and math behind identifying and tracking a target, like possibly an OpenCV function

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    @@hunterpruett5455 I only used two, since a paintball gun's accuracy already falls within the error range of that. Just make sure they're far enough apart since your accuracy increases as the orthogonality of your camera axes increases (my math terminology is not up to scratch but it's along those lines). I will see if I can find the code, but I used a java port of openCV.

  • @hunterpruett5455

    @hunterpruett5455

    3 жыл бұрын

    @@ThoughtinFlight Hmm, okay. How far apart were your cameras? I'm thinking about making this fairly portable. Did you ever try using a single camera and use motion detection to track? I don't think motion detection is any good mainly because you can't mount the camera on the barrel, and are therefore limited by the FOV of the camera, which is relatively small. You could use some sort of fish-eye lense, but then there's lots of weird math finding out what coordinate on the screen goes to which point on the gun.

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    @@hunterpruett5455 I used two cameras 1m apart. If you wanted a 360 field of view I'd have 4 sets of 90deg FOV cams. you can easily just apply an un-distort filter in your pre-processing and it should make the corner accuracy only slightly worse.

  • @user-rd5nc1nb9f
    @user-rd5nc1nb9f3 жыл бұрын

    HI fellow ave fan

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    Haha! Finally someone spots it.

  • @qwertyui90qwertyui90
    @qwertyui90qwertyui903 жыл бұрын

    She's really cute :D

  • @really741
    @really7415 жыл бұрын

    Dale I got it working with another controller and software. It is very fast but I had to remove the entire upper gun and rockets that I 3D printed because of the weight. The servos I used are in gearboxes still not strong enough. So I have now only a gun mounted to my stand. If you give me your email l I can send pics or video. Thanks

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    hey Onslaught, I honestly thought I'd replied, seems it didn't post. Did you sort the issue out?

  • @muhammedburak3072
    @muhammedburak30722 жыл бұрын

    Could you share your final project report with me? I'm working on a similar project for engineering project but the difference is, my system will be on a car. So it can be movable.I'm not well with projects, if you share your project report, I'll very glad..

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    Contact me on my site at www.stlr.co.za and I'll try give you some tips also why my project probably wont help much

  • @dirkhoekstra727
    @dirkhoekstra727 Жыл бұрын

    No thug is going to enter my property with something like that in backyard!

  • @waiphyopine4984
    @waiphyopine49842 жыл бұрын

    Can I get this design drawing dimensions?

  • @popinmo
    @popinmo5 жыл бұрын

    How much for 3 I also need a phone app to shut them off?

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    I only had 7 months and 10 000 to build this prototype, but an app and voice commands was certainly a feature I'd have added.

  • @popinmo

    @popinmo

    5 жыл бұрын

    @@ThoughtinFlight IT Would Be Cool if it Could auto lock on to stuff and have a sensor so it has to be a certain amount of movement from the Motion sensor to fire off shots and a audio 3 second warning and a red laser

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    It does lock on and I have to click a button before it's allowed to fire three shots. So to add that functionality would only take one or two days

  • @popinmo

    @popinmo

    5 жыл бұрын

    @@ThoughtinFlight have you looked at the turret from the game rust it would be cool if you could build a fully functional one that looks almost the same and actually make it a product I can think of a ton of safety features and modes and how it would all work but it would be cool to buy one from a gun store for a good 2k or 1k if it was in full production

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    @@popinmo I agree, I wish I had a company and a few engineers I could guide to produce these. Time is the only limit so delegating some things would speed up development time considerably.

  • @laurencebedford133
    @laurencebedford1335 жыл бұрын

    Could you make a tutorial i think this would help a lot of people

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    I will strongly consider it, I am currently in the middle of 3 other projects though. I wish I was fast at editing so I could get them out there.

  • @laurencebedford133

    @laurencebedford133

    5 жыл бұрын

    @@ThoughtinFlight ok thanks as this is such a slick well desined turret i think it would answer wveryones questions if you showed where you got the parts how to make it and thw code

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    @@laurencebedford133 Yea, the problem is that some of the aspect will take a few videos to explain, like the targeting and control systems etc...

  • @laurencebedford133

    @laurencebedford133

    5 жыл бұрын

    @@ThoughtinFlight you could use github to paste the code

  • @chewy9625
    @chewy96255 жыл бұрын

    Jys Suid Afrikaans? Dis presies wat ons land nodig het

  • @SICKFREDO
    @SICKFREDO2 жыл бұрын

    nice eye protection 2:15 lol

  • @ThoughtinFlight

    @ThoughtinFlight

    2 жыл бұрын

    The gun was not loaded or pressurized XD. There's no way I'd let someone walk in front of it like that.

  • @oldmanschild2032
    @oldmanschild20322 жыл бұрын

    jou arme bure XD.

  • @marekprazak
    @marekprazak3 жыл бұрын

    i want house just so i can mount this on the roof

  • @holgerfarber194
    @holgerfarber1943 жыл бұрын

    adapt it to protect sheeps agains wolfs, you would be rich!!! -maybe on a high center pole in the middle the sheep pen -hive off Livestockguardian Dogs with a transmitter collar

  • @linglingpho
    @linglingpho4 жыл бұрын

    I want one please let me buy one from you

  • @BloodyB3TZ
    @BloodyB3TZ3 жыл бұрын

    Anybody else pause at 0:48 to cross their eyes to see what the turrets see?

  • @justinc2633

    @justinc2633

    Жыл бұрын

    no, i just simply picked one side to see what the camera sees 🤣

  • @Serenelove520
    @Serenelove5204 жыл бұрын

    Dale, do you have time to build me five or six of those, but for an orbeez weapon, meaning shooting waterballs instead of Airsoft? Would you have time to build? I will pay you.

  • @cryptoworldgames793
    @cryptoworldgames79310 ай бұрын

    why did she not have safety glasses

  • @ThoughtinFlight

    @ThoughtinFlight

    10 ай бұрын

    The turret wasn't loaded or connected to gas for that point in time. When we did firing as you'll see later she definitely did.

  • @muhammadnasromyusoff651
    @muhammadnasromyusoff6515 жыл бұрын

    Deal. Dale Sparrow. Costing only around USD80 or below per unit for large quantity manufacturing now. We can up the sales price 10-25 times(say USD800-2000), it is still cheap because this one time investment forever, may help some 30 milions asean (malaysian',indonesian, thailand eyc) king fruits owner to kill squirrels on their backyard, saved thousands of their income yearly. If your profit only USD100 per unit, minimum total profit guaranteed in your hand, for this product is USD100 x 30 millions = USD3,000,000,000.00 or USD 3 billions within only 1 years of less, for asean market only. You're the billionaire....!!

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    I'm currently busy with a new project, but I'd love to work with anyone that wants to set something up commercially.

  • @muhammadnasromyusoff651

    @muhammadnasromyusoff651

    5 жыл бұрын

    No wonder whatever make your busy now since you already had billion asset that impossible for normal person. Come to malaysia anytime we will show how you can easily manufacture and commercialize your brilliant product 100% sponsored by our local financial institution with 50:50 profit sharing agreement fully securely.

  • @ThoughtinFlight

    @ThoughtinFlight

    5 жыл бұрын

    @@muhammadnasromyusoff651 drop me a message on the contact page of this site: gewonemossie.wixsite.com/simple-principles

  • @muhammadnasromyusoff651

    @muhammadnasromyusoff651

    5 жыл бұрын

    @@ThoughtinFlight Done. Thanks a lot.

  • @shaikhjunaid5577
    @shaikhjunaid55772 жыл бұрын

    Hi im doing almost same final year project can u plz help with our project bcz our teachers r not much cooperative.. Can u give me ur email something

  • @jeune_snowbird_millionario
    @jeune_snowbird_millionario3 жыл бұрын

    I'm interested by this product, hit me up (pun intended)

  • @newbiebeatz5418
    @newbiebeatz54183 жыл бұрын

    chi can copy this design

  • @ThoughtinFlight

    @ThoughtinFlight

    3 жыл бұрын

    I have a friend obsessed with Love Live! China can copy this design if they want, its very old now :P

  • @153SCORN
    @153SCORN4 жыл бұрын

    Gun is too slow, not sensitive enough and not fluid.

  • @ThoughtinFlight

    @ThoughtinFlight

    4 жыл бұрын

    I agree. It can be made a lot better. It was my first attempt while doing final year subjects. I would completely re-design the drive system with harmonic gear boxes and brushless motors.

  • @ThoughtinFlight

    @ThoughtinFlight

    4 жыл бұрын

    However, the design requirements were to mark a human target with luminescent paint. It didn't need to be faster or better, that would be over designing.

  • @153SCORN

    @153SCORN

    Жыл бұрын

    @@ThoughtinFlight I managed to write a program in processing 3 that linked the Mouse to an Arduino that could drive Brushless motors. Their speed ramps up really fast, when moving the mouse quickly. The issues I was having is that the drone motors I was using only spin one direction...it is possible to reverse with a second motor driver. Also there is no sensor on the drone motor...so the speed control and targeting needs to be done through the camera. A simple program like "Track Red" should work perfectly with drone motors. I also wrote a program that locked onto a target when designated. With collaboration it would be possible to build a Turret that is incredibly fast and accurate.

  • @Jaco_joubert
    @Jaco_joubert9 ай бұрын

    hi all. amazing project. Did you share any stl files or plans for this project anywhere. Would love to attempt this.

Келесі