Laser Tracking System -using OpenCV 3.1 and Raspberry Pi 3

Final year project for Electrical and Electronic Engineering degree. Platform with a mounted laser pointer to track a person. Using OpenCV 3.1 and a Raspberry Pi 3.

Пікірлер: 183

  • @supersonic2101
    @supersonic21013 жыл бұрын

    Hi, this is 2020 and this project still seems soo good. Can you please share tutorial on how you made hardware and software both? Thanks

  • @tashrif4444
    @tashrif44446 жыл бұрын

    The soundtrack is just awesome!

  • @mxcollin95
    @mxcollin957 жыл бұрын

    This is rad!!! Any chance you could post a video on how you did this??? It'd be greatly appreciated!

  • @AlanMedina314
    @AlanMedina3147 жыл бұрын

    Very Cool the mechanism to rotate the cam seem very smooth.

  • @laurentmichalski7171
    @laurentmichalski71717 жыл бұрын

    great job, congratulations

  • @cosmicallyderived
    @cosmicallyderived6 жыл бұрын

    Good job! I think a second image that closed up to the guy's clothes to show the red-dot intercepting it would have been a real winner.

  • @glegoo195
    @glegoo1957 жыл бұрын

    can you do a tutorial regarding how to do this please?

  • @VascoCC95

    @VascoCC95

    4 жыл бұрын

    From what it seems, the recognition is based in a kind of motion detection. You have an open-cv function for that and there's an youtuber called sentdex that has some very nice tutorials on that! About making the laser pointing to your target I don't know much on the topic, sorry...

  • @alvaroboven

    @alvaroboven

    3 жыл бұрын

    @@VascoCC95 Something incredible of this one is the fluent of the video. With sentdex tutorials, video doesn't exceed 5 fps

  • @VascoCC95

    @VascoCC95

    3 жыл бұрын

    @@alvaroboven I'm not saying it is better than this one, I'm just helping him to understand what is behind the scenes and pointing to a tutorial

  • @alvaroboven

    @alvaroboven

    3 жыл бұрын

    @@VascoCC95 yeah sure, I didn't want to insinuate a comparison. In that case, do you know which is the optimizer way to program object detection in rp???

  • @VascoCC95

    @VascoCC95

    3 жыл бұрын

    @@alvaroboven Well... You are lucky because I JUST ran a test on a RP and I got average 12,7 FPS. I used OpenCV's HAAR Cascade for face recognition in a RP 4B with 2GB RAM. I installed OpenCV via the link's tutorial and placed the haar file "manually" in the project's folder. www.pyimagesearch.com/2018/09/26/install-opencv-4-on-your-raspberry-pi/

  • @bmk5019
    @bmk50197 жыл бұрын

    Great Job!! very impresive.

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Bastiaan Klaasing thanks😉

  • @bmk5019

    @bmk5019

    7 жыл бұрын

    Happy and smart New Year ;-) just a few hours left in Holland.. Keep it up!

  • @jeffbeck6501
    @jeffbeck65016 жыл бұрын

    I died from the music.

  • @zulqarnayeenschaftler9323

    @zulqarnayeenschaftler9323

    4 жыл бұрын

    Crazy music

  • @FIREMAN-ff3cj

    @FIREMAN-ff3cj

    4 жыл бұрын

    Music for my ears

  • @ANGEL-mb9yx

    @ANGEL-mb9yx

    3 жыл бұрын

    My condolences

  • @MadhuKumar-hi2qs

    @MadhuKumar-hi2qs

    3 жыл бұрын

    Name of the music

  • @jyotiradityakumar1174

    @jyotiradityakumar1174

    2 жыл бұрын

    @@MadhuKumar-hi2qs KZread where by pewdipie

  • @kentvandervelden
    @kentvandervelden4 жыл бұрын

    Did you make your own closed loop system? Looks like you used DC motors and pots. Nice work! Though, the music seems a little off for a person tracker :)

  • @foti4822
    @foti48222 жыл бұрын

    Interesting project. Would love to know more about the hardware used in this video!

  • @tinkmarshino
    @tinkmarshino5 жыл бұрын

    great some guy walking around..

  • @KulbirAhluwalia
    @KulbirAhluwalia5 жыл бұрын

    Well done bro

  • @programming_hut
    @programming_hut3 жыл бұрын

    what frame rate did you got for realtime detection

  • @prakhardixit1597
    @prakhardixit15977 жыл бұрын

    Great work there! I am working on a somewhat similar project, I would be very grateful to get your insight as to how exactly did you manage to get this working. Could you please brief it?

  • @mysteriouslymysteriousmyst9139
    @mysteriouslymysteriousmyst91396 жыл бұрын

    great project!

  • @andyeggert8578

    @andyeggert8578

    6 жыл бұрын

    Thanks!

  • @prakashchandran1416
    @prakashchandran14166 жыл бұрын

    Hi Andy, This project look's very cool and perfect :). How you established the connection between the raspberry pi module and arduino to share the object coordinate information.

  • @TheRealJackfrog
    @TheRealJackfrog6 жыл бұрын

    LOVE the music

  • @IDoNotLikeHandlesOnYT
    @IDoNotLikeHandlesOnYT6 жыл бұрын

    Why not use premade servo motors? What computer vision algorithm/pipeline does it use? Would it be confused by multiple people?

  • @sayomshakib4965
    @sayomshakib49657 жыл бұрын

    Love it!!!

  • @tuncfreeman
    @tuncfreeman3 жыл бұрын

    Add heavy metal music and nerfgun to project. Boom! :D good project yours

  • @MrProzaki
    @MrProzaki7 жыл бұрын

    How was ur experience with rasp 3 in terms of speed while working with opencv ? I have rspb 2 model b and using a simple color detection it would slow the processing around 3-5 fps . I hope u get my question sorry for my English .

  • @gnimoay7489
    @gnimoay74897 жыл бұрын

    Hi there, I was wondering how did u make the laser point to the real position of a person. I'm doing sth sort of similar with urs, projecting images on the back of one's palm. For the projection part ,I selected the area of projection in camera and then corrected the perspective of this area. SO I can just draw at the perspective corrected coordinate in my projection area. But how did u get the right rotation for a real world position. Thanks.

  • @junyang1710
    @junyang17104 жыл бұрын

    The object is about 1.7 meters high, and it is on the ground, so from en.wikipedia.org/wiki/Pinhole_camera_model, calculate intersection of a line (from camera positon calibration) and ground plane , you can get the positon of the man. then point your laser to him.

  • @mahirshafiyev9863
    @mahirshafiyev98637 жыл бұрын

    what happens when second person appears?

  • @amitgoel6830
    @amitgoel68306 жыл бұрын

    Can u please make a tutorial having some details of your excellent project.... It will be very helpfull....

  • @willzyxw1422
    @willzyxw14226 жыл бұрын

    so much drama in the music

  • @kostasnikoloutsos5172
    @kostasnikoloutsos51726 жыл бұрын

    New level of security

  • @ashkanikov3269
    @ashkanikov32697 жыл бұрын

    is this on github?

  • @TheSephrn
    @TheSephrn6 жыл бұрын

    what method are you using? Background subtraction, HOG, Haar or something else? Looks accurate!

  • @FIREMAN-ff3cj

    @FIREMAN-ff3cj

    4 жыл бұрын

    someone knows each other and could tell what technology this gentleman used.

  • @Brickkzz

    @Brickkzz

    3 жыл бұрын

    1:15 looks like background subtraction

  • @Brickkzz

    @Brickkzz

    3 жыл бұрын

    I wonder how erratic this would be at low light conditions

  • @burakhandogan2856
    @burakhandogan28565 жыл бұрын

    Is it possible to make this with Rasperry Pi Zero?

  • @ayeyefookinw0tm859
    @ayeyefookinw0tm8594 жыл бұрын

    how did you figure out how the degrees the servo had to move compared to the x y of the video?

  • @anam_nadir
    @anam_nadir6 жыл бұрын

    Hi! How far can detect? Thank you.

  • @wayneolaya3572
    @wayneolaya35726 жыл бұрын

    what laser did you use? can you tell me all the material that you use.

  • @jalan4524
    @jalan45247 жыл бұрын

    How does it lock the target?

  • @fernandorivdev1389
    @fernandorivdev13897 жыл бұрын

    Very Impresive, Congratulations! Any tutorial to replicate your work and Learn?

  • @mustafardk
    @mustafardk4 жыл бұрын

    Hi! What camera did you use? USB, PiCamera or what?

  • @zohebsajid3627
    @zohebsajid36277 жыл бұрын

    is it possible to get a list of all the parts for a project like this ?

  • @spencer998
    @spencer9987 жыл бұрын

    So I see that you've used C++... I've been trying to code with OpenCV and C++ for quite some time but I can't seem to figure out what IDE to use (if any) that will make it easy to use with OpenCV (building/path to the libraries gets really annoying). Are you using Code::Blocks, Geany, the Linux Terminal, or just your favorite text editor? Just curious if you're around 🤔

  • @diegooriginalesmontoya5863

    @diegooriginalesmontoya5863

    3 жыл бұрын

    How is it going?

  • @enzopulido2579
    @enzopulido25796 жыл бұрын

    Can you put is up on a drone?

  • @heel57
    @heel57 Жыл бұрын

    What is the laser doing in this setup? Is it used in the control loop or just a pointer? I assume the latter is the case.

  • @ahmeta.112
    @ahmeta.1126 жыл бұрын

    What did you use for opencv? C++ or Python?

  • @kalebakeitshokile1366

    @kalebakeitshokile1366

    3 жыл бұрын

    You can use either but Python is way easier

  • @digioasis4832
    @digioasis48324 жыл бұрын

    Actually, I am also working on a target tracking system. need your help is possible.

  • @edith_1232
    @edith_12323 жыл бұрын

    What is camera use for detection? Plss

  • @hritiksoni
    @hritiksoni3 жыл бұрын

    @Andy May I have the design files for the infrastructure of laser movement? Or can you please guide me where can I get it? Thanks

  • @Anton-sz6ef
    @Anton-sz6ef5 жыл бұрын

    Please how did you do that ?

  • @edinsonst2939
    @edinsonst29397 жыл бұрын

    Se ve muy bien

  • @pokerspace_pro
    @pokerspace_pro7 жыл бұрын

    damn! cool!

  • @tha531
    @tha5314 жыл бұрын

    This will be awesome for making movies.... with a camera instead of laser.

  • @alicanozkum6290
    @alicanozkum62907 жыл бұрын

    Hi, I am designing a motion tracking project with raspberry pi. I will use it as a finishing project. I want to get information about the laser project. can you help me.

  • @bilalunes
    @bilalunes6 жыл бұрын

    Hey andy. I am workinkg in a project that looks similar to your project. Can you please give me the details of your project?

  • @sachingarg8429
    @sachingarg84296 жыл бұрын

    Dope

  • @weswest2654
    @weswest26547 жыл бұрын

    How does it track the person (heat/motion/position/etc.) ? Can it track an object like a car or a drone?

  • @nextronicCasablanca

    @nextronicCasablanca

    7 жыл бұрын

    yes you can , using image processing in OpenCV

  • @danielf950

    @danielf950

    7 жыл бұрын

    DROIDii1 Yeah, on a serious note on your number 4... how would a system like that distinguish between hostile and friendly individuals? One way I see it is by marking friendlies with an IR emitter, but that wouldn't do in a military situation where this would denounce the operative's position on the enemy's NVGs. It could be used though if it is stationary and it has to protect a perimeter AFTER a certain limit (as this can be easily programed in OpenCV), limit within which there can be safe movement of troops.

  • @rohitkarle

    @rohitkarle

    7 жыл бұрын

    can we have a code for the same? or how to do it/?

  • @khtan5531

    @khtan5531

    5 жыл бұрын

    @DROIDii1 this would be true for a static camera facing a fixed scene. But won't it be problematic for a moving camera which has to deal with a changing background scene?

  • @yeshacroe9354
    @yeshacroe93543 жыл бұрын

    Hello how do you code to make it have a blue box thing.

  • @muhammadhanifudin2666
    @muhammadhanifudin26667 жыл бұрын

    How fps guys,, i wondering it gets fast fps,, i doing same project but get low fps,, thanks dude

  • @nicorudikan8844
    @nicorudikan88442 жыл бұрын

    Hey, im interested on making this project do you mind sharing the tutorial how to make this?

  • @wobbuffet8791
    @wobbuffet87917 жыл бұрын

    I could see how this would work with a moving camera. You would basically keep panning/tilting until the object is centered, but how does this work with a static webcam? I am truly puzzled by this.

  • @Schmuck

    @Schmuck

    7 жыл бұрын

    Are you talking about tracking the object (or in this case, person)? If so, then I haven't heard of anyone doing this in the method you provided, panning/tilting until the object is centered. How this was done, was using the open sourced OpenCV library by intel. You feed it some input, a video frame, and then it analysis the frame using a series of algorithms to determine the location of the object.

  • @raisbastomi
    @raisbastomi5 жыл бұрын

    can i see the code? i so impresive. where we can now tutorial e

  • @jui-yanghsieh381
    @jui-yanghsieh381 Жыл бұрын

    What is the purpose of the laser? How does it help the camera track the person?

  • @claudioLuna02
    @claudioLuna027 жыл бұрын

    tutorial ? please

  • @FRANK2810
    @FRANK28107 жыл бұрын

    What operating system do you use to do the project? Raspbian, ARCH LINUX, RaspEX, Rasp ARCH, Ubuntu, etc.

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Frank PS raspbian

  • @jean-pierregergie1847
    @jean-pierregergie18473 жыл бұрын

    Hii I am reall intersted i knowing how you calibrated the lazer so it can track human It will be great if you share more abou this subject

  • @ianchan2624
    @ianchan26247 ай бұрын

    cool

  • @ShivaniSingh-jc4pg
    @ShivaniSingh-jc4pg6 жыл бұрын

    plase help me i need a tutoriall

  • @enesozdinc8441
    @enesozdinc84413 жыл бұрын

    Bro What is your motors models. I watched 1080 and focused but I couldnt see :) I can see only RS

  • @user-lb9dd8et9v
    @user-lb9dd8et9v6 жыл бұрын

    所以這部分做到的是追蹤對吧?

  • @Omkar_Srivastava
    @Omkar_Srivastava6 ай бұрын

    Can you plz explain me how to do this I want to make one plz using raspberry pi 3 pls

  • @deepakpv8537
    @deepakpv85376 жыл бұрын

    Can you please give me the code of this project ?

  • @duartedias3460
    @duartedias34605 жыл бұрын

    Next step: swap the laser for a gun and implement a firing mechanism

  • @VascoCC95

    @VascoCC95

    4 жыл бұрын

    Already exists... Just join the army

  • @carunyazx950

    @carunyazx950

    3 жыл бұрын

    😂😂😂 Absolutely 👍

  • @MilesVranas

    @MilesVranas

    3 жыл бұрын

    the fact that this video showed up on my recommended just know. I'm literally making a yt series on making a nerf gun turret that uses open cv to aim and shoot darts at ppl.

  • @BlensonPaul

    @BlensonPaul

    2 жыл бұрын

    would work well with paintball

  • @lol-et1fz
    @lol-et1fz2 жыл бұрын

    РЕСПЕКТ

  • @spotdoit6047
    @spotdoit60475 жыл бұрын

    I will be thankful if you will give me source code for it because i am working on same.

  • @sasadamin
    @sasadamin7 жыл бұрын

    what language you used for the program? Also do mention if this is release build that is causing high fps... Thankyou...

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Asad Amin using C++. Working at 20fps.

  • @sasadamin

    @sasadamin

    7 жыл бұрын

    Andy Eggert thankyou for the reply i figured that much. Did u used hardware acceleration? Finally, great work... it gave me few ideas.

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Asad Amin nope. Thanks

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Asad Amin nope. Thanks

  • @BlensonPaul
    @BlensonPaul2 жыл бұрын

    good one.. Wondering how would it work with AI..??

  • @gomenaros
    @gomenaros6 жыл бұрын

    I smell military applications (dron rockets etc) in this tech and I can't say I m happy with that.

  • @montanacaleb

    @montanacaleb

    6 жыл бұрын

    The military is far beyond this primitive tech, they have mini tank-like robots with mini guns mounted on them.

  • @JaydipPatelindia
    @JaydipPatelindia6 жыл бұрын

    can i Buy the CODES from you !

  • @ganstagirs
    @ganstagirs6 жыл бұрын

    were code?

  • @giorgosiotis1557
    @giorgosiotis15573 жыл бұрын

    Programming code is only private???

  • @dqalitz
    @dqalitz6 жыл бұрын

    Can you post the code?

  • @bhaskarjyotidutta3253
    @bhaskarjyotidutta32535 жыл бұрын

    What shoul I learn for this types of computer vision. I mean I need the starting point.

  • @ayeyefookinw0tm859

    @ayeyefookinw0tm859

    4 жыл бұрын

    python

  • @arifikhsanudin9987
    @arifikhsanudin99875 жыл бұрын

    it can be a weapon

  • @suleymankocamaz3743
    @suleymankocamaz3743 Жыл бұрын

    Great project. Could you please share a code please?

  • @Quarkburger
    @Quarkburger5 жыл бұрын

    I did this in 3 weekends except instead of a laser I had a flash light.

  • @fullmoon6661
    @fullmoon66617 жыл бұрын

    what motor are you using mate? please kindly reply, I wanna make smooth pan & tilt like yours

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Willyam Adhi I am using geared DC instrument motors from McLennon.

  • @fullmoon6661

    @fullmoon6661

    7 жыл бұрын

    Andy Eggert thanks

  • @bmk5019

    @bmk5019

    7 жыл бұрын

    +Willyam Adhi Hi, i recently bought two optical scopes, i already made an adapter to mount my smartphone on it (digi-scoping), works great. Next step in the project is to make a pan & tilt for the scope(s) and use the pi camera instead of the phone. Then stream the image via a web server on the pi. Then i created a remotely controlled extreme zoom webcam... i live in a high building with great view... So i need 2 (or 4) servo's for the pan & tilt, the spotting scope weight is 988 gram, but in balance, i dont think it's hard work for the servo's. What's your plan with the pan & tilt system? Regards, Bastiaan

  • @fullmoon6661

    @fullmoon6661

    7 жыл бұрын

    Bastiaan Klaasing hi, that is cool project. Mine is just like yours but it's focused on surveillance. So I kinda need smooth pan & tilt but also compact in size. I'm still working on it

  • @muhammadhanifudin2666

    @muhammadhanifudin2666

    7 жыл бұрын

    How fps guys..? im wondering it gets fast fps tracking

  • @mm168mm8
    @mm168mm84 жыл бұрын

    i just can see your laser pointer ..I don't see the laser light ??!!

  • @ISHANSDungeon
    @ISHANSDungeon6 жыл бұрын

    next up laser guided missile

  • @toyteardown5722
    @toyteardown57227 жыл бұрын

    How does it prioritize multiple targets?

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Toy Teardown hi. Tracks the biggest moving object.

  • @toyteardown5722

    @toyteardown5722

    7 жыл бұрын

    wow, very clever.

  • @marinenav8
    @marinenav82 жыл бұрын

    tutorial, please

  • @dqalitz
    @dqalitz6 жыл бұрын

    Hello can you send or sell your code?

  • @annas.227
    @annas.2277 жыл бұрын

    Hi guys, nice work! I'm trying to get OpenCV installed on a Pi3 and keep getting errors. Are there any docs or tutorials on the install that you could point me towards?

  • @probibably

    @probibably

    6 жыл бұрын

    In case you still need it or anyone else is looking for a step by step: www.pyimagesearch.com/2016/04/18/install-guide-raspberry-pi-3-raspbian-jessie-opencv-3/

  • @jarisipilainen3875
    @jarisipilainen38757 жыл бұрын

    would be faster track just with camera lol or is camera tracking and laser is just moving there ha

  • @brendethedev2858
    @brendethedev28586 жыл бұрын

    Neighbors used to walk in front of my office all the time now they don't because I blind them. With my laser

  • @insonia-somdomundomusicasp3128
    @insonia-somdomundomusicasp31286 жыл бұрын

    1:30

  • @navar45000
    @navar450005 жыл бұрын

    The cool thing to do is put the camera where the laser pointer is and have the camera move so as the object that is tracked it is always drifting it back to the center of the screen. Now you have an auto tracking gimbal like soloshot without a tag. I don't think distance is being calculated here, because the camera is fixed the image the movements of the laser are limited to the fov and so the laser moves in relation to the center of the image. It probably took trial and error of some sort to move the laser to the correct extents of the image and distance is irrelevant. You would need additional data (gps) to calculate distance.

  • @andyeggert8578

    @andyeggert8578

    5 жыл бұрын

    funkyfreestyler thanks for your comment! True, distance was not calculated here and was irrelevant. The aim was to only have the laser point at the middle of an object in the fov of the camera. Having a moving camera would mean I would have to change my method of image processing as I made use of the ‘steady’ background.

  • @XwitterEye
    @XwitterEye2 жыл бұрын

    the guy on the motorcycle

  • @guardrepresenter5099
    @guardrepresenter50997 жыл бұрын

    Easy man.Substract background picture from recent picture than get moment of substraction.Can you do it moving background with two similar object or more :)

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    bilen basarir can you sir??

  • @guardrepresenter5099

    @guardrepresenter5099

    7 жыл бұрын

    I am trying to do last 3 years. The answer is %70 yes % 30 no with all situation.

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    What methods are you using? Also using OpenCV?

  • @guardrepresenter5099

    @guardrepresenter5099

    7 жыл бұрын

    I am using shape descriptors or their combinitions.Some times i am coding some times iam using opencv But the key is to find invariant features of the shape.In opencv you can find some of them like sift,surf,blob.Then elemination of redundant unneccessary features.Some moments like hu,zernike usefull too.Depents on situation.Good like my friend.

  • @andyeggert8578

    @andyeggert8578

    7 жыл бұрын

    Is it possible to see some of your work results?

  • @alexshmidt4297
    @alexshmidt42974 жыл бұрын

    Hello do you have scripts and instructions ?? I can buy $$$#

  • @oSJmee
    @oSJmee Жыл бұрын

    I guess now he or she is building battlebots.

  • @grodarh
    @grodarh3 жыл бұрын

    Waited for an accurate laser headshot but no.

  • @YellowOysterCult
    @YellowOysterCult2 жыл бұрын

    This is impressive and all but what's with the music..

  • @aimless3827
    @aimless38274 жыл бұрын

    How to make guided missile under $300 for the next video.