Laser Tracking System -using OpenCV 3.1 and Raspberry Pi 3
Final year project for Electrical and Electronic Engineering degree. Platform with a mounted laser pointer to track a person. Using OpenCV 3.1 and a Raspberry Pi 3.
Final year project for Electrical and Electronic Engineering degree. Platform with a mounted laser pointer to track a person. Using OpenCV 3.1 and a Raspberry Pi 3.
Пікірлер: 183
Hi, this is 2020 and this project still seems soo good. Can you please share tutorial on how you made hardware and software both? Thanks
The soundtrack is just awesome!
This is rad!!! Any chance you could post a video on how you did this??? It'd be greatly appreciated!
Very Cool the mechanism to rotate the cam seem very smooth.
great job, congratulations
Good job! I think a second image that closed up to the guy's clothes to show the red-dot intercepting it would have been a real winner.
can you do a tutorial regarding how to do this please?
@VascoCC95
4 жыл бұрын
From what it seems, the recognition is based in a kind of motion detection. You have an open-cv function for that and there's an youtuber called sentdex that has some very nice tutorials on that! About making the laser pointing to your target I don't know much on the topic, sorry...
@alvaroboven
3 жыл бұрын
@@VascoCC95 Something incredible of this one is the fluent of the video. With sentdex tutorials, video doesn't exceed 5 fps
@VascoCC95
3 жыл бұрын
@@alvaroboven I'm not saying it is better than this one, I'm just helping him to understand what is behind the scenes and pointing to a tutorial
@alvaroboven
3 жыл бұрын
@@VascoCC95 yeah sure, I didn't want to insinuate a comparison. In that case, do you know which is the optimizer way to program object detection in rp???
@VascoCC95
3 жыл бұрын
@@alvaroboven Well... You are lucky because I JUST ran a test on a RP and I got average 12,7 FPS. I used OpenCV's HAAR Cascade for face recognition in a RP 4B with 2GB RAM. I installed OpenCV via the link's tutorial and placed the haar file "manually" in the project's folder. www.pyimagesearch.com/2018/09/26/install-opencv-4-on-your-raspberry-pi/
Great Job!! very impresive.
@andyeggert8578
7 жыл бұрын
Bastiaan Klaasing thanks😉
@bmk5019
7 жыл бұрын
Happy and smart New Year ;-) just a few hours left in Holland.. Keep it up!
I died from the music.
@zulqarnayeenschaftler9323
4 жыл бұрын
Crazy music
@FIREMAN-ff3cj
4 жыл бұрын
Music for my ears
@ANGEL-mb9yx
3 жыл бұрын
My condolences
@MadhuKumar-hi2qs
3 жыл бұрын
Name of the music
@jyotiradityakumar1174
2 жыл бұрын
@@MadhuKumar-hi2qs KZread where by pewdipie
Did you make your own closed loop system? Looks like you used DC motors and pots. Nice work! Though, the music seems a little off for a person tracker :)
Interesting project. Would love to know more about the hardware used in this video!
great some guy walking around..
Well done bro
what frame rate did you got for realtime detection
Great work there! I am working on a somewhat similar project, I would be very grateful to get your insight as to how exactly did you manage to get this working. Could you please brief it?
great project!
@andyeggert8578
6 жыл бұрын
Thanks!
Hi Andy, This project look's very cool and perfect :). How you established the connection between the raspberry pi module and arduino to share the object coordinate information.
LOVE the music
Why not use premade servo motors? What computer vision algorithm/pipeline does it use? Would it be confused by multiple people?
Love it!!!
Add heavy metal music and nerfgun to project. Boom! :D good project yours
How was ur experience with rasp 3 in terms of speed while working with opencv ? I have rspb 2 model b and using a simple color detection it would slow the processing around 3-5 fps . I hope u get my question sorry for my English .
Hi there, I was wondering how did u make the laser point to the real position of a person. I'm doing sth sort of similar with urs, projecting images on the back of one's palm. For the projection part ,I selected the area of projection in camera and then corrected the perspective of this area. SO I can just draw at the perspective corrected coordinate in my projection area. But how did u get the right rotation for a real world position. Thanks.
The object is about 1.7 meters high, and it is on the ground, so from en.wikipedia.org/wiki/Pinhole_camera_model, calculate intersection of a line (from camera positon calibration) and ground plane , you can get the positon of the man. then point your laser to him.
what happens when second person appears?
Can u please make a tutorial having some details of your excellent project.... It will be very helpfull....
so much drama in the music
New level of security
is this on github?
what method are you using? Background subtraction, HOG, Haar or something else? Looks accurate!
@FIREMAN-ff3cj
4 жыл бұрын
someone knows each other and could tell what technology this gentleman used.
@Brickkzz
3 жыл бұрын
1:15 looks like background subtraction
@Brickkzz
3 жыл бұрын
I wonder how erratic this would be at low light conditions
Is it possible to make this with Rasperry Pi Zero?
how did you figure out how the degrees the servo had to move compared to the x y of the video?
Hi! How far can detect? Thank you.
what laser did you use? can you tell me all the material that you use.
How does it lock the target?
Very Impresive, Congratulations! Any tutorial to replicate your work and Learn?
Hi! What camera did you use? USB, PiCamera or what?
is it possible to get a list of all the parts for a project like this ?
So I see that you've used C++... I've been trying to code with OpenCV and C++ for quite some time but I can't seem to figure out what IDE to use (if any) that will make it easy to use with OpenCV (building/path to the libraries gets really annoying). Are you using Code::Blocks, Geany, the Linux Terminal, or just your favorite text editor? Just curious if you're around 🤔
@diegooriginalesmontoya5863
3 жыл бұрын
How is it going?
Can you put is up on a drone?
What is the laser doing in this setup? Is it used in the control loop or just a pointer? I assume the latter is the case.
What did you use for opencv? C++ or Python?
@kalebakeitshokile1366
3 жыл бұрын
You can use either but Python is way easier
Actually, I am also working on a target tracking system. need your help is possible.
What is camera use for detection? Plss
@Andy May I have the design files for the infrastructure of laser movement? Or can you please guide me where can I get it? Thanks
Please how did you do that ?
Se ve muy bien
damn! cool!
This will be awesome for making movies.... with a camera instead of laser.
Hi, I am designing a motion tracking project with raspberry pi. I will use it as a finishing project. I want to get information about the laser project. can you help me.
Hey andy. I am workinkg in a project that looks similar to your project. Can you please give me the details of your project?
Dope
How does it track the person (heat/motion/position/etc.) ? Can it track an object like a car or a drone?
@nextronicCasablanca
7 жыл бұрын
yes you can , using image processing in OpenCV
@danielf950
7 жыл бұрын
DROIDii1 Yeah, on a serious note on your number 4... how would a system like that distinguish between hostile and friendly individuals? One way I see it is by marking friendlies with an IR emitter, but that wouldn't do in a military situation where this would denounce the operative's position on the enemy's NVGs. It could be used though if it is stationary and it has to protect a perimeter AFTER a certain limit (as this can be easily programed in OpenCV), limit within which there can be safe movement of troops.
@rohitkarle
7 жыл бұрын
can we have a code for the same? or how to do it/?
@khtan5531
5 жыл бұрын
@DROIDii1 this would be true for a static camera facing a fixed scene. But won't it be problematic for a moving camera which has to deal with a changing background scene?
Hello how do you code to make it have a blue box thing.
How fps guys,, i wondering it gets fast fps,, i doing same project but get low fps,, thanks dude
Hey, im interested on making this project do you mind sharing the tutorial how to make this?
I could see how this would work with a moving camera. You would basically keep panning/tilting until the object is centered, but how does this work with a static webcam? I am truly puzzled by this.
@Schmuck
7 жыл бұрын
Are you talking about tracking the object (or in this case, person)? If so, then I haven't heard of anyone doing this in the method you provided, panning/tilting until the object is centered. How this was done, was using the open sourced OpenCV library by intel. You feed it some input, a video frame, and then it analysis the frame using a series of algorithms to determine the location of the object.
can i see the code? i so impresive. where we can now tutorial e
What is the purpose of the laser? How does it help the camera track the person?
tutorial ? please
What operating system do you use to do the project? Raspbian, ARCH LINUX, RaspEX, Rasp ARCH, Ubuntu, etc.
@andyeggert8578
7 жыл бұрын
Frank PS raspbian
Hii I am reall intersted i knowing how you calibrated the lazer so it can track human It will be great if you share more abou this subject
cool
plase help me i need a tutoriall
Bro What is your motors models. I watched 1080 and focused but I couldnt see :) I can see only RS
所以這部分做到的是追蹤對吧?
Can you plz explain me how to do this I want to make one plz using raspberry pi 3 pls
Can you please give me the code of this project ?
Next step: swap the laser for a gun and implement a firing mechanism
@VascoCC95
4 жыл бұрын
Already exists... Just join the army
@carunyazx950
3 жыл бұрын
😂😂😂 Absolutely 👍
@MilesVranas
3 жыл бұрын
the fact that this video showed up on my recommended just know. I'm literally making a yt series on making a nerf gun turret that uses open cv to aim and shoot darts at ppl.
@BlensonPaul
2 жыл бұрын
would work well with paintball
РЕСПЕКТ
I will be thankful if you will give me source code for it because i am working on same.
what language you used for the program? Also do mention if this is release build that is causing high fps... Thankyou...
@andyeggert8578
7 жыл бұрын
Asad Amin using C++. Working at 20fps.
@sasadamin
7 жыл бұрын
Andy Eggert thankyou for the reply i figured that much. Did u used hardware acceleration? Finally, great work... it gave me few ideas.
@andyeggert8578
7 жыл бұрын
Asad Amin nope. Thanks
@andyeggert8578
7 жыл бұрын
Asad Amin nope. Thanks
good one.. Wondering how would it work with AI..??
I smell military applications (dron rockets etc) in this tech and I can't say I m happy with that.
@montanacaleb
6 жыл бұрын
The military is far beyond this primitive tech, they have mini tank-like robots with mini guns mounted on them.
can i Buy the CODES from you !
were code?
Programming code is only private???
Can you post the code?
What shoul I learn for this types of computer vision. I mean I need the starting point.
@ayeyefookinw0tm859
4 жыл бұрын
python
it can be a weapon
Great project. Could you please share a code please?
I did this in 3 weekends except instead of a laser I had a flash light.
what motor are you using mate? please kindly reply, I wanna make smooth pan & tilt like yours
@andyeggert8578
7 жыл бұрын
Willyam Adhi I am using geared DC instrument motors from McLennon.
@fullmoon6661
7 жыл бұрын
Andy Eggert thanks
@bmk5019
7 жыл бұрын
+Willyam Adhi Hi, i recently bought two optical scopes, i already made an adapter to mount my smartphone on it (digi-scoping), works great. Next step in the project is to make a pan & tilt for the scope(s) and use the pi camera instead of the phone. Then stream the image via a web server on the pi. Then i created a remotely controlled extreme zoom webcam... i live in a high building with great view... So i need 2 (or 4) servo's for the pan & tilt, the spotting scope weight is 988 gram, but in balance, i dont think it's hard work for the servo's. What's your plan with the pan & tilt system? Regards, Bastiaan
@fullmoon6661
7 жыл бұрын
Bastiaan Klaasing hi, that is cool project. Mine is just like yours but it's focused on surveillance. So I kinda need smooth pan & tilt but also compact in size. I'm still working on it
@muhammadhanifudin2666
7 жыл бұрын
How fps guys..? im wondering it gets fast fps tracking
i just can see your laser pointer ..I don't see the laser light ??!!
next up laser guided missile
How does it prioritize multiple targets?
@andyeggert8578
7 жыл бұрын
Toy Teardown hi. Tracks the biggest moving object.
@toyteardown5722
7 жыл бұрын
wow, very clever.
tutorial, please
Hello can you send or sell your code?
Hi guys, nice work! I'm trying to get OpenCV installed on a Pi3 and keep getting errors. Are there any docs or tutorials on the install that you could point me towards?
@probibably
6 жыл бұрын
In case you still need it or anyone else is looking for a step by step: www.pyimagesearch.com/2016/04/18/install-guide-raspberry-pi-3-raspbian-jessie-opencv-3/
would be faster track just with camera lol or is camera tracking and laser is just moving there ha
Neighbors used to walk in front of my office all the time now they don't because I blind them. With my laser
1:30
The cool thing to do is put the camera where the laser pointer is and have the camera move so as the object that is tracked it is always drifting it back to the center of the screen. Now you have an auto tracking gimbal like soloshot without a tag. I don't think distance is being calculated here, because the camera is fixed the image the movements of the laser are limited to the fov and so the laser moves in relation to the center of the image. It probably took trial and error of some sort to move the laser to the correct extents of the image and distance is irrelevant. You would need additional data (gps) to calculate distance.
@andyeggert8578
5 жыл бұрын
funkyfreestyler thanks for your comment! True, distance was not calculated here and was irrelevant. The aim was to only have the laser point at the middle of an object in the fov of the camera. Having a moving camera would mean I would have to change my method of image processing as I made use of the ‘steady’ background.
the guy on the motorcycle
Easy man.Substract background picture from recent picture than get moment of substraction.Can you do it moving background with two similar object or more :)
@andyeggert8578
7 жыл бұрын
bilen basarir can you sir??
@guardrepresenter5099
7 жыл бұрын
I am trying to do last 3 years. The answer is %70 yes % 30 no with all situation.
@andyeggert8578
7 жыл бұрын
What methods are you using? Also using OpenCV?
@guardrepresenter5099
7 жыл бұрын
I am using shape descriptors or their combinitions.Some times i am coding some times iam using opencv But the key is to find invariant features of the shape.In opencv you can find some of them like sift,surf,blob.Then elemination of redundant unneccessary features.Some moments like hu,zernike usefull too.Depents on situation.Good like my friend.
@andyeggert8578
7 жыл бұрын
Is it possible to see some of your work results?
Hello do you have scripts and instructions ?? I can buy $$$#
I guess now he or she is building battlebots.
Waited for an accurate laser headshot but no.
This is impressive and all but what's with the music..
How to make guided missile under $300 for the next video.