Now take a full frame sensor and make the most powerful mouse on earth !

@InsideOfMyOwnMind

4 ай бұрын

Not as powerful as an NYC mouse. They growl and hiss at you and they have knives, guns and gangs.

@BurkenProductions

4 ай бұрын

@@InsideOfMyOwnMind Lame comment

@stoobidthing

4 ай бұрын

​@@BurkenProductionsLame reply

@TheTanadu

4 ай бұрын

@@stoobidthing lame thread

@Aragubas

4 ай бұрын

@@TheTanadur/brokethechain

would be really interesting to see what a modern high dpi mouse could do. 🤔

@the_only_cheese_bread

4 ай бұрын

231 likes and no replies? Lemme fix that

@the_only_cheese_bread

4 ай бұрын

It would still be better than the bank's security camera

@joshmccollumastrophotography

Ай бұрын

I was actually thinking of this! I started making plans for a modern 16000DPI mouse sensor, and then connect 9 of them to create a full frame sensor

I may be wrong, but I believe this is how most UFO and hauntings videos are filmed

Cool video! This is literally the camera that they use as security cameras

@gerolifium

4 ай бұрын

lol

@UI_PCZ_ZX

4 ай бұрын

Security mouse

@DlcEnergy

4 ай бұрын

I don't blame how it was back in the day since technology would've costed a lot more. But yeah, there's no excuse for potato quality today. Heck, any ordinary people can have quality CCTV at their own home and connect to it anywhere from their phone. Places that truly need it the most shouldn't be cutting costs getting the cheap old stuff. Like police dashcam footage from decades ago was trash, but now everyone can drive around with quality cameras.

@Mine8maniak

4 ай бұрын

this is how UFOs are captured :D

Next episode: "Bad apple but it's through a mouse sensor"

@scaramouching

2 ай бұрын

touhou reference⁉

Incredible! Now have a RGB led quick cycle some flashes to read each color channel brightness and blend the three values overlayed to get a rough color photo

I feel like you should be able to get higher frame rate out of that sensor... I think the ESP mini board was a limiting factor there

@DoctorVolt

4 ай бұрын

No, the limiting factor was the sensor. Reading the images without error takes that long.

@cle4tle

4 ай бұрын

maybe with a newer gaming sensor you would be able to do that

@CreepyMemes

4 ай бұрын

@@cle4tle yeah aint no way a mouse is that slow, how would it manage to be precise EDIT: I looked at the datasheet of the ADNS-2610 chip. Basically it has different registers for either X and Y movement and a pixel data one. (there's others as well) So apparently it can compute internally the X and Y movement, as it only needs to send that, as opposed to sending the whole image, which makes sense why it's slow in this case.

@phosphite

4 ай бұрын

@@CreepyMemes the sensor also has delta_X and delta_Y registers and does tracking internally, I assume in normal operation the raw image data isn't read through SPI

@caiocc12

4 ай бұрын

​​@@CreepyMemeseverything happens inside the same chip, in normal operation only the movement vectors are communicated, not the image.

7:23 Well, I did such a project back in 2005... but I used the good old DB25 (LPT) as an interface and even wrote a simple webcam driver for it... and somehow get like 12fps of a resolution 16x16pix... and it worked perfectly through my 33.6kbit/s dial-up connection =))

@imperia777

4 ай бұрын

You still were using modem in 2005?

@fabiosemino2214

4 ай бұрын

​@@imperia777I had to cope with dial up in rural south of Milan until 2007, so it's possibile

@ruix

4 ай бұрын

​@@fabiosemino2214my uncle had a dial up until 2009-10. He said he didn't need anything better. Atlast he did get fiber optic.

@MKVideoful

4 ай бұрын

@@imperia777 Yes we used dial up to 2008.

@andrew.nicholson

4 ай бұрын

I know people in rural Arkansas who were using dialup in 2011.

Oh, yeah? Well, I hacked a cat into a meowcrophone!

@captainretro373

4 ай бұрын

Are u by any chance from the 1960s CIA?

@Eduardo_Espinoza

4 ай бұрын

I think your cat is bugged :0

@king_james_official

4 ай бұрын

meoooow

@dysphoricpeach

4 ай бұрын

@@captainretro373rip meowcrophone, make sure to keep yours away from cars

@vk8a8

4 ай бұрын

@@dysphoricpeachcars

What an extremely underrated channel

i am astonished by the fact that simple interpolations can build a fairly good video from a bunch of pixels

POV: You're a bank security camera

I noticed "those tiny little stars" are in the EURion Constillation. A specific pattern of 5 dots that, if recognized by photocopiers, color printers, and the like, will stop printing. It's to make counterfeiting just that little bit harder.

@leonnundel2443

3 ай бұрын

I have to try this, update soon 😂

7:24 local man reinvents the bank security camera

Brilliant. This is something I have wanted to try for years, thanks for providing the details

Big thumbs Up for your hardwork and for a new invention you created.

For those who are interested in the mouse model shown in the video. It's a Logitech M-SBF96 Optical Mouse PS/2. You can also find it with Hewlett-Packard branding, but it is essentially the same mouse. Here are some other mouse models that might also work for this tutorial: M-SBQ133 M-SBR-ACR2

Thank you for the captions! What an incredible video, you are amazing! 🖤

Amasing! It can be used to make precious end of range sensor for CNC or 3D printing

Beat you to it by about 20 years? We've done such a camera back then, trying to make it into a slightly smarter motion sensor, with a quick response low resolution image stream. Probably because the sensor is not as good as today, we found that the sensor has a too low dynamic range and can only be used indoor and in a dim environment. Glad to know it works now!

Great Dr. volt, you're the best. Greetings from an old technician.

Thank you for your hard work making this, I have been enlightened.

I may have to recreate this as a game design artist. I think this would be an amazing way to natively scan in drawing with a pixelate filter over them

Excellent work!

Man IDK what they injected into the algorithm over there at YT HQ but I'm getting the feshest content for a while. Another great channel to sub. Keep on with the jokes, even tho the cricket chirps was cute, I actually laughed at that silly joke so totally no need for the crickets. Keep the good content coming (and this is good content) and you will grow and succeed I'm sure of it. Also great video.

I've wanted to do this ever since I saw a video explaining how "New" laser mice worked and they showed how it was tracking dust and stuff on the table and it had a view like this to show what the mouse was seeing.

Very cool!! You've got mad tech skills

Absolutely grey. I'm glad you added all these Meme sounds it makes it fun to watch.

Sir, I think your mouse hack is really cool, I really liked it, congratulations on the work, I'm going to do something for myself too with this mouse camera, and thanks for the idea

I liked the aesthetic, looks like the first videos ever made, but even more crispy...

Amazing Work! Greetings from Argentina!

Great work buddy.

nice lovely project! what happens if you have a high DPI sensor? is your resolution better?

Great project!

Cool project!

Amazing job!

Wow! Well done! I gave you a big thumbs up. Next week make it in colour, and I mean not by scanning the black and white sensor for fractions of microseconds (every colour has its own frequency, by turning on and off the sensor, the colour can by interpreted by the length of the phase) Although, I think you need quicker processors for that. Colour detection can be done with optical filters but that needs fine mechanics. Luckily colour can also be detected by changing the frequency of the light, add a number of different LEDs and let that light shine on the object, red light is not reflected by blue objects etc. After a rainbow of colours the real colour of the image can be calculated. Than you finally can see your cat in colour.

@DoctorVolt

4 ай бұрын

The cat itself is black and white, though.

@AJMansfield1

4 ай бұрын

That is not an accurate understanding of how visible-wavelength sensors work. Visible light image sensors of even very high end cameras are not electromagnetic devices, they are photoelectric devices, i.e. not sensitive to phase. You cannot get visible-band color information from a black and white sensor through any kind of sampling or gating scheme even if you're able to sample or gate at daylight frequencies.

@vanhetgoor

4 ай бұрын

@@AJMansfield1 I am sorry, you can but at this moment not a single optical sensor is fast enough to do so. Not so long ago in electronics magnificent things were done by looking at the phase, the same thing can be done with light as soon as there is some development. The fact that it is not jet possible right now does not place a barrier for thinking further then what is achieved at this moment.

@AJMansfield1

4 ай бұрын

@@vanhetgoor Believe me, I know exactly what you're talking about as applied to radio and microwave frequencies - quadrature sampling is a fairly ubiquitous technique used in all kinds of radio devices to extract phase information from a signal. At visible wavelengths though, the feature size you need in order to construct filter elements that are reactive to those frequencies starts to reach the point where the only construction method possible is "stacking thin films into a filter", and it's not really possible to include active elements in the effective "circuit" formed this way. The way that ccd or cmos camera sensors operate involves an entirely different physical principle - they do not measure the electromagnetic fields directly using an antenna, but rather count the rate of discrete photon events, based on the current across a suitably-tuned semiconductor junction. It's not a matter of "good enough", it's actually a totally fundamentally different way of measuring light. And without some novel breakthrough in the design of the sensor cell, phase information will always be lost by that photon bandgap process.

For higher resolution I think a gaming mouse might be better as they have higher DPI . Thanks for the great video ! Keep it up

Amazing ! Looks like 1900 year videos😁 Unfortunately, most types of cheap mouse i saw were implemented with one chip, just chip and 3 connected buttons and wheel and sends data right to USB

❤incredible content , it needs to be shown in electronics and programming schools . I understood a lot more than if I had read it all somewhere. Practice solves everything

Man i was confused for a second and thought you somehow connected a camera to a real mouse's brain or something.

your videos are very inspirational and make me think i can rebuild an entire computer with software, because i don't feel like i get enough stability, protection and encryption (lets not talk about the performance since every electronic on this earth is now designated to go to the bin after some years) so wish me luck and hopefully i will make affordable electronics better because cheaper electronics=a better world , also i will try to make a camera sensor out of a mouse sensor but a more powerful one since it has more pins, better dpi and more even probably i will get the same result atleast i did something because i feel like it

I came for the tech, but stayed for the dry humor! Great channel!

This is what I've been looking for for a long time, according to my mind

我曾经也想过既然鼠标原理和相机类似，但是没有能力验证，看了作者的视频，终于了却疑虑。 感谢作者。

Nice video, thanks for sharing it. The one data line SPI is the I2C (it is open drain, not push-pull like SPI but it has to be). It is supported with the Wire.h library. 3 fps is pretty wierd a mouse must respond much faster.

@MisterkeTube

4 ай бұрын

If it is I2C then the master is probably the one determining the clock. 18x18 pixels with (guess) 8 bit resolution and wanting something like at least 60Hz refresh rate (again a very rough guess, some mice claim >1000Hz) would require around 150kbit/s. Many I2C devices can operate at 400kHz, so that should be feasible. I hence think the 3Hz will be a limitation by the implementation on the ESP32.

A cat captured by a mouse... oh the irony...

I’m impressed, you earned a sub

nice! such cheap (easy to find as recycled...) sensors could be used as image-detection for home automation presence detection: I did make some tests with USB webcam connected to a MCU and it's okay, only need a good pattern recognition layer

i'd love to see this done with a more modern mouse, and even if the resolution isn't much higher, you can use the data from multiple captures to increase the resolution by also using the original motion tracking of the mouse to put more pixels between the ones you have

@RandomByte89

4 ай бұрын

Modern mice don't have debug pins on their sensors for ouputting raw iamges. Only the old ones.

Loved it. Turn a camera into a mouse next 😀

I thought that optical mice sensors captured images very rapidly so that they can still measure very high speeds of mouse movement. I was expecting you to be able to read at 1000s of frames per second. What would be required to make that happen? A high-fps camera would be cool even at 17x17 resolution!

@havelsand

4 ай бұрын

It looked like an old mouse he used. Definitly no gaming mouse. Thx for the great video Doctor 👍🏼

@suki4410

4 ай бұрын

All is designed for slow speed. You would not expect a mouse with usb3 cable, do you? For a high speed camera, a high speed controller needs to buffer into much RAM. Nothing of it is in the cheap mouse.

@AlanTwoRings

4 ай бұрын

@@suki4410 optical mice do not transfer the images to the host computer - all of the processing happens on the mouse controller.

@suki4410

4 ай бұрын

Not worth the hazzle. Many new mobile phones can capture high speed movies with lower resolutions.@@AlanTwoRings

@imqqmi

4 ай бұрын

I thought so too, at least 60fps and likely higher should be possible to prevent lag. Maybe the sensor needs much more light, the illuminating led is usually quite bright and concentrated on a small area. Ambient indoor light is much much lower.

Best camera ever! :-D Really nice work. Bitbanging a single-wire protocol is hard, wow. I think the capture performance is limited by your bitbanging, right? Should be possible to increase the pixel speed by some factor x, 'cause otherwise it would not be able to achieve the original task of tracking that fast mouse movements. But hey, as I said: Brilliant. Awesome work!

@DoctorVolt

4 ай бұрын

It is so slow because it takes quite a long time to read out the images. The sensor needs at least 100 microseconds for each pixel. You also have to wait a few hundred microseconds between the read accesses to the individual pixels. So it adds up to about 1 millisecond per pixel, which at 324 pixels is about 300 ms per image. So we get about 3 images per second.

Instant sub! Amazing! I wonder if a better mouse would generate a higher quality image? Like one of those logitech G pros, razer viper whatever Or if those have more custom parts that are harder to modify. I'd love to see a part 2 exploring that!

@DoctorVolt

4 ай бұрын

Better mice don't have more pixels. They are only closer together so the resolution per inch is better. Furthermore, not all mouse sensors feature reading the raw images.

@SianaGearz

4 ай бұрын

@@DoctorVolt Of course there are mice with more pixels, 3360 sensor raw image dump is 1296 pixels large, that's 36x36 pixels. Reading is quite tricky though, the sensor requires different volatile firmware uploads for each of its operating modes including test mode.

very brilliant thought concept & having correct infrastructure to realize it, what about mice who have invisible light source i tried closely to look with a digital camera couldn't see anything if it was IR would have shown white, i managed to see the dim red laser dot of a laser mouse.

its been done 20 years ago, some even made a "mouse scanner" that makes an image by stiching the camera image using the mouse X-Y movement.

@user-zv2gr3tu1l

4 ай бұрын

those had 2 separate sensors

7:15 *POV: you’re the detective trying to solve the bank heist*

You should have scanned the bank note, by slowly going over it with the mouse, line by line, capturing the data and later stitching it together. Would have probably been a lot of work. But would have also been amazing. Missed opportunity. :D

makes me think a lot of a device we use for vtubing called a 'leap motion' which is an IR sensor type of camera, mainly used for tracking hands.

This is insane! I ❤ it!!

Bro What? This is so Cool!

This has been on my shower thoughts for a long time. Thank you...

Cool stuff 😊

I think your "mouse camera" is much better than many CCTV cameras these days 😂😂

Could there also be temporal filtering (AI) with moving image around to scan better?

Sehr interessantes Video! Ich will mehr! :)

Why not use the ESP32’s dedicated SPI hardware with a diode and resistor to merge the two data pins into one? I assume the image sensor runs I/O at 3.3V.

@DoctorVolt

4 ай бұрын

I am better at programming than at developing circuits. Besides, additional circuits would have taken up too much space.

Awesome! Liked and Subbed!

6:22 - when video speaks with your inner voice (okay) 😂😂

That's amazing!

Insane , you are genius

Did a great job

Very impressive

That is what I call, thinking out of the mouse! sorry I mean the Box!

This is great!

Is it possible to hack a mouse provide image while keeping tracking function? At the same time its not possible as far I understand, what if computer software can switch this usage?

Still has better vision than me without my glasses 😅

I swear there was software I had in Win98 days that would let me scan with my mouse. No mods, just a particular chip in the mouse. (which I was fortunate to have) I'm pretty sure it was a PS2 mouse as I was also doing poll rate overclocking on it.

@float32

4 ай бұрын

Yeah, definitely. This is old school. I first saw someone take a picture of themselves about 20 years ago.

I think John Logie Baird must have used an optical mouse for his experiments in early television, as the pictures look very similar! 🤣

If this is a photodiode array then would it work for thermal imaging?

"And this thing here is a dust particle." - only way this could've been funnier would've been if he had added "for scale" to that sentence 🤣

I wonder if newer mouses have chips that could eventually make better cameras... or at least be faster (or overclocked) so you can get more fps out of them

Brilliant.

What about shooting threw colored filter (red, green and blue)sequentially for colour transmission .

Looks like your pictures come from Mars

Now you have the perfect camera for filming Big Foot and UFOs!

@DoctorVolt

4 ай бұрын

I already filmed an alien and his cat on Melmac :)

I'm not sure if this is the most useless camera or the most useless mouse, but it looks great for taking UFO and bigfoot videos.

Perfect camera to record UFOs

Could you do something liek this with a higher DPI mouse to get higher resolution?

How many people thought he did brain surgery on an actual mouse to make the camera see through the mouses eyeballs? I certainly did.

I will write again, this is an incredible video thank you author ❤

Good job.

This is the type of camera sensor that pictures UFO

I'm curious how good the motion detection algorithms are, that run in a tiny chip at 24MHz

amazing my friend

This mouse video quality is still better than bank security camera footage

Serious application vould hr used to detect astronomy events if you could design it to look through a telescope

Better quality than most security cams

The best sensors to use have a 32x32 or 31x31 pixel array.

i am stunned by you, madlad. i mean.. what in the good world?! imagine waking up some day and just going "fuck it, imma make camera from mouse" this is insane. instant like and repost.