The FULL CODE Breakdown video is in the first link below the video! Also pictures and a blog post with more details! And as always all the files can be downloaded there!

I had considered an IMU/gyro combination to measure lateral vibration when moving a robot in a straight line. I probably went through the same university papers and math you did. Turns out the output drifts within the integral, like an accumulation of noise. Yeah, complete dead end. Sorry you had to go through that madness! -Derek

@MAYERMAKES

4 ай бұрын

it is incredible how often I hear..thats easy...without any info that backs it up. its not easy.

thank you for posting very informative videos on electronics , we learn a lot from them

@MAYERMAKES

5 ай бұрын

you are welcome

Try making a PS/2 to Bluetooth using esp32. Let's revive good old keyboards!

@MAYERMAKES

5 ай бұрын

its athing....maybe

About 25 years ago, I had a VFX-1 headgear virtual reality headset. This came with a cyberpuck 3D mouse that operated in the same way as the final mouse in this video. I believe the cyberpuck and the headgear used the earth's magnetic field to detect the changes of the devices orientation. It worked very well, and I used the cyberpuck on its own as a mouse on several occasions. Unfortunately, the VFX-1s interface card plugged into an ISA slot, so when I had to upgrade my PC and couldn't get one with an ISA slot I had to give up using the VFX-1 and the cyberpuck.

Great video and project, love the little face on the mouse!

@MAYERMAKES

5 ай бұрын

thanks, its the little faces in live that count.

You are not incorrect in calling them mouses, computer mouse is an acronym: Manually-Operated User-Selection Equipment the plural of which is MOUSEs. Mice refers to the animals.

@MAYERMAKES

5 ай бұрын

vindicated after all!

@MisterkeTube

5 ай бұрын

Somehow I get the impression that acronym was conceived after the term was already widespread, right?

13:38 "We should find an actual use case where this thing is actually useful." Uh oh, Clem is talking crazy again!

@MAYERMAKES

5 ай бұрын

as expected

As a native English speaker, I have always used mouses as the plural for a computer mouse

@MAYERMAKES

5 ай бұрын

very reassuring

tried to transplant an MPU6050 once and had similar results - not sure if I threw it in the ultrasonic cleaner, but they're definitely sensitive

@MAYERMAKES

5 ай бұрын

garstige kleine biester

thanks for the video, very interesting ;-)

i like that he is making an opensource version of everything i agree that there is supposed to be an open source version of everything

@MAYERMAKES

5 ай бұрын

😮 it does not have to be better, just working, so there is a free choice and the tech is documemented and preserved

Given a slightly elevated stand to help maintain the mouse angle and revert back to no movement between tilts, I can almost picture potential here to be less frustrating than a regular mouse. You know, because you're not running out of tracking space or knocking the coffee over.

@MAYERMAKES

5 ай бұрын

😮

@aviandragon1390

5 ай бұрын

In the meantime... Trackball

if you designed the bottom plate like a half ball shape, you can use it on an surface, an tip it in all directions, or just design the bottom like a spinning top. So you can use it in mid air, and on a table too.

@MAYERMAKES

5 ай бұрын

if you look closely o nthe underside ofth the final red mouse you will see a little conical shape, that was supposed to hiold a spring and a weighted baseplate so I actually tried that idea the trouble was with return to center, it was just to jiggly to reliably move and the deadspace required was to big so I removed it again.

@green64

5 ай бұрын

@@MAYERMAKES oh you right, if the mouse don't jump back in an neutral resting positions you can't release it with you hand. But how do I release the Air mouse? Do I need a stand to put it on a table, if I need to use the keyboard for example?

@MAYERMAKES

5 ай бұрын

so far I just laid it on a flat surface.@@green64 when turning it own it calibrates itself to whatever position it currently is in. so i rest it on my "neutral surface" and pick it up whenever I use it.

Hi , just to know how i could use virtual clicks (ie movement of mouse in z direction for few seconds means i had pressed /Clicked an App)intsead of buttons to press the same app on the mouse ?

I'm surprised you can't get them optical mouse sensors from Mouser, of all places 😅

@MAYERMAKES

5 ай бұрын

I was equally as surprised. could only find NOS quadrature encoders or salvaged ones.

Great build !!!! I think maybe specially abled people could find good use of the mouse !!! What do you think ??

@MAYERMAKES

5 ай бұрын

We would need someone to actually try and say if its useful to them.

what should I do if I want the mouse to move not only rotating it so like an acutal air mouse. should I use another sensor? can you please help me out

thats cool with a gyro 😎 but kinda missing the middle click button or a scroll wheel for "full" functionality

@MAYERMAKES

5 ай бұрын

The ffc header on the biard was meant for a switch joystick to provide rhat funktionality, but i ran out of time.😂

It looks like you have recreated the 3d space mouse that some CAD users are fond of, just a floating version. I still prefer the traditional mouse.

@MAYERMAKES

5 ай бұрын

yes, kinda like a space mouse

the thing us said about imu getting damages is real bro, i have been struggling with my self balancing robot. Now i am going to buy a new one ,if it makes my project work, im gonna come back with 10++ subs

There are some optical sensors in stock, have not checked every single one of them but there is probably something "usable" ?

@MAYERMAKES

5 ай бұрын

Can I haz link? 😢

@sjoervanderploeg4340

5 ай бұрын

@@MAYERMAKESI think optical sensors like the APDS-9500 could possibly be used? There were ADNS "LaserStream" sensors, but there might be others as well. The APDS has "cursor mode" and from what I can tell from the surface calibration some mice do... they do look at a tiny image from the optical sensor!

@MAYERMAKES

4 ай бұрын

sadly I don´t think these sensors are usable, they cannot measure exact movement just general direction and are not meant to slide close to the ground but recognize gestures from farhter away.@@sjoervanderploeg4340

If it's already Bluetooth, why not couple time of flight with the imu?

@MAYERMAKES

5 ай бұрын

Both to imprecise/unreliable

Doing a double integral of IMU samples wouldn't be too hard. The problem is that the IMU isn't perfect - you are measuring acceleration with a bit of error. And you're integrating the error twice as well - and that's why the device just shoots off in seconds. Similar problem needs solving for VR. There, it's universally accepted you need to correct it several times a second to get proper readings (an external system provides an absolute position, but slowly, an IMU can be sampled at hundreds of Hz, but by itself would run away. So an IMU fills in the blanks between samples of another positioning system). What an IMU can measure very well is rotation, so a trackball would be possible if the PCB was inside the ball with a battery. To get rotation, samples from a gyro get integrated - but only once - so it drifts, but at a constant speed, so it's manageable. The other sensors in an IMU can be used to correct that drift. I'd recommend madgwick's algorithms for doing so, correcting the drift is actual hard math. For a drift-free result you'll need gyro+accel+magnetometer. Magnetometers aren't great, usually needing calibration because they are influenced by metals around them, but you could provide a fake stronger north with a magnet in the casing

@MAYERMAKES

5 ай бұрын

i like the idea of putting the imu in the ball! thats a cool concept! my math capabilities are very limited so for me it was to hard to do, but Iḿ sure some community memebers will figure it out!

Эх... а ведь в этом видео можно было увидеть пару часов матана на тему извлечения перемещений из многоосевых датчиков положения... Ну или хотя бы пару трюков как без высчитывания реального перемещения таки управлять курсором (дифференциальный метод).

Now you must design a giant floating keyboard to go along with this. Otherwise it is just out of place.

@MAYERMAKES

5 ай бұрын

oh swet summer child....look a few videos back I already did a BLE keyboard from scratch, granted it is not giant, but it could be used floating

@aviandragon1390

5 ай бұрын

😄

Perhaps a joystick shaped device would make it a bit more intuitive for tipping the mouse in the x/y direction, than a puck-shaped mouse?

@MAYERMAKES

5 ай бұрын

could be, i think for these sort of devices finding the right shape could be a personal thing. not everybody might prefer the same shape, i could also see the appeal of moving the mouse only while a button is held for example for presentations.

@dj1NM3

5 ай бұрын

@@MAYERMAKES The only commercial version which I can remember the name of is Gyration Air Mouse, which adopted a Star Trek TNG phaser shape, mostly because one mouse button is the trigger underneath and there's a control pad for your thumb on top.

Trackballs do not reqire integration like a IMU mouse would. You just need to have ball drive two slotted wheels and then count the slots as the wheels rotate.

@MAYERMAKES

5 ай бұрын

that would require mechanical design Iḿ not getting into yet, and an optical variant would require the seemingly unobtainable sensors, but yes atrackball might be a good follow up project as it would be interesitng to see how encoder wheels work.

@davidhayward1426

5 ай бұрын

@@MAYERMAKES for some circa 1984 documentation on how this used to be done check out page 1028…1030 of this www.weihenstephan.org/~michaste/pagetable/mac/Inside_Macintosh.pdf

@Domspun

5 ай бұрын

​@@MAYERMAKES So a ball mouse would also be possible?

@MAYERMAKES

5 ай бұрын

well yes, but the mechanical design is much more complicated and I thought people would not like to see such an Oldschool design for a mouse.@@Domspun

@Domspun

5 ай бұрын

@@MAYERMAKES haha Touché!

What is its battery life?

@MAYERMAKES

5 ай бұрын

no idea but likely several hours without any sleep function, can be optimized like with any other mouse in code.

@raguaviva

5 ай бұрын

@@MAYERMAKES what you built is called an air mouse, and their battery life is 4 months... If you are not addressing consumption, which is the elephant in the room, the rest is useless

I was pretty sure you would not be able to get the original concept off the ground!

@MAYERMAKES

5 ай бұрын

thats why we accept adapt overcome!

Can you elaborate more why IMU mouse require complex math?

@bartz0rt928

5 ай бұрын

I tried to do something similar in uni and basically came to the same conclusion. The IMU measures acceleration. To get from that to translation ("I have moved this far in this direction") requires a second order integral. The integral itself isn't that hard, but any error in the measurement grows exponentially. So you end up lowering the sensitivity to reduce noise at which point it can't track small movements accurately anymore, and any large movement quickly leads to the error piling up to where it becomes useless. The paper he refers to probably uses the second IMU so it can sort of average the noise out, but that only gets you so far. What you need is a way to recalibrate to a known anchor very often. That's how IMU-based position systems like the inside-out tracking in the Meta Quest VR headsets work, and also the Wii controllers.

@MAYERMAKES

5 ай бұрын

here is a paper on that: actascientific.com/ASOR/pdf/ASOR-02-0063.pdf

@gendragongfly

5 ай бұрын

The IMU he wanted to use is a 6 DOF IMU. It measures acceleration and rotation in 3 directions. But it has no magnetometer and doesn't output translation. This means the translation movement and position would need to be calculated from the acceleration. So, imagine you move the mouse from A to B in a straight line. It starts stationary, then accelerates. When the movement speed stabilizes the acceleration is zero again. If we want to know the position (distance traveled) we need to know how fast the mouse is moving. But in order to know how far you are moving you need to know how fast you are going. This means you need the integral of the acceleration over time (which is the change in velocity). And then you need to take integral of the velocity over time to get the distance. From the distance the change in position can be calculated. When you decelerate upon arrival at point B you need to do the same calculation but in the opposite direction (with negative values). If the calculations (and measurement data) are perfect the acceleration and deceleration, and the velocities should cancel each other out. But if you miss data or have any measurement error the acceleration and velocities won't cancel each other out and your velocity never reaches zero, so your mouse cursor would be all over the place (this is the problem Clem was running into). TLDR: this IMU doesn't output translation movement or position, so relative movement and position need to be calculated. No IMU is very accurate as a position sensor, as this is not measured directly. A 9 DOF IMU would have been better, but it would still require the calculations to be done on a computer in order for it to work as the calculations need to be performed as close to realtime as possible.. An ESP32 is simply not fast enough to even get close to real time when dealing with such complex calculations.

@AlexandreLefaure

5 ай бұрын

It does not. It is simple integrals of integrals. IMU gives (among other things) accelereration in X, Y, and Z. If you compute the integral, it gives the speed in X, Y and Z, if you take the integral again, it gives the displacement in X, Y and Z. Respectively, the gyro of the IMU gives the angular acceleration -> angular speed -> heading in X, Y and Z. So it's not complex math, but the thing is sensors (especially this one) are not perfect and a tiny error in measurement passing twice through integration might result in very bad measurements of displacement and heading of the mouse.

@janekkouril476

5 ай бұрын

Another problem is the existence of gravity. You can't easily distinguish an acceleration that is much smaller than gravitational acceleration from tilt.

For little rodents that can gnaw their way into anything, and are scared of cats, "mice" is right, yes. But for mechanical rodents (I've heard people refer to a mouse as "rodent", and was impressed by this) as far as I'm concerned the correct plural is "mouses", not mice. Mice are little rodents. Lots of them. Mice is their collective noun. Mouses are just metaphorical mouse instances. It's much more sensible to keep things simple, call them mouses, and leave whatever ancient reason there was to give the word "mouse" and irregular plural, whereas "house" plurals to just plain "houses", regularly. Hmm ... lice are the plural of louse, so it's not a perfectly irregular thing. If they make a device they decide to call a louse, go with "louses" and not "lice", in the plural, as well. Lots of words in an irrelevant matter, yes I know. What can I say? This is the Internet. This kind of thing is happening all the time.

@sicko_the_ew

5 ай бұрын

I'd better try to be relevant. OK, so maybe what you really need is a Wild West Colt 45 pointing device with a lazer beam that changes colour when you trigger an action. So you'd fast draw it, take aim, and pull the trigger to left click. That should be nice and useful.

@MAYERMAKES

5 ай бұрын

turns out I wasn´t so wrong after all

@sicko_the_ew

5 ай бұрын

@@MAYERMAKES Yes. As in IMHO you were completely correct. :D

Its already there years ago with LG motion Remote.

@MAYERMAKES

4 ай бұрын

as far as I can tel lthis one uses angular movement not lateral movement so it works liek the thing I ended up with.

You know that prototyping is a thing, right :P

@MAYERMAKES

5 ай бұрын

You know that what you see is prototyping, right? :P

@crosswick

5 ай бұрын

Well I mean making an entire custom PCB before testing out the basic functionality seems a bit overkill, but perhaps you’re just very good at it

@crosswick

5 ай бұрын

To clarify: I don't mean to throw shade here, the video is great - I guess my point would be that seen as element14 provides informative and entertaining content by and for playful makers, it would be nice if they could offer something like $5 IMU breakout boards

@MAYERMAKES

5 ай бұрын

I actually save time by using pcbs instead of handwiring, with a tight knit schedule airwiring modules and then stuffing it into a shell is just to erro prone, but I dod have to make bodges quite often.@@crosswick

Getting position from acceleration is taught in high school.

@MAYERMAKES

5 ай бұрын

Doing it in practice is a different beast.Reality often disagrees with theoretic assumptions

@raguaviva

5 ай бұрын

@@MAYERMAKES Physicist here, I've done that and it is just a couple of additions per axis ;)

@MAYERMAKES

5 ай бұрын

Then post your code on the community page , it will surely be interesting!

You can make it with a rumble Pack inside And make the scroll wheel control the speed of the vibration. Mmmmmm that be good ❤

Make a small stash in it… just enough for a gram or 2..

@brookerobertson2951

5 ай бұрын

That way Stacey can’t find it and snort it all and then sleep with your bf.. 😢