Now everything looks like the Steamboat Willie cartoon.

@FixerUK

4 жыл бұрын

Good one!🤣🤣🤣

@trulyUnAssuming

4 жыл бұрын

I guess that tells you something about the quality of the cartoon, if they accurately drew an exaggeration of the real thing. Which is exactly what makes a good cartoon.

@mattwinward3168

4 жыл бұрын

This was my exact thought. Now I want to see a steam boat with motion amplification.

@AndersEngerJensen

4 жыл бұрын

Haha, that was spot on! And everything looks really shady and unreliable! Freaky video! ^_^

@FixerUK

4 жыл бұрын

Or Cuphead, for those who don't know about Steamboat Willie.

As someone who's don factory work, those clips look terrifying.

@t395delta

3 жыл бұрын

and thats without the thought of cctv tracing your pulse

@carlosandleon

3 жыл бұрын

As a factory worker that looks like glorious chaos to me. Subarashi.

@General12th

3 жыл бұрын

@@adranirdoradrie4922 GUYS I THINK WE HAVE A HUMAN HERE PULSE AND EVERYTHING HOLY TITS IT'S ALIVE

@acmefixer1

3 жыл бұрын

Reminds me of The China Syndrome movie! 😱😱😱😱

@diraziz396

3 жыл бұрын

@@MadsterV It's started as a research by few Israeli scientists. They sampled an old HD video, where the actor was covered with Make-op, still they've managed to show his Pulse!

The most important thing I've taken away from this is that, really, I should get paid by Google every time I prove I'm not a robot.

@eliteextremophile8895

3 жыл бұрын

How much would you pay for a work of about 10 seconds a week? I mean, the services they provide for free is kinda the pay for you being a part of its development.

@redpillaware5101

2 жыл бұрын

What I took away from it is that to defeat to AI overlords you should purposely fail the captchas.

@MrCrackbear

2 жыл бұрын

@@redpillaware5101 what you really do is select the audio captcha, put in one correct word, and then put in one wrong word. you will still pass, but you will not be giving them useful data. don't make the second word vulgar, it's incredibly likely that they will filter that out of their database, regardless of whether you pass.

@Krokoklemmee

2 жыл бұрын

@@eliteextremophile8895 i mean, google services aren't free, you pay with information

@raresmircea

2 жыл бұрын

@@rerikm Just wait until these corporations say "ok, people have started requiring money for these tasks, purposely getting them wrong, not wanting to contribute with their info anymore.. so let’s not require it.. *and from now on they’ll have to pay with money for their mail service, youtube watching, googling, social media account,etc etc"*

I'm an audio engineer and I find this to be really interesting because I could possibly use it to see how different materials resonate within a room and be able to spot problematic areas

@ben_jammin242

Жыл бұрын

Holy S. Filter by frequency and look for reverberating materials...? if I understand correctly

@TesserId

Жыл бұрын

Fantastic idea. Would really love to do this on a big bass trap... Just watched the Slo Mo Guys video on comparing the speed of glass breaking to that of a bullet, and suggested that some kind of polarizing filter could be used to highlight stresses in glass or plastic as sound waves move through the material in slow motion. So.... would love to see this motion amplification technology used in conjunction with slo mo tech to view the effect of sounds on objects.

@lupsik1

Жыл бұрын

Thats easier done with a measurement microphone? What would motion amplification solve that this doesnt: Make a full frequency sweep with software like REW, find the problematic frequency, then play back the pure tone and look for the cause by ear. Ofc you’re the pro, im just asking out of curiosity

@stavroshouiris

Жыл бұрын

​@@lupsik1 It's funny how anything can be turned into an argument. I already use REW and Smaart and I do Waterfall graphs which show me the resonance of a room. However I'm just simply pointing out that it would be interesting to have a visual feedback as to what's going on. Never said this is necessary but would provide some interesting results, for example seeing how a grand piano resonates when the hammer strikes, Or how a speaker cabinet resonates. It isn't necessary but it's interesting and last I checked I'm allowed to be fascinated by new technologies and of course there will always be obnoxious keyboard warriors like yourself

@lupsik1

Жыл бұрын

@@stavroshouiris I was just asking because I don't know the topic and thought I could learn something from you, didn't expect to offend you this way.

I worked as a Vibration Analyst for almost 12 years. We could profile a machine's movement using a series of acceletometers and graphically depict the directionality, amplitude(severity), and frequencies(potential sources and/or resonance). But the linear graphs left a lot to the imagination for those with little or no experience in Vibration Analysis. Motion Amplification painted crystal clear picture that our managers could easily understand and helped motivate some much needed preventive maintenance. It was an amazing experience working with this technology!!!

@gokiburi-chan4255

Жыл бұрын

Yeap. Have you tried pitching this tech your company?

@iwanttwoscoops

8 ай бұрын

@@gokiburi-chan4255did you even read their comment before replying?

@olivervision

8 ай бұрын

In the motion amplification video examples... are the moving/vibrating parts actually traveling those distances albeit imperceptibly? It's not exaggerating the motion, it's the actual (imperceptible) motion yes?

@jerrygilliam7349

8 ай бұрын

The generated report gives the actual displacement(distance travelled), frequency(rate of travel), and direction of travel(XYZ plot). Both displacement and frequency are scaled so the motion can be seen with the naked eye. Displacement is amplified by multiplying the distance travelled.(ex. x2, x3, x4 etc.) Frequency is slowed down in divisions.(ex. ÷5, ÷10, ÷20 etc.) The scaled video provides a live demonstration of how each component is moving in relationship to a selected stationary object.

@iwanttwoscoops

8 ай бұрын

@@olivervision Did you watch the video? no; it’s exaggerated because it wouldn’t be visible. Even high frame rate cameras can’t catch the changes, because the distances are so small. did you not hear how the visible change is sub pixel, and so detecting the difference requires turning those slight-pixel-brightening into visible change? Watch the freakin video and use your brain this time around

that effect to visualize the vibration is trippy as balls

@kinuorthel8096

4 жыл бұрын

looks so cartoony

@thecommenter578

4 жыл бұрын

I can see it applied in YTP memes in the future

@Littlewing6was9

4 жыл бұрын

@@thecommenter578 look again I bet you spot them really soon

@pvanukoff

4 жыл бұрын

I can see it being used in movies, when someone is tripping out. Or, music videos (is that still a thing?).

@Bananakid11

4 жыл бұрын

it is, because that's what the brain does, but in reverse

7:20, reminds me of the captcha minesweeper xkcd comic. “To proceed, click all the pictures of mines.” “This data is actually going into improving our self-driving car project, so hurry-up-it’s almost at the minefield.” (# 2496)

@jtw-r

2 жыл бұрын

JIT captchas

@Flourish38

2 жыл бұрын

@@jtw-r lmao

@craffte

2 жыл бұрын

lol

@klausstock8020

2 жыл бұрын

For me, it was the memory of Tay AI, which got trained through Twitter. Microsoft pulled the plug after 16 hours, as the AI had already learnt how to tweet offensive "politically incorrect phases" (including, but not limited to, racism, sexism and Hitler quotes) and had proclaimed a "race war".

1:32 "One [sensor] for each pixel" was probably correct. There are usually only as many sensors as there are pixels (even though each sensor only detects one color, whereas each pixel is composed of 3 colors). The sensors are arranged in a Bayer pattern (wherein there are twice as many green sensors as either red or blue) and a "debayering" process is used to construct each RGB pixel centered on each sensor location (using information from a small neighborhood of sensors).

@leewriter4656

2 жыл бұрын

Jesus Christ SMH

2 жыл бұрын

Industrial cameras are usually black and white, without a Bayer filter, so it's a moot point.

@flyingsky1559

2 жыл бұрын

@ T H E M O R E Y O U K N O W

@weetabixharry

2 жыл бұрын

@ Yeah, the calculation is a bit simpler for black and white :D

@SupperGammer

2 жыл бұрын

@@weetabixharry Also, Sigma worked with Foveon sensors that were three sensors stacked on top of each other. One sensor for each colour so you get true colours and amazing dynamic range, the drawback of those cameras were bad high iso performance and files that were hard to work with.

Video motion amplification: It's great when you want to give your boss a heart attack!!!

@andrewvirtue5048

3 жыл бұрын

How so.

@thanksfernuthin

3 жыл бұрын

@@andrewvirtue5048, If you just show your boss the motion amplified video it looks like his machinery is about to fly to pieces!

@TW-lt1vr

3 жыл бұрын

Just wait till you tell him how fast the Earth is moving ;)

@ATAdude666

3 жыл бұрын

@@TW-lt1vr 15 degrees per hour? fucking cooking

@aussie4237

3 жыл бұрын

@@ATAdude666 how about our velocity relative to the galaxy... or our velocity relative to the universe! thats a lotta speed

That sounds interesting! 10 seconds in and you have my undivided attention! Just have to go make a comment before continuing to watch.

@fewstr

4 жыл бұрын

@muddy6932

3 жыл бұрын

You might want to capture the seismic movement at chicken hole base 😁

@muddy6932

3 жыл бұрын

Hey cody seeing your comment made me think this might be about the only way to grab your attention without commenting on your content. Anyway here's a channel I find incredibly interesting and useful and often think this would be someone you would appreciate kzread.info

@pingumcping

3 жыл бұрын

is this robo Cody or real? re-Captcha required.

@yomybutthurtzzz8051

3 жыл бұрын

Cody your the man!!!

I've used Strobe Lights (timing lights) to visibly see the vibrations. Items were failing for customers and I used the strobe to detect the failure mode and make changes. This would only work for items that are vibrating at a given frequency. If it is random vibrations then you can't detect those with a strobe.

1:30 One for each pixel is actually correct. Color in color images is usually interpolated for each pixel (element in the processed image file) over several colored subpixels (actual sensor elements) so that you get about the same number of both (some are cut off at the corners of the image).

@TMinusRecords

Жыл бұрын

There are two green pixels for every red/blue

@w0ttheh3ll

Жыл бұрын

@@TMinusRecords true

I've used strobes before to detect cracks and misalignments in factory equipment. Use a variable strobe that you dial to a particular frequency based on the motor and drive speed. When you get to around the right frequency everything looks like it's in slow motion and cracks or loose stuff is easily visible. That amplification looks really useful for large areas though! Good stuff!

@seraphina985

Жыл бұрын

I used a PWM controller and an Arduino to do the same thing trying to figure out which of the 8 fans in my computer was making a strange noise and why. Turned out one of them needed a new blade assembly as one of the blades was vibrating excessively I presume the plastic had become fatigued and was deforming around an invisible weakness in the plastic. 3D printed a new blade assembly and that fixed it, probably handy I had that though as I couldn't find anything on visual inspection and might have left it alone for a while otherwise. That could have been a bad move as if it was a fatigue issue it would probably have failed entirely at some point a blade from a 120 mm fan at 3,000 rpm would probably be more than enough to rip components free of their solder joints if not actually break the components or the PCB itself if suddenly released.

@Lishtenbird

Жыл бұрын

@@seraphina985 Kinda fascinating that just an hour ago I was trying to troubleshoot a quirky PC fan hub and thinking "eh, I could use a strobe here", and there's this comment now - and a fresh one on a year-old video to boot...

@NavigatEric

Жыл бұрын

Thats a good idea. Sounds like setting the timing on a car.

@davidegaruti2582

Жыл бұрын

Ok , the pepole who made that cam software are intelligent ... But you sir , you are smart !

@voxpopneverdies2025

Жыл бұрын

How do you build it please.

10:07 I never thought I would see that here

@yukimoe

4 жыл бұрын

Matt always shows up when you least expect it.

@Huegell

4 жыл бұрын

But it's kind of strange to see Matt with hair

@calinguga

3 жыл бұрын

i never thought i'd see that period

When you said "Phase variation of a complex steerable pyramid" and then proceeded to show a pyramid with a steering wheel, you definitely got my sub and a like 🤣 The videos you're making are informative, intelligent, and quite literally some of the most interesting and thought provoking subjects I've ever run across. Telling everyone I know about this channel... you deserve so much more exposure for your work than you receive.

@drworm5007

Жыл бұрын

The thing is once you make the pyramid steerable its phase variation can transpose contuatively with its parse aspect, leading to the phase-contax hyper-oscillation we're all so familiar with. And if the pyramid is stick-shift as well? Watch out for side fumbling is all I can say.

@tyttuut

8 ай бұрын

​@@drworm5007Phase-contax hyperoscillation is actually an illusion caused by the interluction of pseudo-photopic light waves interacting with the oscillization frequencies of electron groups.

There's another video on here which instructs on the technique for DIY, no need to make a 'steerable pyramid': using any video editor, copy and overlay the footage. Invert luminance of one layer. Offset the playback time by layer by a second or milliseconds. There's ways to show colour changes too. Fascinatingly simple. Extending the time offset reveals slower changes, like clouds scudding across shy. I recommend looking up the video if you can find it. My description may not be quite right.

@VoltisArt

5 күн бұрын

The "difference" layer blending mode in Photoshop or After Effects is one simple way to do this. Offset your time of a copy of the same footage in the video editor, or use two nearby frames overlaid in the photo editor, and use the difference mode on the top layer to make any pixel differences pop. Other non-Adobe editors may use slightly different terminology, but most should be capable of this. I believe my source was Captain Disillusion, but it's been a while.

Interesting. btw typical image sensors only have one photosite per pixel, the 3 color channels are deduced from neighboring pixels that are RGB filtered in a pattern. called bayer mosaic.

@timemachineoutput

4 жыл бұрын

1 2 1 2 ....

@jamesvoss9367

4 жыл бұрын

Adding to this, Sigma have their Foveon line of imaging sensors that actually do have full RGB subpixels for each pixel.

@float32

4 жыл бұрын

James Voss, yes all four colors: red, green, blue, and noise.

@zzjerozz123

4 жыл бұрын

Thanks for sharing, just had a interesting time learning about it

@jkenny1

4 жыл бұрын

And then there's weird new sensors that are trying to do more, like R-G-B-IR or clear pixels for better low light performance.

"Started out as an astronomer, wanted to be an astronomer, but I had a conversation with my advisor about being gainfully employed."

@chaomatic5328

3 жыл бұрын

Post university fears

@dewdop

3 жыл бұрын

Sad

@dewdop

3 жыл бұрын

@@chaomatic5328 existential fear

@packguar6617

3 жыл бұрын

Haha I have a masters in astronomy and I am a graphic designer now.

@rancidpitts8243

3 жыл бұрын

Have an A&P Licence, Pilot's licence.The fields were flooded, so I went to work at a Phone Co.

I'm actually astounded, you are the ONLY person I've ever seen actually make an ad seem personable and like you genuinely care. Hats off to you, sir!

I like how this guy has a full wall in his library of National Geographic magazines, for a kid fascinated with NGm this is a dream come true.

Edit: just to say, a lot of people are asking how can a captcha decide if you're human if it doesn't know the right answer itself. Good question! I should have made that clear. The answer is that some times they're testing if you're human, in which case they know the right answer in advance, but other times they're hitting you up for the answer. I don't know the exact details of when it's one or the other buy for example in a grid of images maybe one of them is unknown to them. Of if you have to run the challenge multiple times only one of them is the real captcha. This one was really fun to play with. The amplified pulse video is really freaky. The sponsor is Skillshare. The first 500 people to use this link will get 2 free months Premium Membership: skl.sh/stevemould8

@Joseph843

4 жыл бұрын

Its cool how they used CAPTCHA to train their machine learning algorithms

@david-spliso1928

4 жыл бұрын

So every time we complete a captcha form we're unwittingly aiding our own A.I. destruction..

@blueboats7530

4 жыл бұрын

I want it known that I watched the video right on through to the very last second. Actually, it's a pretty engaging sales pitch.

@bbgun061

4 жыл бұрын

It’s only creepy because you wore that horrible mask!

@PabloSanchez-qu6ib

4 жыл бұрын

One correction, digital cameras usually don't have three sensors per pixel just one. They use a rgb color mask and interpolation to come up with the final image.

7:00 I totally believed you. After all, Abraham Lincoln once said that everything you hear on the internet is true.

@OrangeC7

4 жыл бұрын

I thought Marie Curie said that?

@cringium

4 жыл бұрын

I thought it was "Everything on the internet is false" -The internet

@insanejughead

4 жыл бұрын

It's from the bible, y'all. Sheesh...

@Kokurorokuko

4 жыл бұрын

Yes, exactly. That quote is on the cover of a book called "Interstellar" by Albert Einstein.

@brainkells

4 жыл бұрын

Can confirm, I was there

I love how your eye's are more stable than the rest of your head, kind of a pleasant affirmation that this method does what it should do, and it also confirms that the eyes work the way they should work.

Hi Steve, amazing video, as always. Back in 2018 I did the porting of that MIT work to c# inside unity and I was able to actually get the pulse out the wrist just using a simple webcam.

As someone who works in an industrial setting this blew my mind. The safety applications are immediately obvious. I have 50 tanks on my site like the one in the first seconds of this video.

@squidcaps4308

Жыл бұрын

Yup, and the costs are for you one good camera, installing it, raspberry pi and some open source code... oh wait.. no, you have to pay for this, arm and a leg because it is patented. The tech is super cheap, the code is not difficult but... note, i'm sure open source solution for this exist but it is missing the parts that the private side has found. Which is the stupidest way to go forward, by hiding the map.

@bloodclot

Жыл бұрын

@@squidcaps4308 do you have more information about the patent?

@MathewPollard-vj4uq

8 ай бұрын

Yes, we should wait for all the innovation to come out of the non-capitalist countries so we don't have to pay for it. Not sure why they aren't they working on what I find useful ? @@squidcaps4308

@Darthjammer224

6 ай бұрын

Where are your vibration monitoring microphones? You can do predictive maintenance cheap and easy with them.

The RANGE of topics is the greatest value this channel offers, imo. 😊

@SteveMould

4 жыл бұрын

Thank you!

@Willam_J

4 жыл бұрын

Steve Mould and Tom Scott cover the most original topics. Everyone else just copies each other. I don’t know where Steve and Scott get their ideas from, but they’re always interesting to watch!

@WanderTheNomad

4 жыл бұрын

@@Willam_J Those two occupy a very similar spot in my brain for some reason.

@SteveMould

4 жыл бұрын

@@WanderTheNomad maybe it's the accent!

@Jesse__H

4 жыл бұрын

@@SteveMould It's true that we Americans tend to react more favorably to being taught things when the teacher has an accent from somewhere in the UK 😁🤷‍♂️. It's a silly thing really, but I think it's definitely a real phenomenon!

This video is packed with great information of new technologies, even about how our body works somehow, not just the motion amplification and that's amazing!

Movement and color amplification is a subject of research for monitoring neonates. I've seen some prototypes of heart rate and respiratory rate monitoring using a relatively cheap camera. Great stuff!

You have to sample - more - than twice the frequency you are interested in. Nyquist-Shannon theorem. Pretty cool once you visualize it.

@drinductor8150

4 жыл бұрын

Actually, if all you are about is the video and not the measurement, you can admit some aliasing. It will just appear as a slow-motion thing.

@TStoneEntertainment

4 жыл бұрын

Not necessarily, there are cases where we can go below Nyquist-Shannon criteria ("Shannon was a pessimist" is one of my favorite names for a conference talk ever ;)) . See compressed sensing type applications

@float32

4 жыл бұрын

This is only true if you need to capture a non-periodic waveform. If I you have something repeating over and over, you can cheat by capturing slowly, then aligning those points into one cycle of the periodic wave. It’s cheating since, in the end, you still need Nyquist samples of that periodic wave to reproduce it, like you’re saying. But it’s a nice way to work with slow acquisition equipment.

@T3sl4

4 жыл бұрын

​@@float32 Yup, the key is the criteria applies to any band*width*, not just baseband (0-some Hz). This is how equivalent time sampling, a lot of SDR (software defined radio), some extremely-high-framerate video (specifically the pulsed laser stuff) and other things work! More generally, it's also relating to bandwidth and dynamic range; you can use some methods to sacrifice one for the other, and "violate" the common, but more specific, version (bandwidth alone).

@forloop7713

4 жыл бұрын

Actually you can sample at almost any frequency and still get thesr videos

One of the fundamental pieces of video compression is motion detection; it's used to predict what pixels will change in subsequent frames. I wonder how efficient it would be to take a video encoder like ffmpeg and hack the motion detection code to return a larger vector than appropriate, in order to exaggerate motion in the encoded form of the video.

@EGOS42

2 жыл бұрын

If I'm not mistaken that is the general basis of how motion amplification algorithms work. I'm going to be pedantic here and mention that video compression typically describes how pixels move from frame to frame not predict. Otherwise everything you said is spot on.

@jamiejoker118

2 жыл бұрын

What he said lol

@ColaGangster1

2 жыл бұрын

What you are talking about is called "optical flow". Optical flow is actually used to amplify the motion. Your method would apply optical flow analysis to the image in the spacial domain, the motion amplification on the other hand transforms the video from the spacial domain to the frequency domain (eg. through a fft filter). Just to amplify motion in the spacial domain will result in a very blurry and shaky video, because every pixel-intensity variation due to noise is amplified. It would also not be possible to just to change the "vector size" of small motions, because the mathematical method to determine optical flow discriminates small changes with the use of the least-squares-method. The beauty in the amplificaiton in the frequency domain lies in the possibility to choose the frequency that you want to amplify. You could for example only amplify pixels that are moving every 1/20th second.

@craffte

2 жыл бұрын

Isn't that what it does?

@poonholder5643

2 жыл бұрын

The initial team managed to film a crisp packet through glass and work out what was being said near by.

Absolutely fascinating. Would live a follow up someday, or a more in-depth how-to guide. The visceral response to seeing those machines moving so violently was surprising. Would definitely get a manager/boss man to spend some money to fix problems.

Great sense of humor (7:05) especially regarding "real time" autonomous vehicle decisions. I teach middle school and seeing who reacts to bizarre statements is a great way to see who is really listening.

Awesome video Steve! I love how you discuss new technologies that set people's minds on their potentially groundbreaking applications

It's a common practice when doing mechanical simulations to show the movements multiplied by a factor (like x50) for easier visualization. This looks a lot like that.

@19godfather93

Жыл бұрын

Yup. Literally the scaled up displacement visualisation mechanical workbench output. Very cool. Plus you can instantly verify your simulation setup, if the motion amplified video matches that output, your setup was correct.

It's interesting, I was watching a Veritasium video on extracting sound from video (based on how the object vibrates), and it's interesting how the stuff on picking up details from sub pixels is similar between the two.

Thanks for great content, and linking to related videos!

1:32 To be precise, actually the very most cameras just have 1 sensor per pixel and they use a pattern of color filters (Bayer pattern) to calculate the other two color values of a pixel.

4:48 Steve simply cannot contain his excitement when he says "summarised visual representation".

There was a TED talk on this a while back. I could grab the link if need be, but it was likewise very interesting!

Thank you so much for your videos and links. I am so grateful to you. I love to learn and do new and crazy things

Admitting we don't quite understand things ourselves is something we should do more often. Still sharing your fascination for this science will get others into studying it and eventually explain it to you some day :)

The "real time" bit got me so good within the 3 seconds it lasted xD

@Woodledude

4 жыл бұрын

Joke is """borrowed""" from XKCD, but I can't say I'm mad. It's a good joke.

@ancbi

4 жыл бұрын

It's a good technique for education.

Complex steerable pyramid...I think you nailed it ! This is extremely interesting. I've worked in the field of image processing and this is a fantastic application.

Really insightfull video and I can imagine a lot of uses, including forensics and crime investigations

10:33 no, I'm imagining robot overlords scanning my pulse to detect lies when they ask me where the other human terrorists are hidden

@trespire

3 жыл бұрын

EMP gun, heavy duty insulated cutters, bolt cutters and corrosive acid.

@0xB8xor0xFF

3 жыл бұрын

Better than the anal probe method that the aliens use.

@gayass8599

3 жыл бұрын

an "overload," AI would likely have created more intelligent devices than a poly (or in this case mono) graph in order to over-through society given their inaccuracy. but knowing how useless we are as a species and that we are still apes who only think we are intelligent because we have no comparable frame of reference

@hedgehog3180

3 жыл бұрын

There is actually no way to detect lying, polygraphs are complete psuedoscience. The only way to figure out if someone is lying is by finding evidence that they would have known the truth.

@mathiasrryba

3 жыл бұрын

@@hedgehog3180 lies are pretty easily detect using MRIs and other similar brain activity scans. It can detect when you lie even only within your own thoughts.

10:01 a mask that sort-of fails to hide your physiology to a camera? I'd call it a Parker Mask.

@ValentineC137

4 жыл бұрын

:)

@pepkin88

4 жыл бұрын

Is that the Escape key with amplified motion in your profile pic?

@naota3k

4 жыл бұрын

@@pepkin88 It is an escape key, made from resin and heavily Prisma filtered.

@MarceldeJong

3 жыл бұрын

It's a Parker mathk

Great content as always Steve. You really keep the videos succint and capture my attention.

This is just so awesome it's hard to find words. It looks cool and weird as hell, and it's so useful at the same time.

Bots be like: "Tell me what this is... to prove that you are not a bot... totally not to learn how to become better than humans and take over the world. Klick on all the people that are hiding in the trees. Okay now klick on all pictures with people who look like they would rebel against robot overlords." Me: "Sure, can i play GTA now?"

@_XRMissie

3 жыл бұрын

@@onemadscientist7305 I swear, there's always a relevant xkcd lmao

@carlosandleon

3 жыл бұрын

wasn't that what the US army were doing in Vietnam but analog?

@Superabound2

3 жыл бұрын

Phillip K Dick predicted this in the novel Time Out Of Joint in 1959

@MalleeMate

3 жыл бұрын

Which part of the traffic light is the traffic light? Does the pole count? Doesn’t it? It doesn’t seem to matter either way

@eduardokerber2931

3 жыл бұрын

@@MalleeMate should I select only pictures with full traffic lights, if not should I select the images with just a pixel of the traffic light? Where is limited, the exact point ahhhhhhh

I'm wondering who is the incredibly stunning beauty of whom you were wearing the mask. I really hope he's owning a math KZread channel so that I could enjoy his beautiful eyes while gaining a great sense of achievement, watching good videos.

@michaelwarren2391

4 жыл бұрын

Matt, did you need to make a phony KZread account to post this? 😀😀😀

@davedevosbaarle

4 жыл бұрын

And I hope there is a special type of Magic Square named after him!

@AndrewFrink

4 жыл бұрын

@@davedevosbaarle but one that doesn't quite work correctly.

@gayass8599

3 жыл бұрын

"Noah, get the boat ; I have lost any shred of faith in mankind so I doth drowneth upon them," - God 2019

this is so amazing and pure BRILLIANCE..! Doesn't get old when KZread puts it back into my playlist.. videos similar to be reading a textbook or retaking a class 😊

Love your videos. They are all so fascinating

I had a project for my CV course in college where I reversed engineered the algorithm using the research paper. Would love to see you dive into the math behind it!

7:08 HEY VSauce!!! Steve Mould here! I have recovered a VSauce1 password, so now I'm the host!

No lie, this is 100% what stuff looks like while trippin' on acid/mushrooms. (Everything is not in black and white, but the way you perceive things really looks like this motion amplification)

@lonewretch

2 жыл бұрын

What dose of cubes you taking, lol.. I think my grows must be bad genetics, all I do is smile and bliss out...

@mischiefthedegenerateratto7464

2 жыл бұрын

Why are both of you talking about acid like it's legal XD

@Poef

2 жыл бұрын

@@mischiefthedegenerateratto7464 u want them to whisper or something lmao

@NathanChisholm041

2 жыл бұрын

@@mischiefthedegenerateratto7464 Let me guess a goody two shoes! I bet you have never taken a risk in your life always playing it safe! Acid or LSD opens your mind.

@orektez

2 жыл бұрын

@@mischiefthedegenerateratto7464 well mushrooms are legal in Oregon at least.

I've always been told that I am very adept at picking out buses.

The guy who made captcha and re-captcha is a genius. Luis von Ahn is his name.

@infectedrainbow

4 жыл бұрын

And after he realized how much of people's time he wasted, he made duo lingo.

@jonwelch564

4 жыл бұрын

Genius - sort of, pain in the arse - totally. That re-capture crap, stops me logging in to my accounts, because it won't stop throwing up more photos to id. How many buses, traffic lights and crosswalks need IDing? How do you get past it? Ahhhh! 🤬 This video though, utterly fascinating, thanks. Reminds me of the remote fire sensing done with a normal video camera (not IR), probably done using a similar algorithm.

@crytocc

4 жыл бұрын

@@jonwelch564 Those changes were made by Google after they acquired reCAPTCHA, it wasn't von Ahn's work. His system was originally just used for OCRing scanned texts. While he isn't entirely free of blame for handing the reins over to Google, I wouldn't ascribe the frustration of the *current* generation of reCAPTCHAs to him.

@buttonasas

4 жыл бұрын

@@jonwelch564 Sounds like a problem of the website using those captchas. There are separate captchas to be used for logging in that don't waste time and websites have to set it up. In any case, maybe your browser just seems similar to a _bot_, which is the primary thing the system is trying to defend from.

@davidwuhrer6704

3 жыл бұрын

@@jonwelch564 Why don't you just train an AI to solve the captchas for you, so you can log in automatically?

The captcha intervalle was fascinating, thank you!

Thank you for the info about phase variation of a complex steerable pyramid. Now i know there is such thing.

I watched this video months ago and after a few days of thinking about it i had to find it again. What a cool video. It just popped up in my feed again and i saved it immediately

6:35 love the Rick Sanchez reference in the info boxes in the background!

@SteveMould

4 жыл бұрын

You noticed!

@danielchmiel7787

4 жыл бұрын

and also "rick morty" search in Google Books :)

That's awesome! I always thought if it would ever be possible to have a camera that could sense tension in materials. This is getting closer to that.

I remember reading about this years ago and wondered what was the current status of this research. They even had some cool demonstrations, like being able to see makeup in movie scenes from the blood flow of the face;

@lonewretch

2 жыл бұрын

A few years ago I downloaded a python script that would read your heart rate my using your web cam pointed at your face. And since I don't want to upload videos to a website, am trying this older stuff.. Eulerian Video Magnification, but I dont think it's as advanced as we see in this video...

@davidk7544

2 жыл бұрын

I would think that makeup would be ALL anyone could see of any actor.

This is really interesting. Thanks for the video

That's pretty awesome. I used to work for a sawmill when I was younger, and about every 6 months or so, they would bring in some guys from a local company with acoustic and vibration sensors and recording equipment that they would attach to our machines to find faults. Not exactly sure how that data was handled (if it was compared to some baseline or what), but I'm guessing it was used to diagnose how healthy the bearings, gears, and motors were (I remember it being mainly used on our big gang saw that was driven by 2x 200HP motors)

7:10 * Vsauce theme starts playing *

@kayrstar8965

4 жыл бұрын

And immediately stops at 7:12

@le_jackpop

3 жыл бұрын

Same thought here 😆

@upuat

3 жыл бұрын

This!

you made me interested. we use lidars and cameras to find vibrations , but isolating them is a big problem. yes drones but no, the best thing is hovering stand.

Oh boy you are one of a kind mate! 💙

7:07 I can't believe you actually got me XD

It's always a joy when Matt Parker makes a cameo in your videos, haha.

I use RDIs equipment at work and it's still awesome every time I use it

I've heard phase variation in music production. Like if your have a kick and bass in the same phase they will cancel each other out. The sound will go down. That's why sound instruments have phase inverter buttons. The waves that a vibrating system created from each object can be measured and timed for you to see .

7:08: "...you need to act quickly, or otherwise someone gets hurt." I kinda feel the force...😈 Beside that, I didn't know the purpose of these captchas. Thanks for those informations.

@mannyc6649

4 жыл бұрын

That is not actually the purpose, it's a nice by-product. The true purpose is to avoid certain kind of exploits that stem from automating some requests. E.g. in a ticket website I could buy all the tickets in the first millisecond by using a bot, and then re-sell them at higher price. Or with an email provider I can create a million email addresses all at once and use them as throwaway.

@justin.booth.

4 жыл бұрын

I think there was also an xkcd about that!

@TarasMazepa

4 жыл бұрын

@@mannyc6649 sad truth is that captchas are not stopping bots :(

@Some.username.idk.0

4 жыл бұрын

@@TarasMazepa but they are probably slowing the process

@tohfawalker159

4 жыл бұрын

There was a point where the bots were better at completing captures than humans.

Brilliant episode loved it! I really enjoyed how it really makes you think about what's going on around you but so amazingly how much is really happening just in our phones just as is its insane

Man, KZread has really been pushing this video to me for some reason. Even though I was interested, I started to intentionally ignore it just because of how hard KZread was pushing it and to see if it would just keep doing it or drop it, months later I decided to finally watch. This should be everyday tech, the uses are everywhere. The captcha tangent was very insightful--forced crowd sourced computer learning.

This is how I see all things all the time. A note from my own art journal, connections can allow for transformation and phaso modulation of the plane. The points are effected by tunnelations and tesslations.

I wish this technology had been available back when I was doing factory maintenance!

@victormuckleston

4 жыл бұрын

i always stick a long screwdriver on the part and the handle behind my ear on the bone, my not be scientific, but it gives you a gist on how worn something is.

@JC-qu4vu

4 жыл бұрын

@@victormuckleston thats pretty clever, ill take note of it

@YourLordMobius

3 жыл бұрын

I used to work in a factory with similar equipment to the machines shown in the video. Mills and pumps and pipes and such. Very interesting to see how much it moves.

The colour change thing with the pulse is pretty much how pulse oximetry works, granted it uses two different frequencies of light to measure the different absorption of the Haemoglobin more accurately but the pulse is still detected by the slight oscillation in colour as SpO2 fluctuates. Also that point about sampling at twice the frequency you are looking would be the application of Nyquist-Shannon Theorem you can reconstruct any sinusodal oscillation from discreet samples as long as the sample rate is at least 2f. My guess would be that for the factories this will mean you probably want twice the grid frequency at minimum as that is one frequency you are bound to find mains powered equipment vibrating at to some degree.

this is super cool just now finding out about this tech.

Your sense of fun is really worth gold!

That close up on "or is it?" around 7:15 made your eyes look like radiation area warning symbol. Had to double check and realize it's your lighting (3 lights). But now I keep seeing the radiation area warning symbol in your eyes. Maddening.

10:45 my first child was born almost 3 weeks ago. I have definitely done this exact thing. Luckily my son usually just snorts and then continues sleeping.

Another fun fact about those captchas: you may be wondering how if the computer doesn't know what the word or picture is, how does it know if you got it correct? Well that's because you're not the only person doing that captcha; there may be dozens or hundreds of people. It knows you're correct because you put in the same answer as the majority of other people who did it.

This is amazing, limitless potential!

I really like Mould's dry humor. "It isn't." "Or is it..?" *Stares uncomfortably at you*

@berturtle9251

3 жыл бұрын

That's a vsauce reference actually

@BertGrink

2 жыл бұрын

@@berturtle9251 It is indeed. BTW hi there fellow Bert 👋

@berturtle9251

2 жыл бұрын

@@BertGrink That's an AOT reference actually

I love this method of visualization. Now I am going to spend the rest of the night trying to think of new ways to see the data I work with.

This is one of the most fascinating videos I've seen in a while.

I learn so much from you man!

"OR IS IT!!!!!"

Absolutely love the video and as a filmmaker I really want to find a way to incorporate this into a film! This is very nit-picky, but I’m pretty sure camera sensors have four “sensors” or photosites per pixel. 1 red, 1 blue, and 2 green. This is because humans perceive green much more than red an blue, and it is also why camera sensors look greenish when you look at them directly. But again, love the video!

You could point a camera at a window and, from the vibrations of the glass, determine the sounds inside of the room. You would need a camera with a frames per second rate that was fast enough to detect movements at the frequency of sounds detectable by the human ear. This would come in handy in lots of situations.

@boomergames8094

6 ай бұрын

they do it with lasers

I remember the original research on this several years ago. They mentioned the baby monitoring application, as well as the observation of actors pulse on movies (they tested it on footage with Christian Bale). I remember I had to download a trial of Matlab just to test it out. Glad to see it wasn’t abandoned, since it was great research at the time, and continues to date.

1:33 - Interestingly, it's (usually) one or four sensors per pixel depending on what you count as a pixel, since most cameras use a Bayer filter on their sensors meaning you get two green subpixels, and one green and one red subpixel. Camera manufacturers usually quote the resolution of the sensor lying under the filter, so the full-resolution image is derived from the filtered image, which yields a final image with the effective resolution of a filter-less camera sensor about 0.7x (1/√2) the resolution.

Amazing video Steve! thanks for doing it! very bad grout at 03:24 is all cracked, all the system (asset - frame - grout - concrete) should be connected for a good vibration damping.

TIL, and wow this technology is fascinating, in the ballpark with schlieren imaging etc... Moreover, the meta point about how intuitive visualizations convey information to our brains usefully and persuasively - this is soo underratedly deep stuff!

I remember seeing a video about this technique a few years ago focused on the medical applications. Glad to see it is being put to use. I know a few water pumps that could use a scan.

"Steerable pyramid" actually is defined in a section of the wikipedia article "Pyramid (image processing)": en.wikipedia.org/wiki/Pyramid_(image_processing)#Steerable_pyramid A pyramid in this sense refers to a certain kind of 2-dimensional image filter which extracts multi-scale information from an image. A steerable pyramid is a pyramid filter that depends on setting a preferred orientation within the image, where the orientation can be changed within the filter as it processes various levels of the image. It seems fair to say, as Steve did, that a lot of time has to be invested in learning the language and techniques of today's image processing techniques.

I could listen to Steve talk about things all day. I don't even skip the sponsor segments 😅

amazing tech, thanks for the video.

This is incredibly useful for mountain search and rescue. Even if someone is unconscious you'll be able to see their breathing against a steady background