Could be a lot of applications in video games, with controllable simulations and all.

@ET_AYY_LMAO

Ай бұрын

Not really, this doesn't work on simulations but pre baked animations.

@monawoka97

Ай бұрын

Bit difficult given the requirement for a fixed viewpoint. I reckon it's more useful in film, EG a realistic looking building collapse that just happens to avoid any debri landing on the protag.

@ET_AYY_LMAO

Ай бұрын

@@monawoka97 Not even that, it effectively doesn't change the animation, it just swaps around objects / materials at a convenient time where objects are overlapping or colliding and thus can be used for a slight of hand. Its a cool technique, but not exactly useful or groundbreaking. I think I need to read the paper to seriously understand the excitement, maybe there is some cool tricks regarding occlusion and parallelism of the problem solving..

@begobolehsjwjangan2359

Ай бұрын

no more ragdoll dead body in GTA

@Virsconte

Ай бұрын

Yeah, unfortunately it feels like the most useful application there would be manipulating player psychology, for instance with loot box mechanics.

The reverse engineered physical simulation to match a sound sample is the real magic.

I forgot that this is a papers channel and not an AI channel, great to see things outside that space once in a while.

@thedofflin

Ай бұрын

It's good to see a complete and reliable new technology, which can't be said for a lot of AI stuff which gets a bit exhausting

@sean748

Ай бұрын

Give me some rendering and light transport content 😭

@ChristopheLeyder

23 күн бұрын

This the content that made the channel popular to begin with, the AI stuff become quite tiresome honestly.

I honestly love that this isnt AI, sure AI is cool and impressive, but there is something artisanal about just using "normal" math to achieve this effect.

@animation-recapped

Ай бұрын

AI is normal Math

@Vorexia

Ай бұрын

@@animation-recapped You know exactly what they meant lol, no need to get pedantic over this

@jorgezombie78

Ай бұрын

How do you think a.i. is made, chemistry? It's pure "normal" math too. Why is everyone afraid of a tool?

@AlanMitchellAustralia

Ай бұрын

​@@jorgezombie78Not afraid, but it's much easier to reverse engineer and debug "normal" code to understand why a decision is made (with neural networks, it is almost impossible). This implied certainty of "artisinal" systems gives them significant weight over AI in this respect

@animation-recapped

Ай бұрын

@@Vorexia to be quite frank I don’t know what he means. He is completely wrong for assuming any type of AI development doesn’t have basic fundamental math. Would you mind explaining to me what he means because I’m lost lol

This will honestly be great for animators who want realistic physics but also want control over certain keyframes

@AurrenTV

Ай бұрын

Except not really because the technique is entirely smoke and mirrors. It uses camera occlusion to replace things with other things. In the case of the balls it's just using the motion blur to do it and is really obvious if you look frame by frame.

@jamesc5801

Ай бұрын

If the illusion works, it wouldn't matter

@catsnorkel

Ай бұрын

@@AurrenTV and why do you think that wouldn't be useful to animators? A scaled down version of this has been used by animators for decades.

@kawag2780

29 күн бұрын

@@AurrenTV For the non-animator audience who won't be frame peaking it is good enough.

@jimmy9607

18 күн бұрын

If it’s not realtime, you just bake the physics and color the balls on the last keyframe. That’s a very old trick. I was confused until he got to the point.

~"All of these techniques are completely handcrafted. No AI anywhere. This is powered by pure human ingenuity. WHAT A TIME TO BE ALIVE!" Thats a sentence I never thought I would hear on this channel about two years ago. How times have changed

@MajorGunner

Ай бұрын

7:36

@theneonbop

Ай бұрын

I remember him saying this a few years ago.

@kwullums

Ай бұрын

i felt that "What a time to be alive"! So nice to sub to a channel excited about this stuff

@thelelanatorlol3978

15 күн бұрын

You guys realize he feels the same regardless of whether it's AI or handcrafted? It's all cool tech to get excited over.

When I first saw the simulations I thought that the physics was being slightly altered in an unnoticable way, but upon hearing that it's just changing the apperance of objects I was amazed. For an algorithm which just changes appearances when it's hard to see, I'm not suprised it runs almost in real time without much effort.

@dairin0d

Ай бұрын

I actually came across a paper some years ago which was doing exactly that -- I think they were subtly tweaking the forces over the entire physics simulation to get to the desired state, though, naturally, their method wasn't quite as fast as this (it performed some sort of search over the possible evolutions of the simulation). I can't remember the title of that paper, unfortunately.

@IceMetalPunk

Ай бұрын

It's the appearance *and* the paths.

@sollybunn

Ай бұрын

@@IceMetalPunk ", instead of using motion control to estimate plausible motions for objects with fixed appearances, it can be more efficient to estimate plausible appearances for objects with fixed motions. Consequently, our method, ViCMA (Visual Control of Multibody Animations), is simple and practical. It carries out no complicated optimization or sampling, and, in fact, it only requires the animation trajectory to be generated once. The cost of applying the remainder of the algorithm is negligible." - research.nvidia.com/labs/prl/vicma/2023ViCMA.pdf

@sollybunn

Ай бұрын

​@@IceMetalPunk "instead of using motion control to estimate plausible motions for objects with fixed appearances, it can be more efficient to estimate plausible appearances for objects with fixed motions." - the paper. Also the paper name ViCMA (*Visual* Control of Multibody Animations)

Casino owners are like: WRITE THAT DOWN, WRITE THAT DOWN! 😀🤣🤣🤣🤣🤣🤣🤣🤣

@hians8734

20 күн бұрын

Gacha game: Yes YEs YEs

Nice to see a non AI episode ... for a change...

@zestyorangez

Ай бұрын

brings me back to what the channel was like 4-5 years ago

0:40 me explaining how my algorithm works

@Rybz

Ай бұрын

😭😭😭

Just 5 more years and Iwill buy a Graphics card lolol

@RandomGuy-nm6bm

Ай бұрын

relatable

@st20332

Ай бұрын

Come on software optimisation phase of tech, let's make the best of what we have through ingenious tricks and whatnots pls, not just simply brute forcing performance with hardware optimisation and "more and smaller", but I suppose software updates aren't as profitable, so who knows what the speed will go at

You sir had me reading papers. It is really inspiring seeing these implementations. I saw the other day a video of the guy who created ipAdapter by implementing someone's else papers. What a time to be alive!!!!!

@and_I_am_Life_the_fixer_of_all

Ай бұрын

This is probably one of the most fun things I get to do, read papers and see what can I create with them

The Hitchhiker's Infinite Improbability Drive😄. And it would be even more crazy if the pink balls ended at the top.

@wrOngplan3t

Ай бұрын

😄🤣

two years ago your content inspired me to go to computer Science. Thank you!

Glad to see some non AI content.

I am glad, that NV knows, that artist need not just beauty, but artistic control over it. I know how to do such trick end-to-end, but here is a new way, i suppose. The trick is: 1. drop cards randomly. 2. swtich sides for end positions to form text 3. switch sides for start positions to form text 4. if end state and start state do not match, switch state in the middle. So now i will look what NV made.

@bzikarius

Ай бұрын

Okay, so nv did not invent anything new as idea. But the mechanic is tailored well.

This is super interesting with the obvious limitation that it forces a preferred visual frame with occlusion rendering.

At 2:11 one can see the magic at work as around 28 balls (from right to left) a pink one on the third row up changes from pink to lavender.

Good to see you nack with papers related to 3d Graphics, between the mayhem of AI Muckery

This is how online gambling sites work

@anteshell

Ай бұрын

It's not. They don't cheat with visible visualisations. They cheat in the background where it cannot be detected in any way. This kind of animations can be pixel peeped rather easily to detect the cheating, which is not something they'd want.

@getsideways7257

Ай бұрын

@@anteshell That's obvious. Still, you can't help but think of those right away...

@getsideways7257

Ай бұрын

Also elections

@anteshell

Ай бұрын

@@getsideways7257 Also not in elections. Votes are not counted based on computer simulations, much less on fixed animations such as seen in this video.

@voidkid420

Ай бұрын

Really doesn't and anteshell is also wrong. Online gambling is massively regulated with every single game being subject to audit etc If we say there's a 95.01% return and after millions of games it turns out to be just 95% we would get fined ... so no one's giving up billions in profit to steal your $1

I went through the same process as when dumbfounded by a magic trick. First is awe ("Oh, coool!"), then confusion ("wait a minute... How?"), then anger ("How THE HECK is this doneee???"), then enlightenment ("Ohhhh, ok, that makes a lot of sense") to finally back to awe. It's such a simple concept but with really interesting implications and applications.

Those dice were all loaded - opposite faces should add up to 7!🤔😀

Thank you for introducing these interesting researches as always, sir!

The minute I watched this I remember I did this exact same trick in After effects years ago. That was inspired by when I was at school doing calculus. Whenever I was stuck I would work backwards from the answer and just stitched to where I was stuck and hope they middle jump wasn’t noticeable:)

@1:40 YES! XD Thank you Dr. Amazing as usual!

I'd love to see an expansion on this where they figure out how to measure the degree of visibility or alteration which is necessary for certain tricks to be pulled off. This is impressive but imagine how much more impressive it could get if we approach the limit of believability instead of hugely overcompensating.

@federicocaputo9966

Ай бұрын

If using a camera, figuring out if something is visible has been solved for quite a while. Most computing programs do not draw certain elements to save performance. For the balls, I think they just calculate the points of highest velocity, acceleration and or jerk to choose when to perform the swap

Man I love how they figured out how the sound looked like. I am quite blind, because I can never see sound sadly

I knew I'd seen you talk about these simulations before. I just didn't remember it had been such a long time ago...

Holy crap!! This plus time travel can change everything!! Perfection awaits!

felt like something was off in the movement, couldn't pinpoint exactly what it was though. it's like ai interpolation when you don't slow it down

Does it bug anyone else that the dice pips aren't on the right sides?

You should do a video on the RandNLA/RandBLAS paper. It's new algorithms that can do fundamental linear algebra on huge matrices 1000x faster on paper, (closer to 20x in practice but 20x faster is still insane). Things like least squares, for example. The basic idea is that for certain computations you can get an arbitrarily close approximation to the real answer by doing the math on a much smaller matrix made of a random subset of elements from the original matrix, instead of computing the whole thing. So they trade exactness for speed, and notably the tradeoff is configurable so you can tune it to be "good enough" for your specific application.

Our simulations have been so successful we've lapped reality and come back out the other side.

I'm working on a game with a forced camera angle, could make for some amazing results!

That would be awesome if implemented on simulations created in After Effects, Cinema 4D and similar special effects softwares. As this would mean having much more control over the outcome of some of the simulated effects.

If you slow down the video to 0.25 speed at 1:06 you can see that a few of the balls change colour to match the placement. The ball in the centre right turns from blue to pink.

Controlable laplace's demon, damn.

I was really hoping that this was trying to exploit chaotic system. Like, there is a near infinite many ways cards could fall and arrange themselves on the ground, and so one of those possibilities is likely close to our desired image. So I was hoping that instead of simulating physics, it would "tweak" physics so that the desired outcome was guaranteed to happen, while remaining as visually consistent as possible to a person. That would be insane.

Is this similar tech to the one used by nvidia based on the earth clone model to predict the weather? Would this mean the closer our model to reality, the closer we are to predicting the future?

there is a verry easy way to achieve this: just by baking the simulation and apply the texture after

I saw some people on yt doing stuff like that in their simulations. YT short from Pezzza's Work channel is in my head when i look at this 😊

Was I the only one who immediately saw the pachinko balls changing color mid-bounce? I know that the visibility function is never favorable in a sim where everything is visible all the time, but the color changes happening during motion blur turned them into multicolor streaks!

This technique has been seen by many more than 100 people now! Thank you!

I don't get it, though... there's already a simple way to do this, run the simulation once with the balls, then when they're at the end state, set their colors to look like whatever you want the end to look like. Then 'rewind' and run the simulation again (with the 'new' colors in place) and it occurs without any magic, a valid simulation that will reliably produce the end result I guess it'd get slightly more complicated with something like the dice, but doesn't seem worth making all this to solve it...

this is basically simulating Poincare recurrence time^^

There's a flaw in the logic of the system. Specifically, when the dice fall (at 2:05, for example), the system is seemingly told to take advantage of occlusion to change the top face of the die to a six and make sure that no non-top face displays a six. The flaw is that the face opposite the six on a die is a one. So we shouldn't be able to see any ones if we can see the six on the same die...but we do.

I was able to spot the changes in colord in the pachinko ball simulation. I am sure others did as well. It is still a good trick, but not imperceptible

@anto_fire8534

Ай бұрын

yeah i also did. went back, put it in 0.25 and just saw balls changing colors if they were too far away to were they should have been.

I really love the handcrafted papers. AI is all great but we also need new algorithms we can really control not black boxes that do something

6:46 - Holy shit!

Ok now we need a new round of trickshot context from Corridor Crew (An animator try to simulate a trickshot faster than another guy doing it for real)

didn't realise that poker involved dice. what a time to be alive!

Oh, wow, I was expecting this to just be some improvement over that, uh, what was it called? Differentialble Simulations? That one from a while ago where the manipulated the rounding errrors and stuff to subtly steer a simulation towards a desired result, stirring two liquids into an image or doing trick-shots with bouncing objects and stuff like that.

The small music video made me LOL

I love youre videos man!

@TwoMinutePapers

Ай бұрын

You are too kind, thank you so much! 🙌📜

what if this is how quantum particles work in a unit to create reality

I never would have guess they literally cheat during simulation. I would have expected the simply do some reverse physics or something. Setup the final condition and find the initial condition to reach it.

Watching this and I thought about special effect companies being able to finally control a simulation without just having to hope that the next generation looks better

621 balls and 621 bunnies? Oh my what a stimulating simulation indeed.

@ideallyyours

Ай бұрын

9 * 69, yes.

You don't need AI for this; you can simply write some code that changes the object's color, texture, or look in some way as soon as it touches the ground to achieve the same effect.

2:10 watched on 25% speed and the purple balls that get left befind turn blue at some point.. so yeah, they don't make sudden "moves" but they do gradually colorshift.. magic!

I can do that too but with deterministic math, no AI or recoloring needed

I seriously thought the trick was taking a start and end, then generating plausible frames in-between them until complete, sort of like how stable diffusion works with noise.

It's good to see that classic simulation papers haven't been entirely eaten by AI.

When he said he watched specific balls closely, I thought he was saying there were no replacement shenanigans. And the video of the simulated vehicle also made me think it could help the simulated vehicle go from point A to point B. But now I'm disappointed. I thought this was going to be a crazy physics simulations that took the beginning and end state and generated in-between states and worked backwards and forwards deciding chaotic variables like bounce direction and wind as is went, something no human would be able to tell is changing. And the technique was going to be some powerful algorithm that did this trial and error more efficiently than past methods. Like the next best thing after an infinite improbability drive. Now that would be amazing.

it's crazy how this paper got such few views

Someone just invented the final destination for AI agents 🤣

Wait wait, the one where they input sounds and it outputs a video is NOT AI?

2:07 Why is the 1 next to the 6 on the dice :D They should be on opposite sides.

@DougLJames

Ай бұрын

C'mon Dave!! 😂

Cool.. but what is the use case? In what application would this be useful?

@epiicSpooky

Ай бұрын

Motion graphics

Master of entropy!

5:09 That's my favorite job interview discussion. When asked by a big company, how many programmers can we throw at this project, to get it done faster. My answer, 'It doesn't take 9 women 1 month to have a baby. It takes one woman nine months.'

@begobolehsjwjangan2359

Ай бұрын

it takes 9 men to get a woman pregnant faster. more men more probability.

@catsnorkel

Ай бұрын

just try explaining that to MBA bros

Peppers? WE DONT HAVE ANY PEPPERS!

5:15 lol

This algorithm was created just to stress Captain Dissillusion out

everytime i read nvidia somewhere, i ask myself if it is patented somehow

I thought this worked without cheating. Just considering every possible outcome in a random experiment and computing exactly the possibility that leads to the outcome we want.

Im confused, you can do this already with simulation programs?

@Guassian

28 күн бұрын

Nvm that sound thing was insane

I think I have seen the ball switching colors in an ad

Fated simulations

Hiding in occlusion and chaos, so if a tree falls where nobody's around, it indeed didn't make a sound and perhaps even never happened

Casino: The trick I've been using is why it was revealed.

So fantasy/sci-fi media/games/shows could finally fix the giant cgi turtle textures in rising of shield hero. The cgi degraded by two decades when the turtle was in the scene.

Sounds familiar. Didn't someone already did a simulation where things can go in any direction if they are not observed?

Now scientists can get the outcome right of every experiment!

What a time to be AI!

@ET_AYY_LMAO

Ай бұрын

Honestly it almost seems like this video is totally AI generated. The script is way to excited considering what the whitepaper actually contains in terms of knowledge and useful systems. Basically just a handful of expressions for identifying suitable places to swap around the balls, and sure as soon as you have pre-baked this "score" for your pre-baked animation it is very easy to change the end result without doing a lot of calculations... To me it seems like both the script and the voice is AI generated on this channel these days.

Except that the dots on the die don't match reality. Opposite die faces, added up, equal seven. 6-1, 5-2, 4-3, etc. Opposite a six, the face carries a one. But I saw a one on a face ninety degrees from a six, so I at least know they aren't faithfully accurate dice.

I can see a new online casinos with "controlable simulations" not rigged at all.

I don't fall for the "I guess it takes hours and hours" anymore 😂

"With responsible AI built in." GFY GFY GFY

Got really disapointed when you essentially said the simulation was a lie. The sound thing is actually useful though.

Very impressive and even better that this doesn't use AI. +1 for human ingenuity.

Corridor Crew needs to use this on their next digital vs physical challenge!

I wonder how Penn Gillette would feel about all this.

captivating

what an incredible video!

The online casino will be very proud

camera wire tapping intensifies

Never going to a casino again

Finally some algorithms

What a time to be alive!