No video

🧠 Mind-Reading Stable Diffusion Paper

A walkthrough of a recent research paper which had participants view images, and then reconstructed those images using Stable Diffusion and fMRI readings of the participants brains. This was made possible by excellent work from the Neural Scenes Dataset Team.
======= Links =======
High-resolution image reconstruction with latent diffusion models from human brain activity: www.biorxiv.org/content/10.11...
Neural Scenes Dataset: naturalscenesdataset.org/
Good intro to Neural Scenes Dataset: • 2021-02-11 Kendrick Kay
Yatharth's twitter: / reporterweather (get on it)
A nice diagram: / the_stable_diffusion_m...
======= Music =======
Music from freetousemusic.com
‘Butter’ by LuKremBo: • lukrembo - butter (roy...
‘Affogato’ by LuKremBo: • lukrembo - affogato (r...

Пікірлер: 45

  • @roman-tdv
    @roman-tdv Жыл бұрын

    In 5 years, we'll be able to watch our own dreams as if they're movies. Besides all the stuff that will be possible with this technology.

  • @mariokotlar303
    @mariokotlar303 Жыл бұрын

    Freaking insane! Not only does this prove it's going to be possible to control stable diffusion by literally imagining, but it also implies we'll be able to record and watch our dreams.

  • @EddieAdolf

    @EddieAdolf

    Жыл бұрын

    Good luck with your NeuroLink BCI surgery!

  • @danfroal8057
    @danfroal8057 Жыл бұрын

    Awesome vid. "Still frame from Full Metal Alchemist" made me cry tho.

  • @msampson3d
    @msampson3d Жыл бұрын

    Really happy to see you cover this one! When I saw the news I was super skeptical, figuring there was some major gotcha they were cheating with to get such good results. For example I was positive they would have been feeding the text description to the model and only using the brain scan for the latent noise portion. To see it explained and learn that this wasn't the case truly is impressive! Thanks once again for providing an entertaining and informative vid on a fascinating topic!

  • @YVZSTUDIOS
    @YVZSTUDIOS Жыл бұрын

    Oh boi remember when this technology was in his infancy when someone claimed to do this with dreams and he had a very similar looking fold out 2d map of the brain 🧠 But the tech just wasn't there yet to produce images well

  • @zaadworks
    @zaadworks Жыл бұрын

    I always thought of Stable Diffusion like this, the latent space steps looks like when you close your eyes and there's just noise on your mind... Mind blowing

  • @user-pc7ef5sb6x

    @user-pc7ef5sb6x

    Жыл бұрын

    this is why ai images look like images from your dreams.

  • @Qubot
    @Qubot Жыл бұрын

    Now invert the process and give vision to blind people.

  • @lewingtonn

    @lewingtonn

    Жыл бұрын

    wait what? hahaha I don't think that's what this research is about

  • @ludgi1

    @ludgi1

    Жыл бұрын

    Holy smoke, never thought about that. One step closer to Matrix simulation

  • @kingpin4152

    @kingpin4152

    Жыл бұрын

    ​@koiboi if you would put the model inside the brain connected to the right parts of the brain Idk why it shouldn't work. (I am no brain expert tho)

  • @Qubot

    @Qubot

    Жыл бұрын

    @@kingpin4152 The optical nerve maybe ? Just guessing, i am a dumb compared to those genious researchers

  • @lucamatteobarbieri2493

    @lucamatteobarbieri2493

    Жыл бұрын

    The problem is that there is no way to activate specific cortical areas without electrodes. Brain surgery to insert electrodes is dangerous and electrodes dont integrate well into the brain for long times. It is possible to do in principle but very invasive. Fmri just reads indirectly oxygen consomption in brain voxels. Also keep in mind that some blind people have damaged visual cortices and perfect eyes, so not every blind person would be suitable. But still a possible outcome in the long run.

  • @takif8756
    @takif8756 Жыл бұрын

    Thanks for the video, a bit harder to understand whats going on with this one! :)

  • @vickanis2234
    @vickanis2234 Жыл бұрын

    you have so many good vids explaining concepts, when will you do one on the basics about how the base stable diffusion actually works for beginners.

  • @magejoshplays
    @magejoshplays Жыл бұрын

    Imagine training a model to use that reverse prediction method to substitute the human in RLHF so that linear model setup would be self training the base model with every creation it makes as an extension for stable diffusion.

  • @hakuhyo174
    @hakuhyo174 Жыл бұрын

    Imagine predictor of text embedding and latent given MRI image is not linear but specifically crafted model with billions of parameters 😳

  • @lucabonomo241
    @lucabonomo241 Жыл бұрын

    Hi man, can i ask you if does it possible exist a super computer that decoding the mind as we thinking? What signifique predict, decodind and see the mind ? So, i will grate for answer!!! Thanks again Cheers😮

  • @yomaze2009
    @yomaze2009 Жыл бұрын

    This is nuckin futs! Imagine if neuroscientists could use this to find out if you have brain damage.

  • @MilesBellas
    @MilesBellas Жыл бұрын

    point-e next ?

  • @MilesBellas
    @MilesBellas Жыл бұрын

    Team Emad

  • @alterego1509
    @alterego1509 Жыл бұрын

    time to wear a colander hat .. for real

  • @lewingtonn

    @lewingtonn

    Жыл бұрын

    Like I needed an excuse

  • @lupinsensei7456
    @lupinsensei7456 Жыл бұрын

    All great, but that is not a screenshot from FMA, it's from One piece.

  • @Laszer271
    @Laszer271 Жыл бұрын

    I'm impressed about doing brain activity to image mapping. However, image to brain activity mapping is overrated imho. Showing results that are better than random shows nothing. I bet you could train a pigeon to predict some voxels with accuracy that is better than random. Check, even if you predict all voxels randomly, there is a high possibility that you will still get some outliers that will show as "significantly better than random" from the statistical test. That's because of the sheer number of those voxels you are predicting. Btw there was a study about training an ensemble of pigeons to predict cancer from a photo and they had pretty good results, better than the average doctor. So training pigeons is actually not as stupid as it may sound :P

  • @lewingtonn

    @lewingtonn

    Жыл бұрын

    Bahahaha thats so goood: www.google.com/amp/s/www.bbc.com/news/science-environment-34878151.amp

  • @lucamatteobarbieri2493

    @lucamatteobarbieri2493

    Жыл бұрын

    birds are smarter than you think

  • @KingTI192
    @KingTI192 Жыл бұрын

    They can read your thoughts in real time. This is nothing new

  • @RikkTheGaijin
    @RikkTheGaijin Жыл бұрын

    You look exactly like my childhood family doctor. make of that what you will.

  • @lewingtonn

    @lewingtonn

    Жыл бұрын

    Oh yeah, I also wanted to tell you: you have measles

  • @RikkTheGaijin

    @RikkTheGaijin

    Жыл бұрын

    @@lewingtonn I thought I had ligma

  • @HB-kl5ik

    @HB-kl5ik

    Жыл бұрын

    ​@@RikkTheGaijin ligma balls

  • @amiththomas3884

    @amiththomas3884

    Жыл бұрын

    @@RikkTheGaijin LIGMA ? HMMMM WHAT'S THAT ?

  • @janerikjakstein
    @janerikjakstein Жыл бұрын

    This tech is crazy! Can they read my thoughts now?

  • @BobaFit

    @BobaFit

    Жыл бұрын

    😂 Haha, don't worry! While this tech is indeed crazy, it's not quite at the level of reading minds... yet! So, for now, your thoughts are safe, and you can continue plotting world domination in peace! 😜🌍🔒

  • @optimoos
    @optimoos Жыл бұрын

  • @lewingtonn

    @lewingtonn

    Жыл бұрын

    \(º □ º l