No video

Sparse Sensor Placement Optimization for Reconstruction

This video discusses the important problem of how to select the fewest and most informative sensors to estimate a high-dimensional data set. I will discuss the algorithm and give several examples from control theory, to insect flight, to manufacturing.
Book Website: databookuw.com
Book PDF: databookuw.com/databook.pdf
These lectures follow Chapter 3 from:
"Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control" by Brunton and Kutz
Amazon: www.amazon.com/Data-Driven-Sc...
Brunton Website: eigensteve.com
This video was produced at the University of Washington

Пікірлер: 42

  • @ralphie76239
    @ralphie762394 жыл бұрын

    ​ Hi Steve. Slightly different comment than Roger. Many (all?) of your sparsity/sensor/compression videos in the Linear Algebra playlist are "Unlisted". They do not appear in your KZread "Home" tab, nor if I go thru everything in the "Videos" tab. Nor if I do a search on your KZread page will they appear. So, the only way I even came across them (including this one) was because they are in the Linear Algebra playlist. I just thought I'd point it out in case this was an error. The view counts on them are very low because of this and it's great content so people are missing out! (specifically, it's video #s 70-77 and 86-88 in the Linear Algebra playlist) Thanks for all the amazing content, I am learning so much. Just bought your book!

  • @Alexander-ye5hv
    @Alexander-ye5hv3 жыл бұрын

    Amazing lecture and super interesting topic! Always a pleasure watching these videos, Steve.

  • @Eigensteve

    @Eigensteve

    3 жыл бұрын

    Thanks so much!

  • @benjamindeworsop8348
    @benjamindeworsop83483 жыл бұрын

    Brilliant video, really interesting and well explained

  • @AleeEnt863
    @AleeEnt8632 жыл бұрын

    Very clear as crystal! High-quality presenation...

  • @Mutual_Information
    @Mutual_Information3 жыл бұрын

    Excellent recap summary of the vid at 13:16. I think more technical explanations should include a helicopter view like that at the end.

  • @GigaMarou
    @GigaMarou3 жыл бұрын

    Thank you Steve!!!

  • @hamidrezamoazzami
    @hamidrezamoazzami2 жыл бұрын

    Thank you very much for your great lecture. Could you please explain a bit how Si_r matrix is calculated using the training data?

  • @Julianerdoedy
    @Julianerdoedy Жыл бұрын

    just beautiful!

  • @user-qn1bq5ji5w
    @user-qn1bq5ji5w9 ай бұрын

    Thank you! These amazing videos helped me a lot!

  • @Eigensteve

    @Eigensteve

    8 ай бұрын

    Glad they have been helpful!

  • @TheCptEd
    @TheCptEd2 жыл бұрын

    Phenomenal work

  • @DerekWoolverton
    @DerekWoolverton3 жыл бұрын

    This seems like it could also be used in remote sensing, where over time pixels are lost from the satellite, and historically they were just pasted over by interpolating the pixels still working on either side. Training the data on previous images from the region being sensed would provide a better way to restore the lost components, or provide a indication of how serious the lost elements are (if they appear as pivot rows).

  • @jeroenritmeester73
    @jeroenritmeester733 жыл бұрын

    I think it is has been beneficial to the field that targeted sensing came after generalised compressed sensing. It feels like the field has first discovered a general concept and went narrower from there, as opposed to having to generalise a narrow technique. Thoughts?

  • @keving.7871
    @keving.78712 жыл бұрын

    The principle behind that compressing of information is very simple and brilliant. I understand it as an adaption of principal component analysis in statistics. You often uses images as examples. But what if we have a dynamical system like a production line, which depends on the evolving time. How can I use the method when xt with t=0,…,n is given and not only x?

  • @jerolsoibam8724
    @jerolsoibam8724 Жыл бұрын

    Hi Prof. Steve, Thank you for sharing such an amazing content. It is always fascinating to see the amount of energy you put in these videos, and I really enjoy learning from it. I wanted to ask a question regarding the minimization condition (theta). I understand the concept of generating data to create a library of flow field (psi r ), I also get the part of QR factorisation to get the sensor location C , then measuring the values at the C location to create y. But then you stated around 14:00 time stamp that we also know the value of theta (minimization condition). My question is how do we know this value so we can find a?

  • @chanochbaranes6002
    @chanochbaranes60023 жыл бұрын

    Hi Steve I watched your videos for some time and loved them. I wanted to ask you something, what you recommend a second degree in data science or electrical engineering?.

  • @Gkvhkbt
    @Gkvhkbt3 жыл бұрын

    Hi! Can you show a simulation(video) where is trying to classify diffrent images of different classes. I have been trying this with GNU Octave and this method did not work for me.

  • @prasannaiyer1674
    @prasannaiyer16742 жыл бұрын

    Is psi U or V from the SVD? Thanks for the great content

  • @prasannaiyer1674
    @prasannaiyer16742 жыл бұрын

    Since U shows measurements and principal components, V shows principal components and original features, it is not clear why/how QR of U gives the shortlist of sensor placement. Any clarification would be appreciated.

  • @dhruvpatel4948
    @dhruvpatel49483 жыл бұрын

    Hi! Thanks for sharing this. I’m curious to know your views about connection of this to optimal experimental design?

  • @yd_

    @yd_

    3 жыл бұрын

    Second this. Great video!

  • @evanparshall1323
    @evanparshall13232 жыл бұрын

    Could somebody point me in the direction of why the pivoted QR factorization minimizes the condition number. I can't find any source that says that.

  • @maurinejacot8372
    @maurinejacot83722 жыл бұрын

    Hello, thank you for the amazing video ! The methodology seems very powerful. I just have a question about the Phi*Phi^t, used when the number of sensors is bigger than modes. Why did you use Phi*Phi^t and what are the change on the R matrix ? Because we only found that the diagonaux elements relating to the number of modes considered are bigger than those after. Thank you in advance for you return. Maurine

  • @maurinejacot8372

    @maurinejacot8372

    2 жыл бұрын

    diagonal elements

  • @phaZZi6461
    @phaZZi64613 жыл бұрын

    12:20 for the short summary

  • @d7ffab979
    @d7ffab979 Жыл бұрын

    Does that not mean that in graphics engine, they could like 5x their performance by rendering random points only, like 20% and then upscaling that with compressed sensing?

  • @ahmedcelik5448
    @ahmedcelik54482 жыл бұрын

    Thank you for the presentation. What if our data matrix short and fat and instead of tall and skinny. Does QR apply in that case?

  • @Eigensteve

    @Eigensteve

    2 жыл бұрын

    Good question. In this case, you can either just use the first "r" QR pivot points, or you can transpose the matrix, depending on the interpretation of the rows and columns.

  • @ahmedcelik5448

    @ahmedcelik5448

    2 жыл бұрын

    @@Eigensteve thanks

  • @alegian7934
    @alegian79343 жыл бұрын

    "If you do know what type of *sister* you're measuring..." lol made me giggle

  • @ainmiky4620
    @ainmiky46204 жыл бұрын

    Hi some of your videos on this playlist are on private.....

  • @Eigensteve

    @Eigensteve

    4 жыл бұрын

    They are released on a schedule. Stay tuned!

  • @abdjahdoiahdoai

    @abdjahdoiahdoai

    3 жыл бұрын

    which playlist is this from?

  • @innidynamics7510

    @innidynamics7510

    2 жыл бұрын

    @@abdjahdoiahdoai Sparsity and Compression

  • @gmoney6829
    @gmoney68293 жыл бұрын

    How long does this take you to edit

  • @Eigensteve

    @Eigensteve

    3 жыл бұрын

    Great question! It usually takes me about 5-10 minutes to make the intro 5 second clip and align the audio, touch up picture, etc., and then it processes on my laptop for 30min.

  • @gmoney6829

    @gmoney6829

    3 жыл бұрын

    Aah

  • @Veptis
    @Veptis2 жыл бұрын

    Isn't this a really hard combinatory problem? I mean you essentially want a vector mask C that is optical for chosing k points of a big vector of size n. And you use those k number of measurements, multiply them by k eigenvalues and hope the sum is as close to n as possible. Wouldn't this just mean you have n chose k options for said mask? And your approach is to take the most weighted point from every single eigenvalue and that results in your mask? I have to see some of the older lectures or sleep a day first to understand the mathematics of those QR matrix optimization.

  • @THIRAWAT-lo5kc
    @THIRAWAT-lo5kc3 жыл бұрын

    What pen are you using in this video->kzread.info/dash/bejne/pWZ_k6yffrWdg8Y.html Can you lead me? thank you very much

  • @bocckoka
    @bocckoka2 жыл бұрын

    Every language you would ever program in... *drumroll* MATLAB. Yeah.

  • @xlarity675
    @xlarity6753 жыл бұрын

    Hi Professor , I'm inspired by this idea and would like to try extending it beyond 2d images. But first of all, I need to get the EigenFace example running. I went to the book link for the Eigenface dataset, but the data format are different and there is no "allFaces.mat" directly available, which is used by the code example in the book. I searched in the book, but there is no instructions on how to make this "".mat" file. I could probably try to create this "allFaces.mat" with my own understanding of how this file is structured, but it would be much more convenient if you can provide it directly for the readers. Thanks!