Autoencoders Explained Easily

Ғылым және технология

Join The Sound Of AI Slack community:
kzread.info?even...
Learn how autoencoders work in an intuitive way. Learn about representation learning, latent space, and other fundamental concepts. I also explain how autoencoders are applied to important tasks such as data generation and denoising.
Slides:
github.com/musikalkemist/gene...
Interested in hiring me as a consultant/freelancer?
valeriovelardo.com/
Follow Valerio on Facebook:
/ thesoundofai
Connect with Valerio on Linkedin:
/ valeriovelardo
Follow Valerio on Twitter:
/ musikalkemist
===============================
Context
0:00 Intro
1:17 Key idea in autoencoders
3:03 Encoder
4:15 PCA vs Encoders
7:05 Decoder
8:21 Training autoencoders
10:13 Optimal autoencoder
12:57 Deep Autoencoder
14:11 Deep Convolutional Autoencoder
16:15 What's the point of compression/decompression?
17:12 Autoencoder applications
17:51 Generation with autoencoders
22:29 Denoising with autoencoders
26:06 Anomaly detection with autoencoders
26:39 Coming next

Пікірлер: 79

  • @KillKRT
    @KillKRTАй бұрын

    Eventually, after 6 useless videos on this topic, I found this one that clearly explains why, what and how autoencoders are doing! Great video! Bravo Valerio!

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    Ай бұрын

    Thanks!

  • @dhruvmatani7824
    @dhruvmatani7824 Жыл бұрын

    Valerio thanks so much for putting together such great content and providing insights into Machine Learning concepts!

  • @mejimix
    @mejimix6 ай бұрын

    This channel is gold!. It really helps to understand Ai, and its "convoluted" topics. The terminology really confuses me, but you manage to explain it in a very simple way. Watched 3 videos already ... more to go!

  • @avidreader100
    @avidreader1003 жыл бұрын

    I am reminded of my boss asking for a 10 page report, and then asking for a 1 page summary. After some deliberation, he would again ask for expanding the summary to a 3 or 4 page report. What would happen is the important elements would get picked when we reduce and these would be elaborated when we expand again. Intuitively one catch would be the error should not be minimized to a very low value. Perhaps we would call that over fitting. The balance may be in how high is the correlation retention relative to data reduction.

  • @omidstudies2926
    @omidstudies2926 Жыл бұрын

    Thanks for the great presentation that does not make the subject so complex and keep it as simple as possible.

  • @cafardine
    @cafardine Жыл бұрын

    Well done. Great explanations without being oversimplified

  • @tunestar
    @tunestar3 жыл бұрын

    Excellent! Can't wait for next video!

  • @hackercop
    @hackercop2 жыл бұрын

    27:04 yay, looking forward to watching the next video. Thanks for making this series.

  • @wixor_69
    @wixor_693 жыл бұрын

    Epic. Just what i was looking for

  • @ueakarnviwatpanachat9606
    @ueakarnviwatpanachat96063 жыл бұрын

    Love all your videos! Looking forward to the next video from this series :)

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    Thanks!

  • @autismo1969
    @autismo1969 Жыл бұрын

    very well explained, in perfect detail. thanks a lot man

  • @jaytube277
    @jaytube2778 ай бұрын

    Great video Valerio, thank you so much!

  • @pavankumarkhot8521
    @pavankumarkhot85212 жыл бұрын

    Awesome!! Best explanation I have ever seen 👏👏🙌😍😍

  • @rajeshpalgp120
    @rajeshpalgp120 Жыл бұрын

    Don't have any background in CS, but,2 mins into the video and you are so easy to understand.

  • @Nunocesarsa
    @Nunocesarsa3 жыл бұрын

    cool! just gave me a research idea x) nice, clear and simple!

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    Glad I could help :)

  • @kavinyudhitia
    @kavinyudhitia Жыл бұрын

    Oh my!! Your video made a lot of sense!! thanks a lot and subscribed!!

  • @vladimirbosinceanu5778
    @vladimirbosinceanu577811 ай бұрын

    I don't know why, but it was so easy to understand it once you made the 2D plane instend of two nodes there. Awesome

  • @fabioantonini5421
    @fabioantonini54212 жыл бұрын

    Great job! Thanks for sharing😊

  • @phuonglethithanh8498
    @phuonglethithanh849810 ай бұрын

    Thank you for this video. Very easy to understand ❤

  • @entertainmenttv2362
    @entertainmenttv2362 Жыл бұрын

    Best explanation so far

  • @carlystair5502
    @carlystair5502 Жыл бұрын

    Great video! Thank you!

  • @yumenoqiao
    @yumenoqiao Жыл бұрын

    Extremely useful and easy to understand 🎉🎉🎉❤❤❤thank you so ooo much

  • @tanyachutani7272
    @tanyachutani72723 жыл бұрын

    Best video for autoencoders

  • @tasnimalaref3121
    @tasnimalaref312126 күн бұрын

    I really enjoyed every secound, it was very helpful. Thank you :)

  • @juliagarciatorne1712
    @juliagarciatorne1712 Жыл бұрын

    Good explanation. Thanks!!

  • @amcoderipper4116
    @amcoderipper411611 ай бұрын

    Thanks so much! شكراً جزيلاً 😎

  • @gustavwahl
    @gustavwahl3 жыл бұрын

    Great video! When are you going to publishing a video for anomaly detection?

  • @giuseppemastrangelo
    @giuseppemastrangelo3 жыл бұрын

    Great video 👍🏼

  • @alisaja11
    @alisaja113 жыл бұрын

    nice video!!! thank you so much

  • @saranticha8137
    @saranticha813717 күн бұрын

    Grazie mille! sei un grande

  • @Shiny_Mewtwo
    @Shiny_Mewtwo2 жыл бұрын

    Thank you, so helpful

  • @kirtipandya4618
    @kirtipandya46183 жыл бұрын

    Nice job 👍🏼

  • @nabeelkoya.a6889
    @nabeelkoya.a68893 жыл бұрын

    Great informative video.

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    Thank you Nabeel!

  • @peterkanini867
    @peterkanini86711 ай бұрын

    Great explanations! One question though. In the denoising example, how different is using Autoencoders from regular deep learning? I mean, you feed in the audio with the noise and test your results against the clean audio which kind of acts as the label to the data.

  • @Alig4realz
    @Alig4realz2 жыл бұрын

    awesome presentation! Subscribed

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    2 жыл бұрын

    Thanks!

  • @EngRiadAlmadani
    @EngRiadAlmadani3 жыл бұрын

    great work sir my question is can we use kernel pca as encoder in Autoencoders because as I know it can reduce the dimensions of nonlinear data

  • @chaimarebah115
    @chaimarebah1152 жыл бұрын

    I will use autoencoder for speech watermarking I hope you will aborde this subject too and thank you for this awesome videos you are the best

  • @gildasorseau9783
    @gildasorseau97833 жыл бұрын

    Thanks a lot Valerio, I really like the way you explain all of these "non-obvious" stuff ! I would really appreciate if you could make a video which deal with AEs for Anomaly detection. Do you still plan to cover this item, as you mentionned in this video ? If so, by when do you think possible to have it ready ? Thanks again, and above all : keep on going !

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    Thank you Gildas! I intend to cover AEs for Anomaly Detection in a self-contained video / project. Not sure when it'll come out, but it's in the pipeline ;)

  • @manuelmuller-wb3le

    @manuelmuller-wb3le

    7 ай бұрын

    @@ValerioVelardoTheSoundofAIThanks a lot Valerio! I am new to the field of audio signal processing and especially to AI approaches. Your channel helped me a lot. It was perfect to get an understanding of the whole topic. I am currently writing my master thesis in the field of anomaly detection of engine noise. I wanted to use an autoencoder as an example for the detection. I would therefore also be interested to know whether you are planning a video on this or whether it is already available on your channel. Thank you for the work and time you put into your channel! Keep up the good work! :)

  • @killersride2108
    @killersride21083 жыл бұрын

    Great video! I am keen to see the implementation of this. What are your thoughts on using GANs to generate spectrograms?

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    GANs are also effective at spectrogram generation. I'll definitely cover them at some point in the future.

  • @shivambatra70

    @shivambatra70

    3 жыл бұрын

    @@ValerioVelardoTheSoundofAI Please conver them. I am waiting for that for over a month now and there is no other channel which cover audio processing as you 😃

  • @Jorge-wf3tg
    @Jorge-wf3tg3 жыл бұрын

    Cool video!! I'm doing a research of speech to speech (voice convertion)

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    That sounds interesting!

  • @saurabhpandey4357
    @saurabhpandey43572 жыл бұрын

    please make a video on semi-supervised learning along with practical implementation.

  • @franklyvulgar1
    @franklyvulgar1 Жыл бұрын

    working on a project that does this in some way right now :) the first thing I thought was, why use random noise when a latent vector would work so much better.

  • @ritwikamajumdar5967
    @ritwikamajumdar59673 жыл бұрын

    Thank you so much

  • @jeremyuzan1169
    @jeremyuzan11693 жыл бұрын

    thank you so much

  • @avidreader100
    @avidreader1003 жыл бұрын

    Auto-encoding and de-noising seem to be equivalent to the processes we use for selectively listening to one speaker when in an environment where multiple members are speaking simultaneously.

  • @MARTIN-101

    @MARTIN-101

    2 жыл бұрын

    can we do both of the applications at the same time ?

  • @MARTIN-101

    @MARTIN-101

    2 жыл бұрын

    can you explain how background noise will be removed.

  • @mehrdadkazemi3969
    @mehrdadkazemi39692 жыл бұрын

    ty :)

  • @ashokbasnet798
    @ashokbasnet7983 жыл бұрын

    Very Nice session. Would be grateful if you explain attention mechanism implication.

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    Thank you! I'll definitely cover attention / transformers in another series.

  • @TehCannonMan
    @TehCannonMan3 жыл бұрын

    which loss metric would you use for the deep convolutional auto encoder? cross entropy or RMSE still?

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    3 жыл бұрын

    RMSE / MSE are a good starting point here.

  • @juanestebanflorez2826
    @juanestebanflorez28263 жыл бұрын

    Thanks, can you cite your sources? (great explanation. thanks be)

  • @aliazak6948
    @aliazak6948 Жыл бұрын

    At the denoising part, do we always need to have same kind of noise in sound, for AE to denoise it ? For example, can samples with white noise and random noise denoised together ?

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    Жыл бұрын

    If you have enough samples for different types of noises, you should be good to go.

  • @yashjain6372
    @yashjain6372 Жыл бұрын

    good

  • @ethiotechnotube7982
    @ethiotechnotube79822 жыл бұрын

    can we implement VQ to audio classification with python?

  • @pasinduekanayaka8023
    @pasinduekanayaka80232 жыл бұрын

    Does anyone know how to find what are the important features that are stored in the latent space?

  • @MARTIN-101

    @MARTIN-101

    2 жыл бұрын

    did u found a answer ?

  • @bansalll15
    @bansalll152 ай бұрын

    can I make this project if I'm working on macbook m1 without a gpu?

  • @ahmedanwer6899
    @ahmedanwer6899 Жыл бұрын

    It's so cool how one idea like autoencoders can be used in audio, anomaly detection and I think even nlp as well! JVUVICFJ

  • @MARTIN-101
    @MARTIN-1012 жыл бұрын

    can someone please explain how can i use auto encoders to filter out the background noise and reatain speaker voice ?

  • @arturakobyan4171
    @arturakobyan4171 Жыл бұрын

    I can't find video about anomaly detection with AEs(

  • @bluestar2253
    @bluestar22532 жыл бұрын

    You still didn't explain exactly how the autoencoder works!

  • @chegevarra1036
    @chegevarra1036 Жыл бұрын

    Valerio, can you give me an email? has some important to say/

  • @ValerioVelardoTheSoundofAI

    @ValerioVelardoTheSoundofAI

    Жыл бұрын

    valerio@thesoundofai.com

Келесі