Andrew Ng: Deep Learning, Self-Taught Learning and Unsupervised Feature Learning

Ғылым және технология

Graduate Summer School: Deep Learning, Feature Learning
"Deep Learning, Self-Taught Learning and Unsupervised Feature Learning (Part 1 Slides1-68; Part 2 Slides 69-109)"
www.ipam.ucla.edu/publication...

Пікірлер: 111

  • @veloxsouth
    @veloxsouth10 жыл бұрын

    I really liked this slideshow. My brain could almost learn to see his movements like this was a video.

  • @siddharthnibjiya
    @siddharthnibjiya9 жыл бұрын

    good content. video lags constantly and becomes unconvenient for our eyes. please prevent such lags.

  • @N3ur0m4nc3r
    @N3ur0m4nc3r8 жыл бұрын

    If you are having lag issues ... helper.ipam.ucla.edu/wowzavideo.aspx?vfn=10595.mp4&vfd=gss2012 This video from the site posted by David Sanders (see below) was working better for me.

  • @VertigoAt1977

    @VertigoAt1977

    8 жыл бұрын

    +Fifty7V thank you :)

  • @N3ur0m4nc3r

    @N3ur0m4nc3r

    8 жыл бұрын

    VertigoAt1977 Your'e welcome. If you like a video like this, you are my kind of people. -Happy to help.

  • @jaggar28
    @jaggar289 жыл бұрын

    Many thanks for sharing the lecture, it's so clear and concise. Now, I've an overall better understanding of the difference between various machine learning algorithms.

  • @chunyangzhang2948
    @chunyangzhang294810 жыл бұрын

    This is all about applications of deep learning, and give an intuitive explanation of why deep learning works well. G. Hinton and Y. Bengio released several presentations online that present detailed and theoretical part of deep learning. I started my study from there.

  • @CherieOliviaAnondananda
    @CherieOliviaAnondananda9 жыл бұрын

    I remember working on Natural Language Processing as an undergrad in the 80's ... it's come so far ... of course, back then we didn't compete with Neuro-Linguistic Programming for the NLP acronym.

  • @msgeinstein
    @msgeinstein8 жыл бұрын

    This was the video i am looking for after machine learning classes of him. I hope we'll meet in some conference.

  • @alexander_adnan
    @alexander_adnan6 жыл бұрын

    I'm in the field since 2010 machine learning and computer vision.. man this is a great state of the art presentation.. Nice ... really nice

  • @ProfessionalTycoons
    @ProfessionalTycoons5 жыл бұрын

    Man Dr. Ng is such a humble man.

  • @Lycheeee11
    @Lycheeee118 жыл бұрын

    I like Andrew Ng. He is always so humble!

  • @sikor02
    @sikor028 жыл бұрын

    Thank you very much for sharing this! That gave mere new direction to extend my knowledge

  • @fungiside
    @fungiside10 жыл бұрын

    Great video, but intermittently very choppy for some reason.

  • @Chorizzosoup
    @Chorizzosoup10 жыл бұрын

    I feel the same way currently - is that machine learning tends to be just curve fitting and statistics. This is not what I really want to learn when I say I want to learn AI/Machine Learning.

  • @Pianofy

    @Pianofy

    10 жыл бұрын

    So up to you to invest your spare time into finding new methods, right? I think having a stereoscopic view or a time element, or both will greatly help improve image recognition algorithms. I think humans would also have a lot of trouble recognizing motorcycles if they spend their entire lives living in a world of non-moving 2D images. The reason we can pick apart objects from others is because we have seen them often, at other times, as if moving in 3D space. Humans use a combination of parallax and both eyes to map their 2D view into a 3D understanding of the world. If we want computers to make sense of the world in the same way as we do, the first preprocessing step would be to do the same: try to guess a 3th dimension onto 2D images. Just my thoughts. Might be utter bullshit :)

  • @therealadrian
    @therealadrian11 жыл бұрын

    In case anyone is curious, the powerpoint presentation Andrew is giving can be found just by Google searching "DeepLearning-Mar2013.pptx". If you want to see some of the slides that Andrew talks to but which do not get into the video, this is helpful.

  • @AileenFang0000
    @AileenFang000010 жыл бұрын

    Great video! Thank you! I can listen to Andrew Ng all day...where is part 2?

  • @TheodorosKatsikis
    @TheodorosKatsikis10 жыл бұрын

    I would love to study side by side wth this guy!!!!!! He rules!!!!

  • @IuliusCurt
    @IuliusCurt10 жыл бұрын

    16:20 - Dacia 1300

  • @CreationTribe
    @CreationTribe10 жыл бұрын

    Wow - great talk! Extremely interesting material. I've been fascinated with AI every since I was a kid. In fact, I think that's what got me into the field of software dev in the first place. Mayhap it's time to truly start playing around with neural nets and learning algorithms.

  • @aristaukulis4275

    @aristaukulis4275

    9 жыл бұрын

    what kind of software are you developing?

  • @CreationTribe

    @CreationTribe

    9 жыл бұрын

    Aris Taukulis Currently I'm writing proprietary software for social communities based on different medical issues. RoR as it happens.

  • @douglaskell1275
    @douglaskell12758 жыл бұрын

    Very good and clear development of the main mainstream ideas in modern deep belief networks

  • @allensirolly2495
    @allensirolly249510 жыл бұрын

    Part 2 here: www.ipam.ucla.edu/schedule.aspx?pc=gss2012

  • @pleiadian

    @pleiadian

    9 жыл бұрын

    The link doesn't seem to work anymore ...

  • @allensirolly2495

    @allensirolly2495

    9 жыл бұрын

    pleiadian www.ipam.ucla.edu/programs/summer-schools/graduate-summer-school-deep-learning-feature-learning/?tab=schedule

  • @pleiadian

    @pleiadian

    9 жыл бұрын

    cool. thanks a lot!

  • @assaad33
    @assaad338 жыл бұрын

    thanks for sharing this video, awesome !!

  • @urjeans2896
    @urjeans28969 жыл бұрын

    Cool talk! Thanks for the video!

  • @bujin5455
    @bujin54558 жыл бұрын

    Great video, wish it wasn't so choppy.

  • @spiritusinfinitus

    @spiritusinfinitus

    7 жыл бұрын

    It doesn't actually inspire too much confidence that some of the greatest brains on the planet developing AI that will presumably be responsible for our safety and well being can't figure out how to upload a decent quality KZread video ten years after its inception. ;D (jk btw)

  • @bujin5455

    @bujin5455

    7 жыл бұрын

    The thought had crossed my mind, but I decided to keep that to myself.

  • @imaekgames
    @imaekgames9 жыл бұрын

    Should all AI have a standard eventually for a "base" brain? Should an individual AI be on a knowledge island of their own or should they all be interconnected and all be able to share their acquired learning and knowledge?

  • @johnvonhorn2942
    @johnvonhorn29427 жыл бұрын

    We're a start up called "#Winning" and we're using convolutional neural networks to predict lottery numbers. We're currently training a recurrent network on coin tosses and dice rolls before moving onto the holy grail (but never holy fail) of predicting next week's lottery numbers

  • @isospin8u
    @isospin8u9 жыл бұрын

    I wish Andrew would move forward from text, audio and images/video as there are more interesting problems and I'd like to hear about possible solutions to these problems via algorithms.

  • @nhnifong
    @nhnifong11 жыл бұрын

    Well, Gabor-like filters that deep nets tend to discover are the basis of JPEG which is an important part of MPEG compression. But it's only one layer of "features" and there are no learned temporal features that take advantage of the redundancy from frame to frame. The keyframing technique does not count as a learned feature. Geoff Hinton has applied stacked restricted boltzmann machines to video of bouncing balls and found that it can learn temporal features, so yes!

  • @ProfessionalTycoons
    @ProfessionalTycoons6 жыл бұрын

    Amazing video!

  • @TobiasDeml
    @TobiasDeml5 жыл бұрын

    Need an unsupervised learning algorithm to fill in the gaps of the video lag. Other than that, really good!

  • @jayp6955
    @jayp69558 жыл бұрын

    6:43 textons, spin image, SIFT paper

  • @chrisanderson1513
    @chrisanderson15138 жыл бұрын

    Found this in a probabilistic programming playlist. When does that portion of the talk start?

  • @ishirraj8554
    @ishirraj85549 жыл бұрын

    at 24:00 the edges numbers 36 and 42 are misrepresented :)

  • @zhuuxi
    @zhuuxi6 жыл бұрын

    He is using the same table of numbers to represent an image on several different talks.

  • @azmodaipaul8023
    @azmodaipaul80239 жыл бұрын

    Great video !

  • @sergeysmyshlyaev9716
    @sergeysmyshlyaev971611 жыл бұрын

    In-lecture quizzes: tested on Coursera, now applied to in-class lectures.

  • @neotechfriend
    @neotechfriend8 жыл бұрын

    thks for uploading this video

  • @stiLLa2000
    @stiLLa20008 жыл бұрын

    thx for the upload!

  • @ProfessionalTycoons
    @ProfessionalTycoons5 жыл бұрын

    just appreciate the video guys.

  • @akash1playboy
    @akash1playboy10 жыл бұрын

    Help!! I am currently working on spatio-temporal feature extraction from videos using deep learning. Unfortunately there hasn't been much work on it. Can anyone provide me with links on deep neural networks for video features???

  • @joseinTokyo
    @joseinTokyo9 жыл бұрын

    great!

  • @K4moo
    @K4moo9 жыл бұрын

    parse the data into feature vectors very interesting idea=)

  • @seaslee2010
    @seaslee20109 жыл бұрын

    clear and rich

  • @wlorenz65
    @wlorenz658 жыл бұрын

    The statement at 19:30 "Humans have 20 years of experience looking at unlabeled images" is nonsense. Human experiences are always labelled by their feelings (aka rewards in machine learning).

  • @JasonLivesay
    @JasonLivesay11 жыл бұрын

    Can you apply these types of techniques to video compression?

  • @fabianlobrij7134

    @fabianlobrij7134

    4 жыл бұрын

    Through Digital Signal Processing (DSP) type of operations I believe

  • @ProgrammingTime
    @ProgrammingTime10 жыл бұрын

    This guy rules

  • @Shiro77_shorts
    @Shiro77_shorts7 жыл бұрын

    i need to learn how programming language convert into machine language.... please upload your lecture videos.....

  • @SweetHyunho
    @SweetHyunho10 жыл бұрын

    Licking to feel voltages on a panel sounds dangerous and painful. Perhaps a soft touch panel would be a better monitor for the blind...

  • @peterdickinson1936

    @peterdickinson1936

    10 жыл бұрын

    The early pre-cursor to the tongue "display" (which apparently feels like varying degrees of soda bubbles rather than a 9V battery) was actually a giant chair that replaced pixels with little actuators. Turns out skin isn't so good with definition whereas the tongue is super dense with sensors - more "pixels per inch" if you will.

  • @clearmenser
    @clearmenser11 жыл бұрын

    Is there a reason to stop at only 4 levels of hierarchy for feature learning? Why not 16 or 32 or 256?

  • @vdoundakov
    @vdoundakov9 жыл бұрын

    Did I hear correctly, single learning algorithm is Andrew Ng's hypothesis? Like, his invention?

  • @seaslee2010

    @seaslee2010

    9 жыл бұрын

    no.

  • @amgadmuhammad2958
    @amgadmuhammad295810 жыл бұрын

    do you have a link for part 2?

  • @hammashamzah
    @hammashamzah8 жыл бұрын

    Oh my god this is great

  • @StriderAngel496
    @StriderAngel4969 жыл бұрын

    how can you have so much knowledge and talk about deep learning and advanced AI but not be able to record a 45 minute video? i really don't understand that...

  • @ahmed101989
    @ahmed10198910 жыл бұрын

    SimpLe, yet informative :)

  • @ganeshjonna
    @ganeshjonna10 жыл бұрын

    Nice

  • @fangweixu6243
    @fangweixu62437 жыл бұрын

    It's great

  • @mingzhang6293
    @mingzhang629311 жыл бұрын

    yeah, found you.

  • @mmm2008mmm
    @mmm2008mmm10 жыл бұрын

    27:40 to 28:13

  • @ankic7745
    @ankic77458 жыл бұрын

    thanks a ton for sharing :)

  • @ckquah1398

    @ckquah1398

    8 жыл бұрын

    the

  • @ckquah1398

    @ckquah1398

    8 жыл бұрын

    the first

  • @superjaykramer
    @superjaykramer10 жыл бұрын

    I want andrew G to come up with an algorithm that just says, this video has has been recorded in a crap way..

  • @sriprasanth1101
    @sriprasanth11014 жыл бұрын

    Can you guide me to learn deep learning pls

  • @m3po22
    @m3po225 жыл бұрын

    The choppiness is in the video. Biology, layers: 20:15 - 33:41

  • @troykillah
    @troykillah8 жыл бұрын

    11:00 still i wonder why our brains are so similiar and these brain regions are normally structured according to one specific task, optical cortex for seeing things, and auditory cortex for understanding sound frequency modulations. Why do certain sensory task occur in the same brain regions. That is my question, thanks for the replies if there are any;D really intresting stuff AI!!!!!! 2040 the internet will be alive!;p

  • @wlorenz65

    @wlorenz65

    8 жыл бұрын

    +Vrolijke Vent Long wires are expensive. Total connectivity in the human brain is about 15%. It's nonsense to connect A1 with V1. The genes know that and therefore brain region connections are predefined in order to speed up learning.

  • @badhombre4942
    @badhombre49423 жыл бұрын

    Impressive...the sparse coding of him, in this video.

  • @gabrielchichi5692
    @gabrielchichi56925 жыл бұрын

    Better Quality here : kzread.info/dash/bejne/opp627ySYbW2irg.html

  • @happyjohn1656
    @happyjohn16565 жыл бұрын

    2012... hmm...

  • @justonium
    @justonium11 жыл бұрын

    Certainly, considering the brain does it.

  • @WilliamKKidd
    @WilliamKKidd9 жыл бұрын

    I think the real question here, is HOW the FUCK is his last name pronounced???

  • @ChristianToh

    @ChristianToh

    9 жыл бұрын

    Voxel Skull ng

  • @WilliamKKidd

    @WilliamKKidd

    9 жыл бұрын

    ***** That does not help....

  • @WilliamKKidd

    @WilliamKKidd

    9 жыл бұрын

    David Sanders I just found out, it's more of an "oong"... I have a friend with that last name, and he explained it..

  • @JohnSee80

    @JohnSee80

    9 жыл бұрын

    Voxel Skull it's a chinese surname used by certain dialects, en.wikipedia.org/wiki/Ng_%28surname%29 similar (in chinese character) to those with 'Huang' as surname. You can pronounce it like "earn" but with a 'g' at the end... so well, "earng".

  • @Lycheeee11

    @Lycheeee11

    8 жыл бұрын

    +Voxel Skull www.quora.com/How-does-Andrew-Ng-prefer-his-name-to-be-pronounced

  • @mswai5020
    @mswai50208 жыл бұрын

    Andrew Ng? Isn't this Rodger Peng?

  • @motezart2867

    @motezart2867

    3 жыл бұрын

    haha hilarious

  • @m.r.wiggins1537
    @m.r.wiggins15378 жыл бұрын

    Anyone interested in this video would enjoy this: www.huffingtonpost.com.au/2015/05/13/andrew-ng_n_7267682.html Andrew Ng interview.

  • @weewilly2007
    @weewilly20078 жыл бұрын

    what do want computers to do? Play fetch like man's other best friend? Seems frivolous when you put it that way. Accept if you're one of those who believes the accurate recollection can somehow make us whole again,

  • @Jensbolte
    @Jensbolte11 жыл бұрын

    no

  • @jonasslrdahlskjrpe3317
    @jonasslrdahlskjrpe33178 жыл бұрын

    LEGO CITY

  • @gcgrabodan
    @gcgrabodan8 жыл бұрын

    Did he seriously have to defend himself for being inspired by nature? deliberately avoiding the term "evolution"??? at around 8:45 min

  • @elhossinyhaitham
    @elhossinyhaitham9 жыл бұрын

    Lotfi zadah dislike the video..

  • @_.-._.-._.-_.-._.-._.-_.-._.-
    @_.-._.-._.-_.-._.-._.-_.-._.-8 жыл бұрын

    human kind play around with their brain to finally know about their God, the Creator. . . . .

  • @ahmed101989
    @ahmed10198910 жыл бұрын

    SimpLe, yet informative :)

Келесі