A Complete Overview of Word Embeddings

NLP has seen some big leaps over the last couple of years thanks to word embeddings but what are they? How are they made and how can you use them too?
Let's answer those questions in this video!
Get your Free Token for AssemblyAI Speech-To-Text API 👇www.assemblyai.com/?...
▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬▬
🖥️ Website: www.assemblyai.com
🐦 Twitter: / assemblyai
🦾 Discord: / discord
▶️ Subscribe: kzread.info?...
🔥 We're hiring! Check our open roles: www.assemblyai.com/careers
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#MachineLearning #DeepLearning

Пікірлер: 162

  • @ozgurak1840
    @ozgurak1840 Жыл бұрын

    Thank you. It is very clear and informative, though i really think you (AssemblyAI) should lose the music on the background; it is distracting and it gives the whole thing an infomercial feeling.

  • @nirash8018

    @nirash8018

    11 ай бұрын

    Somehow the music had a motivational influence for me. I caught myself vibing to it a few times

  • @impracticaldev
    @impracticaldev Жыл бұрын

    Would love a video on ELMo further. Thanks for all this!

  • @originalmianos
    @originalmianos11 ай бұрын

    There are maybe 30 videos on this topic and this is the only one that does not suddenly make a massive jump across whole concepts that the presenter knows but the watcher does not.

  • @marten9334
    @marten93343 ай бұрын

    amazing video. Perfectly clear speech, good explanations, logical visualisations and the background music makes it a lot easier to focus. Thank you!!

  • @KidistAmde
    @KidistAmde5 ай бұрын

    Excellent ! Thank you so much for making an absolutly clear explanation.

  • @estelitaribeiro4196
    @estelitaribeiro419624 күн бұрын

    Thanks! Great information in a very objective way!

  • @idrissnguepi7842
    @idrissnguepi7842 Жыл бұрын

    Very nice explanation of embedding concept, Would love to see pre-trained word embeddings for sentiment analysis.

  • @smudgepost
    @smudgepost Жыл бұрын

    Yes - to all videos you suggest making! Great guide thank you.. was struggling to see value in lemmatization and concerned a bout a loss of coherence. Seeing several worked examples are great. Interested how the final results were all different but all had similarly high percentage match. How do you tackle this?

  • @augurelite
    @augurelite Жыл бұрын

    Wow such a good presenter. I really like the examples super clear. This stuff is amazing

  • @lahiru954
    @lahiru954 Жыл бұрын

    Great explanation! I went through the topics hours of hours. But this channel saved my time. And on target.

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Great to hear!

  • @deepaksingh9318
    @deepaksingh93182 ай бұрын

    Amazing Content.. Exactly what a learner wants .. to Have all the concepts in a single Video with easy to understand way in minimum time..

  • @tommyhuffman7499
    @tommyhuffman74993 ай бұрын

    The absolute best video I've seen on this topic!!

  • @Kmmc2011
    @Kmmc2011 Жыл бұрын

    Thanks for taking the time to break this down and share!

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    You are very welcome! - Mısra

  • @lavanyaseetharaman
    @lavanyaseetharaman Жыл бұрын

    simple and clear explanation. please explain Elmo, thanks

  • @manojjoshi1102
    @manojjoshi1102 Жыл бұрын

    Excellent explanation. I did some study on this topic before coming here and the reason was because so many terms and concepts were quite overwhelming. I generally understood those but still missed the fine tuned clarity. After watching this video, most of what I read before started making a lot of sense. I highly recommend this video. Thank you so much.

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    This is great to hear! You are very welcome!

  • @HashimWarren
    @HashimWarrenАй бұрын

    Very clear, thank you

  • @berkk1993
    @berkk199311 ай бұрын

    çok teşekkürler, bu kadar iyi anlatan başka video yok

  • @UkiDLucas
    @UkiDLucas10 ай бұрын

    Very good explanation, thank you!

  • @diegovnoble
    @diegovnoble2 ай бұрын

    Thanks for the video! I've enjoyed watching and liked the format and pace. I'd add the retrowave background to my playlist if I knew the name. I guess that people would note it less if the volume was lower.

  • @kfirgollan
    @kfirgollan Жыл бұрын

    Great explanation! Thanks for sharing

  • @bibhutibaibhavbora8770
    @bibhutibaibhavbora87709 ай бұрын

    Great and very illustrative video

  • @automatster
    @automatster Жыл бұрын

    Great video. Thanks for sharing it. It would be great if you do a task like train sentiment analysis model with word embedding and share with us.

  • @yusufkemaldemir9393
    @yusufkemaldemir9393 Жыл бұрын

    Interested in “Creating your own embedding before doing binary or multi label classification prediction”! Thanks for the clarity.

  • @yuanjunren5220
    @yuanjunren52203 ай бұрын

    amazing video!!!❣❣❣ Thanks for sharing

  • @michaelng3126
    @michaelng31265 ай бұрын

    This was awesome. Would love to see Elmo video and sentiment analysis video you mentioned possibly making!

  • @user-lq7rh4it7c
    @user-lq7rh4it7c Жыл бұрын

    Brilliant video, as always, thanks so much. Would love to see your suggested follow on using pre-trained word embeddings for sentiment analysis if you ever have time 🙂

  • @investime247
    @investime247 Жыл бұрын

    Thank u very clear. Need to know how to use word embedding for text classification

  • @Harduex
    @Harduex3 ай бұрын

    Great videos there, thank you for your content and keep up the good work!

  • @vigneshpadmanabhan
    @vigneshpadmanabhan Жыл бұрын

    Well explained ! Thanks a lot

  • @sajjaddehghani8735
    @sajjaddehghani87352 жыл бұрын

    great explanation. please explain elmo and other approaches. also please make a video about efficient ways of clustering the embeddings👍

  • @AssemblyAI

    @AssemblyAI

    2 жыл бұрын

    Thank you Sajjad for the suggestion!

  • @shubhamdas5192
    @shubhamdas5192 Жыл бұрын

    Great explanation in less amount of time. Really liked the video.

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    That's great to hear!

  • @hamitguner
    @hamitguner4 ай бұрын

    Thank you

  • @nikitamalviya692
    @nikitamalviya692 Жыл бұрын

    Very well explained!! Thank you so much

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    You're welcome!

  • @mariussame9357
    @mariussame9357 Жыл бұрын

    Thanks for the video I do have a question when you said that for instance in the CBOW there is only one layer it means that the ouput of this layer should be a vector of size dimension of the embedding but in order to train the model we need to compaire this output with the word in the midlle which is actually a one hot encoded vector of size dimension of the vocabulary so it migth have another layer and a softmax.

  • @JayTheMachine
    @JayTheMachine8 ай бұрын

    thnak you soo much, amazing explaination and you beautiful

  • @draziraphale
    @draziraphale Жыл бұрын

    Excellent presentation. I will be teaching this topic to students shortly and will recommend this material.

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Great to hear, thank you!

  • @glowwell4292
    @glowwell429210 ай бұрын

    Thanks dear. Nicely paced intro. Good for recap.

  • @AssemblyAI

    @AssemblyAI

    10 ай бұрын

    Glad you liked it

  • @whifflingtove
    @whifflingtove Жыл бұрын

    Very interested in an in depth explanation of ElMo

  • @hadiloghman1572
    @hadiloghman1572 Жыл бұрын

    great explanation. Please explain ELMO and GloVe. it was really great

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you for the suggestions!

  • @cimmik

    @cimmik

    4 ай бұрын

    ​@@AssemblyAII'd love to see those videos too

  • @TuhinBhattacharya
    @TuhinBhattacharya2 жыл бұрын

    Awesome overview.. Loved it.. Waiting for videos explaining GloVe and Elmo..

  • @AssemblyAI

    @AssemblyAI

    2 жыл бұрын

    Great to hear you liked it!

  • @nogur9
    @nogur911 ай бұрын

    It's a really good explanation, thank you very much :)

  • @AssemblyAI

    @AssemblyAI

    10 ай бұрын

    You are welcome!

  • @captainmustard1
    @captainmustard110 ай бұрын

    top video for embedding introduction

  • @cimmik
    @cimmik Жыл бұрын

    Would it be possible to use word embedding to ask if a text is about a certain topic (or rather to what degree a text is about a topic)?

  • @emandiab9524
    @emandiab952411 ай бұрын

    Thanks that helped a lot.

  • @AssemblyAI

    @AssemblyAI

    11 ай бұрын

    Glad it helped

  • @AhmedKhaliet
    @AhmedKhaliet11 ай бұрын

    Thank youuuu it's my first video but I guess I should make your video my periorties I'm NLP thanks alot❤

  • @dessiabdelkerym5612
    @dessiabdelkerym56128 ай бұрын

    Thanks for the explanation please try to make a video about how ELMOS works

  • @MohamedElGhazi-ek6vp
    @MohamedElGhazi-ek6vp5 ай бұрын

    Excellent Explanation. I have one question please how could I fit my model with this embedding vectors cause for Example in one of my projects for extracting informations from fils. instead of using texts for training my models I thinked of using embedding but I don't know the best way to represent them to my model . I hope u understand my question and thank you.

  • @jeremymarkson1423
    @jeremymarkson1423 Жыл бұрын

    Would be great to see a video on Elmo!

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you for the suggestion, noted!

  • @hileamlakyitayew9450
    @hileamlakyitayew9450 Жыл бұрын

    Awesome video!!

  • @altantoksoz5999
    @altantoksoz599910 ай бұрын

    Great tutorial. She speaks like a native speaker. She looks like a Turkish girl, beautiful one :)

  • @dalehu5606
    @dalehu5606 Жыл бұрын

    Clear explanation! 👍

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Glad you think so!

  • @RiccardoCarlessoGoogle
    @RiccardoCarlessoGoogle5 ай бұрын

    This is amazing. Can you share the python notebook you show at 12m33s?

  • @ShaikRaasikha21
    @ShaikRaasikha214 ай бұрын

    Video on Training a sentiment analysis model please

  • @toshyamg
    @toshyamg11 ай бұрын

    Great job 👍

  • @jenot7164
    @jenot7164 Жыл бұрын

    How large should data for a custom embedding be and is it possible to utilize a GPU for the creation of a word embedding vector space?

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w Жыл бұрын

    Can the embeddings from Transformer be used elsewhere, like with Word2Vec?

  • @r.walid2323
    @r.walid2323 Жыл бұрын

    Great explanation

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you!

  • @abdelazizkhalid4231
    @abdelazizkhalid4231 Жыл бұрын

    is there a video about sentiment analysis yet?

  • @ali75988
    @ali759885 ай бұрын

    8:15 i am having problem with the sentence "no of neurons in hidden layer = size of embedding". i am confused what is size of embedding?

  • @davidheilbron
    @davidheilbron Жыл бұрын

    Great! Thanks

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    You're welcome!

  • @soheiltehrani3792
    @soheiltehrani3792 Жыл бұрын

    Great visual, Great Voice , Good pace of presentation . Everything is awesome in this video. thanks for sharing :D

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you for the nice words Soheil! Glad it was helpful!

  • @lbognini
    @lbognini Жыл бұрын

    From the embeddings of your name, I removed those of "work", added "great" and "relationship" and I came up with the embeddings of my own name? How come? Mere coincidence? 🤔🤔 Great video, btw!

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w Жыл бұрын

    be great to see a video on Elmo.

  • @AliZaki1401
    @AliZaki140111 ай бұрын

    Great work !! Can you make a video on Elmo and Transformer-based word embeddings ???

  • @AssemblyAI

    @AssemblyAI

    11 ай бұрын

    Great suggestion!

  • @MartinJohannesNilsen
    @MartinJohannesNilsen Жыл бұрын

    Great video! As for your analogy, I would guess that changing cocktail to bar would indeed give you cocktail. The analogy of having dinner at a restaurant, is not matching to having bar at cocktail.

  • @shubham-pp4cw
    @shubham-pp4cw2 жыл бұрын

    nice video on word embedding keep it upp.............

  • @AssemblyAI

    @AssemblyAI

    2 жыл бұрын

    Thank you!

  • @danielcanedo5240
    @danielcanedo5240 Жыл бұрын

    I'm your fan already, please make an ELMo video....!!!

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you for the suggestion!

  • @ehichamu
    @ehichamu Жыл бұрын

    Very Good video. I second the other comments. PLEASE drop the music completely. It would increase the quality of the experience by at least 70%. I had hard time finishing the video because of the music

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thanks, will do!

  • @HappyDataScience
    @HappyDataScience10 ай бұрын

    i would surely like to learn elmo guessing that chatgpt used the same correct me if i'm wrong 🙇🏻‍♂️

  • @lemoniall6553
    @lemoniall6553 Жыл бұрын

    if we have a sentence "vishy eat bread". then we vectorize the word "eaat"(misspelled word), why does fasttext see that the word "eaat" is more similar to the word "eat"?. How is the architecture?, is it possible for fasttext without using skipgram to be able to classify words?. Thanks

  • @jtauber
    @jtauber Жыл бұрын

    I love that all your examples are Lord of the Rings quotes because I run the Digital Tolkien Project which applies computational text analysis techniques to the works of Tolkien :-)

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    That's amazing! Nice to meet you! Huge Tolkien fan here. :)

  • @jtauber

    @jtauber

    Жыл бұрын

    @@AssemblyAI you should join the Digital Tolkien Project!

  • @sidindian1982

    @sidindian1982

    5 ай бұрын

    @@AssemblyAI Pls provide the notebook code .. thnx

  • @j0nrages851
    @j0nrages851 Жыл бұрын

    Is there a sentiment training model video that builds from this? Trying to build a recommendation system based on candidate sentences and a job description

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    We don't have that video yet but thank you for the suggestion!

  • @YuraZavadenko
    @YuraZavadenko8 ай бұрын

    what about BOW?

  • @praveenbehara
    @praveenbehara Жыл бұрын

    Hi.. thank you for the video.. great introduction and also a practical example.. One request is to drop or reduce the intensity of the music. It was distracting.

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Noted! Thank you for the feedback Praveen

  • @javidjamae

    @javidjamae

    8 ай бұрын

    Yes, great video but music is definitely too loud and distracting! It's really hard to concentrate on what you're saying.

  • @TuhinBhattacharya
    @TuhinBhattacharya2 жыл бұрын

    How do I know which embedding will be best choice for a specific use case? How do I know which distance measure will be best?

  • @pathikghugare

    @pathikghugare

    2 жыл бұрын

    Depends on your use case, cuz lets say if your use case contains more in general words like tea, king, actor, etc. then you may try different embeddings and see for yourself which ones are working well for particular examples from your use case OR If your use case is quite specific, something like say representing skills as a vector then you may need to train your own word2vec model on your data since pretrained embeddings may not cover what you need

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w Жыл бұрын

    Be interested in seeing a python example of Word2Vec.

  • @joergbieri9701
    @joergbieri97019 ай бұрын

    Great content thanks. Due to a hearing problem I would appreciate it, if you could remove the backround music. Ok? Thanks

  • @tamoghnamaitra9901
    @tamoghnamaitra99017 ай бұрын

    New crush added to life

  • @josephvanname3377
    @josephvanname3377 Жыл бұрын

    I have just created my own word embedding algorithm (no neural networks). I am now training it. Let's see what kind of gibberish sentence it produces after I use it to produce new sentences (I will try to produce sentences without neural networks).

  • @josephvanname3377

    @josephvanname3377

    Жыл бұрын

    Here are some of the sentences produced by my word embedding (and just a word embedding without much on top of the word embedding). "How nevertheless she had credited yourself." "I released the chimneys were committed."-Well, this is two sentences "I released the chimneys" and "The chimneys were committed." The word embedding is not full NLP so this sort of word embedding cannot remember "released" when we get to "were". "Luke fills the intruder boxed the interval."-Same issue here. "I shall be linked unarmed." "He was afraid I know."

  • @peymanhashemi3827
    @peymanhashemi3827 Жыл бұрын

    Great!

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you!

  • @__________________________6910
    @__________________________69102 жыл бұрын

    Noice !

  • @mimori.com_
    @mimori.com_ Жыл бұрын

    Thank you. Easy to understand. But I don't need the music at all. I fight myself listening to the music than your talk.

  • @lexflow2319
    @lexflow2319 Жыл бұрын

    Do transformers from scratch. I heard they can be written in 50 lines. I would like to understand how bert encodes words

  • @princegoyal1843
    @princegoyal18433 ай бұрын

    Hi, Can you please tell you name. Going forward to learn more from you.

  • @iravkr
    @iravkr Жыл бұрын

    Your pretty face holds my concentration, and thus I understand anything taught by you, especially transformer, more than any other youtube video..Thank you so much for such videos...indebted!

  • @yigalirani308
    @yigalirani308 Жыл бұрын

    super helpful, but is there a version of this without the music?

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Sorry about that! We got a lot of feedback in this. Let me see if we can upload without the music. :D

  • @davidswearingen7571
    @davidswearingen757110 ай бұрын

    Another good video marred by the inclusion of unnecessarily loud music.

  • @zaratushtra21
    @zaratushtra2111 ай бұрын

    You should also add the name of the speak to videos. She says I in the video and we even do not know who is she :)

  • @brunam7908
    @brunam790810 ай бұрын

    Waiting for the ELMo video.

  • @moeal5110
    @moeal51108 ай бұрын

    Awesome content but these background music are slightly distracting specially when you play video on 1.5 speed

  • @HikmetYolcusu
    @HikmetYolcusu5 ай бұрын

    Why is there a background soundtrack during the lecture? Does it help with learning or focus? I find it kinda distracting and feel rushed.

  • @flaashmindstudio1468
    @flaashmindstudio1468 Жыл бұрын

    Can you make a video about ELmo?

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Noted!

  • @EkShunya
    @EkShunya Жыл бұрын

    nice and crisp, just one suggestion "please remove background music", It is reductive to the viewers experience :)

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Thank you! And noted!

  • @Nice-po4xg
    @Nice-po4xg10 ай бұрын

    Cosine Similarity, not equal distance bro it just tells direction of that word

  • @mehmetaliozer2403
    @mehmetaliozer2403 Жыл бұрын

    excellent tutor but music distracted me so much 😄

  • @AssemblyAI

    @AssemblyAI

    Жыл бұрын

    Sorry about that! Wish we could take it back 🤷‍♀️

  • @DanielTorres-gd2uf

    @DanielTorres-gd2uf

    Жыл бұрын

    @@AssemblyAI I personally like both

  • @uvurgun
    @uvurgun Жыл бұрын

    Thanks for sharing! It would have been great to remove the background music.

  • @josephvanname3377
    @josephvanname3377 Жыл бұрын

    So when are we going to construct word embeddings from good old fashioned pictographs?

  • @zilaleizaldin1834
    @zilaleizaldin1834Ай бұрын

    I would recommend you to make your videos without the music background. It is quite distracted. Your video is helpful for me to understand this concept but I am trying to be patient with the mushic!!

  • @sdsunjay
    @sdsunjay10 ай бұрын

    I was hoping this video would cover BERT as it can be used to generate embeddings. Bidirectional Encoder Representations from Transformers (BERT) is a family of language models introduced in 2018 by researchers at Google. However I do see there is another video about BERT: kzread.info/dash/bejne/aJWc2rKNfL3ehZs.html

  • @DrLouMusic
    @DrLouMusic Жыл бұрын

    Stoooooo[pppppppppp the awwwwwfffffuuuuulllll music!!!!! It’s beyond disracting😊