AI Body Language Decoder with MediaPipe and Python in 90 Minutes

Ғылым және технология

Want to start decoding body language?
Need to see who’s really saying what in that interview?
Trying to work out what’s the sign for Wakanda Forever? 🤣
You’ll learn how to do exactly that in this Python AI tutorial. In this video you’ll learn how to leverage Mediapipe to estimate both facial and body landmarks. With that data you’ll then be able to build custom pose classification models that allow you to decode what a person might be saying with their body language with fine grain accuracy. Best of all, you can customise this to suit your own needs. If you wanted to extend this to perform drowsiness detection or extended pose classification with hand models you could!
You’ll learn how to:
1. Set up MediaPipe for Python
2. Estimate Face and Body poses using your Webcam and OpenCV
3. Collect and process Joint Coordinates using Pandas
4. Train a custom Pose Classification model using Scikit-Learn
5. Decode Body Language in Real time
GET THE CODE FROM THE VIDEO: github.com/nicknochnack/Body-...
Mediapipe Holistic Tutorial: • AI Face Body and Hand ...
Mediapipe Holistic Baseline Code: github.com/nicknochnack/Full-...
Chapters:
0:00 - Start
0:22 - Introduction
1:05 - How it Works
3:15 - Tutorial Start
5:09 - Installing Mediapipe and Dependencies
19:24 - Capture Landmarks using OpenCV and CSV
41:48 - Load Pose and Face Data using Pandas
49:08 - Train Sciki-Learn Pose Classification Model
57:04 - Evaluate Classification Model and Pickle
1:05:28 - Making Detections using the Model
1:19:09 - Decoded Body Language Demo
1:24:41 - Displaying Probabilities
1:26:00 - Adding in New Poses
1:32:16 - Wrap Up
Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV
Happy coding!
Nick
P.s. Let me know how you go and drop a comment if you need a hand!

Пікірлер: 371

  • @ameensamhan751
    @ameensamhan7512 жыл бұрын

    The most professional easy to understand and implement tutorials on youtube. You really are the best.

  • @hargobindsingh9763
    @hargobindsingh97633 жыл бұрын

    One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks sooo much @Hargobind, so glad you enjoyed it!!

  • @friedafrikadelle9483
    @friedafrikadelle94833 жыл бұрын

    I just discovered your channel and I‘m obsessed. Thank you so much for doing such great content🙏🏻🙏🏻🙏🏻

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thank you so much @Frieda, so stoked you're getting value from it!

  • @Virtualexist

    @Virtualexist

    3 жыл бұрын

    Me tooo !!!!!

  • @francis3725
    @francis37253 жыл бұрын

    One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    🙌🙌🙌 sending you all the luck, you'll smash it @Francis!

  • @harshdasila6680

    @harshdasila6680

    2 жыл бұрын

    have anyone actually implemented this code Please let me know Very urgent !!

  • @NiKiTjA_OFF
    @NiKiTjA_OFF4 ай бұрын

    I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?! And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model

  • @one_done_facts

    @one_done_facts

    Ай бұрын

    HI. you can send requirements.txt string , please!

  • @VikramSaigal
    @VikramSaigal3 жыл бұрын

    Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Awesome usecase, I'll add it to the list. Never even thought about comparing poses!

  • @isaackay5887
    @isaackay58873 жыл бұрын

    Looking forward to watching this later!! Thank you for all the quality videos. Have a great one!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Anytime @Isaac! Thanks a bunch 🙏

  • @emelsoylu3002
    @emelsoylu3002 Жыл бұрын

    Your videos are very descriptive and useful. Your content is of high quality. Thank you.

  • @EduardoGarcia-tv2fc
    @EduardoGarcia-tv2fc3 жыл бұрын

    your tutorials are the best tutorials I have seen in my life, congratulations!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks a tonnn @Eduardo!!

  • @shivlymizi3211
    @shivlymizi32113 ай бұрын

    Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing

  • @one_done_facts

    @one_done_facts

    Ай бұрын

    HI. you can send requirements.txt string , please!

  • @shalomsonekar6985
    @shalomsonekar69852 жыл бұрын

    This is really awesome , loved the way how you explained everything, great Job. Really Thankful for this. 💯 THANK YOU SO MUCH BRO ! KEEP HUSTLING ❤️

  • @danielamemba5307
    @danielamemba53073 жыл бұрын

    The 210th comment is dedicated to the best content on KZread. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Anytime my guy, better late than never, WELCOME TO THE FAM!!!

  • @marcfinger4549
    @marcfinger45492 жыл бұрын

    Your channel has helped me so much when working on my dissertation. Thank you 🙏

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    YESSSS, go getem Marc! Hope you smash it out of the park!

  • @srirammadduri8078
    @srirammadduri80783 жыл бұрын

    Man! Your tutorials are really really cool!! And DAMN RIGHT we want a bigger data science series!!!!! Awesome work man!!! Cheers!!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    YESSS! So glad you enjoyed it!

  • @srirammadduri8078

    @srirammadduri8078

    3 жыл бұрын

    @@NicholasRenotte Mann! I thought you wouldn’t respond! Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@srirammadduri8078 nah man! I try to get to all comments. Hit me up on Discord, I check every night and if crazy every second night. bit.ly/3dQiZsV

  • @priyambordoloi771
    @priyambordoloi7713 жыл бұрын

    Good job brother. I will always appreciate the tasks that you do.

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks so much @Priyam!

  • @talhaeneskoksal4893
    @talhaeneskoksal48932 жыл бұрын

    Thanks buddy for really helpful videos. Keep going, Wakanda Forever!

  • @CalebSchantzChristFollower
    @CalebSchantzChristFollower3 жыл бұрын

    Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.

  • @eddysaoudi253

    @eddysaoudi253

    3 жыл бұрын

    Exactly.

  • @friedafrikadelle9483

    @friedafrikadelle9483

    3 жыл бұрын

    Yes!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!

  • @CalebSchantzChristFollower

    @CalebSchantzChristFollower

    3 жыл бұрын

    No hurry, you are already putting out content at a crazy pace! Take that break!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.

  • @nicolasabosch
    @nicolasabosch10 ай бұрын

    Great tutorial, i wish your channel have more visibility

  • @one1896
    @one18963 жыл бұрын

    Only you have the best python vidos on KZread. Greetings from Russia)

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks so much @ONE! What's happening from Sydney!?

  • @jonathonvandyke6328
    @jonathonvandyke63283 жыл бұрын

    Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Nothing around it yet but will probably do something soon @Jonathon!

  • @shai8559
    @shai85592 жыл бұрын

    really amazing content. im currently working on my final cs project and this video (and some others) were tremendous help for me. amazing job man!

  • @harshdasila6680

    @harshdasila6680

    2 жыл бұрын

    have anyone actually implemented this code Please let me know Very urgent !!

  • @shai8559

    @shai8559

    2 жыл бұрын

    @@harshdasila6680 i did. What you need?

  • @harshdasila6680

    @harshdasila6680

    2 жыл бұрын

    @@shai8559 i am getting error

  • @shai8559

    @shai8559

    2 жыл бұрын

    @@harshdasila6680 you can type the error and ill see if i can help

  • @amilakelum2670
    @amilakelum26702 жыл бұрын

    This video help me in creating my final year project thanks lot ❤

  • @victormustin2547
    @victormustin25473 жыл бұрын

    I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Yah, agreed! Working on a bunch of stuff in that space rn @Victor!

  • @victormustin2547

    @victormustin2547

    3 жыл бұрын

    @@NicholasRenotte Amazing ! I’ll be there to see it as soon as it comes out !

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@victormustin2547 yesss! Thanks a bunch for checking out the vids so far as well!

  • @naratilife
    @naratilife2 жыл бұрын

    Excellent Presentation. Just loved it.

  • @winniepooh2533
    @winniepooh25333 жыл бұрын

    Hey Man...! You are really cool!!!! I love this project, I'm your new subscribers!!!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    YESSS! Welcome to the fam!

  • @creathyang9413
    @creathyang94132 жыл бұрын

    Excellent vid man, thanks

  • @KamalMahss
    @KamalMahssАй бұрын

    first, i want to thank you about this big effort. second, can you make a video about fall detection using media pipe please this video will help me a lot

  • @one_done_facts

    @one_done_facts

    Ай бұрын

    HI. you can send requirements.txt string , please!

  • @leonelp9593
    @leonelp95932 жыл бұрын

    Such a cool content ! Thanks for sharing this

  • @micheletufano6848
    @micheletufano6848 Жыл бұрын

    Amazing work! Thank you so much!

  • @vishalm954
    @vishalm9543 жыл бұрын

    Amazing stuff! Getting to learn a lot:)

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks so much @Vishal 🙏!

  • @danieladama8105
    @danieladama81053 жыл бұрын

    Just what I needed. Thank you

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    YESS! So glad to hear Daniel!

  • @shwetapatil1726
    @shwetapatil17262 жыл бұрын

    Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?

  • @jmacron4652
    @jmacron46522 жыл бұрын

    Great tutorial....Can you do a tutorial where you can save body and facial motion to BVH or FBX files to use with a 3D Character..

  • @joinushugabear5847
    @joinushugabear58472 жыл бұрын

    Hi @Nicholas Renotte thank you for this nice tutorial. I was wondering how you could give the face detection data a bit more weight? So that I can do a classification that relies more on if i for instance smile or not? Or is that a training thing mostly? I still want the body language to count, but give more weight to the face in the model. Hope that makes sense? Cheers

  • @shahdsg4527
    @shahdsg45272 жыл бұрын

    Thank you so much!!!!! Please can i do same steps for sign language recognition instead of using mediapipe+LSTM ???

  • @faraazmohammed3693
    @faraazmohammed36932 жыл бұрын

    Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Check this out! kzread.info/dash/bejne/lqN4t8uhoM2cotI.html

  • @olatundeolukoya1788
    @olatundeolukoya17887 ай бұрын

    2 years but the video still Lit

  • @danielkristioutomo1344
    @danielkristioutomo13442 жыл бұрын

    Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou

  • @lamsongianm
    @lamsongianm2 жыл бұрын

    Awesome content!!

  • @user-jc1eg9ob2n
    @user-jc1eg9ob2n Жыл бұрын

    hi nick can you make a more detailed video on explaining the libraries you imported and how the code works in detail?

  • @shudarshankongkham198
    @shudarshankongkham1982 жыл бұрын

    how do we put the threshold on the prediction? also, thank you for all the effort you put into each modules.

  • @jeffreylin2488
    @jeffreylin24882 жыл бұрын

    underrated channel

  • @coffeecoder9458
    @coffeecoder94582 жыл бұрын

    YOU ARE THE SH**!!! Props my man and thank you for making such great content!!

  • @nurulsyifa9035
    @nurulsyifa90353 жыл бұрын

    so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thank you so much @Nurul! You could particularly with the hand models! Could even pass to a RNN for action detection!

  • @yuriemond7340

    @yuriemond7340

    3 жыл бұрын

    @@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@yuriemond7340 definitely, take a look at some of these action models: tfhub.dev/s?q=action

  • @mayamayonnala1712
    @mayamayonnala17123 жыл бұрын

    Awesome content. Is it also possible to train the csv file with tensorflow instead of sklearn? Looking forward to watching your other videos!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Sure can!

  • @shortcomedyclip
    @shortcomedyclip3 жыл бұрын

    Thats Awesome! For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset? Thanks

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!

  • @wanjohichristopher8556
    @wanjohichristopher85562 жыл бұрын

    Hi Nicholas,i love the content you make.Much thanks for sharing. Can we deploy this??

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Sure can! Been messing around with Kivy for CV (could probs do that).

  • @tedbryantesoro
    @tedbryantesoro2 жыл бұрын

    hello thank you for this tutorial i was wondering if you can use a group of still image as a dataset instead of manually recording pose

  • @01bit
    @01bit3 жыл бұрын

    Excellent video!!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks so much @01bit!

  • @fisiologicageral
    @fisiologicageral3 ай бұрын

    Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.

  • @AiPhile
    @AiPhile3 жыл бұрын

    Awesome 👍 work appreciated ♥️

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks a ton @AiPhile!

  • @amalendhu8610
    @amalendhu86103 жыл бұрын

    Hey brother, I like your content, your presentation. And a request, can you build a project on a sentence generator when some words are only given.

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Yup! Check this out: kzread.info/dash/bejne/lXytz6-tYba3nps.html

  • @yousseffarhan8901
    @yousseffarhan89013 жыл бұрын

    محتوى ممتع ومفيد، شكرا جزيلا لك 🙏🏼 تستحق المدح والتشجيع

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thank you so much @Youssef! So glad you enjoyed it!

  • @stanley-elmagico
    @stanley-elmagico9 ай бұрын

    Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?

  • @JohnGalanakis
    @JohnGalanakis3 жыл бұрын

    I love your videos and your work

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks a bunch @John!

  • @pierrehachey
    @pierrehachey2 жыл бұрын

    Awesome videos on object detection and great teaching ability. Great video on sign language detection. I wonder if you can create or already have a video on this. Scenario: User takes phone and hovers over an object, like a credit card, where entire credit card must be captured within the defined outlined box. Once the full object is detected "within" the outline a success message appears notifying user that they are centered and can now take a picture. Do you have any videos like that? Kinda like google lens but entire object would have to be inside outline. Thanks!

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Closest I'd have is the ANPR series kzread.info/dash/bejne/YmFo0sGKl9XKkqg.html

  • @shivamsingh-vv9vm
    @shivamsingh-vv9vm3 жыл бұрын

    Let's try something in 3D. That will look great. The AI gym trainer in 3D would be great!!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Agreed, on the R&D list as we speak!

  • @roboticsforunitedindia9421
    @roboticsforunitedindia94212 жыл бұрын

    Nice video sir

  • @abcd-zw9oh
    @abcd-zw9oh3 жыл бұрын

    Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Sure can! I actually did it in the past with a video of the Royals being interviewed.

  • @satishchandrasekaran3045

    @satishchandrasekaran3045

    2 жыл бұрын

    @@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you. Could you please point me to the video where you use other videos/pictures to train the model?

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    @@satishchandrasekaran3045 still a work in progress at this stage!

  • @user-um1kn5rr1q
    @user-um1kn5rr1q7 ай бұрын

    Hi Nicholas! Depending on the position of the wrist, can you tell me the coordinates of the joint at that time??

  • @modyngs5985
    @modyngs59852 жыл бұрын

    Hey Nicholas, Thanks for this tutorial ... i was wondering if there is a solution for training a model with sentence instead of single word? lets say for training a sentence of ""HI, How are you doing?"" and then use it to recognize the sign language or for generation of sign language using animations. I dont want you to go through the whole process but my question is about teaching sentence(instead of single word) to the model using webcam and csv Thanks Best regards

  • @nguyenvu6371
    @nguyenvu63713 жыл бұрын

    Hello Nicholas. I'm new to your channel and I'm glad that I found you. I saw someone can find bounding box of the face using mediapipe's pose estimation. I don't know how he can do that. I think he can find the width of bounding box by calculating distance between left ear and right ear key points, the center of bounding box probably is nose key point. But I don't know how to find the height of bounding box. Hope you can help me out. Thanks so much.

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Heya @Nguyen Vu, they might have been using this model instead: google.github.io/mediapipe/solutions/face_detection.html

  • @TejrajParab
    @TejrajParab3 жыл бұрын

    I want that pipeline video.

  • @soothingrelaxation8725
    @soothingrelaxation87253 жыл бұрын

    Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!

  • @soothingrelaxation8725

    @soothingrelaxation8725

    3 жыл бұрын

    Heyy @@NicholasRenotte, yes if u can do that will be great! Thanks a lot for your help.

  • @houstonkoh7614
    @houstonkoh76142 жыл бұрын

    thanks for the video I have a question: i was trying to export the coords but it didnt export to excel

  • @tasarm4939
    @tasarm49393 жыл бұрын

    hey man ıhave been followin you for a while you done greeaaat jobs your channel is like a full stack course of data science thank you so much for that. but ı really wantto know why are you doin that ı mean beside of a youtube content what do you expect from your projects ? is that something about your IBM carreer ? (like a part of portfolio ? )

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Ayyye, anytime man, glad you like it. I'm just doing it because I enjoy it at the moment 🙂

  • @ameerazam3269
    @ameerazam32693 жыл бұрын

    this one is amazing

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    It's pretty slick right? There's so much you can actually do with the workflow @Ameer!

  • @finance315
    @finance3153 жыл бұрын

    thats so cool! i have a question, how can we fix the flickering at then when it's running?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    It would need a more powerful GPU or machine. The lag is due to the FPS drag from the ml model.

  • @finance315

    @finance315

    3 жыл бұрын

    @@NicholasRenotte i have fixed it!! now running at 10 to 12 FPS, thats still good. thank you so muchhhh

  • @kirtipandya4618
    @kirtipandya46183 жыл бұрын

    Awesome awesome work.

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks a bunch @Kirti, so glad you enjoyed it!

  • @yoman9446
    @yoman94463 жыл бұрын

    Awesome!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Thanks so much @MONKey!

  • @user-ks2jf8tt9u
    @user-ks2jf8tt9u Жыл бұрын

    Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.

  • @firthmanee7735
    @firthmanee77352 жыл бұрын

    Thanks for the great video as always !!, May I ask a question If I want to count how long for the specific position what should I do , do you have any suggestion ? , Thanks in advance.

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Could look at counting the number of frames that position had the top score!

  • @firthmanee7735

    @firthmanee7735

    2 жыл бұрын

    @@NicholasRenotte Thanks !!

  • @deepshrivastava229
    @deepshrivastava2292 жыл бұрын

    Great Tutorial, very professionally and amazingly done. Thanks a lot !!! just an issue in loading the model again after restarting the kernel. Have to train the model every time when I open my jupyter notebook(cuz when loading the model in this condition it is not making predictions even after saving in pickel). Is there any way that I can keep the model intact even after I close the notebook or I have to train it everytime I open my notebook ? Please guide. Is there any way wherein I can save it not using pickel but using h5 format. Please guide !!

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Pickle should work fine, are you sure the model is being saved? h5 is normally reserved for keras/tf models.

  • @deepshrivastava229

    @deepshrivastava229

    2 жыл бұрын

    @@NicholasRenotte Firstly, A Big Thanks for the reply !!!! You Are AWESOME❤️❤️. I am saving the the model with pickel and its working fine for when I am making detections for the first time (just after training), but as soon as I close the notebook and open it the next time and load the same model its not making the detections, and I have to train it everytime. Hence I am unable to save/load it (i.e pickel might not be working or maybe I am doing something wrong in the last part). Can I do it using joblib as well ? Please guide. Thank you.

  • @prtdesh25
    @prtdesh253 жыл бұрын

    Heyy!! Nice video actually I was looking for something like this but is this way generalized. Will this model work on different faces.

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Sure will, just gotta fine tune!

  • @prodbyrish
    @prodbyrish2 жыл бұрын

    This is so cool! Can I set this up to only detect poses I make with my hands?

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Yup, there's mediapipe models that only detect hands as well. I've got a vid on the channel!

  • @prodbyrish

    @prodbyrish

    2 жыл бұрын

    @@NicholasRenotte Got it! Il check it out!!

  • @somyatomar6292
    @somyatomar62922 жыл бұрын

    Hi, this is an amazing project! I followed the method discussed here for exercise pose classification. It worked good. But now I have a doubt that's very different from pose classification. How can I rate a user's exercise pose accuracy given that I know the class of the pose?

  • @harshdasila6680

    @harshdasila6680

    2 жыл бұрын

    have anyone actually implemented this code Please let me know Very urgent !!

  • @KriGeta
    @KriGeta3 жыл бұрын

    So awesome, is there any way to control a 3D model in blender using this body estimation technique? Like motion capture?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Haven't seen it in blender but I've seen it in Unity using the Barracuda framework!

  • @KriGeta

    @KriGeta

    3 жыл бұрын

    @@NicholasRenotte may you pls tag me a tutorial?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@KriGeta don't have anything yet but will shoot it through once it's up!

  • @KriGeta

    @KriGeta

    3 жыл бұрын

    @@NicholasRenotte that's great 😍

  • @brucewayne9708
    @brucewayne97083 жыл бұрын

    hey can we use this to do real time sign launguage . If we can use this please do a video on it.Thank you

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Bruce! Heya, yup, got something in mind!

  • @rupendrakrishnaraavi4217
    @rupendrakrishnaraavi42173 жыл бұрын

    Hi Nicholas, first of all, it's really a great piece of work but here again, I have a scenario where I will train my model with different signs(Alphabetical blind signs) and I wanted all of them to come up in a phrase/sentence that may be in a new window any clue how to do that?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Heya @Rupendra, check this out: kzread.info/dash/bejne/h4SHl5aiZ67TY5M.html

  • @MsSonoFelice
    @MsSonoFelice3 жыл бұрын

    Hi Nicholas !Thank you for nice work sharing. May i know the way to increase the fps for mediapipe . i have very low fps as 1 to 2 fps only. Kindly advice. thank you

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Heya @MsSonoFelice, what type of machine are you running this on? Possibly try a different machine, something with a GPU perhaps?

  • @sagarsingh2601
    @sagarsingh26013 жыл бұрын

    Good morning sir hope you have a great day thanks for this one

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Anytime @Sagar Singh, what did you think of it?!

  • @sagarsingh2601

    @sagarsingh2601

    3 жыл бұрын

    @Nicholas Renotte that is super awesome...😁

  • @anishaudayakumar1778
    @anishaudayakumar17783 жыл бұрын

    Hola !! This is so much fun to implement and decode the pose.... Thanks a million

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Heya @Anisha, thanks so much!! Unfortunately, it looks like mp only supports single poses. I'm taking a look at OpenPose for multi pose estimation.

  • @anishaudayakumar1778

    @anishaudayakumar1778

    3 жыл бұрын

    @@NicholasRenotte Back with another fan request❤️! I'd love to see a tutorial on exploring Mediapipe's 3D face mesh to render some kind of face filters like in Insta. Digging deep on their graphs and calculators 😀

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@anishaudayakumar1778 oh that's a hotly requested one, definitely got that one planned!

  • @anthonysoronnandi1459
    @anthonysoronnandi14592 жыл бұрын

    I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.

  • @joshlenuelpontillas5202
    @joshlenuelpontillas52022 жыл бұрын

    Hi! What do I need to learn about if I want to detect motion instead of a pose? and compare my shooting motion(basketball) from the shooting motion of a pro? Thanks for the videos, I struck goldmine from your channel!

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Check this out: kzread.info/dash/bejne/lqN4t8uhoM2cotI.html

  • @gameofwealth12
    @gameofwealth122 жыл бұрын

    I just discovered your channel and Learned So much about Machine Learning. Could you help me in my project? My Project is Classification of Bad and Good Sitting Posture. How would you deploy this in raspberry pi and send data to mobile application? Hoping for your response and tutorials on this. Thanks! I totally in love with your contents

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Heya, you couldi fine tune this model for good and bad posture and deploy the same code to RPi!

  • @FindMultiBagger
    @FindMultiBagger3 жыл бұрын

    Thanks lots for great approch and hardwork 🙏♥️ Question :- 1) does it work for multiple person in frame ?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Unfortunately no @Vinay, check out OpenPose for that!

  • @FindMultiBagger

    @FindMultiBagger

    3 жыл бұрын

    @@NicholasRenotte Thanks Nick 🙏

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@FindMultiBagger anytime!

  • @prateekxx
    @prateekxx2 жыл бұрын

    55:47 that mic glitch made me spill coffee on myself

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Oh shit 🤣, didn't even know that was in there.

  • @CreatingUtopia
    @CreatingUtopia4 ай бұрын

    @Nicholas Renotte , please reply, instead of classifying body language, we can detect spoken words with lip movement right?? Using lips coordinates

  • @yasinyer381
    @yasinyer3813 жыл бұрын

    you amaze me

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Ohhh shucks 😅

  • @gavel8888
    @gavel88882 жыл бұрын

    Thank you so much. Great tutorial. There is only one problem. The hands landmarks do not record coordinates if I use one of the hands to turn off camera. basically, both hands should be in the view of videocamera from the start till the end to record coordinates. I cannot figure out how to stop recording automatically after certain time. Could you please help with this?

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Try using a loop rather than a key, could use something like for x in range(3000) to record 3000 frames!

  • @gavel8888

    @gavel8888

    2 жыл бұрын

    @@NicholasRenotte Thank you!

  • @MH-lr6wm
    @MH-lr6wm3 жыл бұрын

    지렸습니다 선생님....

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Might have the translation wrong for this one but, bored teacher?

  • @MH-lr6wm

    @MH-lr6wm

    3 жыл бұрын

    @@NicholasRenotte maybe translation is wrong😅 it means cool in korea!

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    @@MH-lr6wm phew, dodged a bullet there 😂!

  • @namangoyal8477
    @namangoyal84772 жыл бұрын

    Hey Nick, need a help. Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.

  • @sorochinsky
    @sorochinsky3 жыл бұрын

    so... well, let's go!!)) It looks cool)

  • @sorochinsky

    @sorochinsky

    3 жыл бұрын

    01:03:00 - Yes, we did, thank you)))

  • @sorochinsky

    @sorochinsky

    3 жыл бұрын

    compared to the previous classification method, using image markup, this method looks more promising, but also more complex

  • @sorochinsky

    @sorochinsky

    3 жыл бұрын

    Nick, information is top, in general, as always, this time I loaded it in full)) Considering that you put everything on the shelves. It will take a long time to digest = D

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    YESSSS! You checked it out! It's definitely a lot more sophisticated than the angle calculation method which is why I was so excited to put it out. It'll perform a lot better in complex scenarios and can have additional logic applied over the top of it to do rep counting, form correction etc.

  • @mohamedabudalkrem6289
    @mohamedabudalkrem6289 Жыл бұрын

    wooow thanks for Avery think u real eng 🤩🤩🤩🤩

  • @tahminazebin6099
    @tahminazebin60992 жыл бұрын

    Can you please provide a code version for doing it on a recorded video instead of the live webcam?

  • @nadila3416
    @nadila34162 жыл бұрын

    hi! awesome video bro! what if we want to convert it into a desktop application or web application?

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    Could wrap it in Streamlit or Kivy!

  • @user-yb3hq5bh3f
    @user-yb3hq5bh3f2 жыл бұрын

    hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names "X does not have valid feature names, but". what's I make mistake? thanks.

  • @Greygasm

    @Greygasm

    Жыл бұрын

    Did you find a fix for this?

  • @lakpatamang2866
    @lakpatamang28662 жыл бұрын

    My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?

  • @mohammadadnan5988
    @mohammadadnan59882 жыл бұрын

    I trained my model and it's working fine. I have one issue. My application has to do the estimation on a whole classroom. How can we apply this to a group of people? It just detects one face per pic. Would really love some suggestion.

  • @NicholasRenotte

    @NicholasRenotte

    2 жыл бұрын

    There's a new pose estimation model available that supports multi person! Check this out tfhub.dev/google/movenet/multipose/lightning/1

  • @yuriemond7340
    @yuriemond73403 жыл бұрын

    Is there a way to know to which joint the x1, y1, or x2, y2 are associated to? Am I mistaken to say that x1 would be associated to the first value of the Pose Landmark Model which is the nose?

  • @NicholasRenotte

    @NicholasRenotte

    3 жыл бұрын

    Check this out @Yuri, it shows the index mapping: google.github.io/mediapipe/images/mobile/pose_tracking_full_body_landmarks.png

Келесі