Working with APIs in Python [For Your Data Science Project]

We’re going to be working with the KZread API to collect video statistics from my channel using the requests python library to make an API call and save it as a pandas dataframe. Working with APIs is a necessary skillset for all data scientists and should be incorporated into your data science projects. I talk about the one data science project you’ll ever need in this video bit.ly/3rEt6WG so we’ll start with the first step and learn how to work with APIs in python to collect our data.
The python notebook and links to resources are located in this Github repo: github.com/Strata-Scratch/api...
Link to the video referred to in the Intro: • The One and Only Data ...
______________________________________________________________________
👉 Subscribe to my channel: bit.ly/2GsFxmA
👉 Playlist for more data science interview questions and answers: bit.ly/3jifw81
👉 Playlist for data science interview tips: bit.ly/2G5hNoJ
👉 Practice more real data science interview questions: platform.stratascratch.com/co...
______________________________________________________________________
Timeline:
Intro: (0:00​​​​)
Coding on Google Colab: (2:00​​​​)
Testing with the Requests Library: (4:16​​​​)
Working with the KZread API: (6:32​​​​)
Response from Making API Call: (11:00​​​​)
Data is in the 'items' Key: (12:22​​​​)
Parsing through the Data: (12:57​​​​)
Creating the Loop: (16:17​​​​)
Making a Second API Call: (18:30​​​​)
Saving to a Pandas DataFrame: (20:31​​​​)
Implementing Good Software Engineering Fundamentals: (22:40​​​​)
Conclusion: (27:03​​​​)
______________________________________________________________________
If you want data science interview practice with real data science interview questions, visit platform.stratascratch.com/co.... All questions are free and you can even execute SQL and python code in the IDE, but if you want to check out the solutions from me or from other users, you can use ss15 for a 15% discount on the premium plans.
______________________________________________________________________
Contact:
If you have any questions, comments, or feedback, please leave them here!
Feel free to also email me at nathan@stratascratch.com
______________________________________________________________________
#PythonAPI

Пікірлер: 237

  • @jaggyjut
    @jaggyjut3 жыл бұрын

    After a lot of search, I finally found this tutorial which shows how to get data from an API and then convert the json into a dataframe. This is pure gold. Thank you

  • @stratascratch

    @stratascratch

    3 жыл бұрын

    You wouldn't have thought it would take so long to find a video that does? =) glad you found this channel.

  • @jaggyjut

    @jaggyjut

    3 жыл бұрын

    @@stratascratch there are tutorial on how to use API and then different tutorials on converting json to data frame. So far haven’t found a tutorial showing everything end to end.😀

  • @purvilimbachiya1501

    @purvilimbachiya1501

    2 жыл бұрын

    what is the next step after importing a database??

  • @vijaykumarcn8425

    @vijaykumarcn8425

    Жыл бұрын

    How about applying read_json method ?

  • @Thuvu5
    @Thuvu52 жыл бұрын

    Hi Nate, thank you for this great video! Just a quick tip, if any wants to grab the video data for multiple channel IDs at once you can directly use this method (from KZread API doc): request = youtube.channels().list( part='snippet,contentDetails,statistics', id=','.join(channel_ids)) response = request.execute() where channel_ids is a list of channel ids (e.g ['id_1', 'id_2', 'id_3''] and youtube = build('youtube', 'v3', developerKey=api_key)

  • @purvilimbachiya1501

    @purvilimbachiya1501

    2 жыл бұрын

    what is the next process after importing database ??

  • @farhansarguroh8680

    @farhansarguroh8680

    Жыл бұрын

    Thanks a ton

  • @johnwig285

    @johnwig285

    Жыл бұрын

    OMG you're here anyway thank youuu thu vu 🥺

  • @clockfixer5049
    @clockfixer50492 жыл бұрын

    Incredible how concisely this whole topic can be presented. Happy to very soon become a StrataScratch subscriber.

  • @sitanshumishra6468
    @sitanshumishra64683 жыл бұрын

    Thanks Nate, this is the next level of simplifying a so called complex issue related to an API

  • @prateek2159
    @prateek21593 жыл бұрын

    Hey Nate, your videos are just too good. I love how your channel is so dedicated towards real word data science. By the way I noticed that you started a video series, "For your Data Science Project" and I really want you to continue making videos for this particular series because there's literally no one on KZread with such guidance on DS projects and I have been looking for one since a very long time because I have my placements just after 12 months and I really want to make a full stack data science project. Thank you.

  • @vinutnasai584
    @vinutnasai5842 жыл бұрын

    Very good and easily understandable educational video! Thanks Nate, for making the tech stuff interesting as well !

  • @Davidkiania
    @Davidkiania2 жыл бұрын

    What I love most about your content is how you simplify the building process and then refactoring …. I am hooked.

  • @ivlivs.c3666
    @ivlivs.c36662 жыл бұрын

    Now this is real-world, practical knowledge. After watching your video on the one and only data science project you'll ever need, I knew I had found something amazing. After watching this one, I was sold. Just subscribed. Keep these gems coming!

  • @menchu56
    @menchu562 жыл бұрын

    As a beginner, this really helps me understand how to work with JSON files and API calls. Thanks for the great content!

  • @joaofernandes6349
    @joaofernandes6349 Жыл бұрын

    The best part is how you show in a easy way how to do the whole process and then you clean up the code according to good practices. This was really good, thank you!

  • @soumodeepsen3448
    @soumodeepsen34482 жыл бұрын

    This is probably the best video i watched so far on use of api in data science cause everywhere else the videos are so long and i could not understand a lot of those tutorials. Thank you so much for this video content.

  • @mazhar0001
    @mazhar00012 жыл бұрын

    Covered all the basic and important points is a well structured manner to make it simple enough to follow and understand. You have great teaching skills! Thank you for spreading your knowledge.

  • @naanaaabdelmalek
    @naanaaabdelmalek2 жыл бұрын

    I really wanna thank you so much cause those are the real skills that we need as entry-level data scientist, i'm an artificial intelligence student and everything they are teaching us is a pure academic which will not cover the practical side.

  • @PATRICKCHUAD
    @PATRICKCHUAD2 жыл бұрын

    Thank Nate for this very clear video on API. It is a great help for me as I'm studying python API , flask etc. right now.

  • @badsanta01
    @badsanta012 жыл бұрын

    Thanks for the video Nate. Update : One might get an error in the dislike count part. "The statistics.dislikeCount property was made private as of December 13, 2021. This means that the property is included in an API response only if the API request was authenticated by the video owner. See the revision history for more information."

  • @grimoireen
    @grimoireen2 жыл бұрын

    Wow, you're really give a huge knowledge for data science projects for free, big thanks man

  • @Delchursing
    @Delchursing3 ай бұрын

    Made more api progress today than with days of Internet and ai. Thank you. I love how pragmatic this video is.

  • @cristiansoto7581
    @cristiansoto7581 Жыл бұрын

    More videos about this, please. Great information. I loved it!

  • @bactran7799
    @bactran77992 жыл бұрын

    amazing tutorial. Thank you for your well organized video, your voice and everything you talk about are absolutely clear and help me easily to follow. Please keep your great works

  • @hafsawajid2793
    @hafsawajid27932 жыл бұрын

    You are doing an amazing job. It is what's required to understand the programming side.

  • @CodyJelinek
    @CodyJelinek5 ай бұрын

    This is brilliant. I took way too much time searching and googling and watching hours long videos to find pretty much everything I need in a clear crisp straight forward 30min video. Minus a tiny bit of API beginner information and knowing the basics of Python, this was perfect. Well done. I imagine the next video will be everything I need and nothing that I don’t to take the next step of processing/analyzing the data. I am hitting play on that……. Now!

  • @JMinster
    @JMinster2 жыл бұрын

    Thank you so much for your videos, I just recently discovered this channel and it is amazing!

  • @sitiismi7231
    @sitiismi72312 жыл бұрын

    this video-storyboard on point. very clear, explain the scope and summarize. thank you!

  • @avanishpank7572
    @avanishpank75722 жыл бұрын

    Ever since I started my data science learning journey,this might be the most valuable video I have come across,thanks a lot mate,this is extremely helpful.

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Thanks!

  • @czr372
    @czr372 Жыл бұрын

    I spend couple hours figuring out the url's and the api key, but this is a great help, Thanx a lot!

  • @guoyitang4001
    @guoyitang40012 жыл бұрын

    love your video! Clear explanation and straight to the point

  • @azamatbagatov4933
    @azamatbagatov49332 жыл бұрын

    This channel deserves million subscribers and views. Keep it up!

  • @codehorror6743
    @codehorror67432 жыл бұрын

    the amount of knowledge in this one video!!!!!!!!!! God bless you

  • @javierjdaza
    @javierjdaza3 жыл бұрын

    simple, short, and efective. Keep going bro, amazing content

  • @stratascratch

    @stratascratch

    3 жыл бұрын

    Thanks so much for watching. Glad people like these python videos!

  • @wwmmff
    @wwmmff2 жыл бұрын

    Huge thanks! I really like your video. Systematic and clear in your explanation. hope your channel grows! subscribed!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Thanks for watching! And glad you found it educational!

  • @inigocuervo
    @inigocuervo11 ай бұрын

    Hey there! Just a quick tip for anyone trying out the code: make sure you're using a version of pandas earlier than 2.0. Otherwise, you might need to use a different method instead of .append, or consider adding the data to a Python list first and then converting it to a pandas dataframe. Hope this helps! 😊

  • @lme918

    @lme918

    10 ай бұрын

    Even if you will use append method, it's strongly adviced do not use append as in his video as it's awful for performance. Don't do it!

  • @adityaahire2743
    @adityaahire27432 жыл бұрын

    I cannot comprehend right words to express how great this video is and all the content that you create. For all those who dream, plan or wish to make great career in data science you are simply an angel. The most important part which I want to request is a complete playlist of all the components that you mentioned in the : "The one and only one Data Science Project you need". This video covers the data collection part through API...and if other components are covered and all together that playlist would become the gold mine for aspirants. I hope you get time from your busy schedule to consider my humble request... Thanks a lot for all your videos which keep enlightening the Data Science aspirants.🙏

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Definitely will create this playlist or at least write an article that will provide you with resources for each part of this project journey. Thanks for the suggest. It's a great idea.

  • @alfatmiuzma

    @alfatmiuzma

    2 жыл бұрын

    Next highly expected topic can be .. setting up cloud to store the data. We can have a playlist of videos on topics Nate mentioned in the end to end data science project 😊😊

  • @ellenycnyc
    @ellenycnyc2 жыл бұрын

    Wow this helped so much! Super straightforward thanks!

  • @mariumbegum7325
    @mariumbegum7325 Жыл бұрын

    Fantastic tutorial, easy to follow and presented in a way that is easy to follow

  • @matthewd4972
    @matthewd49726 ай бұрын

    Really appreciate the tutorial, tremendously helpful getting my own api project started.

  • @Networkprofessor
    @Networkprofessor Жыл бұрын

    I thought my video speed was on max, but it wasn't; there is just a lot of information being presented. Very comprehensive. Thank you.

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you. We love to share what we know. Glad we have helped you.😀

  • @procorepierre3124
    @procorepierre31242 жыл бұрын

    Thanks a million Nate for such a great content. You are an inspiration

  • @rohitprajapati2303
    @rohitprajapati2303 Жыл бұрын

    Amazing video ,finally get the understanding how to extract data from the API ,Thanks man

  • @stratascratch

    @stratascratch

    Жыл бұрын

    I appreciate your feedback! Thank you too.

  • @69nukeee
    @69nukeee9 ай бұрын

    AMAZING tutorial, thanks for sharing!

  • @jackpeters1598
    @jackpeters15982 жыл бұрын

    Brilliant! Great explanation of the process.

  • @chiomaeze8245
    @chiomaeze8245 Жыл бұрын

    wow, this is amazing! Thank you so much. It was concise and robust. Learnt a lot from it

  • @stratascratch

    @stratascratch

    Жыл бұрын

    You are welcome. Happy that you found our video helpful.

  • @rajgopalmanoharan
    @rajgopalmanoharan5 ай бұрын

    This is an amazing session, thank you

  • @tuhindas6745
    @tuhindas67452 жыл бұрын

    I have been struggling to learn data science from multiple sources and there are hell lot of content.. After scavenging through the dirt pile, garbage of useless information. I can finally say that I have found the most valuable resource available on the internet ! Thank you Nate ! I can finally see light at the end of the tunnel. Love from Delhi, India

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Thank you for your kind words! More to come!

  • @jeh5842
    @jeh58422 жыл бұрын

    Thanks Nate for making this easy!!

  • @supriya1316
    @supriya13162 жыл бұрын

    Thanks for your video . You make the things easy . Thanks a ton :)

  • @stainxyz3373
    @stainxyz337310 ай бұрын

    thanks. this thing took me an entire day to finish.

  • @stratascratch

    @stratascratch

    10 ай бұрын

    I'm glad you did the project! It's a good one day project

  • @danielmoss7133
    @danielmoss7133 Жыл бұрын

    Best video I have seen on APIs. Thank you so much.

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you! If there are other projects you're interested in, let me know!

  • @eulerthegreatestofall147
    @eulerthegreatestofall1472 жыл бұрын

    Great video!!!! very easy to follow through!

  • @rolandr97
    @rolandr972 жыл бұрын

    I forgot to thank you in April: awesome, thanks!

  • @joelngige5776
    @joelngige5776 Жыл бұрын

    Super informative video on working with API's

  • @alirezakaramali1844
    @alirezakaramali18442 жыл бұрын

    It was very clear and useful. Thank you so much.

  • @sajjad5345
    @sajjad53452 жыл бұрын

    I love this playlist and look forward to seeing more videos in it.👍

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Awesome! Thank you!

  • @sidechain0
    @sidechain0 Жыл бұрын

    Great tutorial, thanks!

  • @stefano_er
    @stefano_er Жыл бұрын

    Thanks! Really appreciated it

  • @luzestrada9536
    @luzestrada9536 Жыл бұрын

    You are the best! Thank you so much for sharing this valuable information

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you. We are happy that we were able to help.

  • @omginever
    @omginever2 жыл бұрын

    this is pure gold!

  • @1cutecouple
    @1cutecouple Жыл бұрын

    THIS IS ABSOLUTE BLISS TO WATCH!!! THANKS FOR THE AWESOME CONTENT

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Glad you enjoy it!

  • @darkflamedoctor9023

    @darkflamedoctor9023

    Жыл бұрын

    @@stratascratch now that we have collected the data how are we going to apply ml to this specific task(yt api) My Guess is we need little more info to predict something with good accuracy these are the things I thought for this data: I think we can cluster the video with less views or likes or something like that, one more thing I can think of is predicting views or likes with the help of regression models I cant think of anything else can u please tell me something else

  • @poo872
    @poo8723 жыл бұрын

    Perfect Explanations. Very useful. Thank you so much.

  • @stratascratch

    @stratascratch

    3 жыл бұрын

    Thank you for watching!

  • @jzh4950
    @jzh49502 жыл бұрын

    Very helpful! thank you

  • @awesomeGuss
    @awesomeGuss2 жыл бұрын

    THANK YOUUU man...woow, love this

  • @Mars.2024
    @Mars.2024Ай бұрын

    This video : highly recommended 🍁

  • @jiangchengli2191
    @jiangchengli21912 жыл бұрын

    good work man, best tutorial of collecting data from api !!!!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Glad you think so!

  • @digigoliath
    @digigoliath2 жыл бұрын

    Awesome!!! TQVM!!

  • @ujjwaltarway1438
    @ujjwaltarway1438 Жыл бұрын

    One of the best videos regarding API call. Subscribed.😇😊

  • @djjiang3718
    @djjiang37182 жыл бұрын

    Good stuff and Thank you Nate for sharing!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Thanks for watching!

  • @saaqibmhd
    @saaqibmhd2 жыл бұрын

    Love this tutorial!!

  • @Paper-Z
    @Paper-Z2 жыл бұрын

    You just gained a subscriber Bro 😃 Nice content

  • @samchimaobi3398
    @samchimaobi339810 ай бұрын

    Thanks for this video. was really very helpful.

  • @wombatwombaffle
    @wombatwombaffle2 жыл бұрын

    Good work!!!

  • @kashifrana6798
    @kashifrana67982 ай бұрын

    Amazing content !

  • @alexwoodard2759
    @alexwoodard2759 Жыл бұрын

    good stuff, sir!

  • @mercantilism954
    @mercantilism954 Жыл бұрын

    Oh my god. Your video is a treasure

  • @kelechiasianya4496
    @kelechiasianya44962 жыл бұрын

    Your tutorials are cool

  • @michelchaghoury870
    @michelchaghoury8702 жыл бұрын

    i really like your content a lottt can you make more SQL and Databases vides (More Advanced) please and keep going

  • @ChrisMaringka
    @ChrisMaringka2 жыл бұрын

    Hello Nate, thank you for sharing this tutorial I appreciate it! I just had one quick question about the second API calling: when I tried to call the statistics, every now and then one of the stats (viewCount, likeCount, dislikeCount, or commentCount) might be missing and I could not assign them into a variable. Do you by any chance know the work around for it? Thanks!

  • @zahedinima732
    @zahedinima7322 жыл бұрын

    FANTASTIC tutorial!! What can possibly top this?

  • @shashibhushansingh1628
    @shashibhushansingh1628 Жыл бұрын

    Great👍

  • @ryandavis280
    @ryandavis2802 жыл бұрын

    thank you!

  • @RememberQuranAlways
    @RememberQuranAlways Жыл бұрын

    Just Awesome

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Wonderful. Hope you find the video helpful.

  • @YashSharma-zg1uk
    @YashSharma-zg1uk Жыл бұрын

    thank you so much dude

  • @stratascratch

    @stratascratch

    Жыл бұрын

    You're welcome!

  • @soujanyamukkala1052
    @soujanyamukkala1052 Жыл бұрын

    Hello Nate, Nice Video, love it! I have a question here, instead of making a second API call for the stats, can we use fields parameter in the URL of the first API call to get the stats. Pardon me if I am not understanding the fundamentals properly. Thanks

  • @mjj2u2
    @mjj2u22 жыл бұрын

    Well done. Nice video.

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you very much!

  • @abhaytiwari6411
    @abhaytiwari64113 жыл бұрын

    Wonderfull video

  • @elhipster1
    @elhipster12 жыл бұрын

    This is definitely the best youtube API video I've been able to find. Thank you so much. I actually went through two other videos before this and this one was the clearest that actually moved into a full pandas dataframe. Thanks!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Hey thanks so much for the kind words! I tried my best to clearly explain all the steps and theory. I hope to create more in the future.

  • @elhipster1

    @elhipster1

    2 жыл бұрын

    I really appreciate how you created the 'for' loops, THEN went back and restructured the code to be more 'fundamentally' sound. bravo!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    @@elhipster1 Thanks for noticing how I do it. I always work in this way where I will write code to make sure the function is there. Once the entire script is finished and it's able to function, I'll go back and refactor everything and try to automate things to make my life easier the 2nd time around. It's a good practice for your self. And if you work on a team, you can even share the code with your team so they can use it for their purposes.

  • @konstantinpluzhnikov4862
    @konstantinpluzhnikov48622 жыл бұрын

    Good old days, you can see dislike_count for any video. Great tutorial, many thanks!

  • @saadmansakib6612
    @saadmansakib66122 жыл бұрын

    I love your videos!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Thanks, man! Appreciate it

  • @vivekrathore1857
    @vivekrathore18572 жыл бұрын

    pure learning..

  • @its_me7363
    @its_me73633 жыл бұрын

    Hi Nate, Thanks for making this video and I really enjoyed and learnt from this video. I have a question, do all big/medium companies/startup make their data public via API?

  • @stratascratch

    @stratascratch

    3 жыл бұрын

    Hey! Thanks for watching. The next video is coming out in 1-2 weeks to close out the series. Sometimes companies make their data public but they usually won't make internal data like user engagement or financial stats public. But they usually do make whatever data you own or whatever is deemed public, accessible to all. Like Twitter has an API you can use to collect tweets because all the tweets are publicly accessible. Hope that helps.

  • @useydkerimoglu5720
    @useydkerimoglu5720 Жыл бұрын

    LOVE IT

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you! Glad you enjoyed it.

  • @pauljordan6346
    @pauljordan6346 Жыл бұрын

    Hi Nate, I love the video, super clear and explains a lot. I am struggling with pagetoken, you said it would be explained later, is there another video I need to watch to get a handle on this? Thanks

  • @senyotsedze3388
    @senyotsedze3388 Жыл бұрын

    Interesting video. I was able to create my own api key from KZread. But since I have no posted videos, it is difficult to conceptualize your teaching. I wish we could get a generic api key to see data populated in the dataframe.

  • @shuang7877
    @shuang78772 жыл бұрын

    That diploma looks very familiar - hello Big Red!

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Hello Big Red indeed!

  • @user-ur2en1zq4f
    @user-ur2en1zq4f2 жыл бұрын

    tHanKs Dude

  • @andrep1370
    @andrep13702 жыл бұрын

    I'm new to Python and this really helped a lot , been programming for a long time , but Python is new to me. It explains a lot Is this code available anywhere will save having to re-type . Thanks

  • @vizdam9537
    @vizdam95372 жыл бұрын

    Awesome

  • @markk364
    @markk3643 жыл бұрын

    Excellent Code Descriptions - breaking down the loop elements BEFORE creating the code is excellent. I was inspired by this lesson - to improve my data ingestion capabilities. At risk of redirecting viewers - I started a LI Learning course: Data Ingestion with Python, Miki Tebeka. (requires a subscription to LI).

  • @jcokonkwo
    @jcokonkwo2 жыл бұрын

    Thanks again Nate, I appreciate the helpful content on understanding/navigating the API through Python. I know you didn't have time in the video to elaborate, but how can we continue looping through pages via 'pageToken' to extract all of data than just the first page?

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    Great question. I actually have the code in the github repo. There's a link in the description. I use the 'pageToken' to do this as you mention. Check out the implementation!

  • @jcokonkwo

    @jcokonkwo

    2 жыл бұрын

    @@stratascratch Thanks Nate! Appreciate the help. Currently in interviews and I've gotten far with your content!

  • @user-np2md7vw5q

    @user-np2md7vw5q

    10 ай бұрын

    @@stratascratchWhen I add the "pageToken" some conflist with response['item'] arises. What could be the reason? ----> 4 df = get_videos(df) in get_videos(df) 6 response = requests.get(url).json() 7 time.sleep(1) ----> 8 for video in response['items']: 9 if video['id']['kind'] == "youtube#video": 10 video_id = video['id']['videoId']

  • @hoanglam2814
    @hoanglam2814 Жыл бұрын

    love that

  • @stratascratch

    @stratascratch

    Жыл бұрын

    Thank you!

  • @sophiez7952
    @sophiez79522 жыл бұрын

    Great

  • @Glenners
    @Glenners2 жыл бұрын

    I'm just getting started on your channel but I feel like this is already so good. All the other projects and teachings I've found just feel so artificial and insulted. Can't wait to slog through my own projects soon! It still feels like my brain is reaching critical mass before it all "clicks" though.

  • @stratascratch

    @stratascratch

    2 жыл бұрын

    That's definitely a feeling I still have as I learn more and take on more complex projects. I don't think it ever goes away! So you're on the right track. A lot of data science and analytics is about being comfortable not knowing all the answers. The learning curve is steep but once you get comfortable, it becomes fun. Good luck!