Pandas Tutorial : Pandas Full Course
New Data Science / Machine Learning Video Everyday at 1 PM EST!!! [ Click Notification Bell ]
Pandas is an amazing framework used to work with tabular data, input data from numerous file / database types, clean data, analyze it and visualize it. If you want a video that condenses the whole Pandas API and all that it can do into 1 video with hundreds of examples, then this video is for you.
I cover most everything you'll learn by reading the API here. Next I'll cover MatPlotLib, Seaborn, SciPy, StatsModels, Plotly, Scikit-learn, TensorFlow, PyTorch, Keras, Scrapy, Linear Algebra, Calculus and more. CLICK THE NOTIFICATION BELL
MY UDEMY COURSES ARE 87.5% OFF TIL March 26th ($9.99) ONE IS FREE
➡️ Python Data Science Series for $9.99 : Highest Rated & Largest Python Udemy Course + 56 Hrs + 200 Videos + Data Science bit.ly/Master_Python_50
➡️ C++ Programming Bootcamp Series for $9.99 : Over 23 Hrs + 53 Videos + Quizzes + Graded Assignments + New Videos Every Month bit.ly/C_Course_50
➡️ FREE 15 hour Golang Course!!! : bit.ly/go-tutorial9 (100 Available)
Pandas GitHub Cheat Sheet : github.com/derekbanas/pandas-...
Install for Windows : • Install Anaconda Windows
Install for MacOS : • Install Anaconda MacOS
Probability in One Video : • Probability for Data S...
Statistics in One Video : • Statistics for Data Sc...
NumPy in One Video : • NumPy Tutorial : Numpy...
#LearnWithMe #NewVideoEveryday #Pandas
The most in demand skills in the world right now are in Data Science & Machine Learning! I will teach you everything imaginable about Data Science & Machine Learning including all the math, libraries, algorithms so that rather then playing with it on an elementary level you will Master it! The journey will be hard, but those willing to put in the time and brain power will be rewarded in the end.
Here is a Table of Contents that will allow you to jump around in the video and learn what ever you are interested in.
TABLE OF CONTENTS
00:00 Intro
01:05 Series
05:55 Creating DataFrames
10:02 Editing / Retrieving Data
18:29 Conditional Selection
24:07 Importing Data from Anywhere
33:00 Basics & Math
41:33 Grouping Data
43:36 Concatenate, Merge & Join Data
46:06 Statistics
51:50 Iteration
53:51 Sorting
55:13 Manipulate Data with Functions
1:03:30 Aligning, Reindexing, Renaming
1:08:33 MultiIndex
1:15:53 Cleaning Data
1:18:34 Real World Examples
1:25:21 Visualization
1:38:14 Installation & Virtual Environments
Like the channel? Consider becoming a Patreon and get access to exclusive videos! All Patreons who contribute $1 or more get a FREE coupon code to my Python Programming Bootcamp Series!!!
Check it out here: / derekbanas
GET FREE STUFF AND SUPPORT MY TUTORIALS
1. Get a Free Stock : share.robinhood.com/derekb1560
2. Get 2 Free Audiobooks : amzn.to/2Y5FV2p
THANK YOU TO MY PATREON SUPPORTERS LIKE :
shapeganic.com/app/store (Calorie Counter & Weight Tracking App)
ckcoder.com
vsolutions.be
lumarycodes
github.com/metabake
greedygammon.com
mrjak318
Пікірлер: 163
Wow, fire, heat, energy, enthusiasm. I can feel all these in this channel. 2 to 4 videos in a week is simply amazing. Thanks Derek
@derekbanas
4 жыл бұрын
Thank you for the compliment :) I've made a video everyday since July 30th
It's a crime you make so much informative high quality content for free and don't have a million more subs.
@derekbanas
4 жыл бұрын
Thank you for the compliment :) I think it just comes down to the fact that most people don't have a thirst for knowledge. I'm certain that the percentage of people that go through life educating themselves past the age of 25 is extremely low.
Hi Derek, I came here after watching your video from which I learnt Perl. I think you've made self-teaching a lot easier by just showing different things programmers can do with specific tools, because whenever I practise along with your video, at the end I already have so many examples of the variety of capabilities of the tool and from there it's just a matter of experimentation and practice. Keep up the great work! Make informal training great forever!
@derekbanas
2 жыл бұрын
Thank you very much :) I'm happy you enjoy them. I do my best to make the tutorials interesting and useful
@badribaskaran8612
2 жыл бұрын
@@derekbanas , I am trying to find online deep learning courses, but I’m finding that many of them already have the code written down for me on a notebook and I want something that pretty much requires me to write down every line, because that’s the only way I feel I can learn. Do you have any recommendations by any chance?
loc and iloc was something that I used to always get confused about. Thanks Derek for making it extremely clear to me by just mentioning what those mean.
It's hard to believe you packed this much information in such a short video Man you are an artist
@derekbanas
3 жыл бұрын
Thank you for the nice compliment :) I try to do my best
extremely underrated channel and I cant stress enough! the amount of you info you put out is phenomenal.
I can't tell you how much I have been looking forward to this one!
@derekbanas
4 жыл бұрын
That makes me very happy :) The goal is to completely teach data science and machine learning by the end of the year along with all the math involved.
Taking the time to tell you! ❤ Also, when I just started coding I was a bartender watching your Java tutorial vids. Eventually switched to web development, did bootcamp, now professional dev and coming to you to learn about pandas.
@derekbanas
3 жыл бұрын
Wow that is awesome! Congratulations! I hope you find these tutorials useful. This is what I do for a living and I did my best to cover everything understandably
watched it to the end :) thanks again for the great content! I have some regular python experience and now dipping my feet into Data Science, pandas seems to have an immense amount of functions, a lot to learn.
@derekbanas
3 жыл бұрын
Thank you :) Yes Pandas is central to data science. I do this stuff for a living and I can say it is amazing what can be forecast with these tools
Your videos are truly phenomenal!! I’ve never seen videos that are this succinct and informative at the same time!
@derekbanas
3 жыл бұрын
Thank you for the very nice compliment :) I try to do my best
You're a Data Science rockstar, Derek! I am addicted to your videos. Thank you for making Data Science fun! :)
@derekbanas
2 жыл бұрын
Thank you for the nice compliment :) That is what I do for a living and it’s fun to teach
Thank you so much!!! I was thinking about reading the docs and then *clear and concise tutorial came up* :)
@derekbanas
4 жыл бұрын
Thank you :) I did my best to cover everything in the Docs with examples.
Yes Derek, there are people that watch your videos til the end. These videos are gold.
@derekbanas
2 жыл бұрын
Thank you for taking the time to tell me :) I appreciate it!
Used your videos to learn python and pandas in one go and now I am using the knowledge to do algotrading in 2 days. You, sir are the moses of programmers.
@derekbanas
3 жыл бұрын
That's Awesome!!! I wish you all the best in your trading!
Brillant! I love YT and I love creators like you!!!! Thanks for sharing your knowledge! And thanks for letting me learn :)))
@derekbanas
3 жыл бұрын
Thank you for the nice compliment :) I'm happy I could help
Honestly, I am at a loss for words. All I can say is God bless you mightily
@derekbanas
4 жыл бұрын
Thank you 😁 I'm very happy you liked it
Great tutorial, I followed on my own data until the end !
i just was about to get started doing pandas but came here first and found a potential gem haha. you are helping the world my friend
@derekbanas
4 жыл бұрын
Thank you :) I basically crammed all of the Pandas documentation into this one video and then provided the whole thing on GitHub. I hope it helps
Thank you so much for doing this!! :)
Wow! Your channel is highly underrated Your content is amazing! Thanks
@derekbanas
Жыл бұрын
Thank you for the nice compliment :) I try to do my best
This is amazing. I will be using this for work tomorrow. Thanks
@derekbanas
3 жыл бұрын
Thank you very much :) Happy I could help
Thank you for your sharing knowledge! So Cooool your videos are!
I watched till the end. Great overview of pandas and features.
@derekbanas
3 жыл бұрын
Thank you for taking the time to tell me :)
I can't thank you enough for such an amazing and informative video!
@derekbanas
3 жыл бұрын
Thank you :) I'm happy you enjoyed it
can't believe this is free material, thank you!!!
@derekbanas
2 жыл бұрын
I'm very happy you enjoyed it :) I have data science videos for pretty much everything on my channel
Great series, I rather watch your videos than netflix. Keep it up!!!
@derekbanas
4 жыл бұрын
Wow, thank you for the compliment :)
Derek Banas, you are my superhero!! SMASHING the LIKE Button!!!!
@derekbanas
4 жыл бұрын
Thank you very much Happy I could help :)
Thank you, pretty dope.
Derek, 53:10 why was the 'f' used inside the print statement and flower brackets used for 'index' and 'row' ? Thanks in advance
Hi Derek, great video as always. Are you planning to cover streamlit as well? I just found out about it and it looks really great and straightforward for data visualization :).
@derekbanas
4 жыл бұрын
Thank you :) We'll see. MatPlotLib is next and then Seaborn
Exactly what I needed.
@derekbanas
4 жыл бұрын
Happy I could help :) There is a lot here. Basically the whole API in 1.5 hours
love from india bro, keep doing this great work
@derekbanas
3 жыл бұрын
Thank you very much :) I'm very happy to know I'm helping
Love you Derek... !!! MASHALLAH.. you are one Awesome Tutor... !!!
@derekbanas
3 жыл бұрын
Thank you very much Happy to be of help :)
Great lesson. I am the one, who watched tutorial till the end;)
@derekbanas
3 жыл бұрын
Thank you for taking the time to tell me 😁 I appreciate it!!!
Working on my data analysis skills… hoping i can find a job as a recent graduate. Thanks for the vid
@derekbanas
2 жыл бұрын
Happy to help :) I wish you the best of luck
Are you a mini god or something? Just tomorrow I was thinking it would be great if there is learn numpy and pandas in one video and there is one. Wow. Thanks a lot. Please matplotlib next.
@derekbanas
4 жыл бұрын
If you took one quantum string from God you’d have me :) I’m happy you like them. Yes MatPlotLib and Seaborn are next. Give me about 6 days or so
Hey KZread, our man is making videos day after day, acknowledge him give him boost and views..:
@derekbanas
4 жыл бұрын
Thank you for the shout out, but KZread mainly promotes university connected channels over mine now :(
@digigoliath
4 жыл бұрын
Yes, KZread don't do this to Derek!!!
1:08:40 I think a better way might be to use "product" from "itertools": >>> days = ['Day 1', 'Day 2', 'Day 3'] >>> meals = [1,2,3] >>> list(product(days, meals)) [('Day 1', 1), ('Day 1', 2), ('Day 1', 3), ('Day 2', 1), ('Day 2', 2), ('Day 2', 3), ('Day 3', 1), ('Day 3', 2), ('Day 3', 3)]
great video!
@derekbanas
4 жыл бұрын
Thank you very much :) I did my best
Great tutorial, like always! :) Don't forget that Derek has a patreon page, guys! 😊 😉
@derekbanas
4 жыл бұрын
Thank you very much 😁 I greatly appreciate the support
Great tutorial as usual! Just a small correction. At 1:20:32 the most profitable product is (Product ID GT13-0024, Profit 230.89) which can be obtained by using something like: df.loc[df['Profit'].idxmax()][['Product ID', 'Profit']].
AWESOME!!!!!!! nothing else to say
@derekbanas
3 жыл бұрын
Thank you :) More are coming soon
Great video! How do I set up a database like the one you accessed at around 29:27?
@derekbanas
3 жыл бұрын
Thank you :) Everything is explained here kzread.info/dash/bejne/iqV9zZSJp7OWhNI.html
59:22 Hi, what in function means? df[names.columns] = names
Hey at 59:00 can you explain how df[names.columns] = names works inside split_names function
Have you considered a "learn how to learn" video or series? I've seen your anki tutorial but would be great to see your methodologies of how you pick up and master so many things so readily.
@derekbanas
4 жыл бұрын
I don’t do anything fancy. I break down the verbose information into a shorter version. I find definitions for strange jargon. Then if I want to 100% memorize it I use Anki. I think the real secret is motivation. If someone isn’t 100% motivated to do something they will find it extremely hard. Let’s take a common example of something people struggle to learn being Calculus. This is how I would tell them to learn. 1st find learning material that works for them being videos, books, blogs, all of the above. If a particular book isn’t working move on. Then when you are not studying calculus surround yourself with content that motivates you to want to learn calculus. Watch documentaries about Newton, space, crazy physics, etc. I think someone that does that will dramatically increase their odds of learning versus someone that just tries to study from some random book they don’t particularly like.
@amankaushik5833
4 жыл бұрын
@@derekbanas wow this is an amazing tip !!! I mean thank you for taking out time to write that.... *and you should have a derek banas discord server it would be really helpful if you created one :-)*
Hi Derek, Really like your videos! I think I noticed an error in this one. for the line: # Get the product with the highest profit cs_df[['Profit','Product ID']].max(axis=0) I think this is actually returning the max of each row, not the product with the highest profit. If you look at the product ID of the system with the highest output the answer should actually be GT13-0024.The profit of the answer Q526FA is only 143.09. A way I found to get the desired answer is cs_df[cs_df['Profit'] == cs_df['Profit'].max()][['Profit','Product ID']]
@hamza1543
2 жыл бұрын
Another way of doing it: df[["Profit", "Product ID"]].iloc[df["Profit"].idxmax()]
I watched until the end!
@derekbanas
2 жыл бұрын
Thank you for tasking the time to tell me :)
Finally got to watching this. It has been in my "Watch Later" for 2-3 weeks now. Now for Matplotlib... Maybe tomorrow? Or the day after?
@derekbanas
3 жыл бұрын
That's great 😁 Happy you liked it
Muchas gracias a lot (:
@derekbanas
4 жыл бұрын
c'est mon plaisir d'aider 😁
can we use "and" and "or" instead of "&" and "|" for the conditions?
Thank you
@derekbanas
4 жыл бұрын
I’m very happy to help :)
Thanks =)
@derekbanas
3 жыл бұрын
Happy to help :)
Yes yes :) can we expect Signal processing with SciPy as next series ??
@derekbanas
4 жыл бұрын
Coming soon. MatPlotLib is coming next and then Seaborn
@ThirumaleshHS1
4 жыл бұрын
Derek Banas thanks
@yosolonopuedo
3 жыл бұрын
What about Altair?
Why do you have to specify axis when deleting columns. Aren't columns implicitly axis =1. So why wouldn't the name of the column be sufficient as the argument for drop()
Is web Scraping included in series likes of scrapy..?
@derekbanas
4 жыл бұрын
Yes Scrapy will be covered soon
Awesome content a minimal data visualization tutorial please for analysis
@derekbanas
4 жыл бұрын
I just uploaded one on Matplotlib kzread.info/dash/bejne/qXZtpZKGqpzNg9I.html
@anindasadman443
4 жыл бұрын
Great ! right on time love your dedication
@anindasadman443
4 жыл бұрын
@@derekbanas please make a video on mathematics for deep learning
db_connection.close() is not defined this error is showing while connecting database I think u didn't gave the database of students in your github rep
What is the part one, two and three? What is the part five?
I freaking love this channel. Derek I 8> you
@derekbanas
3 жыл бұрын
Thank you very much :)
@DrRandyDavila
3 жыл бұрын
@@derekbanas I'm an Assistant Professor of Data Science at the University of Houston-Downtown and pretty much every semester I refer my students to your videos. Maybe one day we could exchange emails. I would love to chat about teaching data science topics.
Hi sir 1. I have 300 columns in one csv without headers where i need only 4 columns pd.read_csv('ab.csv',names=[a1,......a300],usecols=[a1,a2,a34,a54]) Is this efficient or further can be optimise 2. In a csv i have uncommon columns Row 1: 15 columns Row2: 20 columns When i do readcsv it throws found 20 expected 15 columns Please advise 3. I have two csv where i need to compare row1 from csv1 to row1 from csv2 Currently using for loop Please suggest better way
Why don't you create a new cell every time, for new output. It would be a lot easier to understand if same thing is not on output over and over again,
Hi sir plz make a video on Ethical hacking
1:35:33 I’m taking the time to tell you. And thanks!
@derekbanas
3 жыл бұрын
Thank you :) I appreciate it!
I have a question, if I want to make 2d games that are kinda like 3d but not really, what are some languages I should learn?
@derekbanas
4 жыл бұрын
One C#
@derekbanas
4 жыл бұрын
Use Unity like almost every indie developer in the world. I have a tutorial if you are interested where I make a bunch of real games.
@archangeltactics3802
4 жыл бұрын
@@derekbanas Thanks a bunch!, ill look at the tutorials.
how do i get the cheetsheat from Github?
@derekbanas
3 жыл бұрын
github.com/derekbanas/pandas-tutorial
Can it be used for Game A.I. development?
@derekbanas
4 жыл бұрын
This is way beyond game AI development on many levels. Soon I’ll be showing how to teach your computer how to master chess and make money on the stock market
@SkyFly19853
4 жыл бұрын
@@derekbanas Oh... And I am looking forward to your next video about A.I. ... ✅✅✅✅✅✅✅✅
SOOOOOOOOO here is what i got: 1. Tasi and her BF had a girl that died of an unknown/genetic illness that cant be healed by conventional medicine 2. this traumatized Tasi but she lived on with her BF 3. they decide to go onto an excoursion in west africa, crossing the sahara desert with a plane to get there. Slightly before thehy start the journey, Tasi and her BF realize that she has a second child in waiting, which gives her great hope. MEANWHILE IN THE OTHER WORLD: 4. This seems to be the homeworld of alexander. The people are technologically advanced and highly stratified. They have used the ORBs are sourced of great power and as a gateway to gather knowledge, to which OUR world has no access. One of these powers is the Ability to rip open Reality itself, in order to enter different dimensions and timelines. 5. Another technology is the extraction of VITAE as a form of energy, although it is not clear whether they discorvered this by themselves or via use of the orb....the first game makes it seem as if Alexander found out about vitae during his Exile (or at least figured out that it CAN be harvested from humans) Hinting at the idea that his knowledge must have been conveyed to his old world either by Agrippa or Alexander himself (depending on the ending you got) 6. Vitae is a powerfull energy source, capable of even controlling and making use of the power of the ORBS. Another main advantage is that it can heal people AND allow them to basically life forever, as long as a steady supply is available. To get such a supply, VITAE must be harvested constantly through torture (seemingly the only efficient way of doing so) 7. So the Other world sends out agents into our world via the ORBS and kidnaps people to be tortured forever and provide limitless energy for the civilization and the empress. 8. the empress herself, on the other hand, is not fully satisfied, as the VITAE injections have destroyed her ability to have a child, something she seems to have an incredibly strong instinct for. 9. Some workers at the "VITAE plants" start to rebel against the order. They can not accept the torture of human beings for the rest of their lifes as a justifiable cost to their own happiness/prosperity and plan to destroy the system. They first plan to destroy the "Gate" which allows them to send through and communicate with the "Harvesters" on OUR world. Effectively cutting off the VITAE supply at the source. They also plan to sabotage the existing VITAE plants. 10. The Shadow of the ORB (the red flesh) is well known to the scientists in that world and they purposefully plan to use some of it and sabotage the VITAE flow to the Empresses chamber, by injecting it into the "pipe system" . the flesh feeds off of the VITAE and would quickly not only Clog the VITAE flow but also spread through the entire city and Tower, killing everybody and destroying the system 11. The plan is enacted, the Main gate is destroyed and the Red flesh is injected into ONE of the Vitae pipes, but it has terrible consequences: The World gets basically destroyed, Everything outisde the protective wall of the city is turned into a wind swept wasteland of constant storms. We can not tell how this has impacted the Civilian population of the OTHER WORLD, but it seems that the empress is still in control and still getting vitae via her mindless Harvester troops. The Red Flesh was only inserted into ONE of the 4 Supply lines and therefore she is still secure. BACK TO OUR WORLD: 12. As the Main gate is destroyed, a great chain reaction is unleashed that also affects the Plane Tasi and her Team are traveling in. A great sandstorm appears out of nowhere and pictures of the OTHER WORLD flash in and out, leading the plane to crash. 13. The survivors Push for some nearby caves to seek shelter, but many are heavily wounded. Tasi, Yasmin, Hank, the Guy with the Thick accent and the Doctor try to reach a settlement for help, the rest remain in the cave (including tasis BF. who is also gravely wounded) 14. They reach a French fort, but find it full of dead (people that had been attacked and killed by the Harvesters, frantically send out from the OTHER WORLD by the empress to get more vitae, after the sabotage didnt fully work out). Hank gets wounded as the Ghuls in the fort attack the survivors and will surely die before they can reach help. The survivors try to go further but conflict breaks out over whether to abandon Hank or not. amulet 16. With the help of Tasis amulet, they are transported to the OTHER WORLD (as a side note: that amulett mateches Alexanders descripotion of the Device capable of opening rifts between worlds. He lamented the fact that a device, small enough to fit in the palm of his hand, must be recreated by him with Steam and pipes and is the size of a mansion). In that world, the empress tries to manipulate them, by claiming she can only help them if they surrender the Child (tasi staying in the OTHER WORLD until she gives birth, then leaving the Child there) 17. Tasi refuses, even though the others try to convince her that this could save not only hank, but also her BF AND that they need the help in order to survive the desert and get back home. Tasi is unwilling to give up her child, even if the others die. slowly
Why is data created by column instead of by rows? It seems to me in the real world you’d add records, not a column at a time. So if I grabbed all the products from Amazon, I would not add a product list csv and then a price list csv praying they’d match up properly. I’d add a product in one row with all the info for the product, or a table of products with the product info schema. Not just this tutorial but other tutorials start off with adding data by column and it doesn’t make sense to me what am I missing
Hello sir can you provide me the link to csv files? Thank you
@derekbanas
Жыл бұрын
Everything for all my tutorials is on my Github github.com/derekbanas/pandas-tutorial
When you tried to find the most profitable product, you did it wrong. All you actually did was find the product with the lexicographically largest product ID.
pd.melt is not there
@odins_claw
2 жыл бұрын
Cheers for that comment. It was very useful
Hey man! How are you?!
@derekbanas
4 жыл бұрын
Just making videos with my broken foot.
@arunavnanda7
4 жыл бұрын
@@derekbanas say what?! How did it happen? Are you alright?
@derekbanas
4 жыл бұрын
Dropped a washer in my foot. I just have a few broken bones. I'll be ok. Thanks for asking
@vicdatasets4419
4 жыл бұрын
@@derekbanas Thats sad bro! Take care!
@arunavnanda7
4 жыл бұрын
@@derekbanas yo that's sad! Is it still sore?
35:33
Dang Derek, you must be really busy
@derekbanas
4 жыл бұрын
I broke 3 toes on my right foot and I can’t do anything except make videos
Watched till the end, just fyi
@derekbanas
2 жыл бұрын
Thank you for taking the time to tell me :)
If I close my eyes, I can hear "Bueller? Bueller?"
Oh man, not a single bamboo eating panda in the video.
@derekbanas
4 жыл бұрын
🐼 That's funny :) 🐼
First
@derekbanas
4 жыл бұрын
Thank you for following my videos :)
Your channel and playlists are a gift. Such a relatable style and intuitively set out playlists. Cheers and I hope you're reaping the benefits of kharma.
@derekbanas
2 жыл бұрын
Thank you for the nice compliment :) No joke, my Great Grandmother believed that a persons goal in life was to attract good Kharma. I hope that I am serving her proud.
What's your Instagram Username?
@derekbanas
4 жыл бұрын
Sorry I don’t use Instagram. Actually I don’t use any social media aside from posting on Twitter, which I never read.
Pandas are gonna provide black and white fluff. Thank me later
@derekbanas
4 жыл бұрын
That's funny :)
Not even a single panda.
@derekbanas
4 жыл бұрын
🐼🐼🐼🐼🐼🐼
I’m here to make you feel good @DerekBanas