How Data Science ACTUALLY Works

Check out Deepnote for the easiest way to practice your data science skills: deepnote.com/?...
Dataset used in this video: www.kaggle.com/datasets/thede...
Ever wanted to know how a real Data Science team operates? Join me, me, and me, as we take you through a rushed Data Science ask from management. Can we get the work in on time?
00:00 - Introduction
00:14 - Management Call
00:56 - Team Overview
09:38 - Data Engineer Work
14:11 - Data Scientist Work
20:58 - Data Analyst Work
My FREE Courses:
🐍 Python 🐍. : • Python for Data Analys...
⌭ SQL ⌭ : • SQL for Data Analysts ...
📊 Tableau📊 : • Tableau Beginner Cours...
📈 Statistics 📈 : • Practical Statistics f...
🤖 Machine Learning 🤖 : • Machine Learning for B...
Patreon: / shashankkalanithi
MX Master 3 amzn.to/3sTroBW
LG 35in Curved Monitor: amzn.to/39pPzR3
USB-C Hub: amzn.to/31Ip8Sl
MacBook Pro Retina 16 Inch: amzn.to/2PSwZde
Twitter: / kalamari95
LinkedIn: / shashankkalanithi
Sponsored by Deepnote

Пікірлер: 140

  • @jameswhitaker4357
    @jameswhitaker4357Ай бұрын

    As a data analyst, all I do is CODE. But I love it! Interesting to see how my job functions align more with your description of Data Engineer.

  • @fenrir433
    @fenrir433 Жыл бұрын

    This narrative scenario/example was amazingly put together and would love to see more of this type of content! Even unique scenarios or complex projects that a DS/DE/DA team may typically or rarely encounter.

  • @ubaldo7227

    @ubaldo7227

    Жыл бұрын

    Motion seconded. Thank you very much

  • @lifejourney1661
    @lifejourney1661 Жыл бұрын

    This video is just amazing! Not only does it explain the different roles very well but this is the first time where I can directly see the flow of work and the details in practice. Very valuable! I also found out that I am more of a data scientist haha. But I also see that the roles often overlap at least during my PhD in Political Science as I need to find the raw data, merge them, structure, use regression and illustrate the results. It is nice that people can focus on their niche in companies though

  • @Pakman909
    @Pakman909 Жыл бұрын

    Love this teaching format. Would like to see more of these. Great job!!!

  • @fakhruddinmasalawala9525
    @fakhruddinmasalawala9525 Жыл бұрын

    Thank you for such a refined video explaining every role in a data team. Truly eye opening.

  • @dard4642
    @dard4642 Жыл бұрын

    I'm finishing my MSDS in June and this is very helpful. In all of my projects, I am every role from gathering to presenting and it is good to see the real-world demarcations of duties. Thanks!

  • @hazema.6150
    @hazema.6150 Жыл бұрын

    Great video and I love that you didn't cut googling stuff and debugging.

  • @yacoubahmedsidi6168
    @yacoubahmedsidi6168 Жыл бұрын

    Man you the best! As someone who’s interested and studying data analytics, I needed such video to see the bigger picture and to know how the rest of the team works.

  • @hanzoshimada4526
    @hanzoshimada4526 Жыл бұрын

    This certainly gave more clarity of the different roles. Awesome content as always!

  • @latoyabrown9107
    @latoyabrown9107 Жыл бұрын

    I love this. I took a course on how data teams collaborate, but this video connected all the dots. Thank you!

  • @paulbuono5088
    @paulbuono5088 Жыл бұрын

    I just watched one of your earlier videos from a year ago and now this one and I must say you have improved so much on your speaking and presentation skills. I need advanced math to count how many times you used to say "um." Now your videos are much smoother and your presentation is a lot more logical and concise. Bravo!

  • @samirraki3863
    @samirraki3863 Жыл бұрын

    This has been of a great help to wrap my head around how data science works!! Thank you so much

  • @justind7029
    @justind7029 Жыл бұрын

    Awesome explanation of the entire process. Love the format.

  • @maryalvin1357
    @maryalvin1357 Жыл бұрын

    This makes so much sense! Amazing! Really appreciate your channel!

  • @sabzuski
    @sabzuski Жыл бұрын

    Man I think this was excellent! For people in school with no real world experience yet, this is so informative! Thank you so so much! Well done! I think a cool video you could do in the future would be one focused on setting up the S3 and/or DeepNote in more detail.

  • @vamanhameed1402
    @vamanhameed1402 Жыл бұрын

    Awesome video, from the beginning up until the last part, all of it was very easy to understand, clear and put together in a wonderful way. I'm happy that I found this video.

  • @alainj1
    @alainj1 Жыл бұрын

    This is a cool vid on a how a daily team should run. Pretty informative I must say, another video with great info!

  • @pepperpeterpiperpickled9805
    @pepperpeterpiperpickled9805 Жыл бұрын

    Mate, you answer questions I didnt even know I had. Top quality.

  • @roheldham568
    @roheldham568 Жыл бұрын

    These videos are incredibly helpful! I remember you had made a similar style video for analyzing game review data. Please make more of the same!

  • @markslima1557
    @markslima1557 Жыл бұрын

    This really ties the thread into process, so very helpful. I'm wondering about how far I need to take my SQL and Pandas, this cleared up a lot of ambiguity for me.

  • @j192002
    @j192002 Жыл бұрын

    This was amazing to watch. As one of your students, this was great! New job has me working crazy hours, been hard to attend live sessions.

  • @changshenglee8333
    @changshenglee8333 Жыл бұрын

    very clear overview for each roles' duty. good content! thanks

  • @ashwinponnappan9721
    @ashwinponnappan9721 Жыл бұрын

    Really helped in clearing things out! Thank you for this wonderful session

  • @Flylikea
    @Flylikea8 ай бұрын

    Thanks, a very accurate description and definitions.

  • @zarathustrasmonky
    @zarathustrasmonky Жыл бұрын

    Excellent video. Love the narrative format. I’m a research coordinator at Emory and I’m transitioning to data analysis then data science. Your KZread channel has been invaluable. Thanks

  • @Mukawakadoodoo

    @Mukawakadoodoo

    Жыл бұрын

    I’m an optician and am planning to career shift into data science as well, any pointers dude?

  • @zarathustrasmonky

    @zarathustrasmonky

    Жыл бұрын

    @@Mukawakadoodoo Not really. Just be persistent and consistent in applying high quality instruction

  • @ionwhy2561

    @ionwhy2561

    Жыл бұрын

    Look like someone has been reading fredrich neichece’

  • @sereysothe.a

    @sereysothe.a

    Жыл бұрын

    aye I go to emory too!! applied math and stats major

  • @uriastriumph4780
    @uriastriumph4780 Жыл бұрын

    Your videos and the brilliance behind them >>> I appreciate you. 🙏🏾

  • @Eldo_thomasbaby
    @Eldo_thomasbaby Жыл бұрын

    Many people upload tutorial videos. You are the only one who makes video with a good real world example. That helps me a lot. And also you share the file. That also helps a lot

  • @lumiAI
    @lumiAI Жыл бұрын

    this is insanely good, thank you for sharing this!

  • @mohamedabdo-xg6tw
    @mohamedabdo-xg6tw Жыл бұрын

    I am a data Analyst, never used DeepNote. I will start using it from tomorrow. Thank you for the great content

  • @gorkemyilmaz4861
    @gorkemyilmaz4861 Жыл бұрын

    Amazing content, great explanation with simple scenario! Keep it up man!

  • @mohitupadhayay1439
    @mohitupadhayay1439 Жыл бұрын

    Would like to see more such videos with different issues coming up at different roles and how they interact.

  • @livenalive
    @livenalive Жыл бұрын

    Thank you brother, we truly appreciate your efforts. You keep motivating and helping the rest of us!

  • @Headlikeanorange84
    @Headlikeanorange84 Жыл бұрын

    This really is illuminating. Thanks so much for your amazing content!

  • @phostings
    @phostings Жыл бұрын

    You are absolutly right about the environment set up. I have the M1 chip and others have intel. Everyone with a M1 chip had so many issue, including myself. However, I was able to get the environment set up after a few days. Now I'm working with Rstudio and using Rshiny to generate my plots into an interactive webpage. This field is so awesome, but it has a lot of headaches even just getting started. I guess this makes me the Data Engineer,lol.

  • @colinb8332
    @colinb8332 Жыл бұрын

    Awesome video. I work in SE with a cloud focus. Have an economics degree so have thought about moving into either DE or DS.

  • @rishavjain1867
    @rishavjain1867 Жыл бұрын

    This is a brilliant video to give brief insight on how data professionals actually work togetehr

  • @leonidgrishenkov4183
    @leonidgrishenkov4183 Жыл бұрын

    Omg, this so cool. Amazing work! :)

  • @shalimarlittle8374
    @shalimarlittle8374 Жыл бұрын

    SO helpful. Thank you!

  • @EzeChiappero
    @EzeChiappero Жыл бұрын

    Great content!! Super useful and clear!!

  • @benjamin4206
    @benjamin4206 Жыл бұрын

    Beautiful! Thank you!

  • @Pradee1995
    @Pradee1995 Жыл бұрын

    Great initiative!!

  • @JoseAguilar-yz4bq
    @JoseAguilar-yz4bq Жыл бұрын

    Such a good video, you took the fear from me of not knowing how and who to ask for things when I get a data job.

  • @safifaruqi
    @safifaruqi Жыл бұрын

    I am a BI Developer, and wear all three hats in my mid-size organization, this is actually really accurate, and I highly recommend coding in python and SQL for DA/BA guys,

  • @Mohammad-tw7cq
    @Mohammad-tw7cq Жыл бұрын

    Great video! I enjoy these kinds of videos that show the interplay between data analysts, engineers, and scientists. Also, that NASA jacket is 🔥

  • @ShashankData

    @ShashankData

    Жыл бұрын

    Thank you! Yeah I really enjoy it :)

  • @markslima1557

    @markslima1557

    Жыл бұрын

    @@ShashankData sir, where did you get that jacket? it is pretty snappy!

  • @troy_neilson
    @troy_neilson Жыл бұрын

    Great video and a fantastic breakdown of the industry.

  • @dadimontv8414
    @dadimontv8414 Жыл бұрын

    Amazing video. Thank you.

  • @datascienceproject
    @datascienceproject Жыл бұрын

    Amazing video! Thank you :)

  • @nibycolisp974
    @nibycolisp974 Жыл бұрын

    Another great video Shashank. Thank you so much for the great content. Your videos have really helped clear up so much about the analytics industry for me. I have a meeting with my manager in an hour to present my first project to them - a simple reporting tool that automates their reporting process (instead of them going through 500 rows of data a month manually!). I'll be asking them if it’s possible to take me on as a Junior Analyst, as the team/service currently does not consist of any analyst/data professionals. Wish me luck!

  • @ShashankData

    @ShashankData

    Жыл бұрын

    That’s amazing best of luck u got this :)!

  • @abhijitprasad4740
    @abhijitprasad4740 Жыл бұрын

    Love the way you explain the concept

  • @santiagojulianlingeri5386
    @santiagojulianlingeri5386 Жыл бұрын

    Best video ever! Very insightful for a learning DA 🙋🏻‍♂️

  • @brownboi9267
    @brownboi9267 Жыл бұрын

    I should work more on SQL and BI tools specially communications . Thanks Shashank ! I started watching your videos when you had like 1k subs, love to see you grow into a big channel ! Good Luck, Cheers!

  • @brandone487
    @brandone487 Жыл бұрын

    Thanks for such great information. If possible, can you provide an overview of business intelligence/analyst roles and how they relate to the data team in a company.

  • @gamelikofijerome5829
    @gamelikofijerome5829 Жыл бұрын

    Amazing content with great clarity 👍

  • @HoneyBadger-101
    @HoneyBadger-101 Жыл бұрын

    thanks to share this worthy information 😊

  • @ishandandekar1808
    @ishandandekar1808 Жыл бұрын

    Hey Shashank, loved the video. Can you show a tutorial to actually connect to s3 buckets with python code rather than using a GUI?

  • @fadimessi10
    @fadimessi10 Жыл бұрын

    Videos like these are very insightful

  • @alfredoguerrero1208
    @alfredoguerrero1208 Жыл бұрын

    incredible video!

  • @nationhlohlomi9333
    @nationhlohlomi9333 Жыл бұрын

    You always do practical and this is so helpful bro❤

  • @kabelo3231
    @kabelo32313 ай бұрын

    This is informative thank u

  • @aryanambastha4050
    @aryanambastha40508 ай бұрын

    It would be amazing if you could give us a roadmap video for Data Analyst for 2023!

  • @HarshvardhanKanthode
    @HarshvardhanKanthode Жыл бұрын

    I thought this was going to be just another skit or something. Brilliant analysis of real world roles!

  • @joycegemcanete7217
    @joycegemcanete7217 Жыл бұрын

    This makes me less scared of learning DS. Thankyou!!

  • @danzielcempron2589
    @danzielcempron2589 Жыл бұрын

    Thank you so much for creating such valuable content. :>

  • @fouadS31
    @fouadS31 Жыл бұрын

    Man thank you , thaank you thaaank you ❤️

  • @philipogunmola9333
    @philipogunmola9333 Жыл бұрын

    I will love to see more of this

  • @memorian1024
    @memorian1024 Жыл бұрын

    Lol the MS Teams sound, made me instantly press ctrl + w :D

  • @kcdavis3812
    @kcdavis3812 Жыл бұрын

    Great breakdown between the different roles.

  • @ShashankData

    @ShashankData

    Жыл бұрын

    Thank you so much! I'm glad it was helpful

  • @theophilusakugre3936
    @theophilusakugre3936 Жыл бұрын

    Wow Thank you This is soo informative 👏 👌 A to Z

  • @matattz
    @matattz Жыл бұрын

    Oh wow that’s great content!! So basically as a data scientist you don’t have to know everything from coding to data visualization like Tableau. But let me guess in some companies you also have to do the work of a Data Analyst so knowing these type of things are really helpful if needed but aren’t necessary at the beginning of a career

  • @pedrobaaijens4132

    @pedrobaaijens4132

    Жыл бұрын

    In some companies where stuff like this is new they hire maybe 1/2 people, sometimes consultants to set things up and if there are already requests of data driven decisionmaking then you gotta do the whole process alone.. I had to do the engineering, science and visualization part by my self for 2 months until more people got hired.

  • @theviewsx
    @theviewsx Жыл бұрын

    You are talent embodied!

  • @bellaeke1010
    @bellaeke1010 Жыл бұрын

    Great Content!

  • @fiveguys540ee
    @fiveguys540ee Жыл бұрын

    deepnote is a life saver ..

  • @montassarbenkraiem3029
    @montassarbenkraiem3029 Жыл бұрын

    I have a suggestion can you provide for us a tutorial how extract structured data from unstructured ones and thank you very much

  • @vectoralphaAI
    @vectoralphaAI Жыл бұрын

    Just discovered your channel. You seem like a cool knowledgeable person on this topic. So im wondering if you can help me with a question i have. So I am a recent graduate in Computer Science and want to instead go into Data Science industry instead of the traditional Software Developer/ Software Engineer career. So as someone like me who eventually one day wants to work in data science industry, is there an entry level job role that one can apply as a starting point and just get promoted/ level up to a data science in time rather than just trying to apply for a data science position from the get go? I dont mind starting at the bottom and working my way up the ladder. If anyone else have any suggestions i would greatly appreciate it?

  • @DreyKeepItReal
    @DreyKeepItReal Жыл бұрын

    This is definitely motivation when you show your process and thought process of these fields… Some of us Americans wanna do better…

  • @idnessi
    @idnessi Жыл бұрын

    Amazing stuff. Thank you for breaking it down in a way that beginner would understand. In your opinion, is Data Analyst the entry level to the rest of the group or are they all part of different disciplines? Would love to know what to learn first to get into this field. I am coming from HR environment so not much exposure to raw data and big data. Appreciate your content always!

  • @jaikrishanbhardwaj5841
    @jaikrishanbhardwaj5841 Жыл бұрын

    Shashank you are the TOP G of Data people

  • @zahir4215
    @zahir4215 Жыл бұрын

    Amazing!!!!!!!

  • @tavaanaenterprises1882
    @tavaanaenterprises1882 Жыл бұрын

    These three roles cannot be explained better than this. I have one question. Does a person go on Data Engineer role directly or he / she is promoted from the DA or DS roles? Thanks for the efforts you put into this video creation.

  • @divyaranjanmallick2637
    @divyaranjanmallick2637 Жыл бұрын

    Which role is best suitable for freelancing ?

  • @Adi300594
    @Adi300594 Жыл бұрын

    Do you have any courses with structured curriculum, pedagogy definitely helps building from a scenario.

  • @sametcelik8075
    @sametcelik8075 Жыл бұрын

    You know what, it's a great video.

  • @joelhedtjarn9
    @joelhedtjarn9 Жыл бұрын

    Forecasting never ceases to break my brain. The linear regression model predicted an overall downward trend, and yet this magic Prophet seemed to indicate that the next couple of months will be trending upwards. I'd personally have a hard time explaining to a bunch of executives how/why Prophet reached that conclusion, i.e. why did they see a downwards trend and why don't we think that it will continue in the next quarter, which seemed to be what the executives in this scenario were interested in. How would you go about figuring that out, and how would you go from a set of plots to a finished writeup?

  • @ShashankData

    @ShashankData

    Жыл бұрын

    So forecasting really is an art as much as it’s a science. Linear models can’t take into account seasonality and cyclical like the Prophet model can. I purposefully used the linear model to show how you start simple and move from there but realistically basic linear models don’t work too well for a lot of forecasting results

  • @LukeBarousse
    @LukeBarousse Жыл бұрын

    Loving the NASA jacket! 😜

  • @ShashankData

    @ShashankData

    Жыл бұрын

    Thanks Luke!

  • @abhijitprasad4740
    @abhijitprasad4740 Жыл бұрын

    Can you suggest how to jump from Data Analyst to Data Engineer

  • @obakengamos8635
    @obakengamos8635 Жыл бұрын

    👌 wow Awesome

  • @Typezero73
    @Typezero73 Жыл бұрын

    Can you make a video on how to become a data scientist.

  • @user-bz7fj1fk2m
    @user-bz7fj1fk2m Жыл бұрын

    U R all blessed minded, MAY GOD BLESS U IN ABUNDANCE!!!!!

  • @emresahindance
    @emresahindance Жыл бұрын

    Thats me right there playing eu4 instead my fellow gamer scientist

  • @cincomill4230
    @cincomill4230 Жыл бұрын

    Every data enthusiast should watch.

  • @AvgDietCokeEnjoyer
    @AvgDietCokeEnjoyer Жыл бұрын

    You are amazing and I love you.

  • @parthmlulu1618
    @parthmlulu1618 Жыл бұрын

    Sir can you please suggest some good portfolio projects for data analytics role?

  • @thulasikurra2997
    @thulasikurra2997 Жыл бұрын

    How informatica ETL developer become data engineer.. should I learn azure and python

  • @kalanithiv4885
    @kalanithiv4885 Жыл бұрын

    You’re handsome my son

  • @ShashankData

    @ShashankData

    Жыл бұрын

    Hahahah thanks dad!

  • @9MusicisLife5

    @9MusicisLife5

    Жыл бұрын

    This the most wholesome thing on YT

  • @kevidimitrisceci8096

    @kevidimitrisceci8096

    Жыл бұрын

    Best comment on KZread by far.

  • @OscarFromIndia

    @OscarFromIndia

    Жыл бұрын

    And he's a very helping person sir 🙌🙌

  • @supastazz

    @supastazz

    Жыл бұрын

    Chad

  • @abderrahimba7390
    @abderrahimba7390 Жыл бұрын

    love you bro from morocco

  • @inspiregrow2336
    @inspiregrow2336 Жыл бұрын

    Is coding /computer background needed for data science field

  • @nicholaskenney3641
    @nicholaskenney3641 Жыл бұрын

    What game is that at the start?

  • @chiragsisodia413
    @chiragsisodia41310 ай бұрын

    Wow wow wow

  • @gpt.answers
    @gpt.answers Жыл бұрын

    im a data scientist in a large not well structured company and i have to deal with the three steps :S

  • @ykkim902
    @ykkim902 Жыл бұрын

    I don't see much added value in Data analyst, since Data scientist can build a model and communicate as well ...

  • @hamzasehavdic

    @hamzasehavdic

    Жыл бұрын

    Theres alot of work to go around. So specialising into these roles tends to work best for business needs. It does consume alot of time visualising and communicating data into business information quickly.