Fetching data using Web Scraping | Day 18 | 100 Days of Machine Learning

Machine learning algorithms are powerful tools for analyzing large amounts of data. Developers who need more training data than they have access to can use a web scraping tool to extract the right kind of information from publicly available websites.
Web Scraping is a technique to extract data from websites, automating the process of fetching information for analysis.
Code used:
github.com/campusx-official/1...
============================
Do you want to learn from me?
Check my affordable mentorship program at : learnwith.campusx.in/s/store
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
Instagram: / campusx.official
E-mail us at support@campusx.in

Пікірлер: 218

  • @learnenglish699
    @learnenglish6992 жыл бұрын

    i cried when i undertstood all the concept..teachers like you should exist...be lated happy teachers day ...take a bow

  • @snehaltheprogrammer

    @snehaltheprogrammer

    5 ай бұрын

    Can you please tell me from where he took this header url ? Which url is this ?

  • @RohitKumar-wb4pe

    @RohitKumar-wb4pe

    3 ай бұрын

    @@snehaltheprogrammer he has given his github link in description, where u can find the header url.

  • @AnshAneja-cf3le

    @AnshAneja-cf3le

    2 ай бұрын

    @@snehaltheprogrammer Koi bhi random header h wo. Net pe jake random headers use kar skte ho

  • @Shubham-su7sm
    @Shubham-su7sm Жыл бұрын

    I was so much frustrated because I couldn’t find any good Web Scraping tutorials. Thanks man, You’re a legend 🙏🏻🙏🏻

  • @kalam_indian
    @kalam_indian Жыл бұрын

    I don't know which word i should use to express my respect love for you, the best teacher trainer i ever see and totally soft cool down to earth matured behaviour with a charming smile throughout... we all can do only one thing which you will definitely like, praying for you and your family,... We will do this regularly, you are just just above all...

  • @simranagichani4943
    @simranagichani49434 ай бұрын

    No words to describe how clear and descriptive your videos are. You're just legen-dary!

  • @TheNeu2ron

    @TheNeu2ron

    3 ай бұрын

    yes he is just amazing after watching day 17 videos it just blow my mind..

  • @gourabguha3167
    @gourabguha31674 ай бұрын

    Sir, getting addicted to your channel, kash I saw your tutorials earlier

  • @user-bs5ck1yh8u
    @user-bs5ck1yh8u6 ай бұрын

    Well Done, Nitish you are such a great teacher. I have been following your playlist, even I usually dont watch lengthy videos but the way you teach is incredible and I love to watch your videos. You have proved to be the greatest support for the Data Science enthusiasts.

  • @walidadmahtam7512
    @walidadmahtam7512 Жыл бұрын

    Great nitish bro. very late but find you as my first teacher after researching and analyzing for six months. I am happy now that I am following the path in the right direction🙏😊

  • @paragvachhani4643
    @paragvachhani4643 Жыл бұрын

    U remembered my school days teachers... Thise r good at teaching along with ample emotion like you.. Jab emotion hote tab hi koy banda ko kuchh sikhasakte... India needs teachers like you at higher lever education ... Have a great day ...Guruji

  • @sid9137
    @sid91372 жыл бұрын

    Man, this is top notch content, I feel lucky to find this playlist of your sir. Thank you for helping people like me to excel our data skills, I really wonder why I couldn't find this playlist earlier, the content is pure quality and your teaching skills are mind blowing. Thank you once again sir.

  • @zunaidqureshi8521
    @zunaidqureshi8521 Жыл бұрын

    I struggle to find these concepts of web scrapping , but you explained in just one video, Thanks sir for this wonderful explanation

  • @deb1995
    @deb1995 Жыл бұрын

    Your videos are like the Oxygen for data science & data engineering domain..The way of teaching skill is highly appreciated. I was literally stucked to know about API therefore I visited multiple website, YT channels but didn't get any satisfaction & confidence hence finally after 3 months of extreme searching on the internet I landed up on your video..... thanks to you & KZread recommendations engine 🎉

  • @wrenchfusion
    @wrenchfusion3 жыл бұрын

    you are the best of the best teacher. A great explanation saray concepts clear ho gae. thanks alot

  • @kasiviswanath7981
    @kasiviswanath7981 Жыл бұрын

    The best youtube channel for machine learning and data science.Thak you sir for your efforts

  • @te_b4_73_sushant_yelurkar4
    @te_b4_73_sushant_yelurkar42 жыл бұрын

    Bhai tu ek number hai Good teacher Tere jaisa koie nhi ❤️❤️❤️

  • @BollywoodDuffer
    @BollywoodDuffer8 ай бұрын

    The way you teach, is superb. Thanks!

  • @tajveertyagi3084
    @tajveertyagi30842 жыл бұрын

    Great !! concept are well explained in all the videos .

  • @TheChocovini
    @TheChocovini2 ай бұрын

    The way you teach is amazing but even your editing skills are awesome !!

  • @depalvveturkar
    @depalvveturkar Жыл бұрын

    WOW...I have not seen such a course..awesome...may god bless you with all the sucess..

  • @mathics2869
    @mathics28693 ай бұрын

    Best channel for Machine Learning , Thank u so much

  • @mohitjoshi8818
    @mohitjoshi88184 ай бұрын

    Thankyou for posting this sir, very well explained.

  • @anandtale1147
    @anandtale1147 Жыл бұрын

    you are awesome, generally, I learn this using regular expressions, but i don't think there will be another way using logic of HTML though I don't know that time, but now I have one more way to scrap, and this is simple and easy way thank you god bless you🙌🙌

  • @viditvaish7317
    @viditvaish73177 ай бұрын

    amazing sir ,bahut accha explain karte hai aap sir ,best video sir

  • @user-lg7xg9mn5o
    @user-lg7xg9mn5o5 ай бұрын

    wow amazing video I have watched many videos but can't clear so this man help me in this web scrapping skill

  • @AbhishekKumar-eh6zy
    @AbhishekKumar-eh6zy2 жыл бұрын

    thankyou so much sir for teaching this kind of important topic

  • @ankurshivhare8132
    @ankurshivhare81322 жыл бұрын

    very nice web scraping tutorial, i learnt and scrap data from internshala website. Thank you

  • @sameergupta150
    @sameergupta150 Жыл бұрын

    Highly under-rated channel.

  • @AbdurRahman-lv9ec
    @AbdurRahman-lv9ec7 ай бұрын

    Kudos, Nitish ! Your teaching style is phenomenal, and I've learned so much from your Python and Machine Learning tutorials. As I delve deeper into my passion for data engineering, I can't help but wish for a mentor like you in this field. Your guidance would be invaluable. Any plans to explore data engineering topics?

  • @rahulmungali7810
    @rahulmungali7810 Жыл бұрын

    Best video for web scrapping.👍👍👍

  • @zaidnadeem4918
    @zaidnadeem4918 Жыл бұрын

    Amazing teacher My All time favourite. MAY ALLAH BLESS YOU SIR.

  • @TypeFast_hemant
    @TypeFast_hemant11 күн бұрын

    Sir you didn't even know How easy you explain this kind of topic :)

  • @Aestheticdeeps
    @Aestheticdeeps2 ай бұрын

    really the best piece🙌thank you soo much sir

  • @anandtalware2283
    @anandtalware228310 ай бұрын

    Thank you🙏🙏.. Your explanation is awesome...

  • @bhargavkongara2003
    @bhargavkongara200314 күн бұрын

    Thank you sir well understood !!!

  • @ShivamKumar-zq8jv
    @ShivamKumar-zq8jv Жыл бұрын

    Thanku so much for your efforts sir🙏🙏🙏

  • @karansen9101
    @karansen9101 Жыл бұрын

    I have no words to express my happiness thanku very much sir

  • @ArunKumar_237
    @ArunKumar_2372 жыл бұрын

    great class thank you sir

  • @samtyagi6754
    @samtyagi67546 ай бұрын

    as I progress in this playlist my respect for u sir is increasing day by day ❤

  • @dailyenglishvocabulary3116
    @dailyenglishvocabulary31162 жыл бұрын

    Sir your channel deserves millions of subscribers

  • @debashispatra2368
    @debashispatra2368 Жыл бұрын

    At last it was very funny .... i have understood all the concepts that u have taught .... i would wish if i can join ur live sections

  • @atifsalam6802
    @atifsalam6802 Жыл бұрын

    Excellent bro, buhat he bariyah keep it up 👍

  • @surajnikam3327
    @surajnikam33276 ай бұрын

    sir you are just wowwww♥♥♥. I learned and enjoyed this video. Thank you sir

  • @danishthev-log2264
    @danishthev-log22646 ай бұрын

    I really like your teaching way

  • @narendraparmar1631
    @narendraparmar16317 ай бұрын

    Good Lecture Sir , Thanks😀

  • @sagarkhule6439
    @sagarkhule64392 жыл бұрын

    Best explanation foe web scrapping tysm buddy

  • @travelogue.brothers
    @travelogue.brothers9 ай бұрын

    Nitish sir coz of you only i was able to get a good internship. I just dont how can i thank you . Thanks a lot sir🥺 Love from jammu.

  • @mangeshtakras1889
    @mangeshtakras18892 жыл бұрын

    best teaching of all💐💐💐

  • @HappyHumbleHopefulHelpKey
    @HappyHumbleHopefulHelpKey6 ай бұрын

    Love you and your dedication sir ❤

  • @_._Harsh_._
    @_._Harsh_._Ай бұрын

    "Bhagwaan ka naam leke" was epic🤣🤣 Anyways, a great video for Web Scrapping to understand the basics Thank you for this!!!

  • @aayushisolanki2935
    @aayushisolanki2935 Жыл бұрын

    most underrated channel

  • @azqamubeen3934
    @azqamubeen3934 Жыл бұрын

    thanks sir wonderfull work you are doing sir

  • @anshulsharma7080
    @anshulsharma7080 Жыл бұрын

    Unfortunately list out of range so unable to see the magic at last however great work by this man.booooooom💫💫

  • @sudhanshusingh5594
    @sudhanshusingh5594 Жыл бұрын

    "my feature extraction" (it's a Nick name which I gave you & I really really really respect you a lot) once again thank you so much .

  • @JACKSPARROW-ch7jl
    @JACKSPARROW-ch7jl Жыл бұрын

    Thank u bro , u are doing great job , i will certainly pay you something , if i can get any job in data science field in next two years🙌🙌🙌

  • @ashutoshyadav8653
    @ashutoshyadav8653 Жыл бұрын

    very knowledgeable video👍👍👍👍👍

  • @webscrapingfreelancer76
    @webscrapingfreelancer762 жыл бұрын

    Very well explained

  • @TheNeu2ron
    @TheNeu2ron3 ай бұрын

    Your api day 17 video is just amazing

  • @thomasmuller7733
    @thomasmuller77332 жыл бұрын

    Hi sir, nice video and great explanation. I have a question. Some tags are showing inspect but not showing on source code. Is there any way to extract that too? Or am I missing something? Thanks in advance.

  • @grandson_f_phixis9480
    @grandson_f_phixis94802 ай бұрын

    Thank you very much sir

  • @mainakseal5027
    @mainakseal50276 ай бұрын

    what an amazing explanation sir!!! loved it!!! loved IT!!

  • @AryanGuleria-kj1gt

    @AryanGuleria-kj1gt

    5 ай бұрын

    hey!!! if u are interested in learning and sharing knowledge in web scraping pls contact

  • @grithijain132
    @grithijain1327 ай бұрын

    Best thank you so much campus x ...

  • @learnomics
    @learnomics Жыл бұрын

    Also, I'm a web developer. This will be very easy for me. Now, I can extract any data from a web pages!

  • @madhavneupane168
    @madhavneupane1686 ай бұрын

    Thanku so much for this. this is very remarkable video to learn. what is the code for single constant webpage has many next pages tabular data ?

  • @siddhant_n
    @siddhant_n Жыл бұрын

    dhanyavad sir.

  • @MohdRafi_Lover
    @MohdRafi_Lover8 ай бұрын

    Nice teaching sir.

  • @somnathghosh854
    @somnathghosh854 Жыл бұрын

    Hello Sir, thanks for this video. my question is how we get that 'headers' that you used in this video?

  • @shwetkumar8370
    @shwetkumar8370 Жыл бұрын

    FeatureNotFound: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library? I'm getting this error .. I also tried to install lxml via !pip install lxml command but it returns equirement already satisfied: lxml in c:\users ame\anaconda3\lib\site-packages (4.9.1) what to do??

  • @tejasburadkar189
    @tejasburadkar1892 жыл бұрын

    hi sir.. thankyou for this tutorials but i question is u created one variable is called Headers and inside the headers dict contains string where you get it that... i didnt get that point... waiting for your response

  • @anniedhawan7945
    @anniedhawan79452 жыл бұрын

    Amazing !!!!

  • @munisyamputtur9673
    @munisyamputtur9673 Жыл бұрын

    shall you provide the both website and additional link for accesss . so we gonna practise the web scraping

  • @vijayjadonthakur
    @vijayjadonthakur Жыл бұрын

    The way of teaching is awesome. Thanks

  • @aisharawat9102

    @aisharawat9102

    Жыл бұрын

    Hii actually I tried to code it but when I used requests library it is showing this -> name 'requests' is not defined. have you faced this thing or not. can you tell me what can I do?

  • @adarshkumarsingh1509

    @adarshkumarsingh1509

    Жыл бұрын

    @@aisharawat9102 may be you haven't requests library installed in your system in that case you can use pip install requests to install it moreover if you use anaconda environment then you can see the web this may be one issue other might be just clear all and restart the kernal may be it'll solve extra tip :- just see for spell errors sometimes the problem is so tiny that we'cant think of

  • @salonijain6565
    @salonijain6565 Жыл бұрын

    Amazing explanation, how to know which websites are providing APIs and which are not.

  • @jr_jeet
    @jr_jeet8 ай бұрын

    thank you sir

  • @MuhammadJunaid-yr8jd
    @MuhammadJunaid-yr8jd Жыл бұрын

    thank you so much

  • @rohitjadhav2270
    @rohitjadhav2270 Жыл бұрын

    Sir Nice Video !! Just one question , for some products all information available ,but somewhere rating are not available !! So how to deal with that ? For example len of product name is 267 but len of rating is 247 ,this because for some products rating is not there ,so how to deal with this to get proper DataFrame !! Thank You !!

  • @youtubekumar8590
    @youtubekumar8590 Жыл бұрын

    Thanku sir, bhaiya

  • @siddhigolatkar8558
    @siddhigolatkar85587 ай бұрын

    Thank you Sir.. God Bless you

  • @ritikkumarsah7034

    @ritikkumarsah7034

    Ай бұрын

    Headers = jo link hai wo use nhi ho rha h main apne Jupyter Notebook me kr rha hu to Any solution please

  • @ahmbilal
    @ahmbilal4 ай бұрын

    if website have no restriction then still we need to write that header code ?

  • @roselinamoven7986
    @roselinamoven79862 ай бұрын

    what happens when the lists are of different lengths ie if there are missing values in for some fields?

  • @laurkids
    @laurkids4 ай бұрын

    Superb

  • @shubham-yy8tj
    @shubham-yy8tj8 ай бұрын

    Thank You....

  • @sandipansarkar9211
    @sandipansarkar9211 Жыл бұрын

    finished watching

  • @kidzz5153
    @kidzz5153 Жыл бұрын

    Now url address is different like it's not page=1 and so on... What to do then...

  • @puspanjalimuduli9159
    @puspanjalimuduli91596 ай бұрын

    why do my data doesnot appear like Dataframe format.It appear without the bold dark column heading?

  • @rajkumarshedage3200
    @rajkumarshedage3200 Жыл бұрын

    Great❤

  • @fusionfury1699
    @fusionfury16995 ай бұрын

    hye sir , i wanna ask that . how do you get or write "header" part , i am using google colab kindly instruct me

  • @parthpatel473
    @parthpatel473 Жыл бұрын

    Sir headers are different from different laptops or same for all laptops plz anyone know about it so plz reply .

  • @NehaSen10
    @NehaSen10 Жыл бұрын

    Sir how did you get the header code to access another website data, I tried many times to copy this code and fetch data but i unable so please help me how I can do scrap that data

  • @aymanijaz
    @aymanijaz Жыл бұрын

    How tp fix : IndexError: list index out of range .... ? getting this error on ratings

  • @bhushanmali7635
    @bhushanmali7635 Жыл бұрын

    How we get header in second shell of notebook at 7.02

  • @raj4624
    @raj46242 жыл бұрын

    Gem video

  • @AnkitSingh-ir7ir
    @AnkitSingh-ir7ir Жыл бұрын

    Sir kuch website me srf elements me data show hota hai toh usko kaise extract karenge (scrap) in python me

  • @sakshipatil2545
    @sakshipatil2545Ай бұрын

    how scrape website it showing login error and if u are doing internal project data is sensitive how to scrap such url

  • @HetkumarPatel-bf9sc
    @HetkumarPatel-bf9sc3 ай бұрын

    ending badhiya tha

  • @AmarSharma-bp2ie
    @AmarSharma-bp2ie2 ай бұрын

    Sir, how did you write the Headers user agent mozilla .5.0?

  • @IEI-ECE
    @IEI-ECE Жыл бұрын

    Nice explanation Sir. i want to know how do i get headers information

  • @Dipenparmar12
    @Dipenparmar128 ай бұрын

    Thanks.

  • @maroofakhtar3806
    @maroofakhtar3806 Жыл бұрын

    can someone help me with how to use try-except at 33:55?

  • @ritikkumarsah7034
    @ritikkumarsah7034Ай бұрын

    Headers = jo link hai wo use nhi ho rha h main apne Jupyter Notebook me kr rha hu to

  • @ClubLalpur
    @ClubLalpur Жыл бұрын

    sir ye headers wala code ni smjh aya kese kya kr rha ye i mean kha se likhu in future

  • @-mnv
    @-mnv Жыл бұрын

    For anyone trying this in 2023, As of pandas 2.0, append (previously deprecated) was removed. So at 36:37 instead of final = final.append(df) use final = pd.concat([final,df],ignore_index=True)

  • @kaushalsurana6336

    @kaushalsurana6336

    Жыл бұрын

    still my program is not giving output , it is showing empty dataframe

  • @kaushalsurana6336

    @kaushalsurana6336

    Жыл бұрын

    please reply if you know how to solve it

  • @mohammadaffan5001

    @mohammadaffan5001

    9 ай бұрын

    ​@@kaushalsurana6336its working dude...then you might have done some mistakes..

  • @kapilraisinghani8105

    @kapilraisinghani8105

    5 ай бұрын

    thanks bhai for the help

Келесі