Selenium Tutorial - Python Selenium Full Course for Beginners 2022

🌐 NodeMaven Proxy Provider: go.nodemaven.com/scrape
💥 Special Bonus: Use "Michael" at checkout for an extra +2GB of bandwidth.
🤖 2captcha Captcha Solving Service: bit.ly/2captchapromo
Welcome to my Python Selenium Full Course for Beginners. In this video, I have compiled my Python Selenium Series I made into this 2.5 hours full course Selenium tutorial. The video is designed to learn everything necessary about Selenium to be able to complete big projects either your own or professionally. I decided to put the work in and teach you everything about Selenium because documentation is boring :D. I have over 3 years of experience professionally completing projects for thousands of dollars, and all the knowledge required to do so yourself is shared in this video.
AWS Lambda is serverless, event-driven compute service that lets you run code for virtually any type of application or backend service without provisioning or managing servers
Playlist: • Python Selenium Tutorial
Code:
github.com/michaelkitas/Pytho...
github.com/michaelkitas/Selen...
github.com/michaelkitas/Selen...]
Heroku:
Buildpacks:
heroku/python
heroku/google-chrome
heroku/chromedriver
Environment Variables: CHROMEDRIVER_PATH=/app/.chromedriver/bin/chromedriver
Join our Discord: / discord
Gecko Driver: github.com/mozilla/geckodrive...
Chrome Driver: chromedriver. chromium.org/downloads
GitHub Repo: github.com/michaelkitas/Pytho...
Download Visual Studio Code: code.visualstudio.com/download
Download Python: www.python.org/downloads/
Selenium Library: pypi.org/project/selenium/
Append to JSON file functionality: www.geeksforgeeks.org/append-...
Undetectable ChromeDriver: pypi.org/project/undetected-c...
Selenium Wire: pypi.org/project/selenium-wire/
Infinite Scrolling Demo: intoli.com/blog/scrape-infini...
Donate
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
PayPal: support@websidev.com
Bitcoin Wallet: bc1q05j8gcnq4mzvgj603cxdc8xxck4jgnu2ljsrt4
Ethereum Wallet: 0x5e7BD4f473f153d400b39D593A55D68Ce80F8a2e
Social
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Website: websidev.com
Linkedin: / michael-kitas-638aa4209
Instagram: / michael_kitas
Github: github.com/michaelkitas
Business Email: support@websidev.com
Intro (0:00)
Setup, Web scraping & Testing (2:19)
Grabbing Elements From HTML (9:26)
Pagination & Saving Data To JSON File (21:53)
How to bypass/solve reCAPTCHA using 2captcha API (37:38)
How to bypass/solve normal captcha using 2captcha API (47:00)
Bypass Detection using plugins, settings & proxies (56:05)
Save & Reuse Cookies (1:06:30)
Capture, Block & Mock Requests using Selenium Wire (1:13:39)
How to bypass/solve hCaptcha using 2captcha API (1:27:25)
Scrape Websites with Infinite Scrolling (1:39:34)
How To Deploy Python Selenium Script in Heroku via CLI & GitHub in 2022 (1:50:52)
How To Deploy Python Selenium Script in AWS Lambda in 2022 (2:09:37)
Top 8 Web Scraping Tips Every Beginner Should Know (2:23:22)
Tags:
- Python Selenium Tutorial
- Full Course Selenium
- Python Selenium
- Web Scraping Full Course
- Python Selenium Web Scraping Full Course
#python #selenium #webscraping

Пікірлер: 43

  • @LadoKaladzeDev
    @LadoKaladzeDev Жыл бұрын

    Hello michael ! I'm crying right now ! You saved me from all of those old selenium tutorials.this is perfect for me and just...THANK YOU

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    I am glad my tutorial is helpful, thank you for the great comment 🙂

  • @tigron1530
    @tigron1530 Жыл бұрын

    great course, it explains everything someone would need to make a fully functional selenium automation!

  • @svitoch_blockchain
    @svitoch_blockchain Жыл бұрын

    I like your videos! Thx for content !

  • @TheRealSinotra
    @TheRealSinotra Жыл бұрын

    Some of it was hard to follow. Because you were doing things without explaining what you were doing, or what they do. Yet it’s better than the pile of outdated tutorials on YT.

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    I agree, probably will redo the series soon with more detailed explanation and also include more basic functionalities.

  • @prashlovessamosa
    @prashlovessamosa Жыл бұрын

    Thanks man god bless you.

  • @almahanadalmahdhour551
    @almahanadalmahdhour551 Жыл бұрын

    One of the best channels to learn web scraping. Thanks man

  • @almahanadalmahdhour551

    @almahanadalmahdhour551

    Жыл бұрын

    But whenever I try to load up defafult browser it opens but the bot doesn't do anything. Any thought?

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    @@almahanadalmahdhour551 Can you share code?

  • @vrtkarim
    @vrtkarim8 ай бұрын

    thanks a lot mate

  • @tmpmus5985
    @tmpmus5985 Жыл бұрын

    Thank you

  • @ziverch
    @ziverch Жыл бұрын

    12:55 pay attention to the second "find_element" there's an s at the end so it's find_elements

  • @user-tw5uc4te9i
    @user-tw5uc4te9i Жыл бұрын

    This is absolutely wonderful! I was initially looking for how to build bots using selenium and python. I thought you covered it in this course. please could you try to do a tutorial on bot creation using selenium and python?

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    Thank you! What kind of bot, should I develop?

  • @zzzzzzz7291

    @zzzzzzz7291

    Жыл бұрын

    @@MichaelKitas You can screen video about bot development funamentals with Python, Selenium

  • @dantrrrrr
    @dantrrrrr8 ай бұрын

    “I’m watching part 6 right now. I just want to ask if this video is a compilation of all the videos above.”

  • @MichaelKitas

    @MichaelKitas

    8 ай бұрын

    Correct, thank you for watching!

  • @mykun8737
    @mykun8737 Жыл бұрын

    you're amazing, Could you please make a course in micro service from scratch in python?

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    Great idea, maybe in the future

  • @ibrahimetier1134
    @ibrahimetier1134Ай бұрын

    Hi Michael, vielen Dank, alles gut erklärt, warum klappt die Installation nicht wenn IPv6 aktiv ist? Chrome wird gestartet mit URL data, die URL wird nicht angezeigt

  • @Imana23
    @Imana239 ай бұрын

    hi Michael. Your course is very helpful. Could you make a separete videoon how to organize all the files in vsCode and best practices when it comes to test Automation with selenium webdriver and Python, How to reuse the code and so on.

  • @MichaelKitas

    @MichaelKitas

    9 ай бұрын

    Yes, great idea, thank you!

  • @evelynnavazio7405
    @evelynnavazio7405 Жыл бұрын

    This course is amazing . I am really enjoy it. Good explanations. I have an error with the images. Some images are found and others are not. The selector is the same. I don't understand what the problem would be. Can you help me with that ?

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    I can't say without reviewing the target website. Are you sure they are the same selector?

  • @vladarskopin3314
    @vladarskopin3314 Жыл бұрын

    Hey Michael! What do you think about using Pycharm?

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    I switch around multiple languages (Python, Javascript, Swift/Kotlin e.t.c) and VS Code is personally better for me. I don't like using multiple IDE. But if you primarly use Python, Pycharm is a good option

  • @gamingguy577
    @gamingguy5779 ай бұрын

    I got an error at 13:41 that object of type 'WebElement' has no len() while printing the lenth of items.Can't find the solution help if anyone know

  • @MichaelKitas

    @MichaelKitas

    9 ай бұрын

    Try logging without len, for some reason it didn't find the elements. Maybe try a different selector?

  • @RIzalCopo
    @RIzalCopo Жыл бұрын

    Hi Michael, Ur Video is great. i have question. Can u tell me how to getting current request header with using selenium. Why i need request headers not respone bcs on request headers have authorization and i need to get that. Do you know how to get that? thanks. Hope you can reply this and give solution

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    Check the answer to this: stackoverflow.com/questions/62262261/how-to-get-request-headers-in-selenium You can use selenium-wire

  • @zakialzubair2816
    @zakialzubair281611 ай бұрын

    Using selenium on kali nethunter, and I got FileNotFound error when I am trying to use undetected_chromedriver. What should I do??????😢

  • @MichaelKitas

    @MichaelKitas

    8 ай бұрын

    The `FileNotFoundError` typically occurs when Python cannot locate the file or directory specified in the function call. In the context of using `undetected_chromedriver` with Selenium, this error often arises when the system cannot find the ChromeDriver executable. To resolve this issue on Kali NetHunter or any Linux system, follow these steps: 1. **Install Chrome/Chromium**: First, ensure that Google Chrome or Chromium browser is installed on your system, as ChromeDriver requires it to function. ``` sudo apt update sudo apt install -y google-chrome-stable ``` Or for Chromium: ``` sudo apt update sudo apt install -y chromium ``` 2. **Download ChromeDriver**: If you haven't done this already, you'll need to download the ChromeDriver executable that matches the version of Google Chrome or Chromium installed on your system. You can download ChromeDriver from the [official site](sites.google.com/a/chromium.org/chromedriver/). Ensure you choose the version that corresponds to your Chrome/Chromium browser version. 3. **Set the Path to ChromeDriver**: The `FileNotFoundError` might also be because your script doesn't know where to find the `chromedriver` executable. You can specify the path directly in your script. ```python from selenium import webdriver import undetected_chromedriver.v2 as uc options = uc.ChromeOptions() # Other options can be added here driver_path = '/path/to/chromedriver' # update this to your chromedriver path driver = uc.Chrome(executable_path=driver_path, options=options) ``` Alternatively, you can add the ChromeDriver directory to your system's PATH variable, so it's automatically detected. 4. **Correct Permissions**: Ensure that `chromedriver` is executable. You can set the appropriate permissions using the command: ``` chmod +x /path/to/chromedriver ``` 5. **Update undetected_chromedriver**: Make sure you are using the latest version of `undetected_chromedriver`. You can update it using pip: ``` pip install -U undetected-chromedriver ``` 6. **Check Your Code**: Lastly, review your code to ensure you're using the correct syntax and functions provided by `undetected_chromedriver.v2`, as there may be differences from standard Selenium functions. By following these steps, you should be able to resolve the `FileNotFoundError` and successfully use `undetected_chromedriver` with Selenium on Kali NetHunter.

  • @washingtrend9538
    @washingtrend9538 Жыл бұрын

    Sir can you tell me why selenium python is closing after executing code whether its correct whether its wrong and is there any way to keep selenium open sessiin alive

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    First, remove "driver.quit()" as this line closes the browser. If it still closes then use "time.sleep()" at the end of the code to keep the browser alive for x amount of seconds

  • @orolimomov5866

    @orolimomov5866

    Жыл бұрын

    @@MichaelKitas both did not solve the problem in my case

  • @Aminlas07
    @Aminlas07 Жыл бұрын

    Thanks bro, can you make video about bot python by request

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    Sure, I am making a video on that soon 👍

  • @cyrilc8687

    @cyrilc8687

    Жыл бұрын

    @@MichaelKitas thats awsome

  • @mykun8737
    @mykun8737 Жыл бұрын

    hi Michael heruku has stopped for free, Could you please using another hosting for upcoming lectures

  • @MichaelKitas

    @MichaelKitas

    Жыл бұрын

    Sure, will try to find another one as well