Automate your job with Python

Ғылым және технология

DISCORD (NEW): / discord
Learning automation with Python and Playwright can save you hours of work! Use the codegen feature to make it easy too
Patreon: / johnwatsonrooney
Scraper API www.scrapingbee.com/?fpr=jhnwr
Donations: www.paypal.com/donate/?hosted...
Proxies: proxyscrape.com/?ref=jhnwr
Hosting: Digital Ocean: m.do.co/c/c7c90f161ff6
Gear I use: www.amazon.co.uk/shop/johnwat...
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases

Пікірлер: 244

  • @rumble1925
    @rumble19254 ай бұрын

    I'm a programmer but I run my own business. I can't believe I never thought of automating admin tasks. I hate doing admin and I put it off to the last possible moment.

  • @johndavidwoodcock4528

    @johndavidwoodcock4528

    3 ай бұрын

    I also run a business, just to help we with some ideas what kind of admin work do you have in mind?

  • @3g0e

    @3g0e

    Ай бұрын

    What tasks are you referencing?

  • @HaggisMuncher-69-420

    @HaggisMuncher-69-420

    24 күн бұрын

    @@johndavidwoodcock4528 The guy isn't a programmer, if he was, he'd know to automate tasks.

  • @nico2006t

    @nico2006t

    5 күн бұрын

    Me too i am not a programer but i understand how it should work, so spend 2 days talking with chat gpt to automate my admin ( statement client, invoice, save invoice as pdf send in the appropriate folder, send e mail with invoice and statement) took me so much time before. Now i also made a VbA just to click a button and it is done. I actually feel bored now lol.

  • @rumble1925

    @rumble1925

    4 күн бұрын

    @@nico2006t nice work!

  • @JosejuanBlanco10
    @JosejuanBlanco104 ай бұрын

    This is exactly, and i mean EXACTLY what i’ve been looking for!!! I can’t thank you enough.

  • @54tomcat
    @54tomcat3 ай бұрын

    That was cool! In my first weeks right now studying and learning Python. Wanted to see some live coding, and that was so interesting 🤩. Thanks for sharing!!!

  • @jordiwang
    @jordiwang11 ай бұрын

    my man, thanks a lot. This is actually what I was looking for and I am sure this is a MUST skill that everyone should have. So good. Love you

  • @vrk4y
    @vrk4y Жыл бұрын

    Thanks for such useful content, John. I used the library a few times before, but I hadn't known about the codegen. It'll definitely make my new project development easier

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Glad it was helpful!

  • @bmccollum
    @bmccollum Жыл бұрын

    Can't tell you how very much I enjoy your Python-related videos. I always watch them and walk away having learned something new or at least having learned how to do something I already know in a better way. 🙂

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks great! thank you you are very kind

  • @waellerbe
    @waellerbe Жыл бұрын

    Today you have a **new** Subscriber to your channel. I am totally impressed with the value of Playwright powered by Python. Thank you for sharing this tutorial with us. Automating our jobs will boost our efficiency to a high degree. Ready to keep on learning along the way.

  • @davidl3383
    @davidl3383 Жыл бұрын

    This record fonction is incredible ! thank you John !

  • @carlos-ferreira
    @carlos-ferreira Жыл бұрын

    Thank you for tutorials like this. I recently used another one of your videos to fix the code a previous employee had created.

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Great to hear!

  • @graczew
    @graczew Жыл бұрын

    Good stuff as always. Thanx for sharing your knowledge and time.

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks mate hope all is good with you!

  • @training7574
    @training75742 ай бұрын

    Very inspiring, thanks! Amazing that it should be so simple.

  • @aetheon9906
    @aetheon99063 ай бұрын

    Class. Explained well, concise, with example. Love it!

  • @jw200
    @jw20010 ай бұрын

    Thanks so much for showing Playwright. Its excellent. Makes stuff so much easier.

  • @Metalmatt900
    @Metalmatt9004 ай бұрын

    This is what I’ve been looking for. Thank you so much.

  • @sepehrsarjami
    @sepehrsarjamiАй бұрын

    Absolutely enjoyed it. Nicely done.

  • @irfanshaikh262
    @irfanshaikh262 Жыл бұрын

    See. When i sit dow to count my blessings, i count "finding this channel and John" in particular probably a million times. Thanks john for being there for me.

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    that is very kind, thank you for watching

  • @PeterThornton
    @PeterThornton4 ай бұрын

    This is fantastic, i need to do repeated tests on a newly developed webpage, this is perfect. I have subscribed and check out your other videos. Thank you

  • @theshubhagrwl
    @theshubhagrwlКүн бұрын

    I clicked on this video thinking this to be a yet another python video where we automate excel or pdf something but NO, this was a whole different thing and super helpful 🙌

  • @LucasMartins-op7oq
    @LucasMartins-op7oq4 ай бұрын

    Wow, this is awesome! Thanks for sharing.

  • @danlee1027
    @danlee1027 Жыл бұрын

    Very helpful. I didnt know about code gen recording.

  • @swhitt4367
    @swhitt43672 ай бұрын

    Subscribed, if this was a series of examples and queries and question answering I would say you would have a keen audience! Subscribed

  • @sagedoescode
    @sagedoescode Жыл бұрын

    simple and straighforward, good stuff mate

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks

  • @amogu_07
    @amogu_0710 ай бұрын

    this is one of the coolest thing ive watched tnkuu

  • @Cu-da
    @Cu-da Жыл бұрын

    First of all thanks for the useful video. I've already learned python basics and now trying to get into automation and web scraping world and while i'm searching on youtube i found your useful channel but i found many playlists and i hope if you can tell me which playlist i should start with as a begginer in this world.

  • @quangminhnguyen5681
    @quangminhnguyen568110 ай бұрын

    very cool very useful. thanks man

  • @AMindInOverdrive
    @AMindInOverdrive6 ай бұрын

    This is great! Thanks

  • @BERNOUSSAMA
    @BERNOUSSAMA8 ай бұрын

    Thanks man. Never knew playwright had a codegen until now.

  • @michaelmuolokwu5039
    @michaelmuolokwu5039 Жыл бұрын

    Thank you for this!

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks for watching!

  • @Emre-yx6vw
    @Emre-yx6vw4 ай бұрын

    I couldn't stop laughing from happiness. Thank you man, thank you!

  • @pkavenger9990
    @pkavenger9990 Жыл бұрын

    wow this is so much better than selinium, I mean you don't even have to code just perform things on browser and it will convert it into code and you can then use it to automate stuff. Amazing

  • @dundy96
    @dundy965 ай бұрын

    This is going to make inputing student grades SO much easier.

  • @spookimiiki5891
    @spookimiiki589120 күн бұрын

    simple yet effective, the python way! nice video!

  • @jeS77791
    @jeS77791 Жыл бұрын

    Thank you, as always John!

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks for watching!

  • @isekaijoucho4812
    @isekaijoucho4812Ай бұрын

    a casual dig into learning python led me here? to this crazy advanced automation? should've done python long ago

  • @Kazui-gs
    @Kazui-gs4 күн бұрын

    neat, thanks man!

  • @TheEamonKeane
    @TheEamonKeane Жыл бұрын

    Very cool John

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Thanks I appreciate it

  • @victoraguirre7486
    @victoraguirre74863 ай бұрын

    I liked the video, unliked it and re-liked it again so I could like it more. Thanks man!!

  • @tlrehmke
    @tlrehmke3 күн бұрын

    You just made me another 50k over the next year. Thank you for the solution I've been agonizing over for the last 4 weeks!😊

  • @okoeroo
    @okoeroo5 ай бұрын

    Great find

  • @EnzoAuditore
    @EnzoAuditore10 ай бұрын

    Thanks mate

  • @justsh0t
    @justsh0t5 ай бұрын

    lol this codegen looks amazing :O

  • @isagive
    @isagive4 ай бұрын

    Its awesome! lets conenct this to a database and create some schemas... +10 for making such a tutorial.

  • @AlwaysBored1
    @AlwaysBored14 ай бұрын

    I'm going to try using this method to clock in and out of work each day!

  • @andrewlimmmmm
    @andrewlimmmmm12 күн бұрын

    thank you bro you are the best

  • @valuetraveler2026
    @valuetraveler2026 Жыл бұрын

    next level scraping here- will check it out

  • @loicleray
    @loicleray Жыл бұрын

    Interesting, as always. Thanks 😊

  • @devkhare5691
    @devkhare56914 ай бұрын

    That recording part looks like the universal recorder from Automation Anywhere 360.

  • @harrazmasri2805
    @harrazmasri28059 ай бұрын

    kudos to you sir

  • @nssdesigns
    @nssdesigns3 ай бұрын

    Great stuff... is there a way to read .xlms or csv data and loop through each row to automate web form entry data?

  • @ahmed007Jaber
    @ahmed007Jaber4 ай бұрын

    hi John, this sounds intersting. Do you code in R? found helpful resources for R? I have been coding in R for couple of years and planning to stick with it unless I have to change

  • @sweetlulu4306
    @sweetlulu4306 Жыл бұрын

    Thank you, I really enjoy how you explain and walk through the steps. I am curious about the password part tho. Is there a better security method for the username password part? I would hate to have this script to be sitting there on my desktop at work. Just wondering what’s the best security practice for that 😊

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Hey thanks- you could add user input at the start of the script, asking for the user to input the password required then stopping you having it saved

  • @daesagelmar
    @daesagelmar Жыл бұрын

    Hello, I think playwright has some pre-installation dependecies. I could not execute codegen generated code in VSCode due to library dependency problems. When i dig into stackover flow lot of questions raised to handle this library properly. Could you tell us how do you handle this issues? i mean "playwright.sync_api" could not resolved.

  • @Gunat737
    @Gunat73713 күн бұрын

    Interesting tutorials

  • @zettatech_dev
    @zettatech_dev Жыл бұрын

    thanks!

  • @bcavalcante
    @bcavalcante2 ай бұрын

    Tragam um Oscar para esse cara!

  • @dhanashekaranm4725
    @dhanashekaranm472525 күн бұрын

    useful video thanks

  • @mehuljy
    @mehuljy7 ай бұрын

    Hi John, is it possible to add time stamps for each step that is being captured

  • @aminehadjmeliani72
    @aminehadjmeliani72 Жыл бұрын

    Thanks John for the great content, my I suggest you to make video about scraping thousands of websites asynchronously using scrapy

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    good idea, big task - i can certainly look at something that would help

  • @PankajThakur-jq1td
    @PankajThakur-jq1td Жыл бұрын

    Hey John, How can we scrape a page which requires zipcode to open the actual data to scrape and various navigations to go the data.

  • @alexdin1565
    @alexdin1565 Жыл бұрын

    Thanks Jhon please can you make a video on how we can use selenium or playwright on cpanel to make it run 24/24?

  • @urielmedina8449
    @urielmedina84497 ай бұрын

    Hi! Can you use this for exe’s? For example i have an app at work that i have to use to process charges. Its slow and has a few points where i have to wait to load, but for the most part its pretty repeatable.

  • @ouassildahimene4635
    @ouassildahimene4635 Жыл бұрын

    Thanks a lot john, can you make a video about scraping linkedin jobs with playwright ?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Thanks for watching - you can apply the same principles here but linked in has more bot protection to get around. I’m moving away from specific site scraping videos but the methods will be adaptable to the sites you want to scrape

  • @rico5424
    @rico542424 күн бұрын

    That’s awesome! So you would just have to change the numbers and run the script and let it do it for you. That’s cool

  • @aslmate
    @aslmate16 күн бұрын

    Do you think this could work with multiprocessing or multithreading in python? Like opening up many instances of the same process at the same time? How would you change the code so that every error is handled during runtime and to make sure it cannot fail?

  • @RaihanRisad
    @RaihanRisad2 күн бұрын

    I dont know if you can help me with something here but when you were at the step of putting login id and pass, how did you got the value? I thought for auto-fill you need to signed in, but codegen took me to a chromium page where i could not access the sign in or this kind of functionalities. so how did you get the login and pass, and if i want to put it by code, can you to tell me what that would be? I mean how to put key and pass here on code. Thanks for the video. It really got me up from the phone to do this

  • @walterclements7968
    @walterclements79684 ай бұрын

    wow. crazy how easy it is

  • @malwaredev33
    @malwaredev33 Жыл бұрын

    Good content as always, Thanks for that fantastic knowledge base videos, bro. I learn many things from your videos about scraping with python, Now I'm learning API web scraping. Make or suggest some good videos about web scraping through API. using python or making a video with complete detail. Thank You, John

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    thanks for watching, and great video suggestions thank you!

  • @malwaredev33

    @malwaredev33

    Жыл бұрын

    @@JohnWatsonRooney Don't worry I'm also a python lover so I know how much hard it take to make this type of content.

  • @Septumsempra8818
    @Septumsempra8818 Жыл бұрын

    Playwright never ceases to surprise

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Yeah you can do a lot just by controlling a browser

  • @ouchvinny4520
    @ouchvinny45204 ай бұрын

    Question, how does your terminal look so clean?

  • @bashartabbakh6299
    @bashartabbakh62995 ай бұрын

    very nice

  • @robertwallace5498
    @robertwallace54984 ай бұрын

    I wish my job had more of these tasks so I could automate them

  • @ciaranflynn6291
    @ciaranflynn62914 ай бұрын

    If I have to perform a task that requires two chrome tabs open at the same time and a "click event" of a chrome extension... would it work?

  • @Puundaa
    @Puundaa4 ай бұрын

    Hi, can I use this for automatic testing of a webpages as well? If so, how can I store the passed and failed parts?

  • @ngaiyuchan7886
    @ngaiyuchan78865 ай бұрын

    selenium seems cant use back the cookies for specific website, how about this library, thanks

  • @this_is_elvis
    @this_is_elvis9 ай бұрын

    amazing

  • @jasperbaumgarten3612
    @jasperbaumgarten36125 ай бұрын

    Are you able to make it change the date to one day later every time you run it? Also are you able to make it repeat so it completes this entire task say 5 times?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    5 ай бұрын

    Yes both of those are possible and relatively simple to implement

  • @mateip2002
    @mateip200211 ай бұрын

    Can you pull information from emails for the code to paste it into the API?

  • @leoblack8497
    @leoblack8497 Жыл бұрын

    Great video John! One question though, beside playrighte ability to record your inputs , does it have any other advantages over selenium?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    I find its API more intuitive, and I think it has better docs. But functionality wise no - if you are already comfortable with Selenium I don't see a clear reason to switch. I started with selenium and only moved over cos Playwright was new and shiny and I liked using it

  • @user-xy9sq3lg7m
    @user-xy9sq3lg7m9 ай бұрын

    is there code that can automate an excel sheet that needs checking and updating based off latest available data from a number of other spreadsheets? e.g. there is an item code which can be used to lookup different types of information from other sheets, the item code will be present in each other sheet so all that it needs to do is lookup that item code and then input the latest data for that code into my desired spreadsheet. There is also a cell that needs to return a list of "countries" that item code is available in, im unsure where to start or how to go about this

  • @ktsai24

    @ktsai24

    6 ай бұрын

    You'll want to look into Excel macros. Otherwise if you're on Windows, Microsoft Power Automate is a low-code option.

  • @shawn_magnum9208
    @shawn_magnum9208Ай бұрын

    How do i update the code to log in to my utility portal and download the monthly bill? How can i dynamically tell it to download the latest bill since every new bill will have a different name?

  • @TurokAgi
    @TurokAgi Жыл бұрын

    I accidentally entered the smart side of KZread. My brain hurts 😖

  • @matthewj6026
    @matthewj60264 ай бұрын

    I love how the thumbnail of this video has some text reading "work smarter" with an arrow pointing to a screen of code on it. It's just brilliant.

  • @matthewj6026

    @matthewj6026

    4 ай бұрын

    Oh I forgot the "automate" bit- genius! Then the video starts with a man talking into a big microphone stuck right in his face, a must have for the KZread podcaster or today. Also, the look of contemplation on his face as he's talking through his techniques

  • @tr0wb3d3r5

    @tr0wb3d3r5

    4 ай бұрын

    ​@@matthewj6026HAHAHAHAAH hi gpt4

  • @moler512

    @moler512

    4 ай бұрын

    huh?

  • @mortazabaqeri1838

    @mortazabaqeri1838

    4 ай бұрын

    Hahaha what is bro saying?

  • @arleendo
    @arleendo5 күн бұрын

    My company doesn't allow access to PATH editing, so the command playwright install does not work. How do I initialize playwright from the command line manually? Thanks!

  • @johnlenoob6951
    @johnlenoob69514 ай бұрын

    Hi SIr, what is your coding environment ? YOu recommend use of conda or miniconda ? Working on windaube and don t want to destroy my poor system ;) Thanks for your work and knowkledge wharing

  • @JohnWatsonRooney

    @JohnWatsonRooney

    4 ай бұрын

    I just use Python and venv - no need for anaconda unless you are a data scientist in my opinion

  • @johnlenoob6951

    @johnlenoob6951

    4 ай бұрын

    Thanks sir @@JohnWatsonRooney

  • @davidghisk3470
    @davidghisk3470 Жыл бұрын

    Great

  • @os3990
    @os39904 ай бұрын

    Is there a way to not hardcode the values but refer them to another source eg an excel?

  • @shaakirjohaar754
    @shaakirjohaar7543 ай бұрын

    After installing playwright using the pip3 command , when trying to install chromium, it says playwright is not found Please do let me know if there are other requirements one needs before running these commands on mac m1

  • @nunyo7259
    @nunyo725925 күн бұрын

    Might need this to book my T times

  • @makie1467
    @makie1467 Жыл бұрын

    Hey there, thank you so much for your great videos. How can i connect google sheets with playwright? Everytime I try to access google it says it is unsafe and I cant login.

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    If you are trying to get data from google sheet with python there is a google api you can use and a Python package to help - it’s a much better way and it allows you to read and write data to a sheet programmatically. It’s called gsheets I believe

  • @Digitalachievement
    @Digitalachievement2 ай бұрын

    How are you supposed to deal with 2 factor authentication? For example if you need to log into a website with your google account but you have 2 factor authentication?

  • @duyduy5595
    @duyduy5595 Жыл бұрын

    Does we have to create some delays every time we input something to make it human like? Will the website manager know that we are using Python/Playwright on their site and block our IP?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    It depends. I think a lot of cases no, you will be fine. I have read about others though where people have had to mimic real mouse movements and time delays

  • @Nostrada-mus
    @Nostrada-mus2 ай бұрын

    Playwright runs on private nav. Managed to make it work on guest but can't get it to run on any of my chrome's profile. Any idea how to fix this?

  • @arsalan0561
    @arsalan0561 Жыл бұрын

    is this possible with selenium ? as i use scrapy-playwright which doesn't work on windows..

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Yes very possible with selenium, I started with selenium but moved on to Playwright as i preferred the API

  • @zachhalliwell553
    @zachhalliwell55322 күн бұрын

    Do you have to run it from the script window? Or could I save the script and run it while I'm in a browser at the page I want to run the script on?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    22 күн бұрын

    You can do it that way - you can connect to an open chrome browser using the CDP protocol. It’s relatively straight forward to figure out

  • @monicadesai7928
    @monicadesai7928Ай бұрын

    Can you please make video for scraping job roles from individual company career web pages, so we only have to once add those web pages url, rest will be done by script and then automate the modification of job description into resume by removing some words. Please make videos on it.

  • @senecanoles
    @senecanoles3 ай бұрын

    My python doesn't look like that, I have to run it in Terminal. How do I get to this window in the begining of the video?

  • @luffytaro689
    @luffytaro68927 күн бұрын

    Holy shit new programmers have it so fucking easy. I remember when we had to use selenium and find each and every HTML path for each click.

  • @ImSilverstar
    @ImSilverstar4 ай бұрын

    How do you export the code so that it can be a clickable link on your desktop?

  • @urmotiva
    @urmotiva6 ай бұрын

    What is this theme called in VS?

  • @AllVIDEO4You
    @AllVIDEO4You11 ай бұрын

    Can I uninstall any application on my system using Playwright

Келесі