How I Organize Data In Python with Dataclasses

Ғылым және технология

Grab IPRoyal Proxies and get 50% off with code JWR50 at iproyal.club/JWR50
Scraper API www.scrapingbee.com/?fpr=jhnwr
Patreon: / johnwatsonrooney
Donations: www.paypal.com/donate/?hosted...
Proxies: iproyal.club/JWR50
Hosting: Digital Ocean: m.do.co/c/c7c90f161ff6
Gear I use: www.amazon.co.uk/shop/johnwat...
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases

Пікірлер: 44

  • @JohnWatsonRooney
    @JohnWatsonRooney Жыл бұрын

    Grab IPRoyal Proxies and get 50% off with code JWR50 at iproyal.club/JWR50

  • @faisalburdi9414

    @faisalburdi9414

    Жыл бұрын

    Can you make a vid where we can see how can we use this service in any example. It would be better if you can show us, you getting blocked and then extracting all the data by using any poroxy service . As always exceptional way teaching loved it and learned new thing today .

  • @ferrandonea
    @ferrandonea Жыл бұрын

    excellent video as usual, probably you can expand in how to use dataclasses with databases, for example with sqlalchemy

  • @coyoteden8111
    @coyoteden8111 Жыл бұрын

    Wooooah I've been looking for something like this. Normally I'd create a class from scratch to store attributes, retrievable in dot notation. This is next level simplicity

  • @starchildluke
    @starchildluke Жыл бұрын

    I've struggled to get to grips with dataclasses and find use cases for them in my work but this really helped. Also really relaxing to watch and listen to this video haha

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Glad it helped!

  • @durgeshkhade2417
    @durgeshkhade2417 Жыл бұрын

    Thanks for the great tutorial!! :D

  • @siriushp0904
    @siriushp0904 Жыл бұрын

    This in off topic question, but I love how straight forward your videos are. I was wondering if you could do a video on how you organize your workspaces, files, test projects, KZread walkthrough’s etc? I’m having a hard time figuring out an efficient, useful, and understandable organization system that prevents unintended duplicates, etc. brand new in the coding world, so I apologize if this is an easy topic. I found very quickly that files intended for a project could get out of hand fast, then figuring out everything the middle including not having a whole folder of things like packages that just seemed to multiply like rabbits. Eventually I ran into a bug that I couldn’t tell if it was my fault, a bug in the package, or I moved/deleted something that shouldn’t have been, or downloaded an extra copy. I finally just had to scrap quite a bit. Not a huge deal right now, but I really want to figure out a good and efficient file storage for my regular files, coding files, test project files, actual projects files, package locations, and eventually creating scripts that get used often that I can reference. My problem right now is I’m not sure how to do some things so I find myself attempting a new method to test it out and it gets really messy, really fast. Thanks for the content! Love watching your videos.

  • @emiliod90
    @emiliod90 Жыл бұрын

    Really good overview John thank you 🙏

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Thanks very kind .

  • @stewart5136
    @stewart5136 Жыл бұрын

    Excellent. dataclass and asdict = very helpful. Thanks

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Yeah it’s handy to have it all done for you rather than having to write your own class method!

  • @hacvelikarakus9929
    @hacvelikarakus9929 Жыл бұрын

    Great explanation with good example...again👏

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Thanks!

  • @uzairzarry8691
    @uzairzarry869125 күн бұрын

    Informative

  • @Ocelot911
    @Ocelot9114 ай бұрын

    As a guitarist pretty cool

  • @StraightCoding
    @StraightCoding Жыл бұрын

    Excellent video! I have two question, I think Optional is not compatible with dict type, what we can do in that case? another question: is the dataclass decorator compatible when is using inheritance ?

  • @bakasenpaidesu
    @bakasenpaidesu Жыл бұрын

    Ohayou gozaimasu!

  • @srikanthkoltur6911
    @srikanthkoltur6911 Жыл бұрын

    Thanks for the video I have been using pydantic library for a while it's pretty cool but still we need usage of classes in python i think

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Yeah Pydantic is pretty great!

  • @danlee1027

    @danlee1027

    Жыл бұрын

    @@JohnWatsonRooney maybe a dataclasses pro con and where appropriate video?

  • @TomKnudsen
    @TomKnudsen Жыл бұрын

    Do you have a tutorial on how to get certain information out of an json or cvs file?

  • @jamieosh70
    @jamieosh70 Жыл бұрын

    What about using @dataclass with Scrapy (and then returning as dict)?

  • @Klausi-uq4xq
    @Klausi-uq4xq Жыл бұрын

    I deal every day with data classes when i develop apps with flutter. In private datascraping projects with python i use dataclasses too..

  • @chriskeo392
    @chriskeo39211 ай бұрын

    Can we harmoniously combine dataclasses and pydantic?

  • @PavanVarma369
    @PavanVarma36910 ай бұрын

    Hi i am a Data science student and wanted to learn Web Scrapping, so can you please suggest me which of your playlist should I start with. I am at bignier level in Python as well.

  • @san24dec
    @san24dec Жыл бұрын

    Can you please add a video on how to use dataclass with pandas

  • @edwardwong654
    @edwardwong6549 ай бұрын

    Does anyone have that URL handy so that I can just copy and paste?

  • @iwilllearneverything
    @iwilllearneverything Жыл бұрын

    mate, can you tell me how long it takes to learn python + django from scratch for backend & website development? ( no data science , game dev or anything but website dev ) . i have understanding of html, css & basic JS .

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    hard to say but a good few months I'd have thought. There's a lot of new concepts to learn plus then learning the django way. Certainly possible though. If you already know some JS maybe Node would be a better path, I think there's more jobs for JS

  • @peeeeed52
    @peeeeed52 Жыл бұрын

    Which editor do you use?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    This is vs code! But I also use PyCharm

  • @gedtoon6451
    @gedtoon6451 Жыл бұрын

    In the video you say "You can add type hints". This should have been "You must add type hints" as they are mandatory with dataclasses.

  • @enricoroselino7557
    @enricoroselino75578 ай бұрын

    really want to use dataclasses but my data have 78 columns, maybe next time

  • @JohnWatsonRooney

    @JohnWatsonRooney

    8 ай бұрын

    How do you handle it now?

  • @enricoroselino7557

    @enricoroselino7557

    8 ай бұрын

    i found a package named Box, its convert dicts into a "data class" like, it has the dot notation too very neat like you shown on dataclass but only downside its not popping up on autocomplete box, but its there. the types is still messed up so i use pandas dataframe anyway. luckily i have the table up in mssql so i reflect the column types and map it, not neat but my boss doesnt complain 😂 big thanks for dataclass explanation

  • @bx_h23
    @bx_h23 Жыл бұрын

    Dataclass or pydantic basemodel?

  • @JohnWatsonRooney

    @JohnWatsonRooney

    Жыл бұрын

    Pydantic does more but data classes are in core python so one less dependency

  • @irfanshaikh262
    @irfanshaikh262 Жыл бұрын

    9:45 you dont say

  • @robinpipslayertekprofitsfa2644
    @robinpipslayertekprofitsfa264411 ай бұрын

    Man, I was following allowing until I hit the console for a 'run' and....😐🥵🥺🤯😭😭 Maybe because I'm using Python 3.7.16 in the current vm, however, I had to create a whole new function 'get_attributes(sef):' for this one line: '''o = Optional[list[str]]''', just so the imported Optional module would work!! Because this method didn't work for me out the box... The main take-away, I now actually get python algorithms a bit more...now if only the OTHER Tutorials were soo "easy" to follow and solve..... 😣😓

  • @robinpipslayertekprofitsfa2644

    @robinpipslayertekprofitsfa2644

    11 ай бұрын

    nvm...I had to actually create a new vm in -p3.10.10 and it all worked as normal!! What a headache!! Had i not seen the little note in the corner of your screen I would have been lost on which version we was working with 🥲🥲. Lovely lesson though!! Thanks!!

  • @illegalsmirf
    @illegalsmirf Жыл бұрын

    Christ Almighty, that went over my head a bit

Келесі