How I Organize Data In Python with Dataclasses
Ғылым және технология
Grab IPRoyal Proxies and get 50% off with code JWR50 at iproyal.club/JWR50
Scraper API www.scrapingbee.com/?fpr=jhnwr
Patreon: / johnwatsonrooney
Donations: www.paypal.com/donate/?hosted...
Proxies: iproyal.club/JWR50
Hosting: Digital Ocean: m.do.co/c/c7c90f161ff6
Gear I use: www.amazon.co.uk/shop/johnwat...
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
Пікірлер: 44
Grab IPRoyal Proxies and get 50% off with code JWR50 at iproyal.club/JWR50
@faisalburdi9414
Жыл бұрын
Can you make a vid where we can see how can we use this service in any example. It would be better if you can show us, you getting blocked and then extracting all the data by using any poroxy service . As always exceptional way teaching loved it and learned new thing today .
excellent video as usual, probably you can expand in how to use dataclasses with databases, for example with sqlalchemy
Wooooah I've been looking for something like this. Normally I'd create a class from scratch to store attributes, retrievable in dot notation. This is next level simplicity
I've struggled to get to grips with dataclasses and find use cases for them in my work but this really helped. Also really relaxing to watch and listen to this video haha
@JohnWatsonRooney
Жыл бұрын
Glad it helped!
Thanks for the great tutorial!! :D
This in off topic question, but I love how straight forward your videos are. I was wondering if you could do a video on how you organize your workspaces, files, test projects, KZread walkthrough’s etc? I’m having a hard time figuring out an efficient, useful, and understandable organization system that prevents unintended duplicates, etc. brand new in the coding world, so I apologize if this is an easy topic. I found very quickly that files intended for a project could get out of hand fast, then figuring out everything the middle including not having a whole folder of things like packages that just seemed to multiply like rabbits. Eventually I ran into a bug that I couldn’t tell if it was my fault, a bug in the package, or I moved/deleted something that shouldn’t have been, or downloaded an extra copy. I finally just had to scrap quite a bit. Not a huge deal right now, but I really want to figure out a good and efficient file storage for my regular files, coding files, test project files, actual projects files, package locations, and eventually creating scripts that get used often that I can reference. My problem right now is I’m not sure how to do some things so I find myself attempting a new method to test it out and it gets really messy, really fast. Thanks for the content! Love watching your videos.
Really good overview John thank you 🙏
@JohnWatsonRooney
Жыл бұрын
Thanks very kind .
Excellent. dataclass and asdict = very helpful. Thanks
@JohnWatsonRooney
Жыл бұрын
Yeah it’s handy to have it all done for you rather than having to write your own class method!
Great explanation with good example...again👏
@JohnWatsonRooney
Жыл бұрын
Thanks!
Informative
As a guitarist pretty cool
Excellent video! I have two question, I think Optional is not compatible with dict type, what we can do in that case? another question: is the dataclass decorator compatible when is using inheritance ?
Ohayou gozaimasu!
Thanks for the video I have been using pydantic library for a while it's pretty cool but still we need usage of classes in python i think
@JohnWatsonRooney
Жыл бұрын
Yeah Pydantic is pretty great!
@danlee1027
Жыл бұрын
@@JohnWatsonRooney maybe a dataclasses pro con and where appropriate video?
Do you have a tutorial on how to get certain information out of an json or cvs file?
What about using @dataclass with Scrapy (and then returning as dict)?
I deal every day with data classes when i develop apps with flutter. In private datascraping projects with python i use dataclasses too..
Can we harmoniously combine dataclasses and pydantic?
Hi i am a Data science student and wanted to learn Web Scrapping, so can you please suggest me which of your playlist should I start with. I am at bignier level in Python as well.
Can you please add a video on how to use dataclass with pandas
Does anyone have that URL handy so that I can just copy and paste?
mate, can you tell me how long it takes to learn python + django from scratch for backend & website development? ( no data science , game dev or anything but website dev ) . i have understanding of html, css & basic JS .
@JohnWatsonRooney
Жыл бұрын
hard to say but a good few months I'd have thought. There's a lot of new concepts to learn plus then learning the django way. Certainly possible though. If you already know some JS maybe Node would be a better path, I think there's more jobs for JS
Which editor do you use?
@JohnWatsonRooney
Жыл бұрын
This is vs code! But I also use PyCharm
In the video you say "You can add type hints". This should have been "You must add type hints" as they are mandatory with dataclasses.
really want to use dataclasses but my data have 78 columns, maybe next time
@JohnWatsonRooney
8 ай бұрын
How do you handle it now?
@enricoroselino7557
8 ай бұрын
i found a package named Box, its convert dicts into a "data class" like, it has the dot notation too very neat like you shown on dataclass but only downside its not popping up on autocomplete box, but its there. the types is still messed up so i use pandas dataframe anyway. luckily i have the table up in mssql so i reflect the column types and map it, not neat but my boss doesnt complain 😂 big thanks for dataclass explanation
Dataclass or pydantic basemodel?
@JohnWatsonRooney
Жыл бұрын
Pydantic does more but data classes are in core python so one less dependency
9:45 you dont say
Man, I was following allowing until I hit the console for a 'run' and....😐🥵🥺🤯😭😭 Maybe because I'm using Python 3.7.16 in the current vm, however, I had to create a whole new function 'get_attributes(sef):' for this one line: '''o = Optional[list[str]]''', just so the imported Optional module would work!! Because this method didn't work for me out the box... The main take-away, I now actually get python algorithms a bit more...now if only the OTHER Tutorials were soo "easy" to follow and solve..... 😣😓
@robinpipslayertekprofitsfa2644
11 ай бұрын
nvm...I had to actually create a new vm in -p3.10.10 and it all worked as normal!! What a headache!! Had i not seen the little note in the corner of your screen I would have been lost on which version we was working with 🥲🥲. Lovely lesson though!! Thanks!!
Christ Almighty, that went over my head a bit