You Can Do Really Cool Things With Functions In Python
Here are a few not-so-common things you can do with functions in Python, including closures and partial function application. Functions are incredibly powerful and you can use them to write code that's really clean and often a lot shorter than when relying on classes and object-oriented programming.
The code I worked on in this video is available here: github.com/ArjanCodes/2022-fu....
💡 Get my FREE 7-step guide to help you consistently design great software: arjancodes.com/designguide.
💻 ArjanCodes Blog: www.arjancodes.com/blog
🎓 Courses:
The Software Designer Mindset: www.arjancodes.com/mindset
The Software Architect Mindset: Pre-register now! www.arjancodes.com/architect
Next Level Python: Become a Python Expert: www.arjancodes.com/next-level...
The 30-Day Design Challenge: www.arjancodes.com/30ddc
🛒 GEAR & RECOMMENDED BOOKS: kit.co/arjancodes.
👍 If you enjoyed this content, give this video a like. If you want to watch more of my upcoming videos, consider subscribing to my channel!
💬 Discord: discord.arjan.codes
🐦Twitter: / arjancodes
🌍LinkedIn: / arjancodes
🕵Facebook: / arjancodes
👀 Code reviewers:
- Yoriz
- Ryan Laursen
- Sybren A. Stüvel
- Dale Hagglund
🎥 Video edited by Mark Bacskai: / bacskaimark
🔖 Chapters:
0:00 Intro
1:32 Explaining the code example
3:56 About the Strategy pattern
4:29 Replacing the class structure by functions
9:24 Passing extra parameters using closures
13:37 Using partial functions
#arjancodes #softwaredesign #python
DISCLAIMER - The links in this description might be affiliate links. If you purchase a product or service through one of those links, I may receive a small commission. There is no additional charge to you. Thanks for supporting my channel so I can continue to provide you with free content each week!
Пікірлер: 375
💡 Get my FREE 7-step guide to help you consistently design great software: arjancodes.com/designguide.
It's really cool to watch your videos, because they open our minds to other possibilities of how to build the same code. You teach things that are not easy to find anywhere else.
You sir, are putting out the best Python content on the internet. Thank you!
I guess it matters how you define the function of the bread. I may be partial to German bread and will happily eat it by itself, but there's an argument to be made that, say, certain French breads shine as part of a breakfast. With American bread, islice it and toast it and it slaps. Italian bread is in a class of its own. I haven't tried Dutch bread, I gotta find some, I wonder if they import it here. And to give y'all some closure, I'm sure any bread from any country can be great if combined with the right ingredients
@theMuritz
2 жыл бұрын
Dutch bread, it’s simply a slice of very soft very limp toast called Roti … maybe that’s why a Dutch can’t understand other countries being fond of their bread … I’ve been living in Indonesia and they had adopted Dutch bread-making habits, while Vietnam for example offer baguette due to the French, and none of them compares to German variety of course …. 😜
This came in handy for my weekend project! I’ve watched through all your Python videos so far, and my code has started to improve dramatically as a result. Thanks for sharing!
@ArjanCodes
2 жыл бұрын
You’re welcome - glad to hear that the videos help you improve your code.
wow. I am currently working on a project where I use functions that return customized functions, just as in your example. So partial just blew my mind a little. Thank you so much for introducing this awesome tool to me :)
Great video, Arjan. I also use the functools a lot, e.g. partial. What I really love about Python is that it supports many different approaches and does not force you to use a single one. As a developer I can choose between many different approaches, and choose the one that I think is the best to solve my current problem. Python lets me express myself in code directly in various ways.
@ArjanCodes
2 жыл бұрын
Thank you Robert! It’s indeed one of the powers (and dangers) of Python that it allows for so much flexibility.
functools is amazing. Besides partial there is also reduce, wraps and lru_cache which I use all the time. singledispatch can also be nice in very simple cases but it quickly hits a roadblock in more complex scenarios.
Hi Arjan! Thanks for all your work teaching and coding! I came accross partial when I was working with python's multiprocessing library for performing a task with many files with some "standard" parameters that were the same for each and some "variable" parameters (such as the dataframe) that were unique to each process. This video gave me a better context of what partial actually is/does, and it's helping me with an NLP project refactor. 😄
Very informative! As someone who was previously unaware of partials, I have achieved similar functionality by setting constants and using them as default parameters (as you mentioned). This approach seems cleaner, though, so I will definitely give it a whirl in the future!
Thank you for your time and patient, the DOC contains a beautiful explanation in 7 steps about design better.
Little Vim tip: full stop (.) repeats your last action. This includes entering insert mode and typing things. e.g. at 6:10 you type out "_avg" twice. You could instead just type it once, navigate to the next function, then press . and that'll type out "_avg" again for you. Same with _minmax a few seconds later! Edit: Just watched the part about partial functions. Can't believe I've never seen them before, they seem like such a useful tool!
@ArjanCodes
2 жыл бұрын
You’re absolutely right. I still have a lot to unlearn from not editing with Vim for about 35 years.
@astronemir
2 жыл бұрын
Wow. I really need to learn Vim properly and use it.
@joeymea
2 жыл бұрын
But also in vscode you can edit hundreds of lines at once (and I have done so in a productive way before)... I take people who talk about vim/emacs being best in the same way I take people talking up the King James Version. Sure, it's the Bible, but the language is archaic and outdated. Vim is great, but so is vscode. And this is coming from someone who is efficient in both. I definitely prefer vscode.
@lawrencedoliveiro9104
2 жыл бұрын
People think Emacs is old, but they forget that it was built by a whole bunch of smart hackers who lived and breathed coding, knew what they were doing, and were not beholden to marketing managers at any company. For example, they used an advanced programming language (LISP), which can still scare the pants off the Java/C♯/PHP crowd today. Does the automation language in _your_ favourite editor understand closures and lexical binding? (Interestingly, the sort of concepts discussed in this very video.)
@ArpadHorvathSzfvar
2 жыл бұрын
I like Vim too but it's not good at bigger refactors. So I use PyCharm for bigger projects, and sometimes I just switch on the Vim plugin to do some stuffs. For smaller things (indenting the whole file, removing indentation, adding comma to the and of lines, join all the lines, removing every fifth lines with macro) I just start a Vim in command line.
I really like how your tutorials have never been completely OOPs. A functional-leaning python programmer is a rarity :D I wonder if you have a playlist of videos on functional-ish concepts. The way you describe things is perfectly applicable and would be a very clean and organised way to write julia code as well.
@siddsp02
2 жыл бұрын
I wouldn't expect a lot of those types of videos due to Python's fairly limited support of functional programming. A few functional modules that are nice to use in the standard library (which might be covered later on) are itertools, operator, and the map, any, all, and filter functions.
@smalltimer666
2 жыл бұрын
@@siddsp02 Thanks!
@DistortedV12
2 жыл бұрын
Would also appreciate a treatment of the functional approach and its strengths. Also, mentioning how to write good functions in practice.
@DerekHohls
2 жыл бұрын
Actual of lot of folks who are not programmers but who use Python for basic data processing typically would never use a class at all.
@jb_lofi
2 жыл бұрын
@@DerekHohls Yes. I think this tends to get understated -- I've done a lot of Python and PowerShell "programming" for a lot of real-world enterprise uses, and I very, very rarely have to use an OOP approach when coding something from scratch. I rarely have to define my own classes at all; I wouldn't say most/all/anything superlative, but there's a lot of people who understand OOP but just never need to use it Python in that way.
I've temporarily moved to Finland from the Netherlands, and I can confirm: the bread is better in the Netherlands. There is a even bigger difference in cheese though: the cheese is horrible here.
@TheStickofWar
2 жыл бұрын
I feel this way about cheese when moving to Norway
@ratfuk9340
3 ай бұрын
Finnish rye bread is unbeatable.
Great video as always! Partials are nice. I wrote a validate(validate_func, data_type, data, ....) function that I could then call from a partial like validate_json = partial( validate, json.loads, "JSON") or validate_uuid = partial(validate, uuid.UUID4, "UUID").
Once again, Arjan! Super helpful. Thanks!
This is one of your best videos yet (and they're all consistently great!) I had to post a comment just to give extra likes 👍👍👍👍👍 The bits about closures and partial are BOSS 🤓
@ArjanCodes
2 жыл бұрын
Thank you so much!
I've been using partial() for similar applications before. Well explained.
repeat and partial can come in really handy when it comes to multithreading and passing arguments to the executed function
man your channel is underrated!! you are really provide a high quality contents with a great knowledge and experience, partial function are awesome i need to use it more, thank you.
@ArjanCodes
2 жыл бұрын
Thanks Ziad, happy you’re enjoying the content and it was helpful!
you told me to buy Dutch bread after getting the free guide, but I see no link in video description for where to buy it, so I guess I will just keep living in my "bread fantasy world". Love your vids. They are always very informative. Thank you!
I'm in love with your content. I think I'll purchase your course the SW designer mindset. Keep it up my man!
You have the cleanest code I’ve ever seen in my life!
I like the last example with "partial functions". Still Composition, but very flexible. Thank You again for your teaching!
@ArjanCodes
6 ай бұрын
Thank you for the support, Alexa! Glad you're enjoying the content!
While I don't follow everything you do, I like to watch your videos because it exposes me to new ways of thinking as well as showing me the practical reality of what is typed to accomplish an objective. Very cool indeed. :)
Thank you for another great video Arjan! also, your anecdote reminded me of a similar pun "no matter how kind your kids are, German kids will always be kinder"
Bedankt! Thank you, your video's are really helping me getting the most out of python and I really appreciate that as a self taught Pythonista :)
I’ve been living in the Netherlands for 3 years and you are the first dutch that I know that doesn’t like sliced bread 🤣 Very good video, as usual!
Excellent, as usual! The partial function will be used tomorrow, replacing a (very cumbersome) workaround. Thanks👌
@ArjanCodes
2 жыл бұрын
Glad to hear it was helpful, Johan!
Good stuff here. I hadn't come across partial before either. I feel like you could have squeezed in a mention on decorators. Yes the closure construct is a little clumsy, but using the decorator syntax, it's a little less clunky. It seems to me that partial is used when you need more granular customization, where as a decorator helps with a more general replacement. Good video, thank you!
I constantly write code that starts dead simple and expands in options progressively, ending up with very customizable functions. I’m gonna use partials to take care of this now!
Thank you for providing the github repo of the example. Nice!
@ArjanCodes
2 жыл бұрын
You’re welcome!
Great video as always. Keep going!
12:35 But you could replace it with a docstring. Which could be dynamically generated, to incorporate the actual limit, and assigned to the __doc__ property of the function object being returned.
Someone probably mentioned this already, but if you refactor the functions you're passing to partial so the arguments you're specifying therein are to the left of the one the new function still needs, you don't need to pass them by keyword.
Hi, please make series of advance level python. Your way of explanation is very cool and the set of example you used is very cool.
Great video. I've started to use partial more and more in my functional code. I was using lambda for the same result, but partial is a lot better.
@martinleonhardt1541
2 жыл бұрын
Interesting! What are the perks? In short perhaps...
@petermleigh
2 жыл бұрын
@@martinleonhardt1541 Partial will work around mutable types and closure better. Lambda got me in a pickle when I tried using it in a list comprehension.
Man, i'm programming for 15years or more. Mainly c,cpp, python only 3y, but ive newer knows this closure and partial mechanisms! Great!
Good stuff, thanks for this great video!
I sure learn a lot from your videos. Thank you so much!
@ArjanCodes
2 жыл бұрын
You’re welcome, Alfonso!
Nice! Thanks for another great tutorial.
10:38 I like to use a name like “def_should_buy_avg”. The extra “def” on the front looks like the keyword for defining a function -- which is what the function does.
My mother used to make bread with recipes that undoubtedly came from the Netherlands (as my country was a Dutch colony and before that we have no bread) and I'll say they're great! 👍🏽
Like many good things. It's really convenient and right when your team knows each other about it.
The partial function calls looked really practical. Though I can't really recall seing anything like that in other coding languages. A more generic way of dealing with varying parameters would potentially be to pass in a generic payload class, then cast that to the expected version inside the function.
Hi Arjan, Your content is great, found that one amusing in particular, since my wife is Dutch living in Israel for almost 20 years, while still complaining over the local bread taste and praising the Dutch version 🤣hilarious !!! Thanks for the effort you put into the content. 🙏
Nothing really related to your video, but I wanted to thank you for your work. Not only it is very well explained but it really inspires me by debunking some dev "features" and mindset related to development. I don't really study your videos (sometimes still too advanced for me), but they show me every time the beauty of code and keeps me learning further. Furthermore, I tend to really enjoy your both light/humble and technical tone, I'm from marketing, and your channel is doing marketing right focusing on content value first. So again, thank you for your work :)
@davidlakomski3919
2 жыл бұрын
Just yesterday, it inspired me to have fun playing with inheritance and composition with PyMongo's source code (not touching at it, but making my way around it for some purpose). Trying to deep dive into code like you do, finding beautiful and fun features, far from just focused tech tutorials, more of a technical case study / learning experience. thx !
No, no, no - you definitely did not fall victim to the Dunning-Kruger effect (about bread), you just have a very good sense of humor.
Love your videos man
@ArjanCodes
2 жыл бұрын
Thank you!
Great video! Its begs the question of when a functional approach is better then a objected oriented one.
@lawrencedoliveiro9104
2 жыл бұрын
I have used both together.
get_best_bread = partial(get_bread_from, country_code="de_DE") :) Great video! I was astounded seeing the closure part and then really impressed seing partial() in use. The flexibility and simplicity of providing values for named variables and using it on any function is amazing. My wife is gonna get jealous of the love I am developping for Python. Thanks for sharing this!
Hi Arjan, Please continue the Design Pattern Series, You can take one by one different design patterns with practical code for python. There is not much good content out in youtube.
Hi, Your videos are awesome... one question though. How do you place that run button beside the split editor right icon in vs code, are you using any plugins/extensions?
French bread is of course better by far than any other bread, but I guess it wouldn’t be fair to include it in the competition as there wouldn’t be any controversy.
@jasonmcclatchie6877
2 жыл бұрын
I am English and I'm still willing to back you up on the superiority of French bread!
@obed818
2 жыл бұрын
@@jasonmcclatchie6877 thanks hehe
Man you are the best! Could you make a video about design patterns of libraries like django or scrapy?
Really cool indeed!
Great video!
Love your videos Arjan!
@ArjanCodes
2 жыл бұрын
Thanks Nick, glad you like them!
So what would be the difference between using closure and functools.partial? When would you prefer to use closure over partial?
Forget where I saw it on youtube, but someone commented that most classes are basically "collections of partially applied functions". In that scenario where I have similar methods, I would rather have user instantiate a class once than do the partial applications repetitively for the different functions / methods
I rarely comment on video tutorials, unless it gave me that "aha" moment, and this was one of those, thanks ArjanCodes for educating us! btw, have you profile which "way" is more faster, the OOP or FP style?
Thank you for the great tutorial and all the interesting Python content on your channel!
@ArjanCodes
10 ай бұрын
Glad you like them!
Great content, I work in the Netherlands as a Python Backend Dev and and the bread is okish haha!
functools and itertools are realy cool modules to master.
I have just discovered the channel. This is Golden
@ArjanCodes
2 жыл бұрын
Thank you, glad you like the content!
It's nice that you can replace interfaces and their implementations with partial functions. However I'm still concerned with what happens in cases where we need to do some error validation and type checking, any ideas?
Always learning something from your videos. Great content
@ArjanCodes
Жыл бұрын
Awesome! Thank you!
I totally agree about bread, I think the Polish one is the best ;) Anyway, another great tutorial, thanks!
How would you do dependency injection for functions? For instance I have several functions where I want to use a database, for this I have a class or function which I want to re-use and mock for unit tests. If I use classes I would inject this dependency in the constructor. In the composition root I would assemble my objects. If I would do the same on function level for instance with te partial() it sounds like a lot of configuration, and a bit unclear for me how to structure the code then.
Very useful if you want to write to a file using print: with open("output.txt", "w") as f: fprint = partial(print, file=f) fprint("Hello world!") Same for printing to stderr import sys eprint = partial(print, file=sys.stderr) ... eprint(f"Error occurred: {error.description}")
Is there any difference between using a partial function and a lambda function? For some f(x,y), shouldn't lambda x: f(x, y0) be equivalent to partial(f, y=y0) ?
Thank you for this content
@ArjanCodes
2 жыл бұрын
You’re welcome, James!
Your bread tangent made me laugh a lot, thank you haha
Functional patterns are awesome and one of my favourite ways to structure code, u see it a lot in scala or heaven forbid R (their class like defns are terribad) But scalas map, filter, reduce, foldleft, currying or partial hell maybe i just used clojures and they got tail recursive. I had all of my steps be like functional but isolated environments be classes. I think both are cool
Yeah, I'm liking your videos. I'm not a software engineering but I use python a lot to do data science.
17:55 where did the partial grab the prices from however if it was not told..?
I'm not sold on closures. Besides encapsulation what are they good for?
great job
I think we need an ArjanBakes channel where you show off Dutch bread
Have I ever said how much I like your videos?
Nice! I’ve been writing Python for ages and didn’t realize partial was in there. Re:bread you need to try a good shokupan …
What is the name of the theme you use in VS Code? I love the colour scheme of syntax highlighting in your videos.
I really like using functools.partial when using .apply on a pandas Series. It saves me the hassle of writing a lambda function. But now that I'm looking at it, .apply also can take the *args and **kwargs for that function so I don't even need a partial function :)
I'll definitely try these approaches in nim language...
I'm German and I'm eating delicious bread as I'm watching this and I'm highly offended.
Hi Arjan. Thank you for the instructions on passing extra params using closures. I bookmarked this video when I first watched it because I suspected that it would be useful, and today it was exactly what I needed to add functionality to the callback function passed to ftplib.retrbinary()
Even if I'm not yet at the level where I have to implement most of the things you share, I still go ahead to watch your videos anyway. You teach well. That said, I thought I should point out something to you (and to those not familiar with this style). At minute 12:51, you add two additional zeroes, presumably to make the number 35,000. But that actually changes the number to 3,500,000. (And I confirmed this on my python shell.) 35_000_00 != 35,000 Instead, 35_000_00 == 3,500,000 35_000 == 35,000 3_4 == 34 (just to show those who might not know that you don't always have to end with zeroes) In essence, it seems to me you think adding two zeroes after the last underscore means python will treat the variable as a float. It won't. It'll just add two more zeroes to the integer. If you want a floating point number: 35_000.00 1_2.3 12_34_567_8009.027 are all different valid examples.
@jjenn050
2 жыл бұрын
Money is best dealt with in integers because floats will have errors dividing in binary. It is 35000.00. When returning values, you just have to deal with the extra 00 as cents.
I'm from the US, and I can vouch for the excellent NL accent! ...and I'll grant you the bread assertion
This is the first vid I've seen with someone using Vim bindings in VS Code.
Thanks
@ArjanCodes
Жыл бұрын
Thank you Martin, glad you liked the video!
Nice video as usual! Question on partial. Before knowing about it, I used to do: buy_strategy = lambda prices: should_buy_average(prices, window_size=4) vs buy_strategy = partial(should_buy_average, window_size = 4) I think the result is the same. Are these methods equivalent, but partial with less code?
@chriswunder5420
Жыл бұрын
There are a few differences I guess. For example with partial you can change the should_buy_average function (as long as it still takes the window_size) and need not change the partial statement, whereas you would need to change the lambda statement because it explicitly uses the parameters the should_buy_average function expects. You can also change the parameters' order of the function and the partial application still works.
Do partials have any affect on time complexity of a function? Say you have a function where the part that is partially applied takes O(n^2), and the remaining part would be O(n). When calling the partially applied function, would this be O(n), because the O(n^2) part has already been handled or O(n^2) because it hasn't? This seems quite niche, but im currently working on graphical demonstration of time complexities and partials could be very helpful as I could only look at timing a specific part of a function. I watched this video a while back and remembered how useful I found it
you😊 are my python master sir.
@ArjanCodes
Жыл бұрын
Thanks Ehtisham, happy you’re enjoying the content!
cool as always :)
@ArjanCodes
2 жыл бұрын
Thank you!
I have studied industrial engineering in Spain, with little curriculum in programming. Is it possible that I prefer functional programming due to my background in engineering? I.e. decompose the 'problem' in little steps via functions and then there is a main function that calls functions which in turn call lower level functions...and so on.
man, I wish so bad that c++ had something like "partial". it could make function pointer lists for weakly typed scripting much more manageable and most of the heavy lifting could be done by the compiler.
Why did he put the extra 2 zeros on 35_000_00 ? It evaluates in my interpreter as 3,500,000 when I'm sure he meant 35,000. Could someone please explain what I'm missing?
@ArjanCodes
2 жыл бұрын
I’m using the integer type to represent a monetary amount, and then the common way to do it is to use cents as the base unit and not dollars.
How does this affect unit tests? I liked the class style you showed first. Seems easier to test, and read.
@mleger45
Жыл бұрын
My 2 cents: Unit test is part of the positive effects of using functional programming approaches, given that it is definitely simpler to test the strategy functions created (I dont think it is worth testing the partials created though (IMO, I can be wrong on this one), as these are options provided by Python), than using the former class approach. Think of all the complexities you can find in a class, that will need to be tested, as opposed to test functions in isolation. Great video! Thanks a lot
@felipealvarez1982
Жыл бұрын
@@mleger45 surely it is possible to test all the methods in a class just as easily...?
What is "recording" on every line of your terminal?
While I use functools in many occasions I always wondered what the (technical) difference is between the partial function and creating a lambda (or even a function) simply reducing the arguments? I mean, i could also do buy_strategy = lambda prices: should_buy_average(prices, 4) While "partial" usually increases readability I wondered if there are any differences in terms of performance.
@StanislavStratiev
2 жыл бұрын
I am also interested in this.
@marsma18
2 жыл бұрын
Doing that, you use closure, but in simpler form.
@comedyclub333
2 жыл бұрын
@@marsma18 kind of, yes, but not in the way he showed closures in the video as my approach IS a function with a valid signature actually calling another function while the approach in the video RETURNS a newly generated function with a valid signature. Moreover I was interested in the technical difference than the logical difference.
@RitchieDiamond
2 жыл бұрын
@@comedyclub333 The only real difference that I came across was while implementing a naive save system in my game engine (naive in the sense that I just dump whole objects, including attached callback functions and everything to file using pickle). Now callback functions cannot typically have arguments, but often require a variety of them, so I end up using functools.partial fairly often - because lambdas are anonymous and cannot be pickled, while partial functions can.
@comedyclub333
2 жыл бұрын
@@RitchieDiamond That's actually something really interesting. I just tried it and you are right! It seems that lambdas really are not savable into serialized data. Crazy!