Python Regular Expressions - Computerphile
Continuing the exploration of Regular Expressions and Automata with Professor Thorsten Altenkirch.
The professor's code: bit.ly/C_PythonRegEx
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharanblog.com
Thank you to Jane Street for their support of this channel. Learn more: www.janestreet.com
Пікірлер: 101
The way in which Prof Altenkirsch talks during this video is almost indistinguishable from the conversation a lone programmer would have with himself out loud during an intense programming session. If anyone ever wondered what programmers sound like when there's no-one to hear them code, this is pretty much it.
It never came to me that the highest level of Pythonic is to lean back 40 degrees with your upper body while writing Python.
@DrGreenGiant
4 ай бұрын
I do this too. Well, specifically I alternate between ultimate recline and ultimate shrimp lol
@innocentsmith6091
4 ай бұрын
I find to be curled up in a fetal position to be most pythonic
@kylek29
4 ай бұрын
Don't overlook the flower shirt, which is part of the proposed PEP9 spec.
@RagHelen
4 ай бұрын
@@kylek29 That trumps proper whitespaces.
@MethodOverRide
4 ай бұрын
@@DrGreenGiantI feel so seen right now 😂
So this is not an explanation of Regular Expressions as a tool, that we might use on a daily basis. This is the theoretical basis for how REs is implemented. It's stuff covered in undergrad CS, and one of the next lessons is making your own parser for your own programming language.
The amount of times he wrote return as retrun makes this video super relatable and gives me hope
@liamchisari2191
Ай бұрын
You've got this bro 💪
I love watching this guy, he looks like some kind of ancient sage like a programming Gandalf
This feels like they edited a 2 hour video, which explained everything, down to 20 minutes :-)
Prof Altenkirch vids are my favorite!
Another video with Thorsten? Awesome! He has a great sense of humor.
Is he talking about Regularexprechen?
@kellysmith7357
2 ай бұрын
😏
I love Thorsten. ❤❤ the guy is a true genius of our time.
I've always focused on just getting the re to serve some purpose. That's why I got an engineering degree, not a mathematics degree. But this helps me appreciate just how much math is under the hood (bonnet?)! It's fun listening to prof Altenkirsh even though the machine code episode was more my speed
Right back to it, I see! There's an error in the example with the alternating as and bs at 0:59. It should not have a "+" (meaning or) in between "(ab)*" and "(a+ε)"
@phizc
4 ай бұрын
The green text on the screen for the challenge in the end (20:41) is also incorrect. The one in the comment on the monitor is the correct one.
great series! i really liked the implementation style
Just watching because of Prof. Altenkirch
@jalsiddharth
4 ай бұрын
Thorsten is amazing, but beyond all of that, a super kind person. Can't believe I've had the chance to interact with him in real life multiple times.
@Ryan_Hokanson
4 ай бұрын
Sure seems like a nice, verysmart guy. I too watch purely for the fun of (almost~certainly) knowing that if you understand the arcane _jargon_ he is speaking then the _concepts_ are surely simply simple. LSS: Dude... you had me at "Non-Deterministic Automata"
The RE at the end seems to detect binary numbers that are multiple of 3. However, I'm not sure how it checks this.
@ThorstenAltenkirch
4 ай бұрын
Yes this is correct. 🎉Maybe I should do another video how to construct it.
@zamf
4 ай бұрын
@@ThorstenAltenkirch Definitely! And to explain what property of binary numbers you're using in this case.
I think Sean has gotten free university degree from making these videos. I hope he gets his diploma at some point
What makes this project particular to "Python" Regular Expressions? Cause re exists and you could roll your own regex in most languages. Aren't you just making regexes (in some language, that happens to be python)?
It would have saved me a lot of time if the mystery regex had been shown correctly on the screen and the paper (from 20:38). The correct regex (with sensible symbols) is /(0|11|10(00|1)*01)*/. After I had wasted much time on the incorrect one, I drew the AST from the python code in a notebook since I didn't trust the comment above it. The comment was correct as it turned out. Here's the first matches: 0 : 0 11 : 3 (11) 110 : 6 (11 0) 1001 : 9 (10 01) 1100 : 12 (11 0 0) 1111 : 15 (11 11) 10010 : 18 (10 01 0) 10101 : 21 (10 1 01) 11000 : 24 (11 0 0 0) 11011 : 27 (11 0 11) 11110 : 30 (11 11 0) I think I can see the pattern.
@tunafllsh
4 ай бұрын
Ah that's the classical division by 3 test.
@babyeatingpsychopath
4 ай бұрын
The extra credit question on my DFA exam in college was "write a DFA that can determine If a binary number is divisible by 3. Hint, it has 3 states." I recognized the regex instantly.
@jursamaj
4 ай бұрын
@@babyeatingpsychopath Technically, shouldn't there be 4 states? The empty string is not "a binary number is divisible by 3", but it *is* your start state. Then you have 3 states for the 3 remainders modulo 3.
@babyeatingpsychopath
4 ай бұрын
@@jursamaj technically, I believe you're correct, I suspect the actual instructions specified a nonzero length binary string. It's been a couple of decades since that exam.
Unit testing should also know the expected result. There should be some instant feedback instead of someone checking and saying, "Yep, that test case must return false, so it's okay".
@DavidLindes
4 ай бұрын
Yeah... this definitely falls short of proper unit testing. Perhaps Prof. Altenkirch needs to learn to behave... or rather, to learn _behave_ -- the python implementation of the Cucumber conception of unit testing. :)
That final regular expression is just a reformulation of (1(01*0)*1+0)*, obviously. Now, which is better and why is the real question.
Halfway through and I don't understand what's happening... What's the point? Why Python is important for this?
@piyh3962
4 ай бұрын
Yeah, I feel like there's a bunch of missing context
@redjr242
4 ай бұрын
He's implementing regex in terms of an NFA network, in code. He wrote python code for running any NFA network in a previous video. That code will also work on the regex-specific NFA networks he's constructing in this video. He chose Python because it had to be in some programming language, and Python is easier to write than in C for example. Edit: but yeah as others have said, the title of this video suggests it's about python's re regex library, or just regex in general, which could confuse viewers :/
@DrGreenGiant
4 ай бұрын
This is part of a series which is in a playlist. Hopefully that helps you understand the context if you've not seen the previous videos!
@vwtype411
4 ай бұрын
KZread prompting this episode out the blue. I also bailed halfway through.
Thank you
Very interesting and recommended gold mine Channel 🎉😊
Please change the title of this video. Python is not the important part. People are going to search for help with using regular expressions in Python (import re) and find this video which is not going to help.
@BaronFirespawn
4 ай бұрын
If you're watching Computerphile videos and expecting tutorials, you're already in the wrong place.
@djhoese
4 ай бұрын
@@BaronFirespawn Someone who doesn't know computerphile would only see a search result for a popular channel. Regardless, the "Python" in this video had nothing to do with the concept being shown.
....I have no idea what I've just watched.
Also upload videos on compiler design.
I have no idea how he did that. I wonder how many times I have to watch it to figure out what he did?
Prof Altenkirsch is definitely the Alien played by Jemaine Clement in Men in Black. It's so obvious he's a Supermax-escapee from the other side of the moon bent on taking over the world.
I had a problem, so I used regular expression. Now I have two problems.
What about the Fall of Rome where the European people invaded Rome because they where pushed from the east?
Which code editor is he using?
@DrGreenGiant
4 ай бұрын
One without a code formatter lol
@Imperial_Squid
4 ай бұрын
That "In [n]"/"Out [n]" in the console reminds me of spyder, but could be wrong
@DavidLindes
4 ай бұрын
@@Imperial_Squid well, the title of that window (e.g. at 3:25) says "IPython Console"... you'll also see that sort of output in Jupyter Notebooks... I think a lot of these things are interconnected in some manner, though I don't know the details.
@KushagraJuneja
4 ай бұрын
probably Jupyter
Love regex - hate python (syntax) - useful libraries though.
@XenoTravis
4 ай бұрын
If python had better syntax and kept the ease of use it would be so nice! If I can remember the weird quirks in python it is so nice to use
@nathanaelsmith3553
4 ай бұрын
@@XenoTravis it's like a cross between BBC Basic from the 1980s and JavaScript, without any curly braces. And 'elif' - seriously? That just looks like a typo. Deep and shallow copies? Grrrr! Probably all straight forward if you start out learning to code in Python but really annoying if you are previously familiar with other languages. But the libraries are useful. Oh and why is there a while but not a do ... while ?
@RedHair651
4 ай бұрын
What would you improve about the syntax? @@XenoTravis
@XenoTravis
4 ай бұрын
@@RedHair651 haven't thought about what I would do to improve it tbh. Sometimes it seems a little bit bare and I have to assume a lot of things. I would change the for loop or at least add in the classic c syntax along with their style. But that is just me being so used to the 'normal' way
@halfsourlizard9319
4 ай бұрын
The syntax is what you hate? There are way better reasons to hate Python: Mutability. Lack of a type system. Incorrectly / inconsistently-implemented scoping.
Real life Erlich Bachman.
if you have 2 years of comp sci bsc, you will understand this, but then it's not useful for you anymore, well...
Nice try, but your not going to unconfuse me that easy!
e1 = /b?(ab)*a?/
0?00
why does he look like an older version of brad pitt as benjamin button
Python? Oh, you mean Peißn! Yes, hörd of it.
@bogdanstamenic2836
4 ай бұрын
"My English is not ze yellow from ze egg"
Like if you did not understand a sh*t
To disjointed to understand unfortunately, gave up at 15min.
import re already
@DrGreenGiant
4 ай бұрын
That really doesn't explain how RE works, which is the whole point of this video
@DavidLindes
4 ай бұрын
@@DrGreenGiant very much agreed. I wish more was done to draw attention to that distinction, though -- not to mention the fact that he's using a completely different syntax for his regular expressions than anything that's common in the UNIX [and similar] landscape... It's useful stuff if you're thinking about the abstract ideas of it all, but quite disconnected from practical everyday usage of existing implementations. 😕
@halfsourlizard9319
4 ай бұрын
@@DavidLindes Syntax isn't interesting. It's just arbitrary convention. The fundamental ideas are what matters ... the rest is just implementation details.
@DavidLindes
4 ай бұрын
@@halfsourlizard9319 Syntax may not be "interesting" to the theory, but it's critically important to actually doing anything useful with actual computers. Also, it can be _very_ interesting -- see the IOCCC.
@halfsourlizard9319
4 ай бұрын
@@DavidLindes Knowing the theory behind regexps is the interesting bit; there are references (or LLMs) for the derpy idiosyncrasies of the various flavours.
Please write better unit tests than he does
No clue wth is going on here. Thought I was about to listen to a real smart man talk about using Regular Expressions…
Sorry, I can't learn from this dude.
Only Rust
@RedHair651
4 ай бұрын
I don't understand why Rust has so much success
@davt8355
4 ай бұрын
@@RedHair651 A better version of C++, what else do you want? Speed and security. Top-notch for today's needs.
@BruceGrembowski
4 ай бұрын
@@RedHair651because rust never sleeps.
First