Python Regular Expressions - Computerphile

Continuing the exploration of Regular Expressions and Automata with Professor Thorsten Altenkirch.
The professor's code: bit.ly/C_PythonRegEx
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharanblog.com
Thank you to Jane Street for their support of this channel. Learn more: www.janestreet.com

Пікірлер: 101

  • @mokopa
    @mokopa4 ай бұрын

    The way in which Prof Altenkirsch talks during this video is almost indistinguishable from the conversation a lone programmer would have with himself out loud during an intense programming session. If anyone ever wondered what programmers sound like when there's no-one to hear them code, this is pretty much it.

  • @RagHelen
    @RagHelen4 ай бұрын

    It never came to me that the highest level of Pythonic is to lean back 40 degrees with your upper body while writing Python.

  • @DrGreenGiant

    @DrGreenGiant

    4 ай бұрын

    I do this too. Well, specifically I alternate between ultimate recline and ultimate shrimp lol

  • @innocentsmith6091

    @innocentsmith6091

    4 ай бұрын

    I find to be curled up in a fetal position to be most pythonic

  • @kylek29

    @kylek29

    4 ай бұрын

    Don't overlook the flower shirt, which is part of the proposed PEP9 spec.

  • @RagHelen

    @RagHelen

    4 ай бұрын

    @@kylek29 That trumps proper whitespaces.

  • @MethodOverRide

    @MethodOverRide

    4 ай бұрын

    ​@@DrGreenGiantI feel so seen right now 😂

  • @jens256
    @jens2564 ай бұрын

    So this is not an explanation of Regular Expressions as a tool, that we might use on a daily basis. This is the theoretical basis for how REs is implemented. It's stuff covered in undergrad CS, and one of the next lessons is making your own parser for your own programming language.

  • @jackerylel
    @jackerylel4 ай бұрын

    The amount of times he wrote return as retrun makes this video super relatable and gives me hope

  • @liamchisari2191

    @liamchisari2191

    Ай бұрын

    You've got this bro 💪

  • @frederico-kluser
    @frederico-kluser4 ай бұрын

    I love watching this guy, he looks like some kind of ancient sage like a programming Gandalf

  • @BigJonYT
    @BigJonYT4 ай бұрын

    This feels like they edited a 2 hour video, which explained everything, down to 20 minutes :-)

  • @bentationfunkiloglio
    @bentationfunkiloglio4 ай бұрын

    Prof Altenkirch vids are my favorite!

  • @Erik_The_Viking
    @Erik_The_Viking4 ай бұрын

    Another video with Thorsten? Awesome! He has a great sense of humor.

  • @aram5642
    @aram56424 ай бұрын

    Is he talking about Regularexprechen?

  • @kellysmith7357

    @kellysmith7357

    2 ай бұрын

    😏

  • @YuTv1408
    @YuTv14084 ай бұрын

    I love Thorsten. ❤❤ the guy is a true genius of our time.

  • @arthurdent8086
    @arthurdent80864 ай бұрын

    I've always focused on just getting the re to serve some purpose. That's why I got an engineering degree, not a mathematics degree. But this helps me appreciate just how much math is under the hood (bonnet?)! It's fun listening to prof Altenkirsh even though the machine code episode was more my speed

  • @ivarkrabol
    @ivarkrabol4 ай бұрын

    Right back to it, I see! There's an error in the example with the alternating as and bs at 0:59. It should not have a "+" (meaning or) in between "(ab)*" and "(a+ε)"

  • @phizc

    @phizc

    4 ай бұрын

    The green text on the screen for the challenge in the end (20:41) is also incorrect. The one in the comment on the monitor is the correct one.

  • @yedidiapery
    @yedidiapery4 ай бұрын

    great series! i really liked the implementation style

  • @MangoNutella
    @MangoNutella4 ай бұрын

    Just watching because of Prof. Altenkirch

  • @jalsiddharth

    @jalsiddharth

    4 ай бұрын

    Thorsten is amazing, but beyond all of that, a super kind person. Can't believe I've had the chance to interact with him in real life multiple times.

  • @Ryan_Hokanson

    @Ryan_Hokanson

    4 ай бұрын

    Sure seems like a nice, verysmart guy. I too watch purely for the fun of (almost~certainly) knowing that if you understand the arcane _jargon_ he is speaking then the _concepts_ are surely simply simple. LSS: Dude... you had me at "Non-Deterministic Automata"

  • @zamf
    @zamf4 ай бұрын

    The RE at the end seems to detect binary numbers that are multiple of 3. However, I'm not sure how it checks this.

  • @ThorstenAltenkirch

    @ThorstenAltenkirch

    4 ай бұрын

    Yes this is correct. 🎉Maybe I should do another video how to construct it.

  • @zamf

    @zamf

    4 ай бұрын

    @@ThorstenAltenkirch Definitely! And to explain what property of binary numbers you're using in this case.

  • @velho6298
    @velho62984 ай бұрын

    I think Sean has gotten free university degree from making these videos. I hope he gets his diploma at some point

  • @pylang3803
    @pylang38034 ай бұрын

    What makes this project particular to "Python" Regular Expressions? Cause re exists and you could roll your own regex in most languages. Aren't you just making regexes (in some language, that happens to be python)?

  • @phizc
    @phizc4 ай бұрын

    It would have saved me a lot of time if the mystery regex had been shown correctly on the screen and the paper (from 20:38). The correct regex (with sensible symbols) is /(0|11|10(00|1)*01)*/. After I had wasted much time on the incorrect one, I drew the AST from the python code in a notebook since I didn't trust the comment above it. The comment was correct as it turned out. Here's the first matches: 0 : 0 11 : 3 (11) 110 : 6 (11 0) 1001 : 9 (10 01) 1100 : 12 (11 0 0) 1111 : 15 (11 11) 10010 : 18 (10 01 0) 10101 : 21 (10 1 01) 11000 : 24 (11 0 0 0) 11011 : 27 (11 0 11) 11110 : 30 (11 11 0) I think I can see the pattern.

  • @tunafllsh

    @tunafllsh

    4 ай бұрын

    Ah that's the classical division by 3 test.

  • @babyeatingpsychopath

    @babyeatingpsychopath

    4 ай бұрын

    The extra credit question on my DFA exam in college was "write a DFA that can determine If a binary number is divisible by 3. Hint, it has 3 states." I recognized the regex instantly.

  • @jursamaj

    @jursamaj

    4 ай бұрын

    @@babyeatingpsychopath Technically, shouldn't there be 4 states? The empty string is not "a binary number is divisible by 3", but it *is* your start state. Then you have 3 states for the 3 remainders modulo 3.

  • @babyeatingpsychopath

    @babyeatingpsychopath

    4 ай бұрын

    @@jursamaj technically, I believe you're correct, I suspect the actual instructions specified a nonzero length binary string. It's been a couple of decades since that exam.

  • @syjwg
    @syjwg4 ай бұрын

    Unit testing should also know the expected result. There should be some instant feedback instead of someone checking and saying, "Yep, that test case must return false, so it's okay".

  • @DavidLindes

    @DavidLindes

    4 ай бұрын

    Yeah... this definitely falls short of proper unit testing. Perhaps Prof. Altenkirch needs to learn to behave... or rather, to learn _behave_ -- the python implementation of the Cucumber conception of unit testing. :)

  • @Sharaton
    @Sharaton4 ай бұрын

    That final regular expression is just a reformulation of (1(01*0)*1+0)*, obviously. Now, which is better and why is the real question.

  • @IIARROWS
    @IIARROWS4 ай бұрын

    Halfway through and I don't understand what's happening... What's the point? Why Python is important for this?

  • @piyh3962

    @piyh3962

    4 ай бұрын

    Yeah, I feel like there's a bunch of missing context

  • @redjr242

    @redjr242

    4 ай бұрын

    He's implementing regex in terms of an NFA network, in code. He wrote python code for running any NFA network in a previous video. That code will also work on the regex-specific NFA networks he's constructing in this video. He chose Python because it had to be in some programming language, and Python is easier to write than in C for example. Edit: but yeah as others have said, the title of this video suggests it's about python's re regex library, or just regex in general, which could confuse viewers :/

  • @DrGreenGiant

    @DrGreenGiant

    4 ай бұрын

    This is part of a series which is in a playlist. Hopefully that helps you understand the context if you've not seen the previous videos!

  • @vwtype411

    @vwtype411

    4 ай бұрын

    KZread prompting this episode out the blue. I also bailed halfway through.

  • @mountp1391
    @mountp13914 ай бұрын

    Thank you

  • @sargismartirosyan9946
    @sargismartirosyan99464 ай бұрын

    Very interesting and recommended gold mine Channel 🎉😊

  • @djhoese
    @djhoese4 ай бұрын

    Please change the title of this video. Python is not the important part. People are going to search for help with using regular expressions in Python (import re) and find this video which is not going to help.

  • @BaronFirespawn

    @BaronFirespawn

    4 ай бұрын

    If you're watching Computerphile videos and expecting tutorials, you're already in the wrong place.

  • @djhoese

    @djhoese

    4 ай бұрын

    @@BaronFirespawn Someone who doesn't know computerphile would only see a search result for a popular channel. Regardless, the "Python" in this video had nothing to do with the concept being shown.

  • @delmonti
    @delmonti4 ай бұрын

    ....I have no idea what I've just watched.

  • @aounhaider8335
    @aounhaider83354 ай бұрын

    Also upload videos on compiler design.

  • @wpherigo1
    @wpherigo14 ай бұрын

    I have no idea how he did that. I wonder how many times I have to watch it to figure out what he did?

  • @Masheeable
    @Masheeable4 ай бұрын

    Prof Altenkirsch is definitely the Alien played by Jemaine Clement in Men in Black. It's so obvious he's a Supermax-escapee from the other side of the moon bent on taking over the world.

  • @noclafcz
    @noclafcz4 ай бұрын

    I had a problem, so I used regular expression. Now I have two problems.

  • @4984christian
    @4984christian4 ай бұрын

    What about the Fall of Rome where the European people invaded Rome because they where pushed from the east?

  • @unclerojelio6320
    @unclerojelio63204 ай бұрын

    Which code editor is he using?

  • @DrGreenGiant

    @DrGreenGiant

    4 ай бұрын

    One without a code formatter lol

  • @Imperial_Squid

    @Imperial_Squid

    4 ай бұрын

    That "In [n]"/"Out [n]" in the console reminds me of spyder, but could be wrong

  • @DavidLindes

    @DavidLindes

    4 ай бұрын

    @@Imperial_Squid well, the title of that window (e.g. at 3:25) says "IPython Console"... you'll also see that sort of output in Jupyter Notebooks... I think a lot of these things are interconnected in some manner, though I don't know the details.

  • @KushagraJuneja

    @KushagraJuneja

    4 ай бұрын

    probably Jupyter

  • @nathanaelsmith3553
    @nathanaelsmith35534 ай бұрын

    Love regex - hate python (syntax) - useful libraries though.

  • @XenoTravis

    @XenoTravis

    4 ай бұрын

    If python had better syntax and kept the ease of use it would be so nice! If I can remember the weird quirks in python it is so nice to use

  • @nathanaelsmith3553

    @nathanaelsmith3553

    4 ай бұрын

    @@XenoTravis it's like a cross between BBC Basic from the 1980s and JavaScript, without any curly braces. And 'elif' - seriously? That just looks like a typo. Deep and shallow copies? Grrrr! Probably all straight forward if you start out learning to code in Python but really annoying if you are previously familiar with other languages. But the libraries are useful. Oh and why is there a while but not a do ... while ?

  • @RedHair651

    @RedHair651

    4 ай бұрын

    What would you improve about the syntax? ​@@XenoTravis

  • @XenoTravis

    @XenoTravis

    4 ай бұрын

    @@RedHair651 haven't thought about what I would do to improve it tbh. Sometimes it seems a little bit bare and I have to assume a lot of things. I would change the for loop or at least add in the classic c syntax along with their style. But that is just me being so used to the 'normal' way

  • @halfsourlizard9319

    @halfsourlizard9319

    4 ай бұрын

    The syntax is what you hate? There are way better reasons to hate Python: Mutability. Lack of a type system. Incorrectly / inconsistently-implemented scoping.

  • @HarishNarayanan
    @HarishNarayanan2 ай бұрын

    Real life Erlich Bachman.

  • @xxtradamxx
    @xxtradamxx4 ай бұрын

    if you have 2 years of comp sci bsc, you will understand this, but then it's not useful for you anymore, well...

  • @mytech6779
    @mytech67794 ай бұрын

    Nice try, but your not going to unconfuse me that easy!

  • @DavidvanDeijk
    @DavidvanDeijk4 ай бұрын

    e1 = /b?(ab)*a?/

  • @THERODRIGOoriginal
    @THERODRIGOoriginal4 ай бұрын

    0?00

  • @aquaast4571
    @aquaast45714 ай бұрын

    why does he look like an older version of brad pitt as benjamin button

  • @Anvilshock
    @Anvilshock4 ай бұрын

    Python? Oh, you mean Peißn! Yes, hörd of it.

  • @bogdanstamenic2836

    @bogdanstamenic2836

    4 ай бұрын

    "My English is not ze yellow from ze egg"

  • @madplayer5
    @madplayer53 ай бұрын

    Like if you did not understand a sh*t

  • @Tyler_0_
    @Tyler_0_4 ай бұрын

    To disjointed to understand unfortunately, gave up at 15min.

  • @gllizzzy
    @gllizzzy4 ай бұрын

    import re already

  • @DrGreenGiant

    @DrGreenGiant

    4 ай бұрын

    That really doesn't explain how RE works, which is the whole point of this video

  • @DavidLindes

    @DavidLindes

    4 ай бұрын

    @@DrGreenGiant very much agreed. I wish more was done to draw attention to that distinction, though -- not to mention the fact that he's using a completely different syntax for his regular expressions than anything that's common in the UNIX [and similar] landscape... It's useful stuff if you're thinking about the abstract ideas of it all, but quite disconnected from practical everyday usage of existing implementations. 😕

  • @halfsourlizard9319

    @halfsourlizard9319

    4 ай бұрын

    ​@@DavidLindes Syntax isn't interesting. It's just arbitrary convention. The fundamental ideas are what matters ... the rest is just implementation details.

  • @DavidLindes

    @DavidLindes

    4 ай бұрын

    @@halfsourlizard9319 Syntax may not be "interesting" to the theory, but it's critically important to actually doing anything useful with actual computers. Also, it can be _very_ interesting -- see the IOCCC.

  • @halfsourlizard9319

    @halfsourlizard9319

    4 ай бұрын

    @@DavidLindes Knowing the theory behind regexps is the interesting bit; there are references (or LLMs) for the derpy idiosyncrasies of the various flavours.

  • @lorenzobolis5166
    @lorenzobolis51664 ай бұрын

    Please write better unit tests than he does

  • @buttermilk_pie
    @buttermilk_pie4 ай бұрын

    No clue wth is going on here. Thought I was about to listen to a real smart man talk about using Regular Expressions…

  • @misterhat5823
    @misterhat58234 ай бұрын

    Sorry, I can't learn from this dude.

  • @davt8355
    @davt83554 ай бұрын

    Only Rust

  • @RedHair651

    @RedHair651

    4 ай бұрын

    I don't understand why Rust has so much success

  • @davt8355

    @davt8355

    4 ай бұрын

    @@RedHair651 A better version of C++, what else do you want? Speed and security. Top-notch for today's needs.

  • @BruceGrembowski

    @BruceGrembowski

    4 ай бұрын

    ​@@RedHair651because rust never sleeps.

  • @ianlawson94
    @ianlawson944 ай бұрын

    First