8:41 "You know what? I'm just going to leave the lids off" 8:50 *Puts lid back on*

@ojussinghal2501

3 жыл бұрын

8:41 FOR MARKERS 8:50 FOR PEN

@gacsizclickon

2 жыл бұрын

muscle memory

I have actually wanted Computerphile to talk about A* for a long time. It's so fascinating how it works.

@chrisdrew1768

7 жыл бұрын

I love how simple an improvememt A* is over Djikstra

@mrben9058

7 жыл бұрын

In addition, once you got A*, you can recreate Dijkstra by setting all heuristics to the same value.

@chrisdrew1768

7 жыл бұрын

Benjamin Collet bruh

@chillbro1010

7 жыл бұрын

To a non-technical person like me, the simple explanation looks like Double Djikstra, one from each end. The measure of distance is basically giving a weight to the roads from the end state, as in making it choose things based on how close it is to the finish. -- The only problem I see is you can't do things "as the crow flies" because that might put you on the other side of a river because its so close, while a bridge across the river is a long way away. Basically, in some instances it would follow to the bottom of a "cup", fill the entire "cup" trying to access nodes on the other side simply because the nodes are close, before spilling over the edges, where a regular djikstra might not go into the cup, and if it does it would quickly "drop" entire sections of the cup for being too "far/hard/slow" I guess it depends on the strength of the "closeness" but it seems like a single setting doesn't account for concave search spaces.

@StreamlineDeet

7 жыл бұрын

(Almost) any cup that would be filled up by A* would also be filled up by Djikstra's. Remember, A* is still factoring in the distance travelled to get to a given node, so any path that is extremely long will be ignored, unless it brings it substantially closer to the destination. Meanwhile, Djikstra's would check out every node in the cup the moment those paths are shorter than the path it is taking around the cup.

Prefering to call a list a "data structure" is the sign of a true programmer

@sumitmomin5753

5 жыл бұрын

Why ??

@hopko7579

5 жыл бұрын

@@sumitmomin5753 If I had to guess, abstraction?

@sumitmomin5753

5 жыл бұрын

@@hopko7579 wat abstraction has 2 do wid it ?

@TurboWindex

5 жыл бұрын

@@sumitmomin5753 IMO, it is because he's writing pseudocode so instead of using one particular data structure type (Vector, List, Map, etc ) and confuse anyone with "technical" programming terms, he's just saying "data structure" !

@lucaspeters-murphy2770

5 жыл бұрын

@@TurboWindex I mean, technically the only example where Dijkstra/A* is possible is a weighted graph.

Extremely well done run-through! Dr. Pound is right: A* is incredibly fast; so much so that we use it generously in path-finding (in gameplay engineering). That's a subroutine that multiple NPC instances are executing, 60 times a second, along with all the other stuff (that's a LOT more intensive).

@jetardeshna3449

7 ай бұрын

Damn that's reallly efficient

Books on the shelf... _Security Engineering, 2nd Edition._ Ross Anderson; _Secrets and Lies._ Bruce Schneier; _The Elements of Statistical Learning._ Trevor Hastie, Robert Tibshirani, Jerome Friedman; _C++ The Complete Reference, 4th Edition._ Herb Schildt; _Cryptography and Network Security: Principles and Practice, 2nd Edition._ William Stallings; _Computers and Intractability; a guide to the theory of NP-Completeness._ David S. Johnson, Michael Garey; _Computer Security, 3rd Edition._ Dieter Gollmann; _Hacking: The Art of Exploitation._ Jon Erickson; _Database Systems: A Practical Approach to Design, Implementation, and Management, 5th Edition._ Carolyn E. Begg, Thomas M. Connolly; _The Manga Guide to Databases._ Mana Takahashi, Shoko Azuma; /* Yes! Really! */ _A Brief Guide to Cloud Computing._ Christopher Barnatt; _Pro WPF in C# 2010._ Matthew MacDonald; /* Ooh! Companion ebook available! */ /* * Whew! For any simple task, take your initial runtime estimate and double it. */

@williamwambua7710

5 жыл бұрын

Thanks i needed this

@jorandebraekeleer7557

5 жыл бұрын

@@williamwambua7710 Sarcasm?

@mustafamirza6807

4 жыл бұрын

Oh Great

@evanl5299

4 жыл бұрын

FYI - Herb Schildt was the multi-keyboard in the rock band Starcastle.

@novikovPrinciple

3 жыл бұрын

The... I'm sorry, _The Manga Guide to_ *what* ?

Dr. Pound is great in his videos. He has a great on camera presentation and disposition. Thanks for these examples and explanations!

"Let's move the books to be in the frame"

I think something important to note which was very only briefly suggested is that if your distance-to-goal heuristic always underestimates you will always find the shortest path, but if not then the path you get may not be the shortest (which for some problems may be suitable). If you underestimate too much then the benefits of A* diminish and you'll explore more and more of the graph. Additionally, Dijkstra is a generalisation of A* where the distance-to-goal is always underestimated as 0.

@ShaojunZhao

5 жыл бұрын

I think it is the other way around: A* is a generalization of Dijkstra's algorithm, as Dijkstra's algorithm assumes the heuristic function to be zero.

@PHHE1

2 жыл бұрын

Actually we saw an example for that in the video. We finished so fast in the end because the final distance was actually shorter than we expected only a step before. The heuristic being a overestimating one wouldn't have guaranteed to find the optimal path if there would have been a shorter ones in the right branch but it let us finish very fast

@redy55

2 жыл бұрын

A* has its uses. You can program edge weights of ones you want your algorithm to avoid to be positive infinity or something if you want to be sure. Also, the euclidian distance based heuristic you pretty much only use when you have a 2 dimensional map aside from nodes on it. So there cant be a realistic situation, when the path where heuristic is bigger is actually shorter. If you are measuring weight on a different parameter (like, how many shops does the town have, and thats your criteria, not difficulies on the road itself) then you should use another heuristic function or another algorithm altogether :)

This guy is brilliant.

@docwhogr

7 жыл бұрын

Adam Smith. stop trolling

@DontTalkShite

7 жыл бұрын

I wasn't

@CxC2007

7 жыл бұрын

Adam Smith is not brilliant. he did no invented this. he just study computer science, and he knows thing you don't.

@meinbherpieg4723

7 жыл бұрын

You don't have to invent something to be brilliant. Just being able to understand, accurately recall, and be able to explain this material in a way that enables other people - especially people who don't have a formal background in this material - to understand it is brilliant in and of itself.

@DontTalkShite

7 жыл бұрын

I just meant I really enjoy when he's hosting. He's brilliant at explaining things.

This is not to be confused with the Sagittarius A* search algorithm, used often in astronomical science. *That* method simply involves shoving everything together in one big pile so whatever you need is nearby.

Rest in peace, Dr. Nils Nilsson, coinventor of A*, 1933-2019

I had an advanced algorithm exam 2 weeks ago and this algorithm was part of the test, I passed but never understood the algorithm. Until now. Nice video

@tengkuizdihar

6 жыл бұрын

bruno alves I too like to live dangerously.

@davidson2727what

6 жыл бұрын

Yeah this guy saved me on dijkstra. Pre exam thankfully.

@aurelia8028

4 жыл бұрын

Should you have passed then?

@georgeborsa5346

3 жыл бұрын

@@aurelia8028 Yes, he should have passed. Most of the time those exams just test your memory. At that time he was only able to reproduce his college's explanation of the algorithm, after this video he's able to explain it with his own words (and maybe even implement it).

I really appreciate Dr Mike taking the time out to not only host these videos but also make all the materials necessary for them. Being a professor must be definitely a busy job and all this must definitely take quite some effort. Appreciated!

Never in my life did I think that I'd be cracking up at a video about an A* Search Algorithm implementation. An entertaining video for sure 😂 I have a project due in less than 24 hours where we need to code A* from scratch, so thanks for reducing my stress and while teaching me this algorithm. I feel a lot better now.

@justinernest2363

4 ай бұрын

Was it part of a snake game? Like you know the snake searches for the apple etc?

Exactly like having a smart friend in class explaining it to you! Amazing

There's a slight mistake - the distance from S-B-D is 2+4 = 6 and the D is 8 inches away from E, so the total for D is 6+8 = 14, not 12

@user-sv4nq8vq1s

5 жыл бұрын

Its fixed

@ProBarokis

3 жыл бұрын

@@null3081 how bro

@itsCh4rl1e

8 ай бұрын

the description fella@@ProBarokis

"sheep 'n' stuff"

@EgoShredder

7 жыл бұрын

Sheep and Sheeple and Steeples! :-D

I'd just like to note that you, Dr. Pound, are the most likeable Computer Science professor I've ever come across. This is coming from a student of one of Germany's top MINT universities.

@Nadox15

5 жыл бұрын

Ich auf einer der besten Universitäten (bezogen auf Naturwissenschaftliche Studiengänge) als Informatik-Student im Master, wäre mal gespannt zu hören über welche Universität du spricht? :) Das wäre mir neu, dass "MINT" Universitäten die besten in Informatik seien. Aber hey go ahead :)

@Clashkh22

5 жыл бұрын

@@Nadox15Fernuni Hagen natürlich, was denn sonst, du neunmalkluger Sitzpisser

@Nadox15

5 жыл бұрын

​@@Clashkh22 hahahaha und du sagst, "one of the Germany's Top MINT Universities" wtf alter, von der habe ich noch nie gehört. Gute Unis sind, Tu-München, Humboldt-Universität zu Berlin oder auch Tu-Berlin. wat für Fernuni alter

@Clashkh22

5 жыл бұрын

@@Nadox15 siehst auch den Wald vor lauter Bäumen nich, wa?

The use of physical cards really helped make this explanation of the algorithm really clear. I was really struggling to follow purely written explanations, pseudocode, and actual code, because while I can code, I don't have a formal CS background.

@Sindoku

4 ай бұрын

You not having a formal CS background has nothing to do with struggling with algos like this. That is simply b/c you aren't used to solving those types of problems, and 99% of universities do no prepare students adequately in DSA either, so most of them are struggling too.

One neat trick is to "prefer" one metric over another and use power notation to calculate overall heuristic. E.g. a node with distance 7 but weight 2, we added them as 7+2 = 9. But instead of that if we prefer shorter distance over smaller weight then weight should be the base raised to the power of distance. So this way we can choose easily between two nodes that would otherwise yield the same heuristic if we add them but with the new rule if one node is with weight of 2 and distance of 7 (2^7=128) and another has distance of 2 and weight of 7 (7^2 = 49) ... we chose the later as 49 Google maps often use this trick.

8:10 I like to live dangerously, I always shuffle my lists before storing!

@rafaelplugge3214

6 жыл бұрын

or even worse divide by 0! :O

@NZAnimeManga

6 жыл бұрын

dividing by "0!"? - no problem ;)

@bfs7668

6 жыл бұрын

Dennis Fluttershy soooo divide by one Doable

@parktamaroon226

6 жыл бұрын

hahah... did you write “sorting” out of sequence?

@moellerdk93

6 жыл бұрын

0! = 1 - google it

My uni professor made this SO blurry - exact opposite of your explanation. Thanks a ton for restoring my interest in my major, kind sire.

"meh, finished data structure over here" 😂😂

This guy should just do all the videos tbh

Man, I could listen to this guy for ages. His way to present his topics is just amazing :)

I've been watching your videos over the last few days, in order to solve a Pacman algorithm of Ghosts taking the shortest route, and found your explanations and content to be very educational and easy to follow. Many thanks and keep up the great work! Fingers crossed that I can now implement my version of A* on an adjacent list of nodes I've created for the maze...

Dr Mike Pound is fab - so watchable. A KZread star is born. Knows his stuff and a great explainer.

1:55 On the bookshelf; "The Manga Guide to Databases"

I am watching this channel for decades by now. But this is the first time, that i was looking for a video on a topic and this vid was suggested. I'm getting there..

Great video, you've given me some great insights. The clever, subtle (and sometimes not so subtle) humor makes it all the better!

Dr. Mike is one of the best presenters on this channel! Thanks for another fun one.

One question I had was, how do we know we can stop when E is removed from the priority queue? The answer is that every element removed from the priority queue is guaranteed to have the most efficient way to get back to the element before it in the path back to the start node S. So basically, once E is removed from the priority queue, we know there is a path from S to E, and all elements removed so far are part of the shortest path, or the path that minimizes the total heuristic cost.

I'm so thankful for your video! I learned about A* in uni and watched multiple videos about it, but I didn't understand it fully until now. Your explanation is very clear, you helped me so much.

Let me nitpick just a little... You're correct that A* terminates when the destination node gets to the front of the queue *if* the heuristic is guaranteed to be a lower bound on the actual path length. But in this video, the physical distance doesn't actually correlate with the path lengths, and so you cannot actually exclude the possibility that the shortest path to E might go through C, or some other not-yet-examined node. But nonetheless, I loved the video, and it was a great explanation of the algorithm. Thanks!

I like your unorthodox style of teaching. It's like a friend explains it to you. Thank you!

Excellent explanation. I noticed D, and played it twice to make sure it is a mistake. And, then I read the description. Thank you for putting the video up.

Mike Pound is my favorite. What a brilliant communicator.

As someone with very little maths background, this video/ tutorial was just what I needed to get my heard around building a pathfinding algorithm.

this is the best explanation of this algorithm that I have found on youtube thus far! Excellent!

That lean forward with the "imperial woo!" gave me a good chuckle. watching from the states.

@TheALPHA1550

5 жыл бұрын

British chap.

I worked with A* Algo years ago, learning it wasn't that simple, but this man make it so easy to understand, Thump up (y)

Amazing! No other video on A* will ever be needed :)

He actually makes a mistake, writes down for: s->b->d: 8+4 = 12. although the actual value was 6+8 = 14 for D...

Fantastic videos, as always, Computerphile. And thanks Mike, nicely summed up together with other videos.

Never thought I could actually understand A*, BUT this video do make everything clear enough, you are brilliant, thank you!!!

Student here, thank you! This is a really clean explanation and you clearly really love A star :)

THIS JUST IN: POUND BACK, INCHES AHEAD, SHORTEST PATH TO BREXIT PACED

This was one of the most enlightening and interesting ways to explain searching algorithm. Thank you. Subbed and liked!

This video primarily, plus a couple other sites I looked up after, helped me implement pathfinding in my game! Thanks!

why 'D' was 4+8=12? traveled distance is clearly 2+4=6 so... 6+8=14?

@EscapeMCP

7 жыл бұрын

yup

@Rachio666

7 жыл бұрын

kostya pesterew that's correct. it should have been 14

@ThaerRazeq

7 жыл бұрын

To be honest, I was confused too @8:20, it should have been 14.

@NiraExecuto

7 жыл бұрын

I wouldn't call that annoying, because from what I've seen, the people not as talented can get seriously confused if the teacher makes a mistake, so in pointing it out, you're probably doing at least some of them a favor.

@comrade1912

6 жыл бұрын

exactly.. and I was not able to concentrate after that point... :P

very vivid presentation of the graph algorithm helps me a lot to understand the process

Please, ask dr. Mike to explain more stuff. He's very good at it.

finished pack... finished stack... finished list?... finished data structure! :-D gotta love this guy! 9:10

1st: '~ just adds a heuristic to dijktra' was the best statement!! Further, no usage of stupid unnecessary words like 'open list' and 'closed list'. Everythig nice and simple. Also, the animations help overcome handwriting. And the handwriting is there to keep the explaination realistic. 6 from 5 stars

His calculation for "D" in A* was off. D was S + B + D (0 + 2 + 4) or 6, and it had a heuristic of 8, so that is 14. He wrote down 12 in black. Not a major deal breaker here obviously, but just pointing it out b/c that's what us programmers do :). Thanks so much for the video!

@Sindoku

4 ай бұрын

Nvm, they fixed it in the video description. Nice!

brilliant. thank you for this lecture. So much better than what I had heard thus far.

You guys are saving cs students. Got an exam on A* and others soon so thanks (:

You sir, are hilarious and awesome! Just finding this channel and looking forward to much more!

His videos are absolutely awesome.

Many thanks for the good video. However, I think you missed to highlight one thing: The heuristic *always underestimates* the distance. I saw people questioning why it can't be that the path through the right side is shorter when we did not calculate the cost. The actual shortest path is always longer than the heuristic distance. Here this lies in the nature of the problem, the euclidean distance (straight path) is always shorter than the lengths when driving zig-zag.

Was struggling with a bug in my implementation, the timing could not have been better. you made me see it ! Thanks !

Important thing that was missed is that used heuristic must be less than cost of least path to node. Otherwise you can get wrong answer.

@rumfordc

7 жыл бұрын

he mentions that right before he starts using the tape measure

@SuperNolane

7 жыл бұрын

He sad "for A* to work really well you have to have a consistent metric and you have to not overestimate of how far you've got to go". But it will not work at all if you have overestimating metric.

@rumfordc

7 жыл бұрын

won't it just return a less-than-optimal path?

@SuperNolane

7 жыл бұрын

It will. But why to pick such intricate method to get wrong answer when you can just return random path?

@hendrikw4104

5 жыл бұрын

"not overestimating lengths" is called admissible. Every consistent heuristic is also admissible. Consistent means that h(n)

great video!!! I came across a situation where checking the distances of all nodes to the target before starting the algorithm was a pretty hard task. So I recommend to measure the distance of the node to the target only when it need to be inserted in to the queue thank you!

Search from both ends at the same time and stop when the two searches meet. Instead of one search to depth N, now you have two searches to depth N/2. In a graph with many nodes and many connections, the number of nodes at each depth increases with the depth, so each search tree is less than half the size of the original, and the total number of nodes searched is reduced.

I love Dr Pound.

This new office episode looks great

Thank you so much for the very clear explanation of the algorithm !

Finally somebody explains what A* actually does! It was bit rushed but I managed to follow (usually I get lost).

"You could come up with lots of interesting heuristics, not just euclidean distance" I know that he didn't strictly say this, but I totally wanna write a non-euclidean A* algorithm now!

Excellent demonstration!

Best explanation I found so far!! Thank you!

Great content and excellent editing!

Thanks!!! Extraordinary clear. Loved the heuristic device!

For Dijkstra, you get the shortest path from start to every other node, regardless which end node you choose. But for A*, in order to use the heuristic, you need to specify an end node for the algorithm.

I hope to understand this soon... Its so amazing

just in time for my next project, thanks!

It's interesting that you went with a relatively sparse graph for this. Most people introduce A* in the context of grid-like graphs.

@B0XMATTER

2 жыл бұрын

I suppose you don't really have a 256*256*256 grid to describe the basics of A* since what was described here technically works.

I recall a car equipped with a satnav from the mid 90s, and it used a CD to store navigation data across all of Europe, with a slow and silent-spinning optical drive, probably 2x speed at best, maybe 1x. I imagine in my mind that it was equipped with a dinky little 68k processor, capable of addressing a total of 16MB, likely equipped with barely any memory at all, and it didn't take long at all to load the data or compute the path. Indeed it would do so in a couple of very audible optical drive head moves, just a handful. I imagine it would have to load just the local map around the start, a local map around the destination, and then just have all the routes between selected points precomputed on CD, at least one point per map sector, so it would need one lookup into a hash table on CD indexed by map start and end sectors to find the disk address of the route, and then it could fetch that route, and then augment and optimise the route with real start and destination points in mind, instead of precomputed ones, but it would only need to search local data at each end into account for that. This is how i imagine it being done. How wrong am i? How would such a system work in practice, what algorithms are involved at runtime?

Love this dude, quality content!

This explanation is great in that it explains what the machine does. Meanwhile I also like the intuition given in polylog's video.

I love the style of your explanation. Thank you!

@nba2493

3 жыл бұрын

no-one cares :)

@dien2971

3 жыл бұрын

@@nba2493 And now is no-two :)

These are the best. Thank you.

I'm very close to having tears in my eyes from laughing when 'super sneaky' was introduced as 'not an official term you will find in the literature.' Brilliant side note.

I prefer double a* pathfinding....basically you have a start-to-finish on the queue (S:10:E for example) and a finish-to-start on the queue (E:10:S). You work the queue in the same manner, by expanding the smallest value, but you're finished when the one you are expanding connects with the second one in the queue. This helps immensely in situations of tree-like patterns, where the path from one to the other keeps splitting into multiple directions, while the reverse direction is pretty straightforward (think binary tree).

I'd let Dr. Mike Pound me

@spiderstheythem

7 жыл бұрын

😉😘👌

@DJChiefX197

5 жыл бұрын

*the wedding band on his left hand glistens*

@AP-eh6gr

5 жыл бұрын

i knew this one was coming......

Speaking of interesting heuristics, it might be worth doing a pass through Jump Point Search, which is great for grid-based pathfinding that lets A-star expand even fewer nodes than it would normally. It would take a different example graph, though.

Am I the only one who thinks there is a great resemblance between the looks of Toni Kroos and Dr. Mike Pound. Wonderful personality and amount of confidence.

Why does he always sound and look like he is constantly on the verge of breaking out into an unstoppable laughter? Haha, Amazing explanations as always!

At 4:32, s, a and b are forming a triangle and not obeying the triangle inequality theorem, sb+ab < as

You can clearly tell that Mike practiced this explanation beforehand :P

@kwanarchive

7 жыл бұрын

They do edit the videos you know.

@philips9042

7 жыл бұрын

Simon Bugge Siggaard Just shows how much dedication he puts into this. Not saying the others were bad, but Dr Mike Pound is my favorite

@General12th

5 жыл бұрын

I'm sure every interviewee practices first. Also, I think Dr. Pound is a professor, so he's given this lecture before.

As for the SatNav, it might just be a simple system of prioritization. Consider that the highest speed roads are highways. And they're usually as short a distance between cities as they can be. They're expensive. So, the computer will likely just give a very very low weight to those roads, and prune all the other side roads until you get to the closest hub city, and *then* activates the proper algorithm. This has the added benefit of encouraging motorists to use the best maintained roads to boot.

Really enjoyed that. Have written an A* for generating game AI before. Was wondering if you could elaborate on path refinement after finding the optimum route. My waypoints represented the centre of a triangular mesh and struggled with the "line of sight" tidying of the route. I have read into Theta* which appears to be a recent upgrade to A* to incorporate this refinement. Do you have any experience with it? Thanks, Wes

"super sneak is not a technical term you see in the literature" LOL Never change, britbongs!

If I where to guess how satnavs get around the issue of combination explosion problem (or how I'd try to do it if suddenly asked to do it (not at all likely)) would be to store not just the "proper" road system but also a map of only motorways. The algorithm A*s (with euclidean distance to destination as the heuristic) until the destination or a motorway bubbles to the top, if you find your destination it's done, if it finds a motorway it saves that node, then runs A* on the destination, if it also hits a motorway it saves that node as well, then it goes to the motorway map and does the same thing with the two motorway nodes. Honestly it is probably much more complex, with more layers (one map has everything, the next ignores country roads, the next ignores B-roads, etc.), some system to go to a previous map level if maps don't connect, and may sample multiple nodes when going up just in case.

I'd be interested in videos on clustering algorithms, I can see you've already done k-means, but how about some other options like density based clustering with dbscan or optics?

Thanks for that video, I was waiting on A* almost since I subscribe! Can we expect to have a video on Jump Point Search one day?

I found A* very useful in testing and fixing the passabiliy of procedurally generated rooms. A* proper hardly required any code, most of the code was setting up the graph and using the results.

All this is done in mere seconds amazing

I love this. Thank you!

Literally working on a homework that is coding this algorithm. Thanks for the tutorial