For those asking about the rack, I don't remember exactly where I bought it. But here are a few from Amazon that you might like: geni.us/3AAUtfx and geni.us/DbWsT and for the UK this one: geni.us/rGjT6

@DDBAA24

5 жыл бұрын

Does this method your demonstrating using the MPI library allow these RPi's to combine system resources ? I know you said that it sees 4 Pi's = 16 Cores , does it also pool the RAM ? Assuming the answer to both those questions are yes , can you still enable ZRAM within the cluster ? When compiling programs on the Pi it tends to hit swap after a point , ZRAM allows the Pi to swap to the RAM instead of the MicroSD (im sure you familiar). I would want to use a setup like this for compiling , does this cluster configuration help me in that regard ? Thanks Gary .

@kevindeng1889

5 жыл бұрын

I suggest another rack with fan kit: www.amazon.com/dp/B07MW24S61 and for the UK: www.amazon.co.uk/dp/B07J9VMNBL

@jamesanderson478

5 жыл бұрын

Hello Gary, I would like to thank you for making this video and maintaining such an informative channel. you are very easy to listen to and your explanations are to the point. Keep up the good work. Today was the first day i saw your channel link and decided to give it a go. the raspberry pi is a great pltform. However the raspberry PI Zero is a very compact development board as well. The Pi Zero does not have the compute power of the big pi. however the integration of the wifi on the board makes it one of my favorites. I built a super computer using the PI Zero as the main board. I loaded each PI with aversion of Windows 2008 data Center Server. I used RUFUS to flash 64 GB microSD cards with the OS. Once i had the OS working I cloned it using tis program... clonezilla.org/clonezilla-SE/ I have a multi-slot microSD card reader. It holds 24 microSD cards and connects via usb 3.1. I installed teh Windows 2008 Data Center Server on the microSD cards in about 15 minutes. Windows Server 2008 Data Center can cluster up to 32 machines processors at once. The Windows platform is very stable yet it is a little large. About 3 GB on each microSD. I used the data center server services to aggregate all the Raspberry PI processors and resources. i used the Wifi on each chip to bridge them all together. I only spaced them about 1/2 inch apart. The network and teh data processing is so fast that it returns almost instantly. I mainly use the cluster just to browse the web and play games. It is absolutely over kill on any kind of gaming or graphics program. I set the paging file on all the drives to 512 initial max 4096. I also connected an external 3.0 6 TB hard disk to the USB mini on one of the PI. Number 32 in the cluster. Then all teh data i download goes thru the other 31 and passes down stream directly to the external like a funnel. I can download a 4K movie in about 55 seconds with my AT&T fiber. I thought you might be interested in looking at this flavor of PI super computer. Of course i have Python, PHP 7.2 and AMPPS installed on the cluster. Automatic load balancing and wifi VLAN tagging. The windows 2008 server data center can open up a whole venue of new and powerful applications you may be interested in

@eg3730

5 жыл бұрын

@@kevindeng1889 hi

@kevindeng1889

5 жыл бұрын

@@eg3730 hi

A long time ago, a man named Bill Gates had a vision: "A computer on every desktop" Now, thanks to Raspberry Pi, a new vision has emerged: "A supercomputer on every desktop"

@SS-ARYAN

3 жыл бұрын

But if every desktop computer is a supercomputer…

@belaolson8172

3 жыл бұрын

@@SS-ARYAN then we can only dream bigger, my guy 😎

@gustavojhonson7876

2 жыл бұрын

considering the physical limitations of transistors, the only way to turn a single device into a supercomputer is through the cloud.

Thank you Gary. There are a lot of videos on how to build a cluster with multiple rapberrys, but this is the first time I actually see it running as a cluster. All other videos stopped after the build, or ran them as individual computers.

This is by far the best example i have seen on this topic, excellent vid

Reminds me of concurrent & parallel computing class back in college, specifically the grid computing chapter. The classic example we used back then was matrix multiplication, while for the project we choose to parallelize inefficient sequential sorting algorithm with final goal to beat quicksort up to certain data size (because eventually quicksort still wins, it's just a much more efficient algorithm after all).

I do enjoy your videos, even though I already know pretty much everything you discuss usually. And I have recommended it to people who do need to learn about a topic. Great format, production quality and content. Thanks for making this.

The example you used with primes is one of concurrency rather than parallelism it seems. This is a very good primer on the basics of high performance computing though. Good video.

Wow! 12 minutes super computing lecture gives you more than a 4 year bachelor degree

@PersonALANty

3 жыл бұрын

Guessing you have that 4 year bachelor's degree and you're referring to it aren't you?

@gerboog

3 жыл бұрын

No. Just no.

@jarrettg7937

3 жыл бұрын

I know you're trying to compliment the video (maybe inflate the audience's ego?) but I think your university ripped you off...

@infinity5288

3 жыл бұрын

the university teaches you in more detail and less effort. this video is less in detail (in a nutshell)

@PersonALANty

3 жыл бұрын

@@infinity5288 Less in detail with more effort put into explaining the detail. I would say that teaches more, because the less effort put in, the less that you get your point understood, therefore you teach LESS because it is not taught, just stated.

Very informative, i've always considered making a mini supercomputer (raspberry pi 3 +b)

What I find interesting is that that program you ran is the equivalent of what was run on the EDSAC computer in the 1950s when it was doing nothing else and you are generating more prime numbers in 30 seconds than it could in just under 10 years.

@1MarkKeller

5 жыл бұрын

WOW!

@AbhinavSubramanian

4 жыл бұрын

Yeah, even the chips you find in those musical birthday cards have more computing power than all the Allied Forces put together did in WW2. It's crazy.

@dashboy007

4 жыл бұрын

@@AbhinavSubramanian but we went to the moon on that power?

@bnbnism

4 жыл бұрын

@@dashboy007 even your current computer/laptop/phone no matter the model is still many times more powerful than the greatest computers of the ones used for the first few moon landings

@dashboy007

4 жыл бұрын

@@bnbnism I was trying to be sarcastic. There is no way my phone today could power anything else but itself, let alone a rocket ship.

I looked a few of these Raspberry Pi clusters and for less than $800 I bought a used quad processor 32 core Xeon Dell R820 with 96 GB of memory..... and it just works. Sure when it's running it consumes more power but it's a unified memory across the 4 processors which makes HPC easier.

Man I love this channel, always something interesting to learn

What people forget about the old microwulf clusters is they use 2 gigabit connections to per board to share data. The Pi3 has 1 ethernet connection capped at 300mbps, which made clusters actually slower than a single Pi. Now that the Pi4 is here with true gigabit and USB 3 support to add a second one, a Pi cluster might actually be a viable project.

@hammercanttouchthis

5 жыл бұрын

So this video is misleading? 🤔

@bigmacbeta

5 жыл бұрын

@@hammercanttouchthis it was a nice simple example.

@johndunlap9139

4 жыл бұрын

It depends on the problem you're trying to solve. If the problem you're trying to solve requires minimal network bandwidth(small inputs and outputs) but requires a large amount of CPU processing time... Then the older pi's will work just fine.

@gregjalepeno6769

4 жыл бұрын

@@hammercanttouchthis It was obviously a demo of a theory of clustering put to practise, not a video about optimisating data bandwidth and latency.

Wonderful way to explain Gary, thanks a ton.

Yeah, i did it months ago with 4 raspberry pi 3 and MPI4py and it work very well! I also used psh (parallel secure shell), very useful tool.

Thanks I learned something new today!

Really interesting! I’ve always wondered how that worked.

Thank you Gary!! I learn more watching one video than spending hours on so called Tech Channels.

@jamesanderson478

5 жыл бұрын

I agree... He is very good at the explanation and easy to listen to.

@falcondarkshadow

4 жыл бұрын

Watch tech quickie on yt

@philh98

3 жыл бұрын

@@falcondarkshadow agreed linus and the gang really do good job there

@falcondarkshadow

3 жыл бұрын

@@philh98 definitely

Tht why i like to watch ur show... So many things to learn

*GARY!* *Good Evening Professor!* *Good Evening Fellow Classmates!*

@GaryExplains

5 жыл бұрын

MARK!!

awesome, never knew anything about super computing, and now i know, thanks.

Gary, this video was informative :) Thank you

Great explanation!

amazing explanations. Great work, thanks

Thanx a lot Gary. merry christmas.

Nicely done. Thanks!

perfect explanation 2:30 - 3:00 planning to have one built soon aside from having rpi4 , i was also thinking about orange pi to have as another alternative then mix them if possible just need more research on this thx sir Gary

Thanks for the nice explaination 😁

This was such an interesting video. One of the best I've seen in a long while!!

@GaryExplains

4 жыл бұрын

Wow, thank you!

Thanks for your knowledge

Nice video, really well explained!

4:14 On serious note. Love the channel. Love the video. Very informative. Thank you!

Super cool video - would be great to see more examples!

Nice. Very clearly explained and demo'd

Thank you Gary.

Really loved this video :)

excellent explanation. Thank you! Back in the early days of the IBM PC, I wrote a game with virtual robots that did combat in a virtual arena, and each "Warbot" ran its own program, which was an interpreted language I wrote just for that game. The language was called R-Code. In this case, The R-code interpreter was running 5 programs at once, and each program had it's own simultaneous i/o. That was pretty cool in the old DOS days before windows and multitasking.

@hammercanttouchthis

5 жыл бұрын

What version of DOS did it run on? And did you mean it ran on the IBM PC or XT? :)

@antonnym214

5 жыл бұрын

@@hammercanttouchthis By that time, 1991? I was running it mostly at work on IBM XTs running MSDOS 3.3 or later, as i recall because we had 3.5 inch floppies. The entire programming environment and game fit on a single diskette. It was only 10,000 lines of QuickBASIC code. I never released it to the public, but I had one other friend who was interested in programming who liked writing R-code for the warbots.

@nyanates

2 жыл бұрын

Reminds me of Robot Wars. My friend and I had a blast programming our robots to pummel each other in the ring.

enjoyed this video well presented

Great job. Thanks for the video.

This was fantastic!

Wonderful explanation!! Great channel.

@GaryExplains

8 ай бұрын

Glad you think so!

thank you...subbed really intersting video.

wow great video dude!

Fantastic channel love it

something new! thanks prof Gary

Fantastic video! Subscribed :)

Great video!

thanks for the info.need to study more about the clustering pi .For example begin to cluster 2,then 4, then 8, ....until recently Oracle already built the 1060 Pi s

Reallly good sir👍👌

Hey Gary could you please upload a step by step video to achieve node cluster????

Forgetting the cost of power for a moment I am curious how the performance compares to a PowerPC based cluster which was probably the first "out of the box" consumer level hardware solution available that could be configured as a supercomputer cluster.

@GaryExplains

5 жыл бұрын

Yeah, I agree that would be interesting. In fact building different clusters from various bits of historical and new hardware and then benchmarking them would be quite interesting, but alas very time consuming!

@johndoe1909

4 жыл бұрын

@@GaryExplains my master thesis where done in the early 90:es, and it was about creating dynamic computing clusters using heterogeneous computers (various hardware architectures at the time). Given the overall limitations we identified types of problems which could scale using the available technique. Great fun and on the cutting edge for it's time. The main benefit was that the computer clients connected where largely unaware that they committed computing cycles, the jobs was running int the background. The base was done in pvm, in many aspects the successor to mpi.

Thanks Gary. I also tried Apache Spark on Jetson Nano and it works. So I expect Apache Spark can work with Raspberry Pi too. The concept is the same.

Nice and clear

As always... great info... great hob!!! you're the man,,, ;-)

Nice work, Gary! And if you want to remove the overhead and speed up calculations greatly, you can switch from Python to Golang, for example, and have microservices do the work

On my old Amiga I did a lot of fractal scenery animation and it took ages, this would be a really good demo of connecting more computers thru a slow bandwidth link. And raytracing also, Lightwave was really great as renderfarms go, one master/server (with GUI) then just send the resources to a bare minimum program that actually calculates the different images and sends it to the master/slave and it is pretty good on resource management as it just hands the nodes the images that is not done (hard to explain) but it really meant that you could connect pretty much anything... a slow computer, a fast computer and so on... it used everything at 100% all the time. Do Povray exist on the Pi? If it does that might be a good start for a great demo of connecting PI's :-)

Brilliant!

You should make a video about quantum computers. A lot of youtubers have failed to present that topic in a neat way...

Could you use a lower latency/higher throughput interconnect like direct PCIe connection to increase the performance? For a few computers it could be possible (certainly not on large scale supercomputers since PCIe 3 has max. cable length of 8 inches).

@kopai555

4 жыл бұрын

Closet we can get now a day in my Datacenter that i take cared is FC (Fiber Channel). Every single server in DC and inside cluster are connect together in network via FC for lowest latency and maximum transfer rate.

@DataHotep

4 жыл бұрын

We use infiniband in an HPC setting. Its connected through the PCIE bus.

That is a neat idea of making a Super Computer from a group of small computers like the ones you mentioned. I wonder if IBM has thought of that since they are into the Super Computer business.

@He_isI

5 жыл бұрын

That was done with the PS3.

@anthonya.jumelles7103

5 жыл бұрын

Yup, that was a project that the US Military did because the PS3s had a lot of cores in a relatively compact form. It made being able to source machines from around the world really eaay.

This is sick!!!

Cool video! One question, though: can the Raspberry Pis be connected via GPIOs and make them behave like the cluster in the video? Will it be more effective that way?

First of all, Thank you Sir for doing this video, Is any bloggs of people specifically doing this project and maybe expanded the project? Please advice, I want to join.

😎 Real Tech Channel. 👍🏾🙏🏾🇿🇦

Great video Gary:-)

@GaryExplains

3 жыл бұрын

Glad you liked it!

I just desire to have one pi for audio, one for video, and one to run them, to turn three pi's into a great desktop computer.

@kerph

5 жыл бұрын

That would be pointless, because unless your doing instense audio processing, there would be no point in having a dedicated audio pi, and just one pi is not enough to do much video editing on, and at that point what would your third be used for if not everything else?

Great video thank you python it is

Very good.

Hi, I have created a cluster programm, that runs before I even press

What are some use cases for a super computer of this small of a caliber? (I am a bit new to the tech scene so if this is a dumb question, that is why)

Thanks for complete sherlock holmes on your github..

Could this concept be used with computer vision to speed up the process over a single pi3?

helpfull, thanks

This just shows the purpose of Raspberry Pi, a learning tool. I never thought they would bring it to Server/Clusters. It's a great teaching tool from basic programming to now supercomputers. Raspberry Pi may not be a world record PC nor a Supercomputer with Tera flops in processing power. But it has proven to be a super teaching device that's caught a lot of interest world wide for those who want to jump in and learn. And a great gaming emulator! d^_^b

Gary, wich could be an use for a webdeveloper, videomaker or 3d desigenr with blender? Is it possible to do a renderfarm with it?

Very interesting

Really cool👍

I would use Udp to send packets to one of the hosts, then that host sends to the next host, etc etc and then the final host with all that information processes it and sends it to the main computer

Dragonfly BSD is an OS designed specifically to handle a cluster like this.

@gregorykusiak5424

4 жыл бұрын

Loren Sims does each node have to match the rest, or can any machine get added to the array?

There are new SBC micro computers which have a RYZEN 8 core processor called the UDOO BOLT V8 get eight and you could have 64 cores.

I love your channel!

@GaryExplains

4 жыл бұрын

You are so kind

Cool video

You should try this with the rockpro64 and connect each board together through the pcie to get really low overhead. Might even get to write your own kernel and mpi layer!

@NoorquackerInd

5 жыл бұрын

PCIe doesn't act super friendly all the time. It's probably better using InfiniBand cards

@PepsisFormosa

5 жыл бұрын

@@NoorquackerInd Well if you're going to use a comm card, it would be a lot easier to put a ten Gb network card in the pcie slot. I was just thinking to keep costs down, you could try to run the messages over just the pcie lanes.

Question! Can a raspberry pie supercomputer be used for blender software for faster renderings! And can the raspberry pies be configured with gpus.

About checking if a number is prime: square it, subtract one and divide by 24. If that is a whole number (no digits after the decimal point) it MIGHT be a prime number, otherwise don't waste time checking further.

@GaryExplains

2 жыл бұрын

Yes, there are plenty of different ways to check for primes are likely primes. But that isn't the main point of the video.

Very cool

MPI - messaging service used in supercomputer cluster Scatter n gather (lesser data, high latency) (more data, less latency as compared to single core) Public n private key- security

Wow.. I'm an idiot and you explained this so well that i think i could try to do this.

Great job again Gary.

Could you run this kind of cluster with multiple different OSs and machine types? For example, I have a few Pis and also some old office desktops. Could I simply run them together?

Cool video! We have a few raspberry pis laying around, this would be a fun project. Are you going to the SciPy 2019 convention in Austin?

@GaryExplains

5 жыл бұрын

No, unfortunately I am not going to SciPy.

Good now i can create my own server

I wonder how many Pi 4s it would take to produce the same number of flops you get from the minimum baseline Cray super computer set up. Does that setup you have produce the amount of calculations that can be performed by a current gaming laptop? It might be interesting to know how many Pis it would take to produce the same computational power as a gaming laptop and what the difference in price point would be. Thanks for the interesting demonstration.

Interesting.

HI thanks! Beautiful video. I tried your program on 2 RasPi 3's. But it still says running on 2 cores instead of 8 When I use a single RasPi it runs on one core instead of 4. Any idea how to fix this?

Hello Gary, great video, ty. I have a cluster of 11 rapsberry's. no problem with that, but i tried to insert a virtual machine as a node, it is not functionning. the virtual machine can work as a master node but not as a node of my cluster Why is that ? Thank you

Can u post the pic of the final setup on which u run this...

Can i use this to combine multiple chromebooks?

Can you do a video of one running folding@home?

Thank you Gary, this is really great! Is it possible to create a p2p network with Raspberry Pis? That would be really useful in disaster zones or places without internet so that people can communicate with each other over a RPI mesh network