This is my Endgame - Mother Vault Server Room Update
Ғылым және технология
Check out the Manta toolkit at: www.iFixit.com/LTT
The JBODs and the head server are here which means it's FINALLY time to deploy the mother of all archival storage solutions, housing up to 270 hard drives. EEEEK.
Discuss on the forum: linustechtips.com/topic/14475...
Check out Supermicro JBODs: lmg.gg/ztt2P
Check out Supermicro A+ Servers: lmg.gg/8G7vz
Check out Kioxia CM6 Enterprise NVMe SSDs: lmg.gg/xESWf
Check out Micron Registered ECC DDR4: lmg.gg/RXyzo
Check out Mellanox ConnectX-6 Network Cards: lmg.gg/YCwI2
Check out AMD EPYC 74F3 CPUs: lmg.gg/Gm7ql
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► SUPPORT US ON FLOATPLANE: www.floatplane.com/ltt
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
2:15 The head server
8:24 Going on a storage adventure
9:40 Last parts
10:58 Nightmare fuel
11:10 ITS LOUD... sort of
12:10 Does the head server work?
12:58 The game plan
14:13 They lied to us
15:44 Linus & Jake start a moving company
20:13 Pressing the button
21:09 IT'S ALIVE
23:58 Testing it
Пікірлер: 3 000
We all know Linus' real endgame is having enough storage to finally upload his consciousness into a machine, then he can run LTT in perpetuity as a sentient AI that constantly drops database tables
@IngwiePhoenix
Жыл бұрын
inb4 his DROP TABLE permission is revoked :P
@maerk9494
Жыл бұрын
Next LTT video idea?
@Windiguana
Жыл бұрын
Portal style?
@RinaldoJonathan
Жыл бұрын
WHAT THE FUCK LOL THIS IS FUNNY
@shinichixxxx
Жыл бұрын
Ah I see what you did there😅
With the rate that Linus is going, he'll make a seperate channel talking about all his servers
@mito-pb8qg
Жыл бұрын
Great, that's what I care about the most
@echidna8857
Жыл бұрын
I would subscribe to that instantly.
@Deep42Thought
Жыл бұрын
I would subscribe to that past century.
@PhazzeeYeehaw
Жыл бұрын
i’d binge watch it
@OtherTheDave
Жыл бұрын
“Linus Linux Tips”
It is always so great to see big name content creators/tech wizards like Jake Tech Tips and Anthony Media Group collaborate with young and upcoming screw driver enthusiasts like Linus.
@jrkbgk1111
Жыл бұрын
Definitely one of the, if not THE, most underrated comment in this thread!
@shapelessed
Жыл бұрын
Well, you could say Linus has a talent to... Screw things up....
As a server engineer, every time I watch Linus and Jake work on servers I cry a little inside. Please, for the love of your HR department and your own health, please purchase a server lifter. You spend big money on lots of things, this will save your backs and potentially Linus' body if he keeps choosing to lie under servers... I also love the change management Normal Company: I need to raise a change with 5 business days lead time with install and back out plans, passed by Change Advisory Board and approved by change manager\service control manager. Notice sent out to all impacted users. LTT: YO GUYS IM CHANGING STUFF, GET OFF THE DISKS!!!
@MisterSixty
Жыл бұрын
Absolutely true and absolutely NECESSARY to start good business practices as his business is growing.
@agafaba
Жыл бұрын
To be fair they did give advance notice, they just went the extra step of walking around to say its happening now instead of the usual "your fault for not listening, your fault its now gone"
@Peregrine101
Жыл бұрын
If Linus keeps going around like this, there might be the event of him dropping a server on any part of himself. In the event of the part of him that is crushed being his head, the outcome maybe really bad and the endgame part a bit too real. Technically the way they are doing things, the event of any of Jake's extremities being in peril is not to be excluded from the equation. That would be as bad, and a bit of a liability for the company, too.
@cattythecat9161
Жыл бұрын
The same thought, i got, when i watched this video... why dont they buy some kind of forklift for handling the Servers in their rack 😓
@kwith
Жыл бұрын
I shudder to think of what would happen to me if I was doing this on PRODUCTION servers just on a whim like how its depicted here. Now I get it, a smaller operation like this isn't going to have Lab/Dev/QA/Prod environments, but to go basically from the lab to production and just "hope and pray" it works, I cry along side you. I sent one of these videos to our OH&S guy a few years back, I honestly think he had a stroke because he just sat there staring at the screen mouth agape and twitching the whole time. All humour and joking aside, they REALLY need to have better safety practices, every one of these videos is just a worker's comp agent's worst nightmare.
Linus: The weight of this heavy server isn’t being supported Also Linus: Yeah I’m just gonna rest my head under it.
@JETWTF
Жыл бұрын
My thoughts exactly, and he was poking at the support.
@saladgreens912
Жыл бұрын
OSHA is a privilege
@honer723
10 ай бұрын
He had on protective headwear at least?
Can't wait for the next "endgame" server next year.
@cthecheese1620
Жыл бұрын
We all know how this story goes 😂
@danieljonsson8095
Жыл бұрын
That's what happens when you constantly choose a technology which is fundamentally not designed to be expanded (even if it with a lot of work can be but not designed for it). And discounting technology because "no one here knows how to set up and maintain it", and instead choose a different technology that ALSO clearly no one there knows how to set up and maintain and are learning bit by bit on the fly...
@SevenHunnid
Жыл бұрын
We only live physically once so we shouldn’t be afraid to do anything bro, i smoke weed on my KZread channel and i ate Mcdonald’s inside Walmart 😈😈, screw anyones opinion 🎯
@RedRingOfDead
Жыл бұрын
I give them 9 months
@iamalittler
Жыл бұрын
He just needs a separate server for server videos
ZFS for the win! Great pick guys! This time we know your data is safe (unless someone drops a server)!
@Nalianna
17 күн бұрын
unless? - until.
Might I recommend the acquisition of hydraulic table carts. Makes transferring heavy things like that from different heights much easier and safer for both the equipment and your staff.
I love how professional these videos are… right up until they start installing things
@SIlverwolf-fy8ci
Жыл бұрын
Belive me, it's sometimes more near to reality how they do things then one would think. :D
@LastGunslingerTull
Жыл бұрын
Can confirm. It’s all good until someone opens the debug console, or grabs a screwdriver. Then it’s all asses and elbows
@user-rr5ce1wb2j
Жыл бұрын
This went smoothly compared to some jobs I've done. One rack was in a room so small that the 35kg servers had to be angled at more than 45 degrees just for the font of them to clear the wall and there was only space for one person to do so...from the side of the rack.
Hope Wendell can do a video on how he restored some of Linus's bit-rotted files. I've never made this mistake but it would be interesting to see the repair.
@LiLBitsDK
Жыл бұрын
bit rotted?
@user-nm4kq5kw4f
Жыл бұрын
@@LiLBitsDK bit-rot is when the bits that make up your files are changed / corrupted over time. If data is just stored on a hard drive, it will degrade and you can lose the data. ZFS has something called "scrubbing" which checks this and fixes issues before they become unrecoverable. I believe LTT did not have scrubbing setup or it was setup incorrectly so they were not protected against bit-rot
@kaptenkrok8123
Жыл бұрын
@@user-nm4kq5kw4f it was not a bit rot issue...it was a totaly missconfigured setup...
@Catsrules1
Жыл бұрын
You might be interested in this video kzread.info/dash/bejne/polkucVve82cebQ.html Wendell goes full computer janitor on recovering data from an old Enterprise SSD.
@tobiwonkanogy2975
Жыл бұрын
he did mention it a few times . the server build series might be helpful as well. Wendell covers a lot of topics including software and backups.
honestly i love the server content more than the typical videos. because its legit just linus and jake spending a day nerding out and having a laugh while they do it. and this server stuff is far more interesting than another overpriced gaming pc
13:30 always love when Linus & Jake "playing" around with the server, comes the time to shut the server down and had to hesitantly tell the editors. But this episode comes with a twist lol
17:45 Linus be like: "Yeah let me just lay here under a sever with 60 drives in it that isn't mounted correctly and play with the mounting hardware. Not that it could just fall down and will splash my head."
@TheFalseShepphard
Жыл бұрын
Poor linus, He has to lay in a sewer just to make ends meet my condolonces 🙏
@oliverboi
Жыл бұрын
@@TheFalseShepphard Ikr poor linus and his very overpriced Sewer system
@LiLBitsDK
Жыл бұрын
he would be just fine, yes it is heavy but he would still be fine
@marcusbell4449
Жыл бұрын
@@LiLBitsDK 60 drives would make a jbod weigh 210 lbs or so idk
@marcusbell4449
Жыл бұрын
@@LiLBitsDK actually in the video it says 290 lbs and that may be when empty
you know, when I worked in Inventec, we had lifting thingies for carrying servers, so you could just adjust height and slide even full 150gk 4u server in and out of test rack by yourself without help, no matter if it was almost on ground level or 2m high (it wasn't in regular racks, it was more like store shelves with rails, so putting in and pulling out servers was easy) I bet logistics guys would love this thing
@invisi1407
Жыл бұрын
Yeah, I don't know why they don't have something like that - that would make it a ton easier and safer.
@robertt9342
Жыл бұрын
@@invisi1407 . Probably don’t mover servers that much.
@ferky123
Жыл бұрын
They just need a lifting cart.
@AVPEx
Жыл бұрын
He likes Jake's help.
@thekwoka4707
Жыл бұрын
Yeah, any kind of rolling scissor jack. I've used them for automotive stuff, like lifting transmissions into vehicles.
Can’t forget the fire in the old old server rooms and how many you guys had it was crazy but did a very nice recovery on that one
Cool stuff! I love these techy server vids, especially when it shows exactly what LMG are using on-site.
I think Linus needs help, this whole storage thing becomes like an addiction. I don't think there's enough storage in the world to satisfy Linus' hunger for more.
@vibonacci
Жыл бұрын
haha. You should talk to a Google employee. Linus' data hoarding is childs play.
@Mice-stro
Жыл бұрын
Haha my starting home nas is 40TB, i don't even know what I'm gonna use it for yet. But data aggregation is almost exponential.
@poetryandlilies
Жыл бұрын
Linus is the IT equivalent of Galactus confirmed
@ubermidget2
Жыл бұрын
Nah, if that were true he'd be investing in knowledge of Ceph. With a single head node, he knows what the Storage upper limit is. With a proper cluster, he could scale to dozens of PB
@Blacklands
Жыл бұрын
It sounds like a lot, but there's plenty of people who have something approaching (or exceeding) a petabyte at home as a hobby (so, not making money specifically with it)! He runs a business, so even if he wouldn't need quite _that_ amount of storage, a couple of petabytes is pretty reasonable, no?
As someone that manages enterprise IT equipment at an MSP, I love these videos about your backend infrastructure.
@danieljonsson8095
Жыл бұрын
Don't use LTT as a source for good enterprise IT management... Just don't... You're going to be in for a rough time if you do.
@samnope7344
Жыл бұрын
16:45 For the others who enjoy Linus' backend
@HilbertXVI
Жыл бұрын
@@danieljonsson8095 It wouldn't be half as entertaining otherwise lol
@danieljonsson8095
Жыл бұрын
@@HilbertXVI Certainly. I'm just saying, be well aware that LTT is an ENTERTAINMENT channel, not "good practices" channel.
@xnetpc
Жыл бұрын
@@danieljonsson8095 as an enterprise IT Server Engineer, I cringe at everything Linus chooses for his server and network core solutions. It is obvious that Linus, nor anybody who works for him has ever worked in corporate/enterprise IT.
Jake's job is so cool. He gets to design and build these amazing projects for Linus and spare no expense you normally would. With the house and everything he does at the office hes become my favorite face on LTT.
Can I just say how much I LOVE videos with Jake and Linus, you can tell these 2 are bros and genuinely enjoy their time together
Love you too
@guy_autordie
Жыл бұрын
@Jonathan Z they will. Wendell tease it on twitter.
Having followed the new server videos for a while, I’m glad to see things get finalized. Although part of me wonders if Linus was partially inspired by the SSD-based server used for the new house.
@jackhemsworth7515
Жыл бұрын
Or the million dollar all SSD server that they made a video of and then completely forgot about.
@vjuOG
Жыл бұрын
@@jackhemsworth7515 its not optimal to run this many ssds, a million for a server is not cheap
@ZuppaD.Cipolle
Жыл бұрын
@@jackhemsworth7515 they had to return the parts to the sponsor, it wasn't meant to be a stable thing
I love watching you. It seems you really love what you do. Nothing is more enjoyable to watch especially since I love computing and electronics generally myself. All the stuff you have in there. It's like an Ali Baba treasure trove. So enjoyable to watch.
Server update videos are hands down my favorite LTT videos
“It’s LeviosAAAAH” That reference did not go to waste. 11/10
I wonder if this is just the way Linus deals with his own mortality, and the need for permanence in time
@cloudtaker633
Жыл бұрын
Even so, we all will eventually be forgotten, no matter what we do.
@randombrit13
Жыл бұрын
It’s similar to how i do it.
@ZaHandle
Жыл бұрын
He’s gonna upload himself in one of these servers and one on his grandchildren will trip on the power cable
@jalbertgo
Жыл бұрын
@@ZaHandle I can only guess that's the final point, to make a copy someday and for it to be tax deductible hehehehehe
I like the funny dynamic in this video, it's refreshing and actually makes it fun to watch
It's nice to see the intro still being used. I've noticed some videos don't have it and I miss it.
If there is ever a shortage of hard drives, we know Linus has bought them all.
LTT data storage sure has come a long way from random hard drives on the back of a toilet to this beast of a "Storage Solution." I could see Jake having a new channel called "Server Super Fun," and he just reviews and talks about server stuff.
@Lizlodude
Жыл бұрын
I went back and watched that tour video, I loved the archival bathroom lol. Like here's the company's backups, yes the sink is connected, please do not touch it. XD
@ArifKamaruzaman
Жыл бұрын
Hahaha. random stack of disk on bathtub. That's hilarious.
@fade2black001
Жыл бұрын
Well with the insanely overpriced things he sells (and people buying them) he can afford some shit
i love the editing in this video. give that editor a raise!
LMG banter is the best. Couldnt imagine a better place to work!
I love that Jake knows he's in the untouchable zone, ordering food not only infront of the bossman but on video
@illiiilli24601
Жыл бұрын
Jake is Linus' adopted son, he is untouchable
@XTJ7
Жыл бұрын
And insists the editor leaves it in! :D
@ravenof1985
Жыл бұрын
ive noticed an inversion of the early Jake/Linus dynamic, nowdays it feels like Jake is the adult and Linus is the child.
@shapshooter7769
Жыл бұрын
This is why Linus hires employees - so he is free to act like a child in camera. Which is of course, content.
@OfficialSamuelC
Жыл бұрын
I absolutely love their dynamic, and I’m constantly impressed at Jake’s knowledge and skills.
3 years later... Linus: We bought another unit, and we're turning it into the LMG Data Center!
@5dashes
Жыл бұрын
AWS competitor -- Linus Web Services
@Blacklands
Жыл бұрын
@@5dashes They intentionally (totally intentional, wasn't a mistake at all, we swear!) delete/corrupt all your data every 6 months to keep you on your toes and remind you that backups are important!
18:50 "Breaking: CEO crushed under too much server"
Linus: We almost lost all of our data. Also Linus: We're going to build a new storage system with a single point of failure.
@Cyberguy42
Жыл бұрын
By single point of failure, are you referring to the 'head' server? If that goes down, they will temporarily lose access to their data, but the data itself will still be safe, they'll just have to import the zpool on another server, same as they did on the new server in this video. So while there may be a single point of failure, I don't think it is inconsistent with the goal of avoiding losing data in the future.
@jmickeyd53
Жыл бұрын
@@Cyberguy42 A clean hardware failure is far from the worst case scenario. I've seen processors with incorrect AES s-boxes, silently mis-encrypting all data. I've seen memory bit flips lead to incorrect indirect jumps in the processor. Or power spikes (lightning) taking out multiple drives simultaneously. Or just simple software bugs. The list goes on.
@Blacklands
Жыл бұрын
@@jmickeyd53 I mean, you still need backups, yeah. I don't think they contested that? Doesn't Linus always try to throw at least one "RAID is not a backup!" into these videos?
@ray89520
Жыл бұрын
@@jmickeyd53 For pure curiosity: How would your preferred setup look like? Because I don't see how two head servers will solve your mentioned issues from my basic infrastructure knowledge.
@susanyoung6579
Жыл бұрын
@@ray89520 Ceph cluster would have been better immho.
I can't wait for Linus to create a new channel just to show off his backup servers. He could call it Linus Backup Tips?
@sihamhamda47
Жыл бұрын
More like "Linus Backup and Restore Tips"
@DVAerden
Жыл бұрын
As long as it's not "Linus backs his tip up", 'cause that's not exactly KZread material.
@MRtecno98
Жыл бұрын
Linus Back Tips
@laboulesdebleu8335
Жыл бұрын
Linus' Back That Thing Up, Just the Tip, and Only for a Second!
@skippingbear92
Жыл бұрын
Linus server tips
I love how linus just casually lies directly under extremely heavy servers which are poorly held in place.
Man, you guys get the coolest toys to play with.
Whoever edited this video… we’ll done my friend, we’ll done! I haven’t laughed with a LTT video intro in a while. Kudos!
I think the perfect backup for your archives would be an automated tape storage room Edit : yeah tape writing and accessing is slow but it is just a backup for a very dark day
@donc-m4900
Жыл бұрын
VHS or Beta?
@WTFdoNOTpeeONme
Жыл бұрын
@@donc-m4900 fish tape
@ssu7653
Жыл бұрын
As a backup yes, for reading 100% NO
@silverflower0
Жыл бұрын
900,000 feet of tape!
@zixaxi
Жыл бұрын
he would probably need LTO10. Even then... could you imagine trying to backup all that data he has?
LMG guys: I am curious... this will allow you to have access to all those projects.. how do you know which project file to grab what desired clip from? What is a typical list of keyords/tags you might use for a given project and how does your search for relevant video get achieved? Is there any kind of AI invloved in creating metadata for future searches or is it all manual? That might make for an interesting video.. at least I'd watch it. Not a lot of hardware to it.. but the whole workflow thing is interesting and worthy of a video.
@joshjlmgproductions3313
Жыл бұрын
They probably date their videos and name them the same name as the KZread upload.
@JuneNafziger
Жыл бұрын
@@joshjlmgproductions3313 or the internal name for the project, rather than the clickable title on KZread
@yearswriter
Жыл бұрын
they could also search for a video on youtube and then have more info about raw material, if there is some naming convection consistency
@EoRdE6
Жыл бұрын
@@joshjlmgproductions3313 sure but often a simple video title doesn't tell you all the things in a video, especially when you have a specific product or clip in mind that wasn't the highlight of the video...
@kaukospots
Жыл бұрын
pretty sure this is only archival, not active projects, so they probably don't go back to it very often
Server videos are always fun I don't understand anything they are saying but it is still fun to watch
Linus is killing it lately. Goes to show the hard work going on in a time of not much news.
You need a hydraulic lifting table (jack). It's normally used to lift stuff onto the bed of a pickup truck, but seems like a perfect fit here too. They even have wheels so you can cart heavy stuff around.
@q1joe
Жыл бұрын
They make ones specifically for loading racks.
@wobblysauce
Жыл бұрын
Yep, can get them in a veritable sizes
@donc-m4900
Жыл бұрын
Or use Jake and another guy instead...
@mj41374
Жыл бұрын
See my comment earlier: battery powered server lift. I installed an entire datacenter by myself with it!
@whencuriositystrikes880
Жыл бұрын
They seriously better get around to getting some of that before anyone of them seriously injures themselves. Being fun and goofy is cool until people get hurt.
18:14 I love how enthusiastic Linus promotes their screwdriver like "EASY!" while Jakes knee is almost getting crushed by the weight of the JBOD 😂
@TheCoheedIndeed
Жыл бұрын
Then the sponsor is for a competitors screwdriver 🤣
Epic server room updates love these storage server videos :D Really seems endgame this time unless you go for that no controller pure storage setup one day for some reason lol good stuff!
love the server update/upgrade vids
I love Jake. LTT just has such an amazing crew.
@OfficialSamuelC
Жыл бұрын
Ditto. He is clearly so knowledgable, continues to amaze me what he knows and the broad spectrum of things he knows and is capable of!
@kierasher1
Жыл бұрын
Yeah. He's like a super chatty LAN admin. You don't see those very often. It's fun.
LTT video editor: "How many flashy text fields do you want? How big shall they be?" LTT marketing guy: "Yes."
@repzo5551
Жыл бұрын
Yeah it's gotten worse over the past few months, more clickbaity and seems to treat their audience as children or preteens
@Lizlodude
Жыл бұрын
Yeah not a fan of those. I get the thumbnails, YT makes the rules, and however annoying they are you get shanked if you don't play by them, but it gets annoying when it spans the first minute of the video.
@Shanghaimartin
Жыл бұрын
I love LTT, but I'm genuinely considering unsubbing with the childish tiktoky style choices they're making these days :( I just really grates on my nerves for some reason
@repzo5551
Жыл бұрын
@@Shanghaimartin same
@shapshooter7769
Жыл бұрын
Go pay for Floatplane then.
I'm drooling! I want this storage setup so bad!
Linus has got to be one of the only people to make a video building a new data server sound like it's going to be an epic tale that will one day be sung about. Also, he makes it all seem so easy but you can tell when they're talking about adding insulation and temps in the room, his hair at his forehead is soaking wet, meaning he's been sweating his ass off.
You really need a larger server room - something on the order of 5x larger. That one rack should be 3. You really need 5 feet in front and back of clear space for access, and then at least a half a rack for network appliances and patch panels. This would make working on the physical plant a whole lot easier.
@Ornithopter470
Жыл бұрын
I don't think they actually have enough need for that. It'd make sense if they were doing more than basically meming with the server room.
I love seeing the behind the scenes of LMG, it was hilarious seeing the logistics banter
Love to see a chart showing hardware redundancy etc. in case an entire array goes offline. When I was working, servers racks you couldn't easily stand on both sides to load stuff were hell. Glad you bolted it down too, had a server rack not bolted down at a clients site once and yeah. Finally, time to convert one of the bigger rooms into a full service server room with hvac, raised floor, etc XD
I've got that same JBOD enclosure at work full of SSDs, it's wild. That one shelf and the machine it's connected to are worth more than my life.
Reminds me of every experience I've had doing projects in IT, especially new SAN / storage migrations. There's a million little things that are slightly off, with many tasks that have to be finished to deal with the last lingering issues before everything is "right". About what you said on the zones, most people don't use these kinds of setups, and there are always issues that come up. Only vendor appliances are truly headache-free (Nimble / Pure arrays). They are the reason most enterprises don't use these kinds of setups, appliances are vastly more easy to standup and their support is worth its weight in gold--they are the definitive experts so we don't have to be.
@Braindead154
Жыл бұрын
For their use case, they should just toss it in a Amazon S3 Glacier bucket and call it a day… would save him so much money and time.
@weirdguybr
Жыл бұрын
@@Braindead154 I'm not so sure about that. I'm a bit of a data hoarder myself and every time people suggest me to use cloud to store my data, I redo the math and it always ends up being cheaper to just store it locally, even at my scale (under 100TB). For example, using an unofficial glacier calculator, with 3.6PB of data, just to store (not retrieve) it for a year, it's giving me a quote of 175K USD.. And if you are actively retrieving data, you soon end up adding tens of thousands of dollars - as an example, the retrieval cost for 20TB costs 25K USD and requires a minimum of 4 hours. Now, compare to their new server - it's probably close to 200K in hardware (too lazy to do the parts list math myself), but they get so much free stuff from sponsors that I'd be surprised if it ended up costing more than 50K for the build (they got most of the drives for free, got the RAM for free, etc). And, maintained properly, the yearly cost of operation will be much lower than any cloud storage (it's just power plus the occasional hard drive replacement) and you get unlimited retrieval for no additional cost (and it's much faster than 4 hours for 20TB).
@ddognine
Жыл бұрын
@@Braindead154 There is no such thing as the cloud, just someone else's computer.
@Braindead154
Жыл бұрын
They aren’t storing 3.6PB of data, they are storing a fraction of that and using raid for redundancy. You don’t have to do any of that with S3, durability is just there and to a much higher level. Even if they are getting paid to build with the equipment they use, I still hope that they have some offsite data storage.
@Toramt
Жыл бұрын
@@ddognine ... with dedicated support teams who watch the health of the arrays over time, regular hardware maintenance and operations documentation in a trio of purpose-built datacenters, with proper fire suppression and spread across a large enough geographic area that any one minor disaster doesn't lose your data, instead of someones spare time between script reviews and a closet.
" Trust takes years to build, seconds to breaks and forever to repair" That's an amazing quote right there 🥰.
@eq663
Жыл бұрын
No
@sunbleachedangel
Жыл бұрын
a very old one too
New editor? Loved this one!
I would finally be able to install my entire steam library with a setup like this.
@hiibrain
Жыл бұрын
3 games max
Nice! Server content is my favorite part of the channel lately.
Linus: this Server, that needs four people to lift is not mounted correctly and only held in place by a piece not designed for heavy loads Also Linus: says that with his head directly beneath it
"Endgame" we all know a "bigger, better, and faster" one is coming in a few months for Lab 2.
I love the relationship Linus and Jake have 😆 Really makes for a great viewing experience
Server and Moving Vlogs are still the best. Watching since 'whole room water cooling' 😁
It’s your endgame… for now, you’re gonna have a new server by 2023 lol
@q1joe
Жыл бұрын
If they do it right, this should be extendable by updating the "head" servers or adding more arrays.
dude i love ur tech vids u and ur team are great at making videos so yeah thats all folks
Watching you guys struggle with those chassis makes me happy I have a server lift. That looks like a PITA.
I love when Linus and Jake are doing server stuff :) Also I love how they have an order of magnitude more TB of SSD storage than the capacity of my HDD based NAS :D
Clever way of showing “logistics” which has been mentioned many times but hasn’t been seen (by me) until now.
i am beyond confused on how the entire layout of the servers work, but i still enjoy watching the videos on it all lol
Damn dude, as someone who's lost poetry and artwork that only existed in digital form, I feel your pain on whatever wasn't recovered. People say, you can create it again... And it's like no.. you can't.. Glad y'all got the majority recovered. You guys are living my dream, lol not counting KZread stuff. Stay awesome
@Lizlodude
Жыл бұрын
One benefit in their case is that the majority of the content is actually still on YT and can be downloaded, just in significantly reduced quality and organization.
How does Linus not have a "proper" server room/rack by now? I've seen Cogen plants that have better server rooms. I get that he has absolutely insane SERVERS, but they'd probably last a lot longer with proper cooling, ventilation, spacing, etc.
@shapshooter7769
Жыл бұрын
But he does though.
@LiLBitsDK
Жыл бұрын
it IS a proper server room, albeit small AND it is a professional rack... so what are you talking about?
@DominicRusso17
Жыл бұрын
@@shapshooter7769 he really doesn't though. That server room is way too small for the contents of that rack. If AC goes out or is underperforming, the smaller the room, the quick things burn out/up; hence the comment in the video about their UPS burning up in the past. Also, they should be insulated (both thermally and audibly) which they've kind of done once (based on past videos) but clearly not well since both sound and heat can leak out the vented door. I love Linus and especially all his server videos, I just figure by now he'd have a state of the art server room to match his BETTER than state of the art servers 🙂
@deepblue812
Жыл бұрын
It does look like where the janitor keeps his supplies after hours. LTT has enough square footage, I'd like to see something more 'bright tech clean-room' and less 'broom closet vibe' :) With how often they end up filming segments in there you'd think they'd want more space.
@ChaosNebulai
Жыл бұрын
I agree, being able to walk in, have a few shelves for bits and bobs and being able to walk the whole way around the rack is night and day, probably not feasible due to the effort of terminating everything somewhere else though
i am happy to see that you also have trouble with server shelfs...
Oh man seeing you guys lifting those heavy servers out of the rack really brings back memories. Nowadays I work only on cloud services, but I kinda miss my times at the datacenter :/
Imagine waking up in the morning and his new video ITS HERE Me: wow
Linus's segways catch me out everytime, but that one at the end had me crying on the floor
favorite series from LTT!
The fact that Level1techs forum seems to be a technical ressource of almost every big tech youtuber is so cool.
@cloudtaker633
Жыл бұрын
Yeah
"Leftover" 30 TB NVME Drives from Dream's build. Man the stuff that "falls off a truck" at LMG in any given week is prolly worth more than my house. . .
@cerberusshepard433
Жыл бұрын
most of it ends up at linuses house as well i reckon
16:26 is the best part 😂. Two qualified IT specialists in that little Server room move out old servers in new ones in. Love it! Btw, very interesting video!
@bretl8130
8 ай бұрын
qualified is a streach
How dare Jake not drink from an LTT water bottle! What a monster! 12:33
That transition a few seconds after 9:37 💯
@neelb980
Жыл бұрын
I mean it's a pretty basic slide transition lol, nothing crazy tbh
Hey great work on these, I love seeing you guys work on datacenter hardware/software solutions ! Next logical upgrade : geo replication on those storinator (now that you have multiple buildings)? I think trueNAS has some implementation of gluster Georeplication in the SCALE version, so that could be an interesting thing to try out !
@animefreak5757
Жыл бұрын
the two buildings he has are VERY close together. I don't think that's what your usually going for with geo replication.
@MrWadezz
Жыл бұрын
@@animefreak5757 Well, it depends. From what I remember, they're a few hundred meters apart (maybe 90-150m apart or smthg). It's definitely enough for fire to not spread across the two buildings, and it puts both storage cluster on different power circuit, which is probbly enough for a company the size of LMG.
10:59 made me actually cry i literally had to pause thanks for that
8:30 - 9:40 I had a litle bit of ... the plant ... and this storage adventure scene really tripped me out. 10/10 25:27 MaN-TaH. MoN-TuH.
I just love how Linus is being all serious and Jake is more interested in when his burrito will arrive 🤣
Love the show and all you do! I gotta speak up here though. As a content creator and IT professional, managing this large of a redundant data set is going to grow in complexity as your data grows. Eventually, your internal staff will no longer be able to manage it on their own and you will need to hire a full time Tech just to monitor and maintain it. A tape archive system isn't as sexy and you're not going to have instant access to the raw content of your oldest videos [How often do you really need that?] but it's a hell of a lot cheaper and functional for decades. As you've seen in the past and as you will continue to see, having that instant access on a ginormous NAS costs a lot more than the hardware, eventually, it's going to cost you the salary of a dedicated Tech that does nothing else except manage that storage. Then again, you make bank at LTT so this might be something you're prepared to do but I'm already seeing the video title from LTT, 'Guys, I was wrong about the NAS, again, we lost everything!!!!...Maybe' video title in 2023 or 2024. 3.6 Petabytes isn't going to be nearly enough when you consider the steep ramp of camera tech and thus storage requirements.
When i watch these server videos, i'm always questioning myself why even i watch them when i don't understand the technical jibber jabber of server lingo. But damn, am i glued to the screen with all this entertainment.
I loved that Segway during the segue.
I'm a scientist at a multi-million dollar tech company and Linus has a better IT infrastructure than we do.
@blez5418
Жыл бұрын
I'm a gamer!
@thezachdrake
Жыл бұрын
@@djhokage1 I'm a data scientist at a cybersecurity company so its all IT but okay sure.
@valismind
Жыл бұрын
To be quite fair, they're shooting 8K/ 8K HDR content which are LARGE files + they're also a multi million dollar company hahah
@thezachdrake
Жыл бұрын
@@valismind Yeah 1000p. Their data needs are beyond massive. This kind of content is half the reason I subscribe.
@lgpa565
Жыл бұрын
Which company
Ok I'm gonna have an aneurysm from watching Linus laying under the server. Gah! Also, WHERE are your steel toes? Those sneakers, yea no. Maybe some basic safety precautions you guys? I mean at least they wore ear protection, sort of.
that's a BEAST ..... :O and that 90 TB of SSD is the lid ! WOW
Love these videos and seeing sysadmin Jake
I love the Server projects especially with AMD. They are epyc.
Just a thought, maybe try using MLV (mass loaded vinyl) to try and cut down on the noise escaping from the server room. Companies like Audimute sell it in rolls. Using something like mineral wool or acoustic foam isn't going to do much for stopping sound transmission.
@Bartimayus
Жыл бұрын
Linus used cavity wall insulation (recycled jeans) instead of actual sound dampening materials when he set up the room.
@tylerweatherby7131
Жыл бұрын
The issue with vinyl is that if it gets heated beyond a certain point it combusts
Another great video as always - Thanks! One wishlist item is for more bleeping on some of the stronger language. No issue with the base words during the course of a vid but seems like there is more stronger language coming through over the past months. Again not a prude but some words such as gd do bother me. Thanks again and best for all the plans in the works.
To reduce the weight of the JBOD, we usually remove the drives and power supplies before transporting/mounting to the server rack. Only install the drives and PSU back to it afterwards.
17:37 when that happens, get a hex wrench of the right size and L it up in there. If you don't have enough leverage, just get a hex driver with the right tube wrench and make yourself an extra lever. CAUTION, if the rack is 100% full, you risk bending the leg. I usually grab the offending corner and then push the rail in. ALSO, i can't believe you put the rack directly on the floor. WTFrak. No shock mounts?
@marc0523
Жыл бұрын
I've never seen shock mounts, is it possible you live in an earthquake zone and that's why you have them?
@killingtimeitself
Жыл бұрын
@@marc0523 also depends on where you are locating i suppose, if its a building with any possibility of having substantial vibrations shock mounts would make sense.
@katarjin
Жыл бұрын
Only place I have seen racks with shock mounts is on ship installs.
@mal2ksc
Жыл бұрын
It's not like Vancouver never gets earthquakes, either.
Because of LTT I started to build my own NAS with Truenas Core and tried to Backup anything that I can't recover from the Cloud. It's not easy because you can buy only this much as a Teenager but soon I can store the Backups on another place, so that I much safer from getting a data loss than the average citizen.
@jojosworlds1208
Жыл бұрын
@@ianvisser7899 I only backup important document and photos but I don´t want to lose these, but the rest is in the cloud or not important enough so..... And I have not nearly this amount of raw data, must of the things on my PC are games that are already in the cloud.