Level1: We bootstrapped our own ZFS storage server: 172tb, extremely low cost

Ғылым және технология

Be sure to check out the companion article at the Level1 site. More details than we could ever fit into a video!
level1techs.com/video/level1-...
Is anything unclear? or weird? Let us know -- We may use this as a jumping off point for many videos in the future. We want to do several videos on this, including videos for the linux channel, but we want your feedback on what to cover first. There are so many jumping-off points we could cover in this video.
"A day in the life of a system architect."
*1640: Correction, meant ZFS at its core, not FreeNAS. LOL.
**********************************
Thanks for watching our videos! If you want more, check us out online at the following places:
+ Website: level1techs.com/
+ Forums: forum.level1techs.com/
+ Store: store.level1techs.com/
+ Patreon: / level1
+ L1 Twitter: / level1techs
+ L1 Facebook: / level1techs
+ Wendell Twitter: / tekwendell
+ Ryan Twitter: / pgpryan
+ Krista Twitter: / kreestuh
+ Business Inquiries/Brand Integrations: Queries@level1techs.com
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-----------------------------------------------------------------------------------------------------------
Intro and Outro Music By: Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
creativecommons.org/licenses/b...

Пікірлер: 604

  • @spacejaga
    @spacejaga7 жыл бұрын

    god those mini-movies are just on the edge of being most cringeworthy things ever and yet somehow they manage to be funny...

  • @myselfremade

    @myselfremade

    7 жыл бұрын

    Its the uncanny valley of good content/production value.

  • @Teknickel_ftw

    @Teknickel_ftw

    5 жыл бұрын

    still better than cable tv

  • @YanDoroshenko
    @YanDoroshenko7 жыл бұрын

    That horror sequence was MAGNIFICENT.

  • @thingyee1118
    @thingyee11187 жыл бұрын

    I love that SOS with your eye lids.

  • @pedanticat5830

    @pedanticat5830

    7 жыл бұрын

    It wouldn't be the first time he's done that, lol

  • @00101001000000110011

    @00101001000000110011

    7 жыл бұрын

    that really hit the homerun xD

  • @imreloadin
    @imreloadin7 жыл бұрын

    I can honestly say this is the one tech channel that I'm actually excited about when I see it pop up in my subscription box! Keep up the great work guys!

  • @SgtSayWhat
    @SgtSayWhat7 жыл бұрын

    I understood about 7% of this, still watched it all though

  • @thetruthhurts2352

    @thetruthhurts2352

    7 жыл бұрын

    NO

  • @SirCrest
    @SirCrest7 жыл бұрын

    Now THIS is the kind of content I've been hoping for from you guys. Can't wait for more server stuff like this.

  • @tkojabroni2833
    @tkojabroni28337 жыл бұрын

    Y'alls acting is up there with the likes of William Shatner and Ben Heckendorn

  • @scruball1375
    @scruball13757 жыл бұрын

    That wall had like whole of my KZread subscription box.

  • @randomtvninja
    @randomtvninja7 жыл бұрын

    "if you can stick with me" are you kidding I've been waiting for heavy videos like this for a long time! I want full hour videos about all of this I need it!!!

  • @ezforsaken
    @ezforsaken7 жыл бұрын

    "really popular, but canadian" Sorry linus

  • @EposVox
    @EposVox7 жыл бұрын

    Good shit, guys. I wish I had a full server rack to work on. Good deals on bays right now.

  • @MrBiky
    @MrBiky7 жыл бұрын

    Linus - Super popular, but Canadian. Barnacles - no notes. I don't know the top guy. Paul - Real chill, has cute dogs. Qain - Friend of Wendell, actually ??? elite. Kyle - A true BitWit Jayz - no notes. Jennifer - No girls on the Internet. Ryan = clone. Holy smoke, that's some creepy, but true details.

  • @AKAMustang

    @AKAMustang

    7 жыл бұрын

    "Top Guy" is TimmyTechTV Qain's note says "Actually enjoys Elite", presumably referring to Elite Dangerous

  • @scz0

    @scz0

    5 жыл бұрын

    whose jennifer?

  • @chrisbay8578
    @chrisbay85787 жыл бұрын

    I do love it when TechTubers do overkill builds just for the heck of it :D Next time, i dare you to do a 20 GPU server, just to show Linus and his measly 10 GPU rendering machine who's the ballers now :D

  • @Level1Techs

    @Level1Techs

    7 жыл бұрын

    thats the great thing, we spent practically nothing on this and it is still overkill! And, obviously, not sponsored at all. ;) It is GREAT, and made from trash that we have show how/where we get it in other videos. In total we spent only a few thousand dollars on this for everything.

  • @chrisbay8578

    @chrisbay8578

    7 жыл бұрын

    " we spent practically nothing.... .... In total we spent only a few thousand dollars on this for everything." I think you and i have different opinions how much "practically nothing" is :P

  • @brixhodl4765

    @brixhodl4765

    7 жыл бұрын

    You can buy a 01-02 V12 Mercedes CL600 for around $10,000. That is less than %10 of what it retailed for. Do I think $10,000 is a small amount of money in and of itself.... No. That said, If I was able to acquire a functional used luxury sports car for 90% off, I would still consider that practically nothing given the context. You could build a 172TB ZFS for kicks, but chances are there is a necessity for it, so like Wendell said, I took this video as kind of a hypothetical system architect type build. You could play with file systems/RAID arrays/bootstrapping,etc with much less storage.

  • @TheDiamondGames

    @TheDiamondGames

    7 жыл бұрын

    It actually is practically nothing for 170TB of storage. You would spend around $6000 for the desktop class hard drives if you put them in a raid 0 array. One shelf would be overkill for many. Even 6 hard drives can be enough for the majority. After all, you should think what do you need this thing for and how much space you need.

  • @ChrisD4335

    @ChrisD4335

    7 жыл бұрын

    I wish I was at a point in my life I could say oh this is made of trash, it only cost thousands of dollars and mean it seriously. #lifegoals

  • @daviddupoise6443
    @daviddupoise64437 жыл бұрын

    This. This right here. All day everyday. I love this well thoughtout content. It's not the sexiest most expensive hardware but instead it is the smart solution.

  • @kylerjohnson1934
    @kylerjohnson19347 жыл бұрын

    Oh my gosh. The content is just too good on this channel!!! The perfect amount of proper useful nerdy tech, and absolutely hilarious execution. You guys are doing an amazing job. Thank you so much for the content!

  • @grassyclimer6853
    @grassyclimer68537 жыл бұрын

    the file transfer is coming from inside the house!!

  • @CriticoolHit

    @CriticoolHit

    4 жыл бұрын

    ::heavy data transfer sounds::

  • @MaelosV
    @MaelosV4 жыл бұрын

    Thank you for this. I'm getting back into my own lab and this is helping me get back off the ground. I look forward to seeing more of your work and steering people your way.

  • @GNARGNARHEAD
    @GNARGNARHEAD3 жыл бұрын

    LOL!.. whoa, those heatsinks... it's amazing how far Krista has come from being on the news, a little socialization can work wonders

  • @andreijecu765
    @andreijecu7657 жыл бұрын

    The SOS in morse code Wendell is doing at the end of the video got me good,killer Krista strikes again. Excellent video,the way you combine useful knowledge with bits is amazing. Than you for this!!!!!!!!!

  • @wilsonthesphere
    @wilsonthesphere7 жыл бұрын

    Loved this more technical video I didn't except variety so soon. Also the skit was great and made the pace of this 20 min video seem like is was a 5 minute video. You guys are doing GREAT!!! Keep them coming.

  • @ibonitog
    @ibonitog5 жыл бұрын

    Sometimes I come back to this video just for the sketches - and it's worth it every time!

  • @YumzHD
    @YumzHD7 жыл бұрын

    Loved the episode Wendell, keep it up the channel has been amazing since launch. Best of luck.

  • @tachmonite37
    @tachmonite377 жыл бұрын

    Level 1 shows are just awesome. I love their humor and dialogue...and the information of course. great job guys. i cant get enough...

  • @aarongarza4769
    @aarongarza47696 жыл бұрын

    I always love watching Level 1. You all are great. Keep it up.

  • @martyhastings9347
    @martyhastings93476 жыл бұрын

    i am giving a lot of thought to building something like that for my family (maybe not so big). recently my hard drive failure was a failure that i have heard about but have never seen. a platter broke apart. not sure if it was caused by a head crash or not. Anyway.............after i told my wife we lost lots of pics .......lets just say i think my wife and Krista must have grown up together. i will be watching this video a few more times and looking forward to more of the same type in the future. thanks guys.

  • @goldbrick2751
    @goldbrick27517 жыл бұрын

    You guys are freaking awesome!!! Hell yes, Gotta LOVE Krista. All the best. Can wait to see more of this.

  • @77chrisray
    @77chrisray7 жыл бұрын

    Huge fan Wendell. Thanks for all the help for us non computer science guys. You are awesome!!

  • @ScullyBrewing
    @ScullyBrewing7 жыл бұрын

    These are the types of videos I love, as a systems admin student in college, this is my jam

  • @post-leftluddite
    @post-leftluddite6 жыл бұрын

    I would LOVE to see many more videos like this, specifically dealing with Networked Storage, raid arrays and enterprise hardware

  • @solitude335
    @solitude3357 жыл бұрын

    love the hacker typer in the background lol

  • @djsensacion7

    @djsensacion7

    7 жыл бұрын

    He's watching the Internet...

  • @ryPish
    @ryPish7 жыл бұрын

    This is all I need in a video, the tech knowledge, the humour, the cringe, all the things in just the right balance!

  • @Banner1986
    @Banner19862 жыл бұрын

    I'd forgotten how long ago the LSI 8880 EM2 came out... Your video just reminded me of the days when the 1078 ROC controller was taking the storage world by storm right as I was coming into the storage world, working with the field engineering team over there - not to mention the 6Gb first release, where you had everything from ZFS developers at sun working with 600 disks attached, down to the guy in his basement trying to get a new speed record with OCZs drives lol Thanks for the blast from the past Wendell!!

  • @mathiswellmann6858
    @mathiswellmann68587 жыл бұрын

    This Episode was AMAZING!!! I love the backstory and the stuff around the main topic. Very creative

  • @thatsux0rz
    @thatsux0rz7 жыл бұрын

    I love you guys. Love all the videos so far!

  • @rogerg0834
    @rogerg08346 жыл бұрын

    I have to admit..when he said having a barebone Windows image on the network ready to install...that REALLY peaked my interest. We have it at work and I must say it is really cool to do. Just boot off the network and bam..starts the install...major nerd coolness!!

  • @OhItsMulligan
    @OhItsMulligan7 жыл бұрын

    17:46 onward is LITERALLY GOLD. The sticky notes, the SOS from Wendell. 11/10

  • @charleslowery9808
    @charleslowery98087 жыл бұрын

    OMFG the skit with Kreestuh at the end, amazing, and your storage array is surely the envy of much bigger youtubers, even LMG would be jelly.

  • @ringlord13
    @ringlord137 жыл бұрын

    I'm not sure that I've ever commented on any KZread video, but this was a seriously excellent blend of the high level project with hilarious cheesey nerd humor. Well done, +1 for fantastic entertainment!

  • @blackfireburn
    @blackfireburn7 жыл бұрын

    fav episode, i've been waiting for that for a while. good job keep it up :D

  • @neoskribe8986
    @neoskribe89867 жыл бұрын

    best ending ever.

  • @hivijay999
    @hivijay9997 жыл бұрын

    This was fantastic. I would love to see more videos like these showcasing server stuff. Maybe show us how to build a build server or something DevOps related?

  • @ldsudduthhanover
    @ldsudduthhanover7 жыл бұрын

    I am literally rolling on the floor at that outro..blinking SOS...Ryan is a Clone..the KZreadr pictures, including Barnacules..... And I learned something.. Yippee!!!

  • @helchez
    @helchez7 жыл бұрын

    Please don't stop. Love the humor.

  • @oscargarciahinde4247
    @oscargarciahinde42477 жыл бұрын

    Guys, you're nailing it! keep up the great work!

  • @reallunacy
    @reallunacy7 жыл бұрын

    This was fantastic. Question though, did Krista kill the other guy?

  • @MichaelLindman

    @MichaelLindman

    7 жыл бұрын

    What? Gwendell killed Twendell?

  • @iboysven

    @iboysven

    7 жыл бұрын

    They will just clone a new Twendell

  • @Level1Techs

    @Level1Techs

    7 жыл бұрын

    Nothing a tetanus shot won't cure. Plus wendell got to ride the rack like a skateboard.

  • @MrSephkeene

    @MrSephkeene

    7 жыл бұрын

    That was the best part of the video!

  • @jorambahler8799
    @jorambahler87997 жыл бұрын

    That was really interesting stuff Wendell... glad you are up again with a fresh new team...

  • @johanneskaramossov5103
    @johanneskaramossov5103 Жыл бұрын

    awesome to see this, I only have some hobby projects myself using old enterprise hardware that i got cheap.. actually for my own experiments considering enterprises tend to dispose of them instead reselling them getting enough storage at a decent prize is my main issue(closely followed by finding the right finstacks/coolers for the cpu's in 2U and 1U racks that i can buy used).. really helps me understand the concept without needing to get all the stuff myself

  • @AngateWier
    @AngateWier7 жыл бұрын

    Thank you for this. I would love to see more in depth videos about the VMs and use case for this machine!

  • @christoffer4017
    @christoffer40177 жыл бұрын

    I'd love to see a follow up video on this, going into detail as to how it is done in practicality. It's all very fine with talking about it, but showing how it's done also helps in educating!

  • @TrueRegulators
    @TrueRegulators7 жыл бұрын

    I have only watched the intro until this moment. Thumbs up!

  • @scooter4196
    @scooter41966 жыл бұрын

    Love your videos. Very technical and very precise. Thank you!

  • @Aint1S
    @Aint1S7 жыл бұрын

    Really excellent video, the best thing that TEK Syndicate ever did was to have the 🍺🍺liver🍺🍺 forcefully separate from the 🍸brain💻! This channel is like that new email account you created years ago without all of the unnecessary SPAM in-between the messages.

  • @frosty9392
    @frosty93924 жыл бұрын

    aww, look how young and yellow they are!

  • @pcsecuritychannel
    @pcsecuritychannel7 жыл бұрын

    Outro: Twendell was cloned to perform such dangerous tasks! :D

  • @N1CH0LAS12
    @N1CH0LAS127 жыл бұрын

    Welcome to the club of more storage than brains club. I'm sitting here with 130TB redundant usable space :-)

  • @eirajoao
    @eirajoao7 жыл бұрын

    It's for things like these that I subscribe to you guys. You might have just won yourself a new Patreon backer as I don't want you to stop doing this. Keep up doing videos that are way above my head and, therefore, are amazing.

  • @Nimitz_oceo
    @Nimitz_oceo2 жыл бұрын

    This is some next level stuff! Level1 makes Linus tech tips look like a truck stop

  • @txgamer1347
    @txgamer13477 жыл бұрын

    I remember working on those PER710 Google servers at a Dell facility in Austin. Google required FLAWLESS paint and chassis, and would reject entire servers if there was one chip in the paint. They were also some of the most expensive configurations we worked out outside of the PEC Cloud series servers.

  • @jokinboken
    @jokinboken7 жыл бұрын

    We always knew who was in charge! :-)

  • @mpar
    @mpar7 жыл бұрын

    11/10 educational entertainment. Level1 pgp cross over contexts. Cross channel tie ins. Great ground floor for building and tangenting content on. Keep up the great work.

  • @sykoteddy
    @sykoteddy2 жыл бұрын

    I can see the quality of the videos and studio has evolved a lot since 2017 :) But as neardy as always! I found you through LTT :)

  • @ryanbester7990
    @ryanbester7990 Жыл бұрын

    The end scene was like a game... so cool. Also maybe put it near the beginning as a prelude for what is still to come haha

  • @1n50mn1ac
    @1n50mn1ac5 жыл бұрын

    Can't say that I understood much of what you said but you do sound like a really smart guy!

  • @cmusic52
    @cmusic527 жыл бұрын

    I swear with the antics I'm just dying for a LOVE button here youtube!!! Ssssoooo Hilarious and Awesome!!!

  • @tim9735
    @tim97357 жыл бұрын

    did wendell blink sos at the end?

  • @TommyThousandFaces

    @TommyThousandFaces

    7 жыл бұрын

    Yeah, he totally did!

  • @chrisfenton1421
    @chrisfenton14217 жыл бұрын

    I would love to see a video when you come up with a virtual-to-physical imaging workflow. Great work!

  • @peterl4190
    @peterl41907 жыл бұрын

    You guys are awesome :p seriously the best tech channel in youtube. Keep it up!

  • @guillermo.gonzalez
    @guillermo.gonzalez7 жыл бұрын

    It'd be good to see some more detailed videos on the hardware setup and its parts and also on the ZFS tuning and why. For example, interested in see how you set up the multipath and the HBAs. Also, ZFS tuning that you mention on the article. Fantastic video BTW!

  • @antfry256
    @antfry2567 жыл бұрын

    Love the ending bit, Better start adding shelves. haha

  • @NathanDavis2
    @NathanDavis27 жыл бұрын

    4:33 holy $$$$ that transfer speed. I can only dream

  • @pauliewalnuts1024
    @pauliewalnuts10247 жыл бұрын

    oh c'mon i was really waiting for a jumpscare there

  • @larrykozlowski6305
    @larrykozlowski63057 жыл бұрын

    I work for a LAN center during the summer and setup a Docker nginx cache using ZFS for all of the different CDN's for games about 5 months back. Think it was around 80TB for Steam/Origin/UPlay/BNet and another 10TB to cache media files from Netflix/KZread/Facebook with a FiFo setup for when data starts getting full. It was actually a beautiful system when it was up and running and saved on a lot of bandwidth and also allowed us to let people download their games instead of being limited to the preloaded ones because we had that extra bandwidth headroom. I also setup a similar setup at home for caching my media and games just on a much smaller scale (5TB) and its actually pretty nice when you consider most of the people in my house will rewatch the same TV shows or Movies on Netflix, will download the same windows updates, and we all play the same games. Now instead of the 3 of us downloading a game 3 times, its just the one time. It is so nice lol.

  • @gorudonu
    @gorudonu7 жыл бұрын

    Really nice video. I liked examples you gave about usage. Please keep going!

  • @ThePeperich
    @ThePeperich7 жыл бұрын

    Hommage to "A beautiful mind" nice sidekick!

  • @Azivegu
    @Azivegu7 жыл бұрын

    alright, if Ryan isn't in the next video then I'll be worried

  • @bingliu2932

    @bingliu2932

    6 жыл бұрын

    It's ok, they can clone a new one.

  • @NoNamenoonehere

    @NoNamenoonehere

    6 жыл бұрын

    Krista Evil Genius page says we are currently on Ryan 4.6. due to fact Ryan keeps finding the secret lair.Wendell tho is original as he has been supplying Krista with Unlimited storage.

  • @cataria3903
    @cataria39037 жыл бұрын

    omg the moment u realize the background on the levelonetechs site is interactive :o omg how do i get this gravity star super cool thing as fullscreen maxed out or as an application? what a beautiful distraction!

  • @cataria3903

    @cataria3903

    7 жыл бұрын

    only pity is that scrolling down makes the new star that gets created go off the screen :( not be created at mouseclick...

  • @Level1Techs

    @Level1Techs

    7 жыл бұрын

    bug fixed :)

  • @onkz

    @onkz

    7 жыл бұрын

    Wonderful, you're very fast at fixing bugs!

  • @cataria3903

    @cataria3903

    7 жыл бұрын

    hm bug is still there. on firefox 64 bit, 50.1.0, multiprocess windows forced on, if that matters for it.

  • @Jobucko

    @Jobucko

    7 жыл бұрын

    nodegarden.js.org/

  • @nadpro16
    @nadpro167 жыл бұрын

    This is excellent, this is almost exactly what I have done with my personal file server at home. It is currently up to 60Tb with much more room to grow. It is nice to know that I think the same way in my designs. Now if only I could find a way to make money off it to. Because this is not cheap as a hobby.

  • @stonent
    @stonent7 жыл бұрын

    Props for the Digital Unix box in the background.

  • @MaelosV
    @MaelosV4 жыл бұрын

    Thank you guys for this.

  • @ipushpeople7221
    @ipushpeople72217 жыл бұрын

    Wow, an informative, technical, intelligent and funny video. I'm always cool with the first 3. But adding the funny parts will be great for the channel growth, congratulations and !praise

  • @monolel
    @monolel6 жыл бұрын

    A great way of ease a very technical video... it reminds me AVGN type of producction.

  • @simopr09
    @simopr095 жыл бұрын

    how can someone talk that much without running out of things to say! pure dedication to technology

  • @johnclark8542
    @johnclark85427 жыл бұрын

    I think I just scorched my shorts. I

  • @AdamJee923
    @AdamJee9237 жыл бұрын

    Wow the level of acting 'scene' here in this video is breath taking lol awesome guys very entertaining

  • @davidg4512
    @davidg45127 жыл бұрын

    heck yeah, been waiting for this video

  • @aarcaneorg
    @aarcaneorg6 жыл бұрын

    I'm already subscribed, but I ain't gonna like or favourite until Krista does something about it!

  • @tamask
    @tamask4 жыл бұрын

    First I thought you were the same person, and I wondered how you could make the conversation so well in sync. Then I realized there really are two of you :D

  • @CameronHeard
    @CameronHeard7 жыл бұрын

    I'm now referring to Ryan as Clone from here on out.

  • @UndeaKnight
    @UndeaKnight7 жыл бұрын

    😂😂 I love your intros and outros 😂😂 they're the best!! 😂😂

  • @breadtoucher
    @breadtoucher7 жыл бұрын

  • @praecorloth
    @praecorloth7 жыл бұрын

    Loving this video, can't wait to see a followup to it. Though I'm surprised to hear that ZFS is supposedly "bad" at handling IO for virtual machines. I've been running VMs on a pool of mirrors for years now. The only performance issue I've run into was when I switched from iSCSI to NFS. NFS, like CIFS/SMB, is terrible at tiny IO, and modern operating systems are loaded with tiny IO. Switching back to iSCSI was a nobrainer, and the VM performance is very smooth again. One of the things I did do, however, was disable atime. For VMs, it just doesn't make a whole lot of sense, so those operations end up being wasteful.

  • @NickMach007
    @NickMach0077 жыл бұрын

    this was awesome. informative and definitely entertaining!

  • @SimpleGunner
    @SimpleGunner6 жыл бұрын

    somehow the first thing i noticed about wendells 'cave' was that hes has what im guesting is wallpaper engine running on the 2 top monitors, running some pretty interesting stuff. that ending skit was a blast.

  • @tyler6859
    @tyler68595 жыл бұрын

    I need more of... all of this...

  • @kienanvella
    @kienanvella7 жыл бұрын

    It's kinda hilarious (but extremely gratifying to know), this was pretty much the exact same solution (DS4243 disk shelves, LSI SAS 9201-16e, ZFS on Debian) I came up with for our data storage needs in our DCs at work, but we're using 12 bay R510s as our storage heads, and keep the boot disks in the internal bays - gives us some better storage density compared to the R710s. FWIW, these disk shelves are manufactured by Xyratex, and can take the same controllers as some of the Dell Compellent SAS6 controllers (model HB-SBB2-E601-COMP), which support SAS link aggregation.

  • @HOLLOWKILLER514
    @HOLLOWKILLER5147 жыл бұрын

    This is so great.

  • @tasha1982ify
    @tasha1982ify7 жыл бұрын

    love that star trek talk - fun video und i learned alot - thx guys!

  • @BloomerzUK
    @BloomerzUK7 жыл бұрын

    Awesome video guys. I'd love to see a video about UPSs and automated shutdowns.

  • @lukehouge9776
    @lukehouge97767 жыл бұрын

    I think an awesome video would be about backups, how you do them, what you recommend etc. Like in the enterprise channel you talked about snapshots, and stuff like that. Thanks!

  • @williamwazere
    @williamwazere7 жыл бұрын

    Hahaha nice skit to wrap it up. The blinking. Great video anyway too, brilliant you lot can have fun and deliver interesting tech content.

Келесі