Unboxing a Petabyte

Ойын-сауық

Wonder how long it will take to fill this thing? Place your bets! Thanks to Synology for the server and hard drives. Check them out below!
HD6500 - sy.to/hd6500
DiskStation Series - sy.to/diskstations

Пікірлер: 1 200

  • @TheSlowMoGuys2
    @TheSlowMoGuys2 Жыл бұрын

    Really appreciate all the advice in the comments on this one. Some changes I made: Switched to 5x12 drive vdevs. Link agg off. Jumbo frames on for the whole network. Data Scrubbing scheduled. I haven't enabled snapshots because I think the max size for that is 200TB. Let me know if there's anything else you recommend!

  • @stevengreidinger8295

    @stevengreidinger8295

    Жыл бұрын

    Is it worth having a bit of additional SDD for the few videos you are currently editing at any given time? Would that speed up the editing?

  • @riccardomarchesini836

    @riccardomarchesini836

    Жыл бұрын

    @@stevengreidinger8295 or caching

  • @JoelBergmark

    @JoelBergmark

    Жыл бұрын

    You guys need proper storage devices that also considers cold storage, read time, malware, ups etc. You need a professional storage solution and relevant network to make use of it. Maybe I can hook you up from worlds largest ICT vendor.

  • @silentracer911

    @silentracer911

    Жыл бұрын

    How much would this have cost if you paid for it?

  • @davidgriffiths2223

    @davidgriffiths2223

    Жыл бұрын

    @@silentracer911 the case without the drives is listing at $17,000 - $19,000 depending on the seller.

  • @Boggin_
    @Boggin_ Жыл бұрын

    Still can't get over Linus' face when Gavin told him his server would last him "until the end of summer", when Linus thought he'd be good for at least a year or two lmao

  • @ColinRichardson

    @ColinRichardson

    Жыл бұрын

    Hehe, I just commented the same thing .

  • @TyNeyedly

    @TyNeyedly

    Жыл бұрын

    I was thinking the same thing. Good to see that storage server still working.

  • @Phabrysio

    @Phabrysio

    Жыл бұрын

    Linus underestimated the slo mo lol

  • @KufLMAO

    @KufLMAO

    Жыл бұрын

    Did I miss something? What part of this was Linus in??

  • @KufLMAO

    @KufLMAO

    Жыл бұрын

    @@kaedenmurphy9937 ohhhh… thanks.

  • @frostbite0707
    @frostbite0707 Жыл бұрын

    I'm almost sad that it's not a 3 hour video of Gavin pulling harddrives out boxes in slow motion.

  • @John_Wales
    @John_Wales Жыл бұрын

    The fact that you guys need a petabyte of storage is absolutely mind blowing. It's inconceivable how much that really is.

  • @iamaduckquack

    @iamaduckquack

    Жыл бұрын

    Pretty conceivable if you do slowmo, apparently

  • @NPzed

    @NPzed

    Жыл бұрын

    For a sense of scale, a 4k blu ray movie is typically on a 50GB disc. 1 PB of storage is roughly equivalent to 20,000 4k blu ray discs

  • @John_Wales

    @John_Wales

    Жыл бұрын

    @@NPzed jesus christ.

  • @RICDirector

    @RICDirector

    Жыл бұрын

    Now...understand that the Apple //e I used in high school was 64K. Total. Mindblowing.....beyond mindblowing.

  • @TheRealSmithFamily

    @TheRealSmithFamily

    Жыл бұрын

    @@RICDirector 64k of ram, no hard drive/on board storage at all.

  • @blobfish.
    @blobfish. Жыл бұрын

    Thank you for your speed ramping Gav! It's part of the authentic SMG video feel. We appreciate you and your ongoing quest for storage.

  • @petersizen3897

    @petersizen3897

    Жыл бұрын

    but for speed ramping, the cine files could drop the frames not needed any more. It would solve the storage issue for another couple years.

  • @nicholastaylor3128

    @nicholastaylor3128

    Жыл бұрын

    The format definitely supports that (I go back and forth on "cine is a wonderfully flexible format well-suited to scientific video" and "it's just a stack of BMP files and some timing information"), but I'm not sure there's good tooling for it and I don't think Gavin wants to add a couple of hours of swearing at Matlab or Python to his editing workflow. If there is good tooling for it lmk, my data is about to get at least 50% better-looking.

  • @petersizen3897

    @petersizen3897

    Жыл бұрын

    @@nicholastaylor3128 no way, the frames are not in a compressed format?

  • @nicholastaylor3128

    @nicholastaylor3128

    Жыл бұрын

    Nope, just brightness recorded for each pixel, like the raw output of a camera. The main customer for the high-end cameras is research, and the whole field has spent too much time going "Compression artefact or interesting physics?" to trust most video compression.

  • @petersizen3897

    @petersizen3897

    Жыл бұрын

    @@nicholastaylor3128 I mean, there are lossless compression options, and slow motion video has many not changing pixels. I guess just a compression and deleting frames from speedramped sections, could mean saving 90% of the storage space.

  • @martijnvangelderen7783
    @martijnvangelderen7783 Жыл бұрын

    I think I speak for all of us when I say: Gav and Dan don’t ever quit

  • @WEKM

    @WEKM

    Жыл бұрын

    Indeed.

  • @Operational117

    @Operational117

    Жыл бұрын

    And with that much data storage available, hopefully they'll have enough for the next few years, or *at the very least* until the end of the coming summer (and that assumes they don't get an even better ultra-high-speed camera that generates even more data per second).

  • @soulreapermagnum

    @soulreapermagnum

    Жыл бұрын

    but they do slow down.

  • @thesnowqueen89
    @thesnowqueen89 Жыл бұрын

    i only ever understand about half of what gavin says in these types of videos, but it's always fun to hear people much smarter than me talk about stuff they're interested in

  • @RICDirector

    @RICDirector

    Жыл бұрын

    Second that...!

  • @chemicalbrucey157

    @chemicalbrucey157

    Жыл бұрын

    He has a great ability to explain things in the simplest of terms

  • @devildante9

    @devildante9

    Жыл бұрын

    About 6 months in IT and you'll understand everything, it's not really advanced stuff

  • @gargaj

    @gargaj

    Жыл бұрын

    I understand all of it and that's what mortifies me. This dude probably has more HDD space in his living room than I ever encountered across my whole life.

  • @JRwhite1991
    @JRwhite1991 Жыл бұрын

    Personally the speed-ramping, iconic background music and added sfx is what makes Slow Mo Guys. Well worth the added storage requirements and associated cost. Great stuff Gav, keep it up!

  • @Honigbiene1
    @Honigbiene1 Жыл бұрын

    This is an almost impossible amount of storage to wrap my mind around.

  • @theflash9068

    @theflash9068

    Жыл бұрын

    Ltt has 2petabytes i think

  • @CPT_Nelson

    @CPT_Nelson

    Жыл бұрын

    Now imagine how much storage google/youtube has to support all those videos.

  • @chuba1

    @chuba1

    Жыл бұрын

    Well there is a camera named after Vera Rubin. Which captures 3.2 GIGApixel photos and it's meant to use 24/7. The write speed of that is 60 petabytes in a day. That is roughly 4x more than the Slow Mo Guys best camera can capture.

  • @Kayrim_Borlan

    @Kayrim_Borlan

    Жыл бұрын

    @@CPT_Nelson At least multiple Exabytes- thousands of times what Slow Mo Guys has

  • @MattyEngland

    @MattyEngland

    Жыл бұрын

    @@CPT_Nelson Probably close to the amount of shekles embezzled by Israeli politicians.

  • @microm4n
    @microm4n Жыл бұрын

    As a sysadmin it's so satisfying to hear you talking about LACP and SMB and expandable storage and having a really practical use for it all. Most people myself included either have the skills but not the use case or vice versa. Your situation is super unique in that you both have the need and the expertise 😀

  • @MC2738

    @MC2738

    Жыл бұрын

    As a sysadmin I can agree!

  • @Varangian_af_Scaniae

    @Varangian_af_Scaniae

    Жыл бұрын

    "Most people myself included either have the skills but not the use case" Everyone has the use case but not the money to spend. Like just think about saving Porn-h-u-b to local storage, that takes a few TB.

  • @GamingXperience

    @GamingXperience

    Жыл бұрын

    @@Varangian_af_Scaniae Me while reading through your comment: "no thats not true, i only have a 8TB and it fits all my da.... yea i agree."

  • @Varangian_af_Scaniae

    @Varangian_af_Scaniae

    Жыл бұрын

    @@GamingXperienceYeah one have to be prepared for the day the Internet goes down. Haha😄

  • @rnedisc

    @rnedisc

    Жыл бұрын

    @@Varangian_af_Scaniae Yea, lol. I play a lot of msfs2020 and I dream of downloading a local copy of their world map. But that about 50 times what Gavin has here and costs as much as a house....

  • @IstasPumaNevada
    @IstasPumaNevada Жыл бұрын

    I get the feeling that the technical explanations you're giving are 95% explaining to the audience, and 5% re-convincing yourself that, yes, you do need this capability. :)

  • @TheSlowMoGuys2
    @TheSlowMoGuys2 Жыл бұрын

    I’m fascinated to know how much total storage you guys have

  • @mitchib1440

    @mitchib1440

    Жыл бұрын

    Last time I counted, I think I have around 30TB, but I've gotten rid of a few computers here and there. I use it because I archive a lot of online stuff. So if a KZreadr deletes a video, I can still watch it / reupload it for archive reasons.

  • @blubbamoja

    @blubbamoja

    Жыл бұрын

    2TB

  • @XRatedPoetry

    @XRatedPoetry

    Жыл бұрын

    Onsite? Offsite? Or total?

  • @pancakeking78

    @pancakeking78

    Жыл бұрын

    ive got 40TB stuffed into my PC case lol

  • @coreymartin9630

    @coreymartin9630

    Жыл бұрын

    I've got 5TB in my main PC for OS and games and 6TB Raid 1 in my NAS

  • @RadicalEdward_115
    @RadicalEdward_115 Жыл бұрын

    Its so satisfying to see everything in one folder.. Congrats dude

  • @jjpark98

    @jjpark98

    Жыл бұрын

    It's something we strive to achieve in the storage world. One folder and done.

  • @RadicalEdward_115

    @RadicalEdward_115

    Жыл бұрын

    @@jjpark98 its so majestic

  • @Lexslayerpride
    @Lexslayerpride Жыл бұрын

    I always love seeing Gavin talk technical, it's just so obvious that he loves talking about what he talks about

  • @SchrodingerMil
    @SchrodingerMil Жыл бұрын

    This is what everyone’s main concern was when you got the LTO! I think it’s safe to say you’ll never lose your backups

  • @EdBruceWRX

    @EdBruceWRX

    Жыл бұрын

    Never ever say tha,t it attracts the attention of the data eating gremlins...

  • @riktheyellowmonkey

    @riktheyellowmonkey

    Жыл бұрын

    @@EdBruceWRX Absolutely true. There's always something!

  • @RumleKjaer
    @RumleKjaer Жыл бұрын

    Nerdy hard drive videos with Gav are my absolut favorites. Guess my delievery deadline can be pushed another 10 minutes 🤣😅

  • @thephantom1492
    @thephantom1492 Жыл бұрын

    Hey Gav, You have two PSU, you really should really also go with two UPS. And if possible two different breakers. One failure mode of psu is to fail short. This mean that the UPS connected to it will fail, and may trip the breaker. If the breaker trip, then you lose power, and possibly lose data. Also, make sure that both UPS are sending signal to your server so if the power fail the server knows about and will shutdown safelly. Also, you really should get a spare hard drive!

  • @matthewtuel2747

    @matthewtuel2747

    Жыл бұрын

    To add to this, rack-mounted UPS would be the way to go. They should be on your network for remote monitoring. The rack probably needs at least 3x 20A circuits (each with a UPS): 2x for the server and a third for the network equipment.

  • @PabloEdvardo

    @PabloEdvardo

    Жыл бұрын

    +1 to the spares. with that many drives you don't want to try searching for same model replacements years later. Buy 4-5 spares now and be set for years to come.

  • @BenjaminKramer

    @BenjaminKramer

    Жыл бұрын

    And don't forget your thermal management. A sound-dampened cabinet is great, until it becomes an oven.

  • @aniasparkle
    @aniasparkle Жыл бұрын

    I love this channel. The behind the scenes stuff for all of this content is so interesting. Especially, since there's another video on this channel of you just shoving hard drives into a massive PC case and calling it a day. Nice to see that you finally have a professional storage system that can grow with you and Dan and your antics :)

  • @scrillen
    @scrillen Жыл бұрын

    It had never occurred to me that speed ramping was so incredibly demanding. Cheers for the lesson, Gav.

  • @CrispOffTheBlock
    @CrispOffTheBlock Жыл бұрын

    I LOVE these 2nd channel videos. There's just something so soothing about listening to someone talk about something they're passionate about. I could watch all day and never get bored.

  • @kinori3198
    @kinori3198 Жыл бұрын

    I’ve noticed the slow down for a long time and it’s always been one of my favourite parts of your videos, truly seeing the whole thing

  • @TesserId
    @TesserId Жыл бұрын

    I love the ramp ups. It's certainly one of the greatest things about what you guys do.

  • @VolkriDesigns
    @VolkriDesigns Жыл бұрын

    Honestly, I really appreciate the technical level that you were explaining this video in. I've been working my first IT job and am going into the Networking field, and being able to keep up with the protocols you were talking about just made realize how much more talented you and Dan are outside of your perceived field.

  • @jasonwilliams8016
    @jasonwilliams8016 Жыл бұрын

    Thank you for your past frustrations and struggles with data storage. Your channel and videos are amazing!

  • @spark_bears
    @spark_bears Жыл бұрын

    Nice to see how helpful Smee is when you unpack something!

  • @box3y
    @box3y Жыл бұрын

    These videos are some of my favorites that you do, no joke. The techy insanity of storage and possibilities.

  • @garthscott4055
    @garthscott4055 Жыл бұрын

    In all the years I’ve watched your content I’m always impressed with it all. Cheers.

  • @TheSftv
    @TheSftv Жыл бұрын

    I grateful for the content you and the guys create, surely one of the top prime content on the tube! I always look forward to yet another slomo video, with great commenting and humour! Cheers!

  • @toamastar
    @toamastar Жыл бұрын

    I have been binge rewatching @howridiculous for the last day or so, I wonder what their data storage looks like considering they do slow mo too! Would love to see a collab between you lot! The banter would be off the charts!

  • @CK-ceekay

    @CK-ceekay

    Жыл бұрын

    And that they release a 15-20 minute video every week, and usually looks like they're running 5-10 cameras a shoot

  • @tompw3141

    @tompw3141

    Жыл бұрын

    @@CK-ceekay 10 cameras with 3 hours 4k footage would generate 500GB or so. If they don't discard any footage (and they probably do), they still wouldn't be close to a Petabyte.

  • @Gh3ttoboy

    @Gh3ttoboy

    Жыл бұрын

    The howridiculous guys dont use a phantom that can take 90k frames a second right so there files are probably big but not as big as a single 2.5TB video thats arround 5 to 8 minutes of slowmo footage

  • @Moshington

    @Moshington

    Жыл бұрын

    Yeah I never thought about how much data slow mo footage was taking up. It’s awesome and now I also want to know what those aussies are packing in their editing dept.

  • @virtual_edition
    @virtual_edition Жыл бұрын

    You put 24 drives into a raid 6. You're going to lose everything, guaranteed. The likelihood of two additional drives failing during the very first rebuild you have to do is effectively 100%. The way you've set this up is insane. If you don't want to take my word for it, then please, for the sake of all your video, send Linus a message and ask him if a 24 drive raid 6 array is bad idea.

  • @genomexp

    @genomexp

    Жыл бұрын

    This is the comment I was looking for. I was watching the video wondering if he would pick banks of 6, or 8 to push it, never 24. That's actually endangering the data as you said. I wouldn't call it a 100% failure guarantee but it's moved the risk needle way to the top. This means 3 disks failing will fail all 24, etc.

  • @francescoceladini

    @francescoceladini

    Жыл бұрын

    @Level1Techs

  • @MumrikDK

    @MumrikDK

    Жыл бұрын

    I can't speak to whether you're right, but he explains this isn't backup. This is access. The backup to this was covered in an earlier video.

  • @JeffGeerling

    @JeffGeerling

    Жыл бұрын

    RAID6 should definitely use pools of 5 to maybe a top of 10 or so drives, especially in a large array like this. Also I spoke to Wendell about it a bit, and he suggested leaving some drives offline until I get it more full, to cut down on power use until I really need all the space. Of course, for SloMo footage... I guess they're already using all that space lol. But having a ton of drives like this is one area where ZFS can really shine. Unfortunately Synology and other NAS vendors don't necessarily support more advanced drive layouts as easily as something like TrueNAS.

  • @melovescotch

    @melovescotch

    Жыл бұрын

    @@JeffGeerling Agreed I have two hotspares on my array.

  • @jamiethomas18
    @jamiethomas18 Жыл бұрын

    Thanks for the insight and thank you for all you do to keep us entertained. Merry Christmas.

  • @Utroliver
    @Utroliver Жыл бұрын

    Love these hardware/upgrade videos It's always fun to get a look behind the scenes

  • @JeffGeerling
    @JeffGeerling Жыл бұрын

    I was worried when you did the tape backup video you wouldn't also supplement that with an online storage system, so I'm glad you're adding this petabyte. Now I'm counting down the days until we see you become the first KZreadr with an exabyte!

  • @TheSlowMoGuys2

    @TheSlowMoGuys2

    Жыл бұрын

    We’ve actually had this synology longer than the tape. Tapes are currently the backup of this server in two locations. And all the data was put on by our older NAS units that combined are another complete backup. Sounds like I should use vdevs with less drives though.

  • @melovescotch

    @melovescotch

    Жыл бұрын

    @@TheSlowMoGuys2 As you can see how many tech guys comment, should make follow up video about using less drives per vdev.

  • @WayStedYou

    @WayStedYou

    Жыл бұрын

    Linus will probably beat him to an exabyte with all the servers they keep making

  • @duelgundam

    @duelgundam

    Жыл бұрын

    @@WayStedYou which Whonnock server is he up to now? 4? 5? I lost count after new NEW Whonnock.

  • @noblebun
    @noblebun Жыл бұрын

    Sound cabinet still needs to have some form of proper external ventilation connection, otherwise the system will cook itself off or experience heat related failures under load. If the fans are just recycling the same hot air in a confined space it will rapidly create a thermal feedback loop which risks significant damage.

  • @ronknight1010
    @ronknight1010 Жыл бұрын

    Super awsome to see you guys got a large solution for storage. Also cool that synoligy pitched in and made this happen.

  • @landrec2
    @landrec2 Жыл бұрын

    Congrats on all your success and great content over the years! I always enjoy the content. Cool getting a peek behind the curtain here, and I will say that the speedup portions are enjoyable and put the slo-mos into context very well. Didn't think about storage, but yeah I can see why network storage would help! Synology has a good reputation too, the Twit TV folks are always recommending them.

  • @hailcat7027
    @hailcat7027 Жыл бұрын

    I just wanted to say, since you did that collaboration with Linus, I have fallen in love with his content and KZread channels and have been watching essentially every upload of his since. It's so funny how one collaboration can greatly impact new viewers, using myself as a prime example. Of course, I still love The Slow Mo Guys' stuff, too!

  • @mathogre
    @mathogre Жыл бұрын

    I'm a techno-geek. This was fascinating. Thank you!

  • @flybimmerttv170
    @flybimmerttv170 Жыл бұрын

    Highly appreciate what y’all do🙏🏼🙏🏼🙏🏼

  • @Zanockthael
    @Zanockthael Жыл бұрын

    Gav in 10 years: Welcome to our newly purchased Server Farm, with one Zetabyte of storage. Hopefully, this will keep us going until the summer.

  • @KannonRomano
    @KannonRomano Жыл бұрын

    Yes definitely keep the speed ramp. Makes the video so much better

  • @fieonshakespearenut
    @fieonshakespearenut Жыл бұрын

    I see that your package passed the obligatory cat scan. 🐈👍

  • @NeedChocyMilk
    @NeedChocyMilk Жыл бұрын

    I really appreciate all the effort you put into your videos they always turn out really good

  • @lieutenant_hentxi7103
    @lieutenant_hentxi7103 Жыл бұрын

    I really enjoyed seeing some of the incredible tech that goes behind making these videos possible

  • @TesserId
    @TesserId Жыл бұрын

    Get two UPS, one for each power supply. All major data centers include to completely separate power rails.

  • @hammerth1421
    @hammerth1421 Жыл бұрын

    LTT themselves are in a very similar situation to you with file bloat, they're running like 8 KZread channels. They also actually had a fire in their server rack.

  • @jjpark98

    @jjpark98

    Жыл бұрын

    Honestly, I'd say Linus is one of the few big youtubers that could go toe to toe with Gavin's storage usage. Like you said, he has multiple channels churning out videos on the reg. They shoot on high end, top of the industry video cameras at 4k resolution and they keep all RAW files of which I can assure they produce at least a couple hundred a day minimum.

  • @ajs787

    @ajs787

    Жыл бұрын

    @@jjpark98 They actually film at 8k at LTT, and have some stuff they did at 12k. Which makes the storage needs all that more necessary. They said they do that for zoom effects while still delivering true 4k.

  • @mastershooter64

    @mastershooter64

    Жыл бұрын

    @@ajs787 cant they all use like super good lossless compression algorithms?

  • @ajs787

    @ajs787

    Жыл бұрын

    @@mastershooter64 When they upload to KZread, yeah, they use H.264. But having the raw files available allows them to do a lot more with things like color grading.

  • @wtf-hc3tp

    @wtf-hc3tp

    Жыл бұрын

    Wasn’t that vid a prank though?

  • @Pelthail
    @Pelthail Жыл бұрын

    I love these videos. I love seeing the behind the scenes and the “how.”

  • @youritguy1
    @youritguy1 Жыл бұрын

    Love the video. Last year I switched to a Synology 4 bay drive with 40TB and I love it..

  • @stevengriffin1758
    @stevengriffin1758 Жыл бұрын

    Consider using jumbo frames. The default MTU of 1500 bytes per frame was designed for 1 to 10 megabits/sec. You are running 10 to 25 gigabits/sec. Most NIC's support higher MTU settings. The key is that every NIC and switch in your entire network must be set to negotiate a higher MTU. Once setup you will see a massive increase in network speed.

  • @hokayson6518
    @hokayson6518 Жыл бұрын

    Love it. I've got a DS918+ so I'm a wee bit behind Gav's level of usage, but I am certainly a Synology fan!

  • @gargaj

    @gargaj

    Жыл бұрын

    I'm thinking about getting one but I can't decide between the DS418 / DS420j / DS420+ ... What justifies the cost of going for the + ones over just the j?

  • @hokayson6518

    @hokayson6518

    Жыл бұрын

    ​@@gargaj oh, I just found out that only the + models (or more technically correct: the Intel CPU models) can run docker! So there's a big differentiator right there, if you care about that.

  • @gargaj

    @gargaj

    Жыл бұрын

    And outside that? I'm not particularly interested in Docker.

  • @hokayson6518

    @hokayson6518

    Жыл бұрын

    @@gargaj Plex? Can you think of anything you might use a NAS for over what the stock apps give you? If not then a J will do you just fine.

  • @gargaj

    @gargaj

    Жыл бұрын

    Honestly not much, it'd be more of a backup storage thing. Then again I have no idea what I'd be missing out on.

  • @Saintel
    @Saintel10 ай бұрын

    I was thinking of upgrading from the RS1619xs+ to the HD6500. This video helped move that process along. Thanks

  • @gabbygrace100
    @gabbygrace100 Жыл бұрын

    Currently studying digital preservation and whilst I only understood about half of the words you said this is a fascinating solution study for large files and example of readability needs and variations! Ta.

  • @Utonian21
    @Utonian21 Жыл бұрын

    At this rate, Gav will soon need an entire server room to store all his footage lmao

  • @KC-rd3gw
    @KC-rd3gw Жыл бұрын

    The only problem with raid 5/6/7 is the write hole when you lose power during a write operation but it sounds like you have that covered. With a good UPS and a redundant PSU it's unlikely you'll lose power in the middle of a write operation without safely shutting down (provided automatic shutdown is configured) Also don't forget to scrub your data at least once a month! You can still get bit rot with any drive configuration!

  • @wxexw
    @wxexw Жыл бұрын

    Big fan of the Synology products; glad they are supporting your channel!

  • @IwishIcanFLighT
    @IwishIcanFLighT Жыл бұрын

    Loving the video about storage and server stuff. Keep them coming!

  • @YuyaAyanami
    @YuyaAyanami Жыл бұрын

    On 5:12 I notice you still on 1500 MTU, if you up the number to 9014 MTU, you will have much better performance, but you also need to change the MTU on the network switch and on the computers that you wish to file transfer. This will help a lot since you dealing with very large files.

  • @holdenpi
    @holdenpi Жыл бұрын

    I know you do your own thing and you guys are probably busy or whatnot but your 130TB Collab with Linus was absolutely hilarious. Maybe when you need a 100PB or 1 EXB server you can do another one!!!

  • @ChefJoshC
    @ChefJoshC Жыл бұрын

    In some ways, totally wild how much memory you can fill up in such a short amount of time. In other ways, super cool to see how other folks who need storage/memory/bandwidth solutions can get so much more common/non-specialized access to high-bandwidth tech like this in such an accessible way :) always excited to see whether I can learn something from this to apply to my day-to-day large-scale-data-related job. Thanks Gavin!

  • @Mister6
    @Mister6 Жыл бұрын

    I've deployed one of these units in production for a university a few years ago (using 8TB drives). They are every bit as good as much more expensive NASs. Congratulations.

  • @MStrong95
    @MStrong95 Жыл бұрын

    Not that lossless general purpose compression or data deduplication should have any real significant space saving benefits for your use case necessarily, but I think it would still be interesting for just exploring if you can at a larger scale of the slow mo guys storage usage. Windows Server since version 2012r2 has had a way to get a file system to run deduplication at the level of the filesystem and if you prefer Mac OS or Linux, there is a way to get a similar if not better solution (ZFS). I guess my point is that at your scale of sheer quantity of storage in terabytes used, even a few percent of savings at this scale could start having significant cost savings and thus more room for more video or just giving you more money since you might have less need for a few of the drives. Also it's kinda industry standard at least in advertising storage to use base 10 notation to describe the capacity instead of binary. So yeah it seems like there's a small amount of tradition in rounding up storage space. Also parity and redundancy and on occasion formatting of the filesystem might loose a little bit of space.

  • @RICDirector

    @RICDirector

    Жыл бұрын

    ZFS......ZeFrankSpace? Hope Jerry stays out of it..... 🤣🤣🤣🤣🤣🥰

  • @OwenBarton
    @OwenBarton Жыл бұрын

    Curious if this will make the Blu-ray idea mentioned a while back easier? I don't own any Blu-ray disks, but would definitely make an exception for this 🙂

  • @SingleTrackMind207
    @SingleTrackMind207 Жыл бұрын

    I watched it to the end. Love all your content. Can’t look away from the little beard bit sticking out.

  • @fanthomans2
    @fanthomans2 Жыл бұрын

    Synology, this is money well spent. Best ad ever.

  • @kriscerosaurus
    @kriscerosaurus Жыл бұрын

    I feel like the importance of Smee’s contribution to this video cannot be overstated. A true master thriving-nay, REVELING!-in a highly specialized field.

  • @Bobtb
    @Bobtb Жыл бұрын

    You don't have to worry about storage, for now 😅 In 5-10 years this 4 Petabyte storage will seem like the 250 TB storage you just replaced! Regarding the power draw, long time ago I learned that you should calculate approx. 10 Watts per disk (and of course add the rest of the hardware as well), so this system is probably drawing around 750-800 Watts I guess?

  • @juraj_b
    @juraj_b Жыл бұрын

    I'm a data hoarder myself but I only got Synology DS920+ with 16TB of space, approaching 13TB. Great unit. I just got the new Synology router which is a beast and so far I'm very pleased with it

  • @Hacktheplanet_
    @Hacktheplanet_ Жыл бұрын

    Thanks for showing us all the petabyte ! 🥳🥳🥳

  • @Holmesy87
    @Holmesy87 Жыл бұрын

    Cut to next year when Gav teaches us about his new storage, because this one is full xD

  • @oso3557
    @oso3557 Жыл бұрын

    You could make a detailed tour of your editing workflow? From ingesting, over editing in Resolve to delivery. Would be awesome! What Programs do you use apart from Resolve?

  • @kempo_95

    @kempo_95

    Жыл бұрын

    He has made a video a while back about editing, I don't know if you have watched that.

  • @oso3557

    @oso3557

    Жыл бұрын

    @@kempo_95 This one "Slow Mo Sound is FAKE"? kzread.info/dash/bejne/d3x4l7KLoraaftY.html (no rickroll)

  • @kempo_95

    @kempo_95

    Жыл бұрын

    @@oso3557 yes that one

  • @JackdeDuCoeur
    @JackdeDuCoeur Жыл бұрын

    I'm awestruck by whatever cataloging system you must use to keep your data storage straight and reasonably available for your use. A petabyte I can imagine. Keeping it usefully, I can't imagine.

  • @_sherloks_
    @_sherloks_ Жыл бұрын

    I love those more technical videos. Please consider expanding the second channel with more content like this

  • @erich.5326
    @erich.5326 Жыл бұрын

    You've probably already thought about it since it's mentioned in the video, but consider having an off site backup. The biggest hazard to the server is something like a fire or a storm or something, which would also threaten your tapes if they're stored in the same location.

  • @nelsone.hernandez6654
    @nelsone.hernandez6654 Жыл бұрын

    8:14 It would be interesting to see why you chose RAID-6 instead of SHR-2 (similar to RAID-6) or RAID-10

  • @matthewlee4929
    @matthewlee4929 Жыл бұрын

    That is ridiculously gorgeous system. Can not even comprehend that much storage

  • @Mort221
    @Mort221 Жыл бұрын

    Out of the entire video, the one thing I appreciated most was right at the start, you straight up saying that you got the system for free. No trying to hide it or be discrete, just straight up "Hi, here's all this stuff. It came from this company and they gave it to us for free."

  • @finminder2928
    @finminder2928 Жыл бұрын

    The ability to be able to lift a petabyte is actually crazy. Well done synospstic.

  • @brohanime

    @brohanime

    Жыл бұрын

    do you realise how easy it would be to lift 1000 1TB microSD cards? at ~250mg each, lifting up 1PB worth of data as microSD cards would only weigh 250 grams. seems an awful lot lighter than the Synology setup. oh yeah, it's Synology by the way, not 'synospstic'. not sure how you arrived at that spelling there, Einstein.

  • @AdamEarl2
    @AdamEarl2 Жыл бұрын

    I have a Synology DS220 for my personal use. I think about $600 once all set up. Wish i did it years ago, so nice to have everything backed up in one spot and accessible across devices.

  • @PabloEdvardo
    @PabloEdvardo Жыл бұрын

    I love the speed ramping, it's a big part of your style

  • @Ozmercyful
    @Ozmercyful Жыл бұрын

    I have used synology for years, I really like their product, it is really well thought out … though I do not need as much storage as you do 😊

  • @BenjaminEmm
    @BenjaminEmm Жыл бұрын

    I've got a Synology DS420j, it's getting on a bit now but it's not let me down yet. I'm only rocking about 32TB of storage in my 4 bay NAS, but it works for our needs!

  • @jonathanirons231
    @jonathanirons231 Жыл бұрын

    Loved the irony of the drive install timelapse from the FastMo Guys.

  • @ssewwess2700
    @ssewwess2700 Жыл бұрын

    I have zero need for such a thing but I love to watch it.

  • @torbenmayer
    @torbenmayer Жыл бұрын

    God I love these behind the scenes videos, especially when it's about tech or specifically cameras/storage. I started out with a WD myCloud with 2x2TB (Raid 1), after that got filled I put in 2x4TB (also Raid 1). After that was filled I mangled my system storage with 2TB without any backup. Now, just before I went to Iceland, where I shot a lot with my Ninja V in ProResRAW ("only" around 500-ish MB/s and still no native support in DaVinci), I bought a QNAP extension unit with 2 bays. It's basically an external hard drive enclosure with a hardware raid controller, which could be used to, as the name said, a QNAP NAS to extend it without needing to buy new storage or a bigger NAS. The extension unit got loaded with 2x18TB Seagate Drives (could've gone for 20TB, but the 18TB drives were a way better bang for the buck) also in Raid 1, and is now filled with 7TB just after the Iceland Trip. Hopefully it will last me a long time until I'll eventually go for a 12 bay unit with 18 or 20 TB drives. It's not the best solution, but a surprisingly cheap and easy option for people who need big storage on the go, to terminally safe it on a NAS in the long run.

  • @RolandSchlosser
    @RolandSchlosser Жыл бұрын

    I remember years and years ago I bought a pendrive of 2Gb at EU$200 and I thought it was the best thing ever XD How fast time goes by, it's amazing.

  • @SuperMetalfan2010
    @SuperMetalfan2010 Жыл бұрын

    We use Synology as our backup at my job. Extremely useful, robust, and can make backing up data super easy to store with their snapshots.

  • @TesserId
    @TesserId Жыл бұрын

    Yup, data centers a full of that jet engine sound. Hope you have a nice cool room to rack that in.

  • @cyn4476
    @cyn4476 Жыл бұрын

    I went from no hard drive (5.25 floppies) to 20mb and I was such a happy camper! I had so much space, I really thought I'd never fill it. 🤣

  • @nenogjunius2208
    @nenogjunius2208 Жыл бұрын

    Never store your back up in the same building !!!! Love your staff

  • @Scyrixus
    @Scyrixus Жыл бұрын

    Back in 2012 a friend of mine built a PC with 1TB of storage and that was astronomical at the time. PB is one thousand times bigger than that. So much space!!!

  • @usmcboyd
    @usmcboyd Жыл бұрын

    You might want to look into colo (Colocation) server racks. Basically it is a datacenter that sells rack space. I have used it for my homelab and the energy and ISP charges are typically reasonable and would take down the power/heat/noise in your house. Also room for growth with those expansion bays.

  • @charlieinsingapore
    @charlieinsingapore Жыл бұрын

    I was installing petabyte+ disk arrays ten years ago. Of course it was in data centres with disk shelves filling multiple racks, but there you go ;)

  • @DTWTheWanderingMuzungu
    @DTWTheWanderingMuzungu Жыл бұрын

    First time ever you don’t have to worry about storage. I don’t believe that. The speed at which you’ve filled everything else I have no doubt this new server will be bursting at the seams very soon.

  • @s0wndman949
    @s0wndman949 Жыл бұрын

    I am so glad you did not stop at just the tape drive. That was scary. This in conjunction with the tape drive for backups and the old server for off site storage should really let you sleep easy at night.

  • @ChewableMeteor
    @ChewableMeteor Жыл бұрын

    Nice vid, big synology fan rockin the ds918+

  • @Lol_Pig
    @Lol_Pig Жыл бұрын

    Thats an impressive setup

  • @grekygrek
    @grekygrek Жыл бұрын

    "What a fool i am" the most relatable statement ever. Except you don't fit the bill Gav. Lol.

  • @apalmiter
    @apalmiter Жыл бұрын

    Was wondering when you'd need to upgrade your storage again. Love these bi-annual videos!

  • @darkai619
    @darkai619 Жыл бұрын

    this is so interesting. fricken love when Gav goes scientist mode!

  • @Breigner01
    @Breigner01 Жыл бұрын

    In the beginning, you highlight the reason why you keep the entire 2 seconds, and honestly, I think a lot of people watch the videos partially because of that, the number of times I've only seen the "important" part and no context of slow-mo stuff on the internet and I was sitting there frustrated to not see more and you guys make it available for us. As an ltt fan, I've seen Linus build its own petabyte server and it's a huge amount of storage and that's definitely something that content creators will need more over time. For Linus to post 17 videos a week (the last time I heard them talk about it it was 17), you need a lot of storage. And you highlighted perfectly why you need It too. I think everybody hears 288Go per file and doesn't really realize that most smartphones couldn't even store a single file like that on it.

Келесі