Dave, the closest thing we have to a tech Bob Ross

@jeffhex

Жыл бұрын

with better hair.

@marvintpandroid2213

Жыл бұрын

Happy little cloud (storage)

@gordonm2821

Жыл бұрын

Bob Ross but using Windows Paint

@BTheBear

Жыл бұрын

We don't have data loss, we just have happy little accidents!

@michaelhanson5773

Жыл бұрын

Happy little bits on happy little platters, written by happy little magnets.

The Garagenator

@Gabber1110

Жыл бұрын

The Garage-inator ?

@zilog1

Жыл бұрын

Grarageenatorinator

I just love seeing how you don't give up on getting it running under Windows

@alisharifian535

Жыл бұрын

Because Microsoft recommends users(developers included) shouldn't bite the hand that used to feed them.😁

@AdrianNelson1507

Жыл бұрын

@@alisharifian535 🤭 storage isn't my thing but I was sat here shaking my head. This limitation wouldn't exist in Linux! But we've all had a crazy summer with Windows that we're not proud of

@MrBlaDiBla68

Жыл бұрын

Yeah, there were really some "Take the pain!" moments ;-))

@debbiebernhardt3742

Жыл бұрын

There is 26 letters, so the limit is 26 based storage.

@palomarjack4395

Жыл бұрын

... even though it is a an obnoxious amount of work. I slapped together a Linux server under the Mint distro, of all things. Brought the storage drives into the directory tree in FSTAB, changed the permissions to share them and there is my network storage. Took about 5 minutes. The best part, I don't have to be concerned with Windows idiocy, security issues and cost. "It just works."

As a big fan of LTT... that gag was soooo great!!! The ONLY thing missing was dropping something.

I had three of the 45 drive units at work a few years back, it was a good learning experience for configuring ZFS for data throughput.

@DavesGarage

Жыл бұрын

Can you summarize 3 years in a comment for me? Just the good stuff 🙂

By default the cluster size is set to small (4kb). If you reformat the pool with a larger cluster size, say 256kb or 512kb or even higher you can go to 256tb volume size with NTFS. And your performance will be MUCH improved.

@andrewfidel2220

Жыл бұрын

Nope, the problem was he was using win10 instead of Windows server, storage spaces in the consumer/workstation builds is artificially limited to 63TB to force you to buy a server license.

@THEhairfarmer

10 ай бұрын

I suspected a licensing limitations - have been there several times before

Hey Dave this is a really great channel I love your stories! Never stop making videos👍🏻

Thoroughly enjoyed watching and listening. I understand some and enjoy the rapid flow of information. Very cool. Thank you and cheers.

Hey Dave, have been watching since last summer. I love your videos! You have been an inspiration to learn about programming and technology of the past (I'm from 2000 so even 1990's technology is from the past for me). Congratulations on passing 250k subscribers. Hope to keep watching your content, keep making it great!

Also the LTT comment, youre hilarious. Well done Dave. Really enjoy your videos man. Thanks for sharing. Always a thumbs up for you

@Holek2

Жыл бұрын

Hilarious, like this segway... to our sponsor!

@judenihal

Жыл бұрын

i hate ltt

@Maty2001

Жыл бұрын

@@Holek2 The sponsor: "Windows NT is the new OS, built with my own hands, here at Microsoft!"

I spent last weekend digging online and reading about maybe setting up a virtualized truenas trying to get a feel for ability, options, possibilities. This video is an excellent addition to my research, thanks again for the content you produce; it's much appreciated.

@wishusknight3009

Жыл бұрын

I have ran truenas/freenas for many years on bare metal. I also have another server running windows bare metal that serves as a secondary NAS for other things. And Truenas is the one that has given me so much more confidence that I cant really describe it. Data integrity is maintained by paranoid levels of paranoia. Where as on windows I am dependent on the HBA to do that. And its just not as inspiring of trust as Truenas Core has been. For my VM's I use a dedicated ESXi box (soon to be migrated to XCP-NG) which does use HBA Raid for its local store. That way Truenas has continuous control over all aspects of its hardware on its own machine. I always recommend running 2 computers if possible, because hybrid systems always need to compromise somewhere.

Very informative, thank you for sharing 😊

Great video. Absolutely fascinating watching someone who dwarfs my knowledge in so many areas, just tip-toeing into storage. I've been doing NAS/SAN administration for about two decades, really interesting seeing what you think is worth sharing, or intimidating.

I just want to say. I appreciate you and your knowledge. And can listen to you for hrs. Thanks for sharing 🙏

Great video! Also liked the outtakes - keep `em coming

Describing something like a striped array as "dangerous" instead of something like "most risky" might just be my new favourite thing

If you want to remove partitions with diskpart, one you have selected the disk, type "clean" and it will wipe all partitions from the drive.

@marcellipovsky8222

Жыл бұрын

I was wondering the same, why he did not use it. That would be much faster.

@Tularis

Жыл бұрын

Ikr

Dave has style. Love the tech insights served up with a side of humour that would probs be lost on most people.

this was an excellent and informative video, or new and old alike. Well done, sir! liked and subbed.

Great video, Dave!! Also love that old CRT you are rocking in your utility closet.

@eDoc2020

Жыл бұрын

From the precise screen borders, the sheen of the display, and the size of the stand I can conclude it is actually an LCD monitor. Although at first glance I also thought it looked CRT-ish.

Hearing that you and Jeff are communicating makes me so happy. And I can't imagine how much he's geeking out talking to you. LEGENDS!!!

Awesome my man, earned a sub!

Awesome again, also glad you hit up Jeff, he's really good at setting up these things.

Loved it, great job.

"...Houston cautiously agreed to install Windows on it". I can imagine the guy of Houston telling his colleagues about it and everyone laughing out loud. 😁

Love the bloopers at the end. Great video by the way.

lol Subbed when you made the LTT Bottle ref as you sipped from a ruby goblet hahaha. Already got me attentive and payin attention!

Well Dave, I saw the title and instantly thought of the “Petabyte of Storage” and you then mention it within 60 seconds of starting the video. Absolute legend 😁👍

Love these videos!

I remember when I was at DEC and first got hold of an RZ26 (3 inch drive, came out about 1995 or so) and I held 1GB of data storage in my hand and (because I went all the way back to 10MB cartridge hard drive RK05s and their equivalents) I was completely awestruck! Now I have 64TB on my video server and I barely think about it - except that I need to upgrade it. No wonder the world has changed so much eh?

@n6cid

Жыл бұрын

Remember back in the day when ordering new drives thinking to yourself "I'll never run out of storage with this drive"....:)

@DavesGarage

Жыл бұрын

Ironically it's mounted less than 6 feet away from my Commodore D9090 10-megabyte unit!

@JohnnieWalkerGreen

Жыл бұрын

Mine was a DEC PDP-11/84 under RSX-11 with two 10MB RL-02 disks and a DECUS C compiler. No virtual memory: that was when the programmers did the memory overlay design and calculation.

@sbrazenor2

Жыл бұрын

I think my first HDD was a whopping 40MB.

@n6cid

Жыл бұрын

@@sbrazenor2 When I was stationed in Germany my first dos box was a Commodore Colt with a 20 meg HD. When we got deployed for operation DS/DS I ordered from the States a 540meg HD (ERLL) with adapter card. That was the beginning of the long journey to include Linux, Free BSD, Red Hat and the list goes on and on...:)

And I feel in heaven with my 6tb Nas, and you came up with this insane storage.... Great video! It would be interesting to test the hardware with something like OpenNas, or Synology OS...

Great video Dave, love watching your videos

@DavesGarage

Жыл бұрын

Glad you like them!

Thank you for yet another inspiring and educational video. It really is nice to learn about things that are possible with computers. Made me imagine using just one computer for an entire team... Might make maintaining the whole system a bit easier. At least it would make really quiet office, if one could put all noise generating hardware in a closet... But that idea would require still much studying, planning and so on... But even if I would never do any of that, it is still nice to have new ideas to enertain ones mind with.

I'm here building a 8TB (12TB raw) NAS and I'm very happy. Seeing big hardware like this makes me jelaous. And then not, realizing how much it would cost in power to run.

@mariusvoicu683

Жыл бұрын

About 20% capacity out of a 2000w ups

@jovetj

Жыл бұрын

*envious

Nice video Dave! Thank you for sharing it with us!💖😎👍JP

First time viewer. One minute in; liked and subscribed. Can't wait to dive into your library. Back to the vid.

I really do love listening to your videos. I'm curious how much time you spend preparing them. The way you loop back to previous points indicates that you are definitely scripting them to some degree and I'm curious, do you make bullet points or do you write a full-on script? Thank you & keep it up. I've only come across one of your long-format videos so far and loved it, except for all of the ads that aren't in the shorter 25 minute videos.

Good stuff Dave 👍 I decided to virtualise Freenas on my Windows 2019 box, there's a few powershell commands you can use to assign a HBA card to a Hyper-V VM, works great! Saves having to emulate both Windows and Freenas in Proxmox - I can just run Win Server and virtualise my NAS. I also UPS protected the box, with a script to gracefully shutdown the VMs and server when battery power reaches a critical level. Fun times!

Thanks again Dave

Thanks for exercising Storage Spaces. I have been daydreaming about what it would be like to build a large array using it. Now I see!

thanks, man I did exactly what you did. I am a windows server man but recently did a proxmox and 45drive implementation , it worked great but looking and look at videos I realise there much that could have gone wrong

Great video Dave, as always. You are a great big shiny, hot-swappable, TO-3 transistor, in my eyes. LOL😂

It's crazy that I'm doing the same things at my house I don't have the fiber speed as you do but my server has the sfps to do so...I plan on adding this later on, as I'm just a KZread learner try to get a network built...great job lov ur videos

Dave, I think I understood about 5-10% of this but enjoyed every minute! Thanks!

@DavesGarage

Жыл бұрын

Glad you enjoyed it!

Very nice, informative and entertaining ...

Every compressor I've been around is not only very loud, but very percussive noise. I'd be worried about the effect on long term disk life.

@Tofflus

Жыл бұрын

I'm not the only one who thinks that could be a big problem :O

@stevedixon921

Жыл бұрын

Valid concern. Heard stories of people 'carting' a stack of drives from one building to another and the vibration from the ground through the cart to the drives was enough to cause damage to the drives (makes sense if you think about it after the fact). For this installation adding some anti-vibration to the mount would be advised, though it being 'detached' from the wall and floor will help. Alternatively there may be anti-vibration mount options for the compressor. Time will tell, but if the drives fault randomly (or fail) it is something to consider. I know two customers who have their servers next to water sources, so, sometimes you make do with what you have.

Nice thumbnail change lol, great video

Thanks for another great video! And yes, your server can definitely beat up mine. 😂

Mine is 500 gigs, so I think you've won this contest. Holy smokes! I didn't know they made them that large.

This was a great video please keep doing more like this

@DavesGarage

Жыл бұрын

Thank you! Will do!

Your wall mount looks as super-level as some shelving I put up a few months ago. It's SO LEVEL I had a call from NASA asking WTF I'd done cos it was messing up some of their satellites. Good job, Dave. Levelness FTW.

@allanrichardson9081

Жыл бұрын

All you need is ONE tiny (level 0.1) earthquake and you have to redo the whole project! Mother Earth has her faults, but when we dwell on them, it’s our fault. 😊😊😊

@dannydoolhoff4215

10 ай бұрын

@@allanrichardson9081 hahaha... faults - earthquake... 🙂

Great Video. TrueNAS is amazing, I run it on bare metal and also with Proxmox on another server for my backups with identical drive setup each with separate 10GiB connections so the backup can happen at the same time as using the drives with no hassles

Nice! The mounting part of the video felt very "Red Green" ish! If only you had made it look like a B/W super 8 film! :)

Definitely deserves the Thumbs Up! Great knowledge on a new Hyper Visor that I had no idea existed. Although I don't need 400+ TBs of data storage I am doing calculations to get a Raid set up that will enable me to have around 40 to 50 TBs of storage available. My reasons are mostly due to 3D Model Texturing and the size of those textures in order to create eye popping materials. 2k, 4k, and 8k textures en masse take up a lot of space. I also like to hoard raw textures so that I can go back to them. I do however also compress using the .DDS format and will be storing those as well. To put things in perspective I currently store everything on a load of external drives piled up in a cardboard box. It's not the best solution :D. Cheers! Stay Healthy and Stay Sane!

Great videos Dave. Been learning a lot and while enjoying videos, very educational. One thing caught my eye is that Fan brace above the HBA cards. I'm going to need the cars and would like to purchase it. May I ask where you got it, or did you make it? I'm getting 2 HL15 builds in the next week and this would be great for my builds.

Thanks for this and so fun to see you using proxmox which is based on debian and also truenas scale which is also based on debian. There are times when you can trust linux over windows

Hi Dave, thanks for creating this channel and sharing your experience and wisdom. In this video you mentioned, when deleting the partitions, "and you can't use diskpart". I was a little stumped by that. Why not? Using Truenas for my setup, I can't test this, but I would have assumed you could select disk xx; clean.

@natemauger9757

Жыл бұрын

Right? I was thinking EXACTLY the same thing there!

@eDoc2020

Жыл бұрын

I would need to assume he meant that you can't do bulk operations in diskpart.

thanks for the good content, really enjoy all of it :)

@DavesGarage

Жыл бұрын

Glad you enjoy it!

I love the important at the end of the video! 🙂

Love that line..."...knowing something is possible, even if you then have to look up the actual steps later...". So true and man a project has that notion started.

I need this Dave 😀

Great video. It was fun to see the comparisons with Storage Spaces and TrueNAS... I'd love to see how you finalize things and how you set up replication, snapshots and backups too.

Awesome !!! Hanging server (and what of a kind) in the closet 😎 You can't make that up !!! Gr8 Video!!!

I initially skipped this video because of "yet another 45 drives sponsored video" but I am actually glad having watched this. I now know the existence about something I need later 😊

Really enjoyed your video. Great name btw!

@DavesGarage

Жыл бұрын

Glad you liked it!

I would be interested to see if you can get both nics going at the same time on the truenas, then use SMB3 multi pathing to double your rates, and get a 2 port 10gb nic on your pc and see if you can get it to work. Love the video!

As someone who uses Netapp storage and the like at work, it's interesting to see how good the open source solutions have gotten over the years.

love your videos. educational and humorous. online since 1983.

Outtakes like at the end of Cannonball Run, love it!

I think you might have run into a limit in NTFS at 64TiB, you would need the "Workstation" or a server version of Windows to format the pool as ReFS in order to get above that limit. ReFS is supposed to compare relatively favorably with ZFS, but as I'm a FreeBSD/ZFS fanboy, I approve of your use of TrueNAS in this instance. ;)

@agy234

Жыл бұрын

How is Dave not running Enterprise already?!

@backupaddict1356

Жыл бұрын

REFS would have solved it all... and is far stable then truenas

Ok that wall mount was smart!

that was a really good video. love that you tried to use windows first..great job.

"Their phat water-bottle-budget" I lolled so hard!

In Disk Part you type in select disk (disk number) and then type "clean" to remove all the partitions. You can create a batch script and do all your HDDs in no time.

Dave, I love your videos, and this one especially speaks to me since I've run various RAIDs at home for over a decade now. My current setup is goofy and overcomplicated; I'm used to running a Windows server for file storage and other services at home, didn't feel like re-working that all to run on Linux servers, but still wanted to get away from hardware RAID (although that old Areca did serve me fairly well). My "solution" was to build a new server as a hypervisor; I spun up a Debian VM, passed through the motherboard's built-in HBA (reflashed to IT mode) to the Debian VM, and then used mdraid on Debian to create a RAID-6 storage pool (raw, no filesystem). I *then* spun up a Windows VM, and attached the Debian array to it via iSCSI, then formatted the array with NTFS. It works well and even proved to be expandable; when it came time to add another drive, after installing the drive I just ran the appropriate commands on Debian to expand the array, and then expanded the partition in Windows. The biggest challenge I faced was the initial iSCSI configuration, as some of the documentation was... not quite complete. I wouldn't recommend this setup to anyone else, and I'm thinking I'll go a different direction in the future; but it was kind of fun to setup. (In case anyone's wondering, I didn't want to go ZFS because I *really* like having the option to bump array capacity one drive at a time.)

@DavesGarage

Жыл бұрын

That's very close to what I'm doing with TrueNAS on Proxmox with the HBAs and Optane passed through...

has the thumbnail gone thru several different iterations or am I losing my mind? Great vid btw!

@DavesGarage

Жыл бұрын

Very much both, perhaps! But yes, there was a Furry interlude...

I used to really LOVE windows,. as a tech geek from the 90s... but I moved to linux years ago and your video reminded my why :) I love your content Dave, keep on click'n!

Thanks,Dave, very geeky.

Love this. 420TBs. I'm reminded of the days of installing MS Office from 30 odd floppy disks. How things have changed. The Storinator "I'll Bit Back...up".

Love the video and the channel. You packed a lot in this one, as usual. Wondering why you went with Proxmox on Bare Metal and then TrueNAS virtualized? Seems like you could put TrueNAS on the bare metal and just run Windows and Linux VMs under TrueNAS?

@maighstir3003

Жыл бұрын

That was covered in an earlier video, "Jeff and Dave: The Big NAS Crossover Episode [Craft Computing]". Basically, while TrueNAS _can_ do virtualisation, that is not its intended use case, and it's not optimal for that. Proxmox' sole task is to act as a bare-metal hypervisor and the UI is built to simplify that task.

@SyberPrepper

Жыл бұрын

@@maighstir3003 Thank you. I found the video. Great information.

never bought a LTT bottle but if there were a "Dave's Garage" equivalent I'd buy it day one, point to it often and say "yeah this dude coded the original task manager"

@DavesGarage

Жыл бұрын

You can buy a mug :-)

@yourfriendwill

Жыл бұрын

@@DavesGarage done! I'd tag you but I suspect that's not a youtube thing, so just know that by the end of the month I'll be enjoying my coffee in your mug and explaining to both my cats - and anyone else who will listen, even odds on my wife - the significance of it. thanks man, love your stuff

A few years back, I was seriously into video production as well. So I completely felt your pain when describing why you need the storinator. For various reasons though, I am no longer doing video production, and it's a good thing too. It was close to a full time hobby. I am not autistic, but because I am an engineer, I had the aptitude to go down the endless rabbit holes associated with hardware and software. It was never ending to be honest, like I was chasing my tail, or in search of some holy grail that nobody, not even me, could accurately describe.

@123sleepygamer

Жыл бұрын

Meanwhile, me; >Takes an old HP with an AMD Athlon 2 X4 645, 18GB RAM, and a 'business class' ATI Radeon R7 250. Pile as many old 2TB HDDs in it as I can and SSD for OS. Slap OpenMediaVault 6 on it. Throw it behind the dresser. Profit. Thankfully, I just needed a simple DIY NAS for backups and being a media server. I don't even use Plex. I just run DLNA on OMV, works like a charm. You sir are the people that find those problems nobody else would, that would go unsolved otherwise. I don't have that level of patience, respect.

thanks for lesson :)

great episode!

Hola Dave! Love this session. What is the timeline you expect 420TB to hold you?

Great video Dave, I dumped storage spaces and switched to TrueNas. Drives run nicely. Still working out spindowns unfortunately. I don't use my HD array all the time. Once a day, and I want WD 7200 spindown after 30 min of no use.

Love seeing the ocz revo. Mines been a workhorse as well.

Maybe I'm being paranoid, but I'd be concerned about the vibration from the compressor running, causing issues with the spinning rust drives. None the less, this is an awesome project and I enjoy your channel a lot. Congratulations breaking 285K subscribers!!!

@andrewfidel2220

Жыл бұрын

Perfectly valid concern considering you can cause a temporary lockup in large arrays by yelling at them.

@josephking6515

Ай бұрын

What about the dirty power with the compressor constantly cycling? That would concern me.

You might want to look into the PowerShell commands. It not only saves time, but also allows you to set custom settings for your storage spaces. The GUI doesn’t allow you to set many settings like number of parity drives, columns/stripes and tiering (available per GUI on Server) which allows you to set the equivalent of other raid modes. The GUI is ok for normal projects, but PowerShell is really needed for these kinds of systems.

@mrmotofy

Жыл бұрын

So what was the 64TB limit he hit?

@RonaldSchneiderGiebenach

Жыл бұрын

I only once tried out storage spaces. Couldnt get warm with the UI that tells you nothing what happens, I dont know how I would be informed that a drive failed. And if a drive failed, I wouldn't know which of the drifes is failed. It should really have a guided UI (mark disk as 1 and plug it in, and restart system, then disk 1 is inserted. Do you want to add another disk? That way in the event of the failure there would be the possibility that you know which drive was failing) In my test one drive failed and windows was trying to resync it for months qithout telling me. I am lucky I catched it by randomly opening the storage spaces UI...

I can share that long term storage spaces and JBODS can be a real bottle neck in an small office environment. Maybe it will work well for your usage, but we had constant performance issues when working with such a system when hosted by Rackspace. The biggest problem was random slow downs and a lack of expected performance. Various issues with HBA's, fiber cables, and even setting that Microsoft engineers helped with we never could get it stable. That was early storage spaces, hopefully the current version is better. Eventually we migrated to a new provider who privded virtualized storage on NetApp filers and unleashed the power we needed.

I'm drewling a bit too much almost to comment but wow that is a nice system.. And glad you finally came to your senses :) and used truenas and ZFS!!! :) Don't even want to know what the total cost of that system is... obviously wayyyy over the budget from most individuals.. Have fun with it and thanks for sharing! Oh and do not ever forget to safely backup your ZFS encryption keys... Losing them is losing all the data.

Flashing controller cards can be a bit of a pain. I don't blame you for dodging this. I had to do this with an LSI card to get my system to run in IT mode because it was configured for UNRAID. I'm still a fan of RAID 10 and quite pleased with my current set up.

That was fun FAST Dave

Granted a 14/15 wide raid 5 is nice. I think for a server based solution a raid 6 based raid is better. Allows for two disk failures. Small loss in overall user disk space for a host of other failure and failure performance benefits. Enjoy your videos. The technical depth of knowledge is great. Thank you.

@DavesGarage

Жыл бұрын

I'm thinking when I add the other drives I will split it into 8-wide ZFS2, but am not 100% sure yet!

Love the fact you reached out to Craft Computing, my two favorite creators working together, now you just need to work with Technotim too :-)

This is a 500 lvl class and I just passed the 101 lvl..... Great teachers inspire students. Thank you

Good job, even if you did push for Windows. I love the hanging mount, saves a lot of space in the closet.

Love this high end storage and networking content. Makes me want to upgrade every piece of equipment I have. 🤣💸💸💸💸

That fucking intro. LTT be shamed. XD So good. I love it.

@DavesGarage

Жыл бұрын

Thanks!