The Hardware in my Homelab, and the Open Source Software I use to run it all in 2023.

Ғылым және технология

I'm a bit behind on my video release this week, I've run into a myriad of issues in the last week or so. I updated my editing software to find it had a bug in it that was completely wrecking my workflow. I got that fixed, and then found that KZread hit me with a copyright claim on my intro and outro music that is Creative Commons licensed, and attributed in all of my videos since I started using it. So, I'm going to make my own music (as soon as I get a little time to do it). Might make an interesting video to use Ardour to do that - we'll see. Time has been on the limited side lately as well, but I'm working through all of those issues.
=== Links ===
Get the AwesomeOpenSource Merchandise
awesomeopensource.creator-spr...
Support my Channel and ongoing efforts through Patreon:
/ awesomeopensource
Buy Me a Coffee or Beer
paypal.me/BrianMcGonagill?cou...
=== Timestamps ===
00:00 Beginning
00:09 Introduction to my Homelab Server Setup
07:00 The Software That Runs on my Hardware
17:00 Where I started vs. Where I am today
22:13 Thank you to my Patrons over at Patreo
=== Contact ===
Twitter: @mickintx
Telegram: @MickInTx
Mastodon: @MickInTx@fosstodon.org
Try out SSDNodes VPS Services! Amazing Specs for incredibly low costs. I'm running a 32 GB RAM / $ CPU Server for only $9 a month! Seriously. FOr long term server usage, this is the way to go!
www.ssdnodes.com/manage/aff.p...
Get a $50.00 credit for Digital Ocean by signing up with this link:
m.do.co/c/a6a61ae55242
Use Hover as your Domain Name Registrar to get some great control over you domains / sub-domains:
hover.com/SHPaiirr
Support my Channel and ongoing efforts through Patreon:
/ awesomeopensource
What does the money go to?
To Pay for Digital Ocean droplets, donations to open source projects I feature, any hardware I may need to purchase for future episodes (which I will then give to a subscriber in a drawing or contest).
=== Attributions ===
Intro and Outro music provided by www.bensound.com

Пікірлер: 106

  • @maxdiamond55
    @maxdiamond55 Жыл бұрын

    Fabulous setup. I'm inspired by the wooden rack setup.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Thanks. One thing I didn't really show is that the shelves have gaps from front to back. This allows cooling to the bottom of the servers as well.

  • @codispatch6869
    @codispatch6869 Жыл бұрын

    Your home lab setup looks clean and beautiful 🙂 Thanks for sharing this video 🙏

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    My pleasure. Glad you like it.

  • @rguifa
    @rguifa Жыл бұрын

    Great setup, thanks for sharing!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    My pleasure!

  • @johnnyg3606
    @johnnyg3606 Жыл бұрын

    Excellent content mate, loving this channel!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Thanks, and glad you're here.

  • @kevinhughes9801
    @kevinhughes9801 Жыл бұрын

    Amazing setup thank you for sharing and the great vids so helpful

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    My pleasure.

  • @gabrielgrommeck2885
    @gabrielgrommeck2885 Жыл бұрын

    Loving all your content

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Thank you so much!

  • @marshall834
    @marshall834 Жыл бұрын

    I'd recommend Storj as offsite storage. It's S3 compatible and integrated into Truenas. Plus its open source and decentralized - I've enjoyed it so far!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Awesome! Adding it to my list of options to look into.

  • @Mikesco3
    @Mikesco3 Жыл бұрын

    I like I-drive for cloud storage, they've been awesome for years. They are very generously priced, keep daily snapshots and will mail you the data if you need it in a pinch and can't download it fast enough (you'll pay for shipping and the drives)

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    That is awesome. Added to my list.

  • @jetskisnowboardski
    @jetskisnowboardski Жыл бұрын

    Thanks for showing your setup! I got a bit curious. Do you ever need to spin up a ova or ovf? Since you only run Proxmox. I understand that you can convert them but it seems a bit cumbersome.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    No, I never use OVA or OVF. But, if I want to make a template in proxmost it's not hard, and can save a ton of time when experimenting.

  • @pecasuy
    @pecasuy Жыл бұрын

    Thank you for your time and knowledge, I loved your rack, I copied your idea, and I suggest that instead of velcro you use small magnets in each corner of the wooden lid, regards

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    What a great idea! Love it.

  • @2mustange
    @2mustange Жыл бұрын

    Great setup! Is there a reason you chose to use iSpy over ZoneMinder? I know you have covered both (I think?) so wasn't sure if there was a reason

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I found iSpy to be a bit less resource intensive. I didn't realize that the open source part of iSpy was actually in their plugins, and not the software only, but it's working well, so didn't want to mess with my setup at the time. I'm looking at moving back to Frigate, or maybe something else so I may have some update videos this summer.

  • @jeffherdz
    @jeffherdz Жыл бұрын

    That's cool ! Question: For running all of that power. What type of battery backup do you have? And how do you cool that rack down?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    My office is kept pretty cool, so the rack itself has no built in cooling. Each server of course has it's own cooling. The fans don't spin much past idle most of the time. Battery Backup is one I got off of Amazon that is just enough to let the servers shutdown nicely, won't keep the servers running, they just use too much power.

  • @TheAlgonmusic
    @TheAlgonmusic Жыл бұрын

    I really thought you would have a crazy hacker enormously rack of servers Amazing just a couple of them in a diy enclosure! Good for you ! You are the best What model is your production server ?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    My production server is a Dell R730-XD with 256 GB RAM and 2 CPUs with 12 Cores each.

  • @kennethodhiambo1803
    @kennethodhiambo180311 ай бұрын

    Hi. Great setup! What hardware are you running TrueNAS on?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    11 ай бұрын

    I believe it's a Dell R710 server with several large HDDs in ZFS Raids.

  • @heeelga
    @heeelga Жыл бұрын

    Nice little setup. I like the self build rack. When upgrading slowly like you do, one can honor the little things more imho. Something I noticed across many of your videos: your microphone sensitivity seems to be set too high, your voice is clipping pretty badly from time to time. Keep it up!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Yeah, I almost never use that lapel mic, so sorry about the audio there.

  • @sonictech1000
    @sonictech1000 Жыл бұрын

    Proxmox is the best thing since sliced bread. Currently I install it separately on Debian rather than using the official images but I may switch due to easier upgrades. I still use Virtual Box on my laptop.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Love Proxmox. it has been an awesome tool!

  • @chuxxsss
    @chuxxsss Жыл бұрын

    I really like your wooden box for your servers. Do you have the diameters for it?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Sure, w x h x l = 27 x 34 x 31 (inches). Not including the casters it's on. That's just the box itself. The shelves are not solid, but have gaps from front to back as well in 4 sections so air can flow under the bottom of the servers as well.

  • @chuxxsss

    @chuxxsss

    Жыл бұрын

    @@AwesomeOpenSource Thank you.

  • @dubas1974
    @dubas1974 Жыл бұрын

    I just backup to icloud my most important docs and photos but use local USB storage for backups. I have 16tb drives as a backup that I rotate out of a fireproof safe.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Nice. Yeah, I need to slim down what I want to backup tot he cloud for sure, but I'm also thinking I might can use URBackup with a friend in another location to backup my stuff, and they can backup theirs to my system.. kind of what Crashplan offered, but in a fully open source way.

  • @bluesquadron593
    @bluesquadron593 Жыл бұрын

    Only thing I miss is the high availability for essential services

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Indeed. It's one of those things where it can be done, but you need more planning and equipment to really implement it well. You have to consider power outages, internet outages, simple networking issues that arise, and so on. That's the value of things like Digital Ocean, where their infrastructure allows you to spread an application or service across multiple hosts in multipel data centers / locations.

  • @andyh3873

    @andyh3873

    Жыл бұрын

    I've got 2x DL360p, a Cisco Nexus 3064PQ and 2x custom built NAS/SAN boxes each running 8x drives linked up to an APC Smart-UPS 1500 with additional battery packs. Gives me around 50 mins continuing runtime of all of those components if the power goes completely..

  • @MichaelMcDonald2
    @MichaelMcDonald2 Жыл бұрын

    For your cloud backups, have you considered Linode?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I have. I'm thinking about a VPS provider with something like MinIO running the object storage, but just not decided quite yet.

  • @brainscott
    @brainscott Жыл бұрын

    Restic + Backblaze makes for a solid cloud backup solution

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Looking into Restic as we speak.

  • @Maleko48
    @Maleko48 Жыл бұрын

    have you checked out the new Latte Pandas and similar hardware making their way to the markets for low power nodes?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Not yet, but I’ll look them up.

  • @Maleko48

    @Maleko48

    Жыл бұрын

    the new LP Sigma model SBC is performant and well rounded considering its size and scope, if not a bit pricey. can't wait for the day they come down in price to something more reasonable or go on holiday fire sale. supposedly roughly equivalent to the newer framework laptops or Intel NUCs that target the 45watt power envelope and afford solid single thread performance 😁 win-win in my book

  • @il51diablo
    @il51diablo Жыл бұрын

    Sorry about your dad. All my condolences.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I appreciate it. It's never easy to lose someone, but he left me with incredible life lessons, and drive to learn, and be better.

  • @il51diablo

    @il51diablo

    Жыл бұрын

    @@AwesomeOpenSource THANKS. This is what I've been trying to do for a long time but I only have people who only take advantage of me and my family...

  • @grigoriks
    @grigoriks Жыл бұрын

    Hi, what if i need to use Windows for a work with CAD software including 3d graphics? Would it work properly and smooth on the server like yours? Or i need to look for other option? Thanks

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    The VM for Windows isn't the issue, but whether you can allocate a GPU to the VM. Proxmox does allow GPU passthrough, and using something on a Gigabit or better wired network with RDP would likely work fine. Not having the setup to test with, I'm making presumptions about a few things. If RDP isn't fast enough, you could try something like Steam Link (lots of videos on how to use it for Desktop Sharing, not just gaming).

  • @silversword411
    @silversword411 Жыл бұрын

    For anyone else looking for that Home Lab Dashboard that was 1/3 of your video. Dashy!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Yes, thank you. I do use Dashy! I talked about it in my previous videos on the Open Source software I use everyday.

  • @thunderslap7390
    @thunderslap7390 Жыл бұрын

    Geez mate I am in Australia and I got about $60 000 worth of racks and Servers, even a Sun with 128 Cores and about 1TB of Ram a monster connected via Optic to two old IBM Storage banks and a lot of Servers mostly 1U's I think the the Storage is about 48TB more or less. and even a set of 2 long range 30KM 5g backhaul wifi, the type with the dishes almost like Ubiquity. Anybody with a UTE, Pickup can get then free, no charge. The have been sitting in my shed on the farm for the past 8 years.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Well...if I were about 12,000 miles closer, I might just drop by. Maybe another Aussie will see this as an opportunity. Seriously though, you've got a really awesome set of stuff. What do you, or did you use it all for?

  • @dimitristsoutsouras2712
    @dimitristsoutsouras2712 Жыл бұрын

    Which VM /CT exactly is eating so much ram? From the names of them I can t figure it out.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    On my Aria Server the VMs will use all of the RAM allocated to them (they reserve that RAM) from the main system. CTs only use what they need, and then will grow up to what is allocated. So on my Ubuntu VM where I allocate 24 GB, it uses 24 GB from the full 256 Available. Inside the VM it shows what's actually in use by the OS.

  • @XSpImmaLion
    @XSpImmaLion Жыл бұрын

    Let me put up a question here that I think this community will be better able to have a good answer for... So, I did all the cabling for my apartment with Cat 5e cabling, and it was kinda harsh. The apartment came with cable TV coax routed to all rooms, but in a very weird convoluted way... For instance, in order for me to reach the living room TV, which is right next to the entrance door which has the utility box, the cabling basically has to pass all rooms of the apartment in order to reach it. Let's say for instance that the living TV is like some 10 meters from the utility box, I actually had to pass some 50 meters of cabling to there there because it goes all around the apartment before getting there. Not actual numbers, but just to give an idea. It's weird like that. And also, it was almost made to fit, they used very narrow conducts, and I think some of it collapsed or are kinda disconnected because it was hell to pass a guide... I basically had to pull all the coax cable to barely fit through the Cat5e ethernet cable. I've been thinking of upgrading speeds for a while now, but I just know a Cat6 cable will be basically impossible to pass through the conducts... My question is, in terms of pricing and how difficult it is, how feasible is it to wire optical through these days? I'm on fiber already, so I know you can pass things through the building to get here, but I have no idea on how to clamp these things, the different standards, how it behaves routing inside the apartment, and stuff like that. Anything to watch out for? I know there are some pretty reasonably priced routes with fiber optic ports, but I'm not totally sure if using those in a home setting is a great scenario... they are mostly sold for business, right? Thanks!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    What speeds are you looking to get? Wifi 6 is pretty fast, wireless, adn avoids all that cabling. Wired is great, but if it's inhibited, sometimes the wireless approach is better.

  • @XSpImmaLion

    @XSpImmaLion

    Жыл бұрын

    @@AwesomeOpenSource Hey Brian, appreciate the channel! :D Hmmm so, it's a bit less about speed, and more about reliability... I've got some interference here, reason why I wired everything. xD Both Wi-fi and Bluetooth are kind of a mess here, I guess too many people using wireless stuff around me. Willing to go through the hassle of passing cables, but I won't mess with the Cat5 cables just yet if the next step either can't go through or is just too expensive to bother... Really, I'm already fine with the speeds I have, it's just a bit of long term thinking since I'm retrofitting an old PC for TrueNAS Scale and changing things around a bit.

  • @plazmax
    @plazmax Жыл бұрын

    hi, How is the power consumption of your server cabinet, have you ever measured it? :)

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I haven't. I'm 100% certain it's a power-pig though. I'm looking forward to better server hardware built on low power stuff like Arm, and better arm support overall. I think it's headed that way, and it's exciting!

  • @plazmax

    @plazmax

    Жыл бұрын

    @@AwesomeOpenSource If you don't mind, can I ask you something from the e-mail address on your channel? Thank you

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Sure thing.

  • @coletraintechgames2932
    @coletraintechgames293211 ай бұрын

    Instead of the cloud, find a buddy that will let you put a server in the basement. Neighbor or parent or whatever. Pay them a small amount for electric, whatever. But that way your data is backed up and cost is cheap and you are in control.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    11 ай бұрын

    100% love that concept. I think just having the right software to make it simple and automated is key. For me, this is what Crashplan really did well.

  • @Glatze603
    @Glatze603 Жыл бұрын

    Hi, please make again a new video about how to install and configure netmaker... Would be great!

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I have 2 videos on doing this today.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Here's the link for one of them kzread.info/dash/bejne/imF2u6aSn7DFY9o.html

  • @mygamedeveloper
    @mygamedeveloper Жыл бұрын

    Is possible to make own personal or business purpose cloud hosting and object storage using Intel NuC mini pc we have 10 + mini pc powerful pc

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Sure, just takes a bit of work, planning, and time. But the tools to do it absolutely exist today.

  • @mambo7668
    @mambo7668 Жыл бұрын

    How you made those servers silent ?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    They aren't silent. I just did some post-processing on the audio so they wouldn't overpower my audio.

  • @varodaya
    @varodaya Жыл бұрын

    I've a problem in netmaker , I cannot connect all the nodes that I install the VPN on , do you know why ? Route table looks ok ,still I can't ping other servers from this node I installed

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    So, without more detail on how you've set it up it's hard to know for sure.

  • @varodaya

    @varodaya

    Жыл бұрын

    @@AwesomeOpenSource how to send you ?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Go over to my discussion site at discuss.opensourceisawesome.com and post in the #help-me-please channel. Someone, or I will take a look and see if we can help.

  • @oso2k
    @oso2k11 ай бұрын

    bia (second server) is an R610. It would have Xeon v3 or v4 CPUs if it was an R630 (not the Xeon E5645s that it has).

  • @AwesomeOpenSource

    @AwesomeOpenSource

    11 ай бұрын

    Thanks. I couldn’t remember exactly. It runs great still, no matter. Used it for testing on two new videos today. Just solid hardware.

  • @oso2k

    @oso2k

    11 ай бұрын

    @@AwesomeOpenSource Yup I had 6x R610s for a few years before I upgraded.

  • @drumer2142
    @drumer2142 Жыл бұрын

    You run all this equipment through just this generic switch ?? Do you have extra network equipment you did not show in the video maybe ?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Oh yes. I have a pfSense firewall, and several APs around my home, but that switch is the switch taking all of those things out to the rest of my network. It's actually been a good little Gigabit switch.

  • @drumer2142

    @drumer2142

    Жыл бұрын

    @@AwesomeOpenSource ​ Great Setup. Thank you for sharing.

  • @bogy5259
    @bogy5259 Жыл бұрын

    Why do you dont have all your server in a cluster?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I was setting them up for different reasons and different testing purposes, and just never went back to re-do them. I like how they run now. I may make a cluster with some different hardware one of these days.

  • @tokoshiro5
    @tokoshiro5 Жыл бұрын

    great, lets see :D ahha

  • @cheebadigga4092
    @cheebadigga4092 Жыл бұрын

    If Proxmox shows 100% RAM usage of a KVM guest, but the guest itself doesn't, then Proxmox simply allocated that amount of RAM to the guest. Meaning the guest is guaranteed that amount. Nothing to worry about.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Absolutely! My guest shows very little RAM usage in general, but the overhead view from the orchestrator (Proxmox) shows it in full use most of the time.

  • @RockNLol2009
    @RockNLol2009 Жыл бұрын

    No sound in intro?

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I explain in the description. KZread hit me with a copyright issue on the music I use. It’s Creative Commons music and attributed in every video, but now it’s suddenly an issue and they are taking forever to resolve it. So until I have time to sit and make a custom intro song, I’ll leave it silent. Sorry for the confusion, but thanks KZread and your not so smart AI stack.

  • @dmckrk
    @dmckrk Жыл бұрын

    Wood? Hmmm it certainly has some disadvantages when connected with some hot IT components. We all started with some funny ideas, but at some stage it comes out that you need real rack even for pi.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    I slotted the shelves, so there are gaps in the shelves that give air flow to the bottom of the servers, but really I don't run the servers hard enough to even spin their fans up beyond idle.

  • @alextekks
    @alextekks8 ай бұрын

    Noice

  • @AwesomeOpenSource

    @AwesomeOpenSource

    8 ай бұрын

    Thanks.

  • @michaelthomasross3251
    @michaelthomasross3251 Жыл бұрын

    Proton Drive e2ee

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Nice, and the pricing isn't too bad.

  • @kaspersergej
    @kaspersergej Жыл бұрын

    I love your content, but if you ever want to grow you need to tackle your bad audio situation.

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Working on it.

  • @TheTrulyInsane
    @TheTrulyInsane Жыл бұрын

    A server has no name

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    Mine do. Their name tags say Dell, but I call them by any name I like. ;-)

  • @TheTrulyInsane

    @TheTrulyInsane

    Жыл бұрын

    @@AwesomeOpenSource lol it was a loose reference, I know you spell it Aria.. but I was thinking of Arya Stark and the Faceless from Game of Thrones.. 'a Girl has no name'.. if you haven't seen GoT, probably a lost reference 🤷‍♂

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    @@TheTrulyInsane I totally missed that! Hahahaha

  • @AB-ns8ix
    @AB-ns8ix Жыл бұрын

    Give TarSnap a try, might meet your needs

  • @AwesomeOpenSource

    @AwesomeOpenSource

    Жыл бұрын

    looks interesting. I'll keep digging in. Thank you.

Келесі