Eight Gaming PCs in a 1U Server - Cloud Gaming Server Part 16
Ғылым және технология
Visit Porkbun today, and get any niche TLD from .ai to .xyz, with prices you won't see anywhere else. Plus support is all US-Based in Portland, OR. Thanks to Porkbun for sponsoring this video. Click the following link to get $1 off a new domain today bit.ly/3UDhAKD .
Microcenter is the place to find all your PC hardware under one roof, or order online at Microcenter.com.
New Customers Exclusive - $25 off all processors micro.center/yyq
Submit your build to Micro Center’s Build Showcase: micro.center/7vd
Check out Micro Center’s PC Builder: micro.center/lm9
Samsung 980 Pro 2TB SSD: micro.center/qzs
WD Black SN770 2TB SSD: micro.center/k5a
Ah, the return of my Cloud Gaming Server series. This time, we're cramming three nVidia Tesla GPUs, two CPUs, 8TB of SSDs and 256GB of DDR4 RDIMMs into a 1U rackmount server, all to run EIGHT gaming VMs at the same time.
But first... What am I drinking???
Kla3 from my Patreon server sent over some Norwegian goodness in the Nøgne Ø Imperial Stout. Definitely a stout like no other... rich and thick, but with a flavor profile closer to figs and cinnamon rather than dark chocolate and coffee.
Links to items below may be affiliate links for which I may be compensated
Set up your own vGPU Server with Proxmox and nVidia GPUs: • Proxmox GPU Virtualiza...
iSCSI Configuration for Game Libraries: • Use your NAS as a Stea...
ZFS DeDuplication in TrueNAS: • ZFS Deduplication in T...
Private Cloud Gaming - Parsec and Moonlight: • Private Cloud Gaming -...
Check out the parts from today's build...
1U GPU Servers: ebay.us/BtwxUr
HPE 32GB DDR4 REG-ECC 2133: ebay.us/MAJyvc
nVidia Tesla M40: ebay.to/3DlPPxu
nVidia Tesla M60: ebay.us/A4C0Zz
4x NVMe m.2 Adapter (require PCIe bifurcation support): amzn.to/3DORY7x
Grab yourself a Pint Glass or Hoodie at craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
The following music was used for this media project:
Music: Disco Of The 70’s by Frank Schroeter
Free download: filmmusic.io/song/8298-disco-...
License (CC BY 4.0): filmmusic.io/standard-license
Artist on Facebook: / frank.schroeter.52
No Good Layabout by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license
Пікірлер: 297
I am glad your channel has found success, so that we can continue getting content like this.
Interesting to see Pork Bun buying sponsorships. Bought mine from them over a year ago and just renewed. They are cheaper than cheap.
@majstealth
Жыл бұрын
you rent it, not buy
@SparJar
Жыл бұрын
@@majstealth "YoU rEnT iT nOt BuY iT"
@sonicalstudios
Жыл бұрын
😆
@parkerlreed
Жыл бұрын
Same. Have a handful with them. No issues.
I know that I will never ever set something like this up. But, the possibilities of the hardware and the setup is what is cool!
"so far so good' joke was on point! I love that you're building on all the other videos and just linking back for tutorials.
@CraftComputing
Жыл бұрын
On projects like this, there's just SO MUCH to cover. One of those tutorials by itself is nearly 40 minutes, so no way I could cover it all in this video :-) Plus, I like getting clicks.
Okay, that intro competes with the Manscaped video for best ad
I can't believe how powerful this Hyper-Visor is. An amazing case study, a fantastic demonstration and proof of concept. Giving you all the virtual thumbs I can brew. Great job, thoroughly entertaining and informative! Cheers 'tink'.'tink'
Outstanding, I'm glad you're sticking with this.
Had to rewind and take a second listen when you said you put the 2 drives in TrueNAS into a raidz1. For those who may not be well versed in ZFS or TrueNAS, it was a zfs Mirror, not a RAIDZ1. I love your content so much, always such great ideas and helpful ways to set things up!
@andrewr7820
Жыл бұрын
Yep, RAIDZ1 is akin to RAID5 (also which not a great idea since long ago with drives getting huge). If you must, RAIDZ2 (2 parity recovery members). I prefer striped mirrors (like RAID10). Much easier to extend existing arrays (no backup, destroy/reconfigure/restore) - just add a new mirror ZVOL to the array and -- done! (There's lots of good info on TrueNAS and ZFS over on Lawrence Systems channel.) Like here, the signal-to-noise ratio is very good, unlike LTT seems to have become (with the exception of ones with Anthony).
Fascinating stuff - was great fun see all the instances of Crysis running at the same time. Would for sure call this project a win !
I wonder if you'd get better deduplication efficiency if you set the volblocksize of your zvols be the same as the cluster size of the FS you format them with. BTW, what are the values for your setup? The default volblocksize is 8kB, I think, whereas the default NTFS cluster size is 4k. I would suggest setting both to 16kB to cut down on the metadata overhead. Jeff, do you feel like giving it a try?
@CraftComputing
Жыл бұрын
That's a great idea. In a quick setup like this, I've left everything at the defaults (8K in ZVOL). I'm working on some testing methodology to start sussing some of this out.
I would still would love to see you do a cloud video editing or similar variation on this eight games one PC idea
Porkbun are great! I bought my domain there a few years ago and I recently renewed it with them, they are cheap and the service is great.
Love the cloud gaming! I'd really like to see a... public cloud / private cloud deployment with a self service portal with vGPU support. It's been something I've worked on before and would love to see your rendition of it.
Fantastic video!! Keep the great content coming
That intro was fuckin hilarious.
I love these videos, I usually aim for quite stuff now a days though
That intro skit OMG Soooo hilarious!! Cool video too.... my maaan!!
@CraftComputing
Жыл бұрын
Aw thanks bro
Don't you just love it when Papa Jeff talks tech ... Gets your bits all messed up in a cluster of ones and zeros. Someone defrag me before I toss an error code or BSOD 😂
Your shirt in the inro... White-Orange Orange ..... LMAO... I have always mumbled to my self while making RJ45 connections ALmost singing it on each line... I've done this for soooooooooo many years that back in 2000 in Highschool in the newly formed "Computer Tech" class, we learned out to make our own Cat5 cables. I know your shirt if right with WHITE-Orange, but i've always had it drilled in my head as the colors first as it helps me remember and sing my little tune. Orange-white Orange Green-White Blue Blue-White Green Brown-White Brown
Thanks to your series, I've been able to build my cloud gaming server PowerEdge R720 with 128GB of RAM, 2x Xeon E5-2697 V2's, and 2x TESLA K80's. My Operating Systems run locally on a NVME drive, however all my steam library games run off TrueNAS VIA iSCSI with zfs de-dup, which was also the result of one of your videos. I really want to upgrade to M60's but they're very expensive right now.
@Darkk6969
Жыл бұрын
I just looked around for M60s on ebay and it's too much for me to spend on one right now. M40 as an experiment is good enough for me to try.
@corbinxtitus
Жыл бұрын
@@spicylemon53234 I didn't. I'm using the Dell redundant SD card module for boot.
Intro was so funny almost made me cry thanks guys
Very cool glad you got this working
Fun! This is what playing with hardware is all about.
I'm really wanting to do this exact project! But I gotta get the necessary hardware to do so. I'm close to getting it tho!
what a legend. nice project.
Great! I love this setup
I've never heard of porkbun will definitely check them out.
Oh my god you were right... the pork bun ad spot. God that tickled a good side this morning.
I have a system with an HV paravirtual guest that I share with my lady. For storage, we both connect to the same SMB TrueNas share for the Steam library. It works very well as we have a 10 Gbit link back to the shared storage. Since Truenas has 128GB of ram with l2arc as well, all games run off the storage flawlessly.
Freakin space ship man. Gotta get into this server building thing. Sure messing with laptops is cool and fun. Certainly building a pc tower from the floor up is great. But geez dude 😅 the server thing looks amazing. Had to subscribe.
Love the flash back shirts!
hahaha the intro was pretty damn good!
This is essentially the perfect hardware target for roughly 30 years of videogames. With a rom library AND a PC gaming library you could categorically load and stream 8 instances of humanities videogame history (or at least the "top hits") from 1980-2010. Some of those instances could feasibly handle multiple players on older multiplayer titles OR indie titles.
@greenprotag
Жыл бұрын
Given that older roms are so small and quick to load, you could offload THAT library to a NAS.
@mycosys
Жыл бұрын
pretty much perfect for the computer games that came before that too - most of them were terminal based and ran on mini/mainframe systems this would have no trouble emulating
Best series on KZread
@CraftComputing
Жыл бұрын
I think I'm in 4th place. 1) Colin Furze Tunnel 2) JerryRig Electric Hummer 3) ALCH Apartment Renovation 4) Me
@tynenharris1256
Жыл бұрын
@@CraftComputing personally this series is the best. I would love to see a practical 2 gamer one system cloud machine. But the real question is how much do you use your cloud gaming system??
Just had my own board meeting before watching this……That ad is hilarious
Just imagine what 180W of fans would sound like. You could just use your server as a leafblower now that we are getting into fall
@neosmith80
Жыл бұрын
i wonder if they would be any better using some noctua fans?
@andrewr7820
Жыл бұрын
Ear protection required. Those things are like a leaf blower straight into your ear. Built like tanks though...
That was a great sponsor plug 😂
Love your content, it is both chilling while informative, hope this kind of things reach out to more people so other tech youtuber can also try it for as niche this sadly is.. I know this is a rather unrelateable thing to ask, but can you do a showcase of gpu passthrough on gaming laptops? I am looking to build like a unified setup, therefore i don't know if it'd be worth to have gaming and workloads to both in and out of my house. Or else just a desktop pc with linux and some vms to work/gaming at home and provide the cloud and a laptop to access it on the cloud and just work/game otg. Keep up the great work :)
Used your tutorials to create a remote gaming VM within Proxmox, setup iSCSI to said VM and other PCs, and some other things regarding Plex all using HP Z840s.
"Crysies Machine", LOVE IT!!!!
Awesome video! I think Crysis Remastered has benchmarking tools. You could get some numbers out of that.
Jesus wept, another S tier sponsor spot!
That grin @17:32 when playing eight instances of crysis at the same time.
The best part is the detailed of whiskeys on your shelf in the now and before section
This is legendary
Watching the Build Montage gave me Mr Roger's Neighborhood vibes idk why 🤣🤣
I enjoy learning from the information that you put out there. I was wondering if it is possible to have multiple windows OSs in the DeDup? Or will that not work? Or does each Windows OS VM need it's own non-DeDup zvol?
Ok, I'm sold. I'm gonna do this soon. They make a 24Gb version of the M40. did you choose the 12Gb because there isn't enough GPU to split?
Thanks for all the great videos :) I would like to know more about "Thin Client" or whatever they call it. If I wanted to make a server for my 2 boys so they could game on it, which "Client" should I use and what are the requirements for them if they want to be able to play at 1440p?
pretty cool Jeff, I have been following you for the last few years. Also it would be pretty cool if there were a way for you to control all 8 instances simultaneously.
Amazing video, thank you. Would this be applicable to a LAN set up? I.e. 1 machine with 8 separate players stations. How would the displays and keyboards/mice work? Would be amazing if you could do a video for this to!
Craft on any of your x79 adventures did u have psu coil while happen when using a sata ssd doing random things? It might just be my board and psu
What are you using to tile all the moonlight windows? I’m trying to do something similar to basically build an “Xbox” based around a bunch of windows VMs
thank you good sir
This makes me curious, is there a way to use a mining rig (or making a similar setup) of just multiple GPU's buy for gaming rather than mining? I have a bung of older GPU's that I would love to do something similar to this with.
Awesome seeing you get a win at last. I look forward to the LAN video ;P
Are there any issues with anti-cheat in a system like this? IIRC Linus abandoned his network gaming server project because of that.
They need to pay you well for that commercial. Very funny
This is amazing, is a complete walk through video coming?
@CraftComputing
Жыл бұрын
Full tutorials are linked in the description for everything you see here.
@3k3k3
Жыл бұрын
@@CraftComputing thanks for your tireless efforts to make these videos, i did try the vGPU / Proxmox video you linked above and must admit that i sadly failed, both times :-) Then i went with the Hyper V approach and that seems much more promising, but admittedly doesn't feel as "cool" as the proxmox stuff. As you i have been hunting for a VDI solution since the "dawn" of computers and with the new streaming clients that uses the NVENC hardware we are finally getting there but what really confuses me is that the nvenc streaming tech isn't just a native the host that the virtual machines run on...
I need to follow along with this eventually. I've wanted to make a gaming server so I can play games on my (non-gaming, fully arting) laptop without issues on the go. It would have been nice to have a total cost listing for a generalisation on what people looking to follow along can expect to pay. I get with eBay it's a bit of a crap shoot. Your $20 Tesla M40 may be $2000 for the next guy. But generally it gives an expected project value from $2k to $20k.
This might be the longest series on KZread and I love it
This takes the question, "But can it play Crysis?" to a whole new level.
I need that RJ45 wire layout shirt 😂😂😂
@CraftComputing
Жыл бұрын
vkc.sh
Awesome!
I managed to setup vgpu follow your guide. but when trying to export video in Pr, it said no available video card. Any tricks that I can do?
How did you get the vgpu driver from nvidia? I tried making an enterprise account with them, but it seems as though they just ghosted me.
This rocks
Excellent 👍👍👍👍👍👍👍👍👍
That opening add 💀💀💀 Jeff lookin like Sammy Hagar 😂
This was my first time watching you and I subbed during your in video ad, that's a fucking first for me . Love that you even changed your booze for the skit when you recalled the past lmao. Bunch of stoners, loved the vid.
Imma buy a few more beer glasses because of that opening. 😂
@CraftComputing
Жыл бұрын
Check out the new TOS shirts too ;-)
@RichardSwift
Жыл бұрын
@@CraftComputing Will do, love your content.
By anychance can you link the GPU power cables that you are using I am having a hard time finding them off ebay?!
[FitGirl Repack] 13:38 I died 🤣🤣🤣🤣🤣🤣🤣
Wondering if the NVME SSDs were not actually heavily loaded by all 8 instances, since most of the data that the Cryses needed for that first level were only read ~once (because of dedup) and therefore cached in RAM for the other instances. Could turn off dedup and reinstall Crysis to test.
@Darkk6969
Жыл бұрын
The reason for the dedup is to save on disk space not for performance. Would love to buy several 4TB NVME SSDs for ZFS raid but too pricey at the moment.
@spagamoto
Жыл бұрын
@@Darkk6969 I understand. I'm just saying the performance test in this video might not perfectly match reality if the machines are loading different levels.
I was wondering if you could run say Star citizen or Tarkov in a VM with kind of maxed resources?
I'm looking to put together a home, rack, gaming server together just for the server, to connect to, not to game directly from. Being new at this do you need graphics cards when all the server is doing is processing incoming player computers ? I've been surprised at how little i've been able to find about making gaming servers when it's not an old PC / Laptop you are converting. Anything would be a great help.
Out of curiosity, would Tesla P4 cards work with this build, and if so, would it be considered a worthwhile upgrade? I recently watched the P4 video and it would seem that those cards out perform by quite a bit.
Where did you get Nøgne Ø beer? I’ve only seen it in Norway.
Is it possible to use your mouse and keyboard to play on all instances simultaneously? If there is some way you could benchmark it.
@andrewr7820
Жыл бұрын
You can use Barrier. Its a open-source fork of an older (now commercial?) app called Synergy. It allows you to have a single keyboard and mouse controlling an arbitrary (and heterogeneous) collection of network-connected machines which each have their own locally attached display. The mouse controls the keyboard/mouse input "focus", much like pressing a button on a hardware KVM switch. When setting it up, you designate one machine as the "server" and the rest as "clients" and describe the positional relationship of the "client"(s) screens relative to the screen of the "server" (right-of, left-of kind of thing). You can use it across an arbitrary mix of Linux, Windows and Mac machines seamlessly. Highest recommendation.
Could you use consumer gpu like an rtx 3070 instead of the tesla’s?
How do you handle Windows Licensing? MSDN/VSS? Also, KZread has been around long enough that watchers know where the links are and pointing to "the usual spot below" isn't required.
yo i need some help,,, should i get 1x p4, or 2x m40 (12gb) for just a bit more?? looking for somewhat hassle free cheap cloud gaming.
Is it possible to play multiplayer between all of the VMs?
Great video. How loud is the server? I imagine even though its passively cooled the case and PSU fan's would be quite loud due to their diameters?
@CraftComputing
Жыл бұрын
If you have to ask how loud it is, you've never been around 1U servers ;-)
@bdhaliwal24
Жыл бұрын
@@CraftComputing Yeah I guess I will keep searching for those unicorns.
I'm a fan of all self hosted cloud gaming videos you put out there. Question: What's encoding the video? H.264 cpu encoding? NVENC? Does this cards support several nvenc simultaneous streams?
@max_uaminecraft1827
Жыл бұрын
It encodes with nvenc, CPU encoding would have horrible latency. That is why he failed with some other GPUs, cause they didn't have an encoder on them
What would be the best way to connect remotely to these VMs? Lowest latency and best performance. I mean, if I have a powerful workstation and I want to run proxmox with 3 VMs for 3 people on a local network.
can you tell me how you use dedupe with iscsi? like if its 4 x 1tb its still allocating 4tb (it may show as 'deduplicated' but its still 4tb). do you use slim provisioning or something? sorry im new to this.
@cts006
Жыл бұрын
I think Jeff has a video on dedup where he went into more detail on setting up dedup for an iscsi steam library.
@kingmorons
Жыл бұрын
@@cts006 ah yes ive watched it before. I watched it again and was using a new zvol target when i was just using a file and thats where i went wrong
interrestung you using sata drives, this means you using a standad SAS controller? or can you use nvme on this system too? if yes why you dont buy a adapter bord thats hase the size of a 2.5 inch drive and has on its self a m.2 connector for nvme drives if you want fast drives
Would a cloud gaming server like this be able to handle cloud VR on the Quest (or Pico)?
@CraftComputing
Жыл бұрын
Don't beat me to the next video on it ;-)
@TheAceWolfe01
Жыл бұрын
@@CraftComputing ah, apologies. 👍
I Loooooove that custom 45 Drives storage.
@CraftComputing
Жыл бұрын
ME TOO!!!!!
where can I find a NVIDIA driver for the guest VMs that doesn't require a vGPU license?
I'm wondering how to go about connecting eight monitors, eight mice, and eight keyboards to this server. Could you provide guidance on the process?
Time to start running an old WoW or Diablo Multibox setup for that sweet loot
i want to do this with something like retroarch so ppl can log in and play games remote but i only have to have xyz space taken do you think that is possible?
Wondering if it is possible to deal with the GPUs in a completely different way - having multiple GPUs for a single gaming VM instance? Using two M40s or P40s could bring some real performance if the thing scaled well. I remember that we used to have SLI/Crossfire in the consumer grade PCs, but I guess it is not the thing anymore.
Hi folks, is it possible to do the vGPU stuff on a linux KVM, for Plex?
I have a question that is a little off the topic. I want to be able to vpn into my home network when I am out of town using my macbook. I do not know what to setup in order to accomplish this. I have a proxmox host server and can setup a ubuntu vm. what do you suggest?
@andrewr7820
Жыл бұрын
You might try pfSense (open source router).
Cool set up. I would of liked to hear about that vgpu rust unlock script?
@CraftComputing
Жыл бұрын
Link in the description to the full tutorial ;-)
How does this do for newer games? Also, is it possible through UnRAID? Been thinking of giving it a try at some point, but also constantly looking at all options
Does your m.2 AIC require 4x bifurcation or does it have a pcie switch?
@CraftComputing
Жыл бұрын
Yes, this is a 'dumb' adapter.