Gotcha! I’ll keep it surface level for most of these applications too, I presume

I appreciate it! I’ll look for alternatives that are more open

I’ll run a 3-2-1 in time! for now, just getting server #1 set up is my starting point. I have a location for my offsite backup, too, so I think I’m set

Gotcha! I misunderstood, but that makes sense. I believe everything I listed is k8s/k3s compatible with containerd, so hopefully it’s pretty straightforward. I’ll stick that instead of docker for enterprise experience

Sweet! I’ll make sure I throw that in the mix, having a sync later for k8s would be so nice. I think I’m going to run k3s for now, since I don’t have a database style rack, though.

Good points! I’ve set up an Ubuntu server before, didn’t have RAID but passed through my drives and set up Jellyfin and Nextcloud storage in Docker containers using Portainer. Ended up nuking it to go for Proxmox running Ubuntu server + TrueNAS, but wanted to figure out if I could just as easily run full enterprise grade stuff.

I think I’d be capable enough to struggle my way through a working setup, and there seems to be fewer YT tutorials and stuff for this specific use case, but I still believe there’s enough documentation for each piece that I’d be able to get them connected in time.

Also, not to be too dependent on others, but it seems like between this and r/homelab, there’s a pretty good number of people who’d be able to help me find my way should there be one or two things that I just can’t get figured out.

Ahhh I get you. Seems like KeyCloak is great if you’re all in on Red Hat systems, but that Authentik would be a better choice for a wider suite of integrations.

Although I’m not sure jf moonlight itself runs in a container.

Pretty sure I can just pass it through when active, so I should be set and not have to split (I believe)

I really want to use HashiCorp Vault for the resume experience, several companies I know use lots of HashiCorp products so while I’m sure it’s clunkier I think it’ll be worth the learning curve

I’ll probably go with KeyCloak since it seems to be the standard enterprise solution, and it’s a Red Hat developed tool so +1 for FOSS. Having SAML experience should also be a good resume boost for me

That’s more for being able to say I have professional CI/CD experience, I was told that’s crucial for landing a DevOps Engineering role

I may be misunderstanding but aren’t k3s a container orchestrator? as in docker containers managed via k3s? So I’d have to use both, and probably eventually set up a shared GPU. For the time being, I’ll likely just run without Moonlight until I feel comfortable getting another card or splitting it

Absolutely sick!!! Love this so much. I’m on a journey to have my own homelab via a k8s setup so that I would have project experience and qualifications for a DevOps engineering job. I’ve also seen people use LocalStack to essentially emulate AWS and set up homeland via LocalStack and k8s to get project experience. That’s next up for my list!

They’re contractors, I’m supposed to approve/deny said contractors

Thank you! Will look into this

They don’t have huge clients, just a steady flow. 3 locations due to small 5-7 person groups per office instead of one big office. Tbh idk why they do it like that lol

Kinda, kinda not? The lawyer who owns the firm really wants new Ai features and asks about stuff all the time, but he doesn’t necessarily have a specific goal, rather, just gives times to create automations with reports or whatever

That’s what I was thinking, they were saying that a 5070 Ti would be good enough for “whatever Ai automations the firm wants to build” which is where I was calling BS

That’s what I was thinking too, I’m pretty sure just using the API for those models or a VM with a GPU like you said would be the only viable options

I’m not an expert at all, I’ve never built out an enterprise system before so that’s why I wanted to verify.

I know you can run really small models on some 16gb VRAM cards, so I didn’t know if people use tiny models for very basic automation systems or something. I haven’t heard of that being viable but wanted to sanity check myself