Category: Homelab
The home network, the Proxmox cluster, storage, and everything I keep rebuilding.
-
I could restore every VM. I couldn’t rebuild the lab.
My guests had four tiers of backup. Every container and VM in
thefellowship, my three-node Proxmox cluster, went to a Proxmox Backup Server (in a VM on a NAS) every night. That copy was synced to a second PBS on a standalone box called gollum. A weekly copy went to a NAS share, and an office drive got a manual refresh now and then.So when I asked myself a simple question, I expected a simple answer. If the house burned down tomorrow and I had new hardware, could I rebuild the lab from my notes and backups alone?
Read more about I could restore every VM. I couldn’t rebuild the lab.
-
I tried for 25 hours to crash the box that kept freezing. It wouldn’t.
A few weeks ago I retired Thorin, a Lenovo ThinkCentre M90q Gen 3, from my Proxmox cluster. It had hard-frozen four times between 27 September and 6 October. Each time the power LED stayed on, the fan kept spinning, and nothing reached the logs. Balin, its twin, took its place. I wrote that up in Four freezes, no logs: retiring a Proxmox node without knowing why it died.
That post ended with the cause still unknown. memtest86+ had passed, so RAM was unlikely. What was left was the board, the iGPU, the power supply, or the workload. So I put Thorin on my desk with no guests and tried to make it freeze on purpose.
Read more about I tried for 25 hours to crash the box that kept freezing. It wouldn’t.
-
Cold Storage: From Manual to Automatic Backups
My files live on two Synology NAS units. The DS920+ is the one everything points at. The DS1621+ holds a second copy, kept in step by Synology Drive ShareSync. A change on one shows up on the other within a few minutes.
That’s good protection against a dead drive or a dead NAS. It’s no protection against me. ShareSync is a two-way sync, so a deleted folder, a bad script or ransomware reaches the second NAS just as fast as a good change does.
Read more about Cold Storage: From Manual to Automatic Backups
-
What my homelab costs to run: 337 W and S$76 a month
I priced my homelab in a spreadsheet, then checked each row against what was actually running.
The homelab’s devices draw about 337 W across 21 rows. After UPS losses that’s about 377 W at the wall, or 276 kWh a month. My rate is 25.39 c/kWh before GST, 27.68 c with 9% GST, so the homelab costs S$76.25 a month, about S$915 a year.
Read more about What my homelab costs to run: 337 W and S$76 a month
-
Homelab hardening, step by step: the commands
The exact audit I ran on my own homelab, in order, with every command you need to run it on yours.
In the first post I covered what to look for and in what order. This one is the toolkit. Every command below is one I ran, adjusted only to strip out my own addresses.
Read more about Homelab hardening, step by step: the commands