FoxDen core

This is the monorepo to control the FoxDen homelab pretty much in its entirety.

router, router-backup and redfox can be rebuilt from a reset by mikrotik/configure.py, except for users, passwords, certificates and WireGuard keys and peers (the VPN portal manages the wg-vpn peers itself). The addressing plan (VLANs, VRRP addresses, router addresses) lives in nix/modules/lib/routers.nix. We still keep regular backups of those devices around.

Machines

BengalFox

• Locator: Rack; 2U, Supermicro chassis
• OS: NixOS
• CPU: Dual Xeon E5-2690v4
• RAM: 256GB, DDR4-ECC, 2400 MT/s
• Storage:
  • nix: XFS: RAID1: 2 * 2TB NVMe SSD
  • zhdd: ZFS:
    • RAIDZ2: 8 * 18 TB SATA3 HDD
    • metadata special RAID1: 2 * 1TB SAS3 SSD (partition)
  • zssd: XFS: RAID1: 2 * 3TB SAS3 SSD (partition)
• Network: 25GbE (SFP28; Mellanox ConnectX-6 Dx)

IslandFox

• Locator: Rack; Miniforum UM980 Pro
• OS: NixOS
• CPU: AMD Ryzen 9 PRO 8945HS
• RAM: 96GB, DDR5, 5600 MT/s
• Storage:
  • nix: XFS: RAID1: 2 * 2TB NVMe SSS
• Network: 25GbE (SFP28; Mellanox ConnectX-4 Lx USB4)

IceFox

• Locator: OVH
• OS: NixOS
• CPU: Xeon D-2141I
• RAM: 32GB, DDR4, 2133 MT/s
• Storage:
  • nix: xfs: RAID1: 2 * 480GB SATA3 SSD
  • ztank: ZFS:
    • MIRROR: 2 * 8 TB SATA3 HDD
• Network: 1GbE (no traffic limit)

RedFox

• Locator: Vultr
• OS: MikroTik RouterOS
• CPU: 1 vCPU "Intel high performance"
• RAM: 2 GB
• Storage: vdisk 50 GB NVMe SSD
• Network: >= 1GbE (max 3 TB traffic)

Router

• Locator: Rack; 1U, white MikroTik CCR2004
• OS: MikroTik RouterOS
• CPU: 4 core ARM64 "AL32400"
• RAM: 4 GB
• Storage: 128 MB NAND
• Network:
  • LAN: 25 GbE (SFP28)
  • WAN: 10 GbE (SFP+)

Router Backup

• Locator: Rack; 1U, black MikroTik RB5009
• OS: MikroTik RouterOS
• CPU: 4 core ARM64 "88F7040"
• RAM: 1 GB
• Storage: 1 GB NAND
• Network:
  • LAN: 10 GbE (SFP+)
  • WAN: 2.5 GbE (RJ45)

TODO: Not-yet automated update cycles

• Every GitHub release artifact download where upstream does not have a digest (likely big files, currently carvera-controller and njs/acme.js)
• ZFS Linux kernel lag-behind
• Kanidm version in nix
• Anything RouterOS

Notes

• zfs must be mountpoint=legacy
• DO NOT use /var/run, always use /run, or the entire OS explodes