Files
agent-estate-wiki/infrastructure/proxmox.md
T
Tony0410 77250ea8c9 incident: SFTPGo outage 2026-09-02 — CT299 tailscaled death + stale lxc-attach recovery
- New incident page documenting CT299 SFTPGo outage (02:18 AWST)
- Root cause: swap exhaustion (43Gi, 100%) killed tailscaled; 5 stale lxc-attach PIDs blocked pct start
- Resolution: killed PIDs 3037951/3334928/3352203/3402511/4004148, pct stop/start 299
- Updated current-state.md with Recent Changes (2026-09-02), bumped updated to 2026-09-04
- Updated log.md with incident entry
- Updated index.md last-updated date

No secrets written. Verified end-to-end: tailscale direct, SFTPGo WebAdmin HTTP 401, SFTP banner SSH-2.0-SFTPGo_2.7.0.
2026-09-04 00:05:32 +08:00

3.3 KiB

title, type, status, created, updated, confidence, tags
title type status created updated confidence tags
Proxmox VE infrastructure active 2026-07-26 2026-08-13 high
proxmox
virtualization
infrastructure
homelab

Proxmox VE

Purpose

Hypervisor hosting all VMs and LXC containers for the homelab.

Details

  • Host: pve.kangaroo-eel.ts.net (Tailscale: 100.96.100.82)
  • Node name: pve
  • Version: Proxmox VE 8.x
  • Primary user: Anthony@pam (full admin)
  • Additional users: root@pam, glance@pve, prom-exporter@pve, homepage@pve

VMs (QEMU)

VMID Name Status Purpose
101 debianvm destroyed Debian VM — destroyed; services migrated to CT200
100 homeassistant running Home Assistant
282 ubuntu-server-xfce running Ubuntu desktop — Sunshine, Kubuntu
403 open-claw running OpenClaw agent
401 hermes-old stopped Legacy Hermes VM (deprecated)

LXC Containers

VMID Name Status Purpose
200 docker running Main Docker host — 42+ containers
201 runtipi running Runtipi — Homepage, ntfy, etc.
205 ollama running Ollama LLM inference + Guanaco proxy (v0.8.14, updated 2026-08-14)
207 webserver running Web server — Vercel AI, manifest router
215 n8n running N8n automation
221 gitea running Gitea git server
241 ntfy running Ntfy push notifications
245 openweb running
255 mattermost running Mattermost chat
260 freshrss running FreshRSS feed reader
270 nextcloud running NextCloud
299 sftpgo running SFTPGo file server — security review 2026-08-09: connects as root, unpinned fingerprint, // root path. Incident 2026-09-02: tailscaled inside CT299 died; PVE pre-start hook then failed because stale lxc-attach PIDs pinned the cgroup. Cleared stale PIDs (3037951/3334928/3352203/3402511/4004148), pct stop 299 --skiplock + pct start 299. Restored, tailscale direct 192.168.178.92:41641. CT299 swap is over-provisioned (43Gi swap fully used at 24Gi/31Gi RAM) — consider reducing swap or trimming workload.
310 monitoring stopped Monitoring stack (deprecated)
333 clawtest running ClawTest — Nanobot, Zeroclaw
450 hermesagent running Hermes Agent LXC
460 hermes running Hermes CT460
465 qwenpaw running QwenPaw LLM
500 litellm running LiteLLM proxy
555 elementsynapse stopped Element Synapse (deprecated)
600 omniroute stopped OmniRoute model router — retired 2026-08-13, migrated to CT601
601 omni running OmniRoute model router — successor to CT600, since 2026-08-13
103 cliproxyapi running Cliproxy API
104 rclone running Rclone sync
106 glance stopped Glance dashboard
209 cloudreve stopped Cloudreve (deprecated)

API Tokens

  • homepage@pve!homepage — PVEAuditor role, privsep=0 (used by Homepage dashboard)

Key Paths

  • /etc/pve/ — PVE config directory
  • /var/lib/vz/ — Local storage
  • /etc/pve/priv/token/ — API token storage