Files
Tony0410 77250ea8c9 incident: SFTPGo outage 2026-09-02 — CT299 tailscaled death + stale lxc-attach recovery
- New incident page documenting CT299 SFTPGo outage (02:18 AWST)
- Root cause: swap exhaustion (43Gi, 100%) killed tailscaled; 5 stale lxc-attach PIDs blocked pct start
- Resolution: killed PIDs 3037951/3334928/3352203/3402511/4004148, pct stop/start 299
- Updated current-state.md with Recent Changes (2026-09-02), bumped updated to 2026-09-04
- Updated log.md with incident entry
- Updated index.md last-updated date

No secrets written. Verified end-to-end: tailscale direct, SFTPGo WebAdmin HTTP 401, SFTP banner SSH-2.0-SFTPGo_2.7.0.
2026-09-04 00:05:32 +08:00

73 lines
3.3 KiB
Markdown

---
title: Proxmox VE
type: infrastructure
status: active
created: 2026-07-26
updated: 2026-08-13
confidence: high
tags: [proxmox, virtualization, infrastructure, homelab]
---
# Proxmox VE
## Purpose
Hypervisor hosting all VMs and LXC containers for the homelab.
## Details
- **Host:** `pve.kangaroo-eel.ts.net` (Tailscale: `100.96.100.82`)
- **Node name:** `pve`
- **Version:** Proxmox VE 8.x
- **Primary user:** `Anthony@pam` (full admin)
- **Additional users:** `root@pam`, `glance@pve`, `prom-exporter@pve`, `homepage@pve`
## VMs (QEMU)
| VMID | Name | Status | Purpose |
|---|---|---|---|
| 101 | debianvm | destroyed | Debian VM — destroyed; services migrated to CT200 |
| 100 | homeassistant | running | Home Assistant |
| 282 | ubuntu-server-xfce | running | Ubuntu desktop — Sunshine, Kubuntu |
| 403 | open-claw | running | OpenClaw agent |
| 401 | hermes-old | stopped | Legacy Hermes VM (deprecated) |
## LXC Containers
| VMID | Name | Status | Purpose |
|---|---|---|---|
| 200 | docker | running | Main Docker host — 42+ containers |
| 201 | runtipi | running | Runtipi — Homepage, ntfy, etc. |
| 205 | ollama | running | Ollama LLM inference + Guanaco proxy (v0.8.14, updated 2026-08-14) |
| 207 | webserver | running | Web server — Vercel AI, manifest router |
| 215 | n8n | running | N8n automation |
| 221 | gitea | running | Gitea git server |
| 241 | ntfy | running | Ntfy push notifications |
|| 245 | openweb | running | Open WebUI (Jul 30 updated, memory 4096 MB) |
| 255 | mattermost | running | Mattermost chat |
| 260 | freshrss | running | FreshRSS feed reader |
| 270 | nextcloud | running | NextCloud |
| 299 | sftpgo | running | SFTPGo file server — security review 2026-08-09: connects as root, unpinned fingerprint, `//` root path. **Incident 2026-09-02:** tailscaled inside CT299 died; PVE pre-start hook then failed because stale `lxc-attach` PIDs pinned the cgroup. Cleared stale PIDs (3037951/3334928/3352203/3402511/4004148), `pct stop 299 --skiplock` + `pct start 299`. Restored, tailscale direct 192.168.178.92:41641. CT299 swap is over-provisioned (43Gi swap fully used at 24Gi/31Gi RAM) — consider reducing swap or trimming workload. |
| 310 | monitoring | stopped | Monitoring stack (deprecated) |
| 333 | clawtest | running | ClawTest — Nanobot, Zeroclaw |
| 450 | hermesagent | running | Hermes Agent LXC |
| 460 | hermes | running | Hermes CT460 |
| 465 | qwenpaw | running | QwenPaw LLM |
| 500 | litellm | running | LiteLLM proxy |
| 555 | elementsynapse | stopped | Element Synapse (deprecated) |
| 600 | omniroute | stopped | OmniRoute model router — retired 2026-08-13, migrated to CT601 |
| 601 | omni | running | OmniRoute model router — successor to CT600, since 2026-08-13 |
| 103 | cliproxyapi | running | Cliproxy API |
| 104 | rclone | running | Rclone sync |
| 106 | glance | stopped | Glance dashboard |
| 209 | cloudreve | stopped | Cloudreve (deprecated) |
## API Tokens
- `homepage@pve!homepage` — PVEAuditor role, privsep=0 (used by Homepage dashboard)
## Key Paths
- `/etc/pve/` — PVE config directory
- `/var/lib/vz/` — Local storage
- `/etc/pve/priv/token/` — API token storage
## Related
- [[systems/homepage-dashboard]] — Dashboard shows PVE stats
- [[infrastructure/hosts]] — Full host inventory
- [[infrastructure/network-map]] — Network topology