Anthony/agent-estate-wiki
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

incident: SFTPGo outage 2026-09-02 — CT299 tailscaled death + stale lxc-attach recovery

Browse Source 
- New incident page documenting CT299 SFTPGo outage (02:18 AWST)
- Root cause: swap exhaustion (43Gi, 100%) killed tailscaled; 5 stale lxc-attach PIDs blocked pct start
- Resolution: killed PIDs 3037951/3334928/3352203/3402511/4004148, pct stop/start 299
- Updated current-state.md with Recent Changes (2026-09-02), bumped updated to 2026-09-04
- Updated log.md with incident entry
- Updated index.md last-updated date

No secrets written. Verified end-to-end: tailscale direct, SFTPGo WebAdmin HTTP 401, SFTP banner SSH-2.0-SFTPGo_2.7.0.
This commit is contained in:
Tony0410
2026-09-04 00:05:32 +08:00
parent 1d42c6bc83
commit 77250ea8c9
13 changed files with 746 additions and 507 deletions
Download Patch File Download Diff File Expand all files Collapse all files
infrastructure/proxmox.md
+2 -2
View File
@@ -23,7 +23,7 @@ Hypervisor hosting all VMs and LXC containers for the homelab.
## VMs (QEMU)
| VMID | Name | Status | Purpose |
|---|---|---|---|
| 101 | debianvm | running | Debian VM — Portainer, filebrowser, code-server, Sunshine |
| 101 | debianvm | destroyed | Debian VM — destroyed; services migrated to CT200 |
| 100 | homeassistant | running | Home Assistant |
| 282 | ubuntu-server-xfce | running | Ubuntu desktop — Sunshine, Kubuntu |
| 403 | open-claw | running | OpenClaw agent |
@@ -43,7 +43,7 @@ Hypervisor hosting all VMs and LXC containers for the homelab.
| 255 | mattermost | running | Mattermost chat |
| 260 | freshrss | running | FreshRSS feed reader |
| 270 | nextcloud | running | NextCloud |
| 299 | sftpgo | running | SFTPGo file server — security review 2026-08-09: connects as root, unpinned fingerprint, `//` root path |
| 299 | sftpgo | running | SFTPGo file server — security review 2026-08-09: connects as root, unpinned fingerprint, `//` root path. **Incident 2026-09-02:** tailscaled inside CT299 died; PVE pre-start hook then failed because stale `lxc-attach` PIDs pinned the cgroup. Cleared stale PIDs (3037951/3334928/3352203/3402511/4004148), `pct stop 299 --skiplock` + `pct start 299`. Restored, tailscale direct 192.168.178.92:41641. CT299 swap is over-provisioned (43Gi swap fully used at 24Gi/31Gi RAM) — consider reducing swap or trimming workload. |
| 310 | monitoring | stopped | Monitoring stack (deprecated) |
| 333 | clawtest | running | ClawTest — Nanobot, Zeroclaw |
| 450 | hermesagent | running | Hermes Agent LXC |