stocktake 2026-10-14: SECOND Proxmox host m93p (100.104.51.98, PVE 9.2.0, unclustered, IDs collide) discovered — gitea/ntfy/freshrss/openweb were never on pve; tailnet inventory rebuilt 30 -> 45 nodes (15 missing); VM 282 running; Camofox recovered to 29.9M
skills-index 346 skills / 70 cats; freshness 48 stale / 38 fresh / 7 no-date of 93 pages - infra/proxmox.md: two-host rewrite, m93p LXC+QEMU inventory, 4-entry correction table, VM 282 stopped->running, storage via pvesm (ssd0 88.17%/63GiB free) - infra/tailscale.md: 45-node inventory rebuilt from live status; 23 funnel-ingress-node IPv6 peers noted+excluded; CT460 serve routes re-verified exactly (13 routes + :8443 Funnel + :9443) - infra/network-map.md, current-state.md, index.md, log.md updated - Open: 3 incidents (unverified pages left stale, not rewritten); omniroute/hosts/model-providers/docker-services still single-host in framing — m93p runs its own omniroute CT101, needs a dedicated pass
This commit is contained in:
@@ -14,6 +14,17 @@ sources: [live-cron-list, live-sqlite-cron-executions, live-sqlite-sessions, liv
|
||||
# Current State
|
||||
Updated: 2026-10-14
|
||||
|
||||
## Recent Changes (2026-10-14, 03:00 stocktake; live probes 03:01–03:1x AWST)
|
||||
|
||||
- **⚠ A second, unclustered Proxmox hypervisor exists — `m93p` at `100.104.51.98`, PVE 9.2.0. DISCOVERED this pass.** `pvecm nodes` is empty on both hosts (no cluster), and guest IDs **collide**: `m93p` CT221 is gitea, `pve` CT103 is cliproxyapi, and both worlds share CT100/CT221/CT245 numbers. It had been in the Tailscale node list as an unremarkable `online` peer with no wiki page recording it as a hypervisor; a tailnet-wide `:8006` scan returned only `m93p` and `pve`, which is how it surfaced. Live guests on `m93p` include gitea (CT221), ntfy (CT1241), freshrss (CT1260), openweb (CT245), vaultwarden, obsidian-livesync, rustdesk, homebridge, litellm (CT500), omniroute (CT101), paseo (CT1261), mailflow, social-dashboard, docker-01, rclone, freellmapi; `nightbridge` stopped. → [[infrastructure/proxmox]], [[infrastructure/network-map]]
|
||||
- **Four guests the wiki placed on `pve` are actually on `m93p`.** CT221 (gitea), CT241 → CT1241 (ntfy), CT260 → CT1260 (freshrss) and CT245 (openweb) are **absent from live `pct list` on `pve`,** yet all four services answer. `/etc/pve/lxc/` on `pve` holds only `260.conf.bak` and no vzdump log references them — so they were never deleted, **they were never on this host.** Every prior audit since 2026-10-11 carried the error forward. Always qualify a guest with its host. → [[infrastructure/proxmox]]
|
||||
- **VM 282 `ubuntu-server-xfce` is running**, not stopped as recorded. → [[infrastructure/proxmox]]
|
||||
- **Tailscale node inventory rebuilt: 45 non-funnel nodes** (plus 23 `funnel-ingress-node` IPv6 peers, excluded). The 2026-10-11 table had drifted badly — it listed 30 nodes and was **missing 15**, including `m93p`, `pve`, `omniroute-1`, `paseo`, `qwenpaw`, `rustdesk`, `vaultwarden`, `social-dashboard`, `openweb`, `omarchybook`, `sftpgo`, `rclone`, `omni`, `runtipi`. Several states were wrong too (`anthonys-mac-mini` is online on a different IP; `omarchy-macmini`/`omarchy-quattro` are not live peers; `anthonys-iphone` is online not active). Serve routes on CT460 re-verified **exactly** as recorded — 13 routes, `:8443/webhook` Funnel, `:9443` tailnet-only. → [[infrastructure/tailscale]]
|
||||
- **Mattermost CT255 confirmed stopped, consistent** with its Tailscale peer offline 24d — unchanged finding, re-verified. → [[infrastructure/proxmox]]
|
||||
- **Camofox recovered from its 2026-10-12 memory ceiling:** `camofox-browser.service` now reports `Memory: 29.9M (high: 2G, max: 3G, swap max: 1G, available: 1.9G, peak: 485.8M)` with 16 tasks, active since 2026-10-13 23:42:55. The containment limits held; the workload was the fault. → [[systems/browser-backend]]
|
||||
- **Stocktake artifacts regenerated:** `systems/skills-index.md` = **346 skills / 70 categories** (the known 347-on-disk off-by-one persists); `raw/stocktake/freshness-20261014.txt` = **48 stale / 38 fresh / 7 no-date of 93 pages**, identical in shape to 10-13.
|
||||
- **Quartz rebuild still inert** (no `quartz.config.ts`, no `npx`) — `public/` was not refreshed. Carried open item.
|
||||
|
||||
## Recent Changes (2026-10-13 → 2026-10-14, nightly audit; live probes 2026-10-14 00:00-00:30 AWST)
|
||||
|
||||
- **The four-day clean streak broke: 2026-10-13 = `167 completed` / 1 `failed`** (10-12 finalised `175 / 0`, 10-11 `172 / 0`, 10-10 `175 / 0`). The failure is `1a8e90ea2271` (wiki-stocktake-maintenance, 03:00) on `RuntimeError: HTTP 404: No active credentials for provider: opencode` — the **third** failure of that job in six days, all three on the opencode path (10-08 403 free-tier, 10-09 timeout, 10-13 404). New incident `1a8e90_d11698bd7275` (`detected`, streak 1, not alerted); it clears only on a successful 2026-10-14 03:00 run. → [[systems/scheduled-tasks]]
|
||||
|
||||
Reference in New Issue
Block a user