stocktake 2026-11-06: 0 stale / 124 fresh / 3 no-date; correct Tailscale state + Docker seeder false negative
Ran wiki-maintain.sh (repo script). skills-index regenerated -> 302 skills / 68 categories. Freshness audit at the 21-day threshold -> 0 stale / 124 fresh / 3 no-date of 127 pages. Quartz rebuilt (761 files) and deployed to public/; hermes-wiki-serve.service restarted. Live-vs-page drift diff (age scan alone missed all of this): - infrastructure/tailscale.md: 1 state transition + 8 offline-age drifts + 2 dead Serve routes. anthonys-mac-mini came back online (peer record Online:true, tailscale ping -> pong via DERP(syd)). Offline ages refreshed +1d each (cloudreve 104d, elementsynapse 107d, freshrss-new 80d, octoagent 4d, octop 2d, omarchybook 15d, omarchymac 4d, openmausbot 15d). Every peer IP still matches the live JSON; no peer missing, no orphan row. /agent-estate->8769 and /synergy-prep->9123 are DEAD (no listener) while still present in `tailscale serve status` - both now marked DEAD, matching network-map.md. All other Serve targets have live listeners. - infrastructure/docker-services.md: the 2026-11-05 "the seeder does not exist on any host" finding was FALSE - a point-in-time sampling artefact. The worldmonitor-seeder-* containers are transient and systemd-timer driven on CT200 (worldmonitor-seed.timer 4h -> seeder-scheduled; worldmonitor-seed-fast.timer 15min -> seeder-fast), visible only while a run is in flight. Both present at 2026-11-06 03:1x; neither at 2026-11-05 05:1x. The "no cron job" claim was also wrong (systemd timers, not cron) and the "rename" narrative was wrong (one script, two container names). Corrected on the page with strikethrough + dated correction. CT200's 61-container running set still matches live set-wise. CT333 container renamed again: flamboyant_mahavira -> nostalgic_keldysh. - systems/scheduled-tasks.md: no drift. Live jobs.json reads 29 jobs / 26 enabled / 3 disabled, 1 non-clean last_status - exactly as recorded. - current-state.md / index.md: false seeder claim and "every state matching" claim marked superseded with dated corrections (SCHEMA rule 9), not silently rewritten. - infrastructure/network-map.md: dates bumped, dead routes re-confirmed, peer recheck note refreshed. - log.md: appended (append-only) with the full stocktake record. No secrets, tokens or keys written or quoted.
This commit is contained in:
@@ -14,7 +14,7 @@ sources: [live-cron-ledger, live-deliveries-db, live-incident-ledger, live-sessi
|
||||
> Operational knowledge for Anthony's agents, infrastructure,
|
||||
> model routing and automation. Last updated: 2026-11-06.
|
||||
>
|
||||
> **2026-11-05 (stocktake) -** **the `systems/skills-index.md` flip-flop is fixed at the root**: two different scripts were writing the page, and the nightly audit was pointed at the stale one; it is now a delegating wrapper -> [[incidents/2026-11-05-skills-index-generator-divergence]]. Docker inventory corrected against live probes on all five hosts - the `worldmonitor-seeder-scheduled` container recorded yesterday **does not exist on any host**. Tailscale node table re-verified programmatically - 52 rows, 52 live peers, every state matching. Freshness **0 stale / 122 fresh / 3 no-date of 125**.)
|
||||
> **2026-11-05 (stocktake) -** **the `systems/skills-index.md` flip-flop is fixed at the root**: two different scripts were writing the page, and the nightly audit was pointed at the stale one; it is now a delegating wrapper -> [[incidents/2026-11-05-skills-index-generator-divergence]]. Docker inventory corrected against live probes on all five hosts - ~~the `worldmonitor-seeder-scheduled` container recorded yesterday **does not exist on any host**~~ **⚠ CORRECTED 2026-11-06: false - the seeders are transient systemd-timer-driven containers, absent only between runs, not removed.** Tailscale node table re-verified programmatically - 52 rows, 52 live peers, ~~every state matching~~ **⚠ CORRECTED 2026-11-06: `anthonys-mac-mini` has since come back online.** Freshness **0 stale / 122 fresh / 3 no-date of 125**.)
|
||||
>
|
||||
> **2026-11-06 (nightly audit - window 2026-11-05) - a clean ledger day and an empty incident ledger:** 2026-11-05 settled **175 rows - 173 `completed` / 2 `running` / 0 `failed`** across 18 jobs, the **first zero-`failed` day since 2026-11-02**. The only two `running` rows are the **Mnemosyne Health Monitor** (12:00:45 slot, still in flight **12 h+** at audit time) and this audit itself. **Unclosed incident rows 3 -> 0** - the *Newsletter Digest* row closed at **07:07:42** and both *Job Radar - Discovery* rows at **12:36:17**, when `dca8482e4f76` finally completed after **5 h 35 m 35 s**; that closes out [[incidents/2026-11-04-upstream-stream-failure-0700-cohort]] and [[incidents/2026-11-03-job-radar-stream-active-timeout]] in full. Fleet non-clean `last_status` **3 -> 1** (only `066bb5191280`, `delivery_failed`, streak 0); deliveries **10 rows / 10 `delivered`**; the 03:00 stocktake overran **3 h 01 m 58 s** (down from 7 h 40 m and 5 h 41 m) and **committed `2f3fc99` at 05:55**. **Fleet unchanged at 29 jobs (26 / 3)** - a fourth audit at the same count. ⚠ **New and open:** live `.env` values (`TELEGRAM_BOT_TOKEN`, `MATTERMOST_TOKEN`, `HERMES_CUSTOM_OMNIROUTE_20128_API_KEY`) sit verbatim in **17 rows of `mnemosyne.db`** (`memories`, `episodic_memory`, `working_memory`, `gists`, `memoria_facts.context_snippet` and the FTS mirrors) - reproduced in full by each of the **7 uncompressed rotation snapshots** - and all four values sit verbatim in the **1.7 GB session store `state.db`** too; `CAMOFOX_API_KEY` sits verbatim in the prompts of two **enabled** Facebook Birthday jobs (`0e753e9720fd`, `fad5a86979d4`) and therefore in `cron/deliveries.db` -> [[incidents/2026-11-05-secrets-at-rest-in-mnemosyne-and-cron-prompts]].
|
||||
>
|
||||
|
||||
Reference in New Issue
Block a user