audit(2026-10-31): document CT460 5h30m host outage; correct the 'paused' health monitor (it was running, closed completed 10:02:48); reconcile fleet counts to 26/3

This commit is contained in:
hermes
2026-10-31 00:39:11 +08:00
parent db6af66878
commit 74a5b2d117
8 changed files with 241 additions and 27 deletions
+10 -3
View File
@@ -3,8 +3,8 @@ title: Mnemosyne
type: system
status: active
created: 2026-07-22
updated: 2026-10-24
verified_on: 2026-10-24
updated: 2026-10-31
verified_on: 2026-10-31
review_after: 2026-11-07
confidence: high
tags: [memory, mnemosyne, backend]
@@ -94,7 +94,14 @@ Primary agent memory store for Hermes.
## Known Management Jobs
- Mnemosyne Auto-Consolidate every 30m — script: `consolidate_mnemosyne.sh`, mode: no-agent
- Mnemosyne DB Backup weekly Sunday 03:00 — script: `mnemosyne-backup.sh`, mode: no-agent
- Mnemosyne Health Monitor every 12h — skill: `mnemosyne-operations`, reports only on exception
- Mnemosyne Health Monitor every 12h — skill: `mnemosyne-operations`, reports only on exception.
⚠ **2026-10-30: the monitor was twice flagged and neither flag survived contact with `finished_at`.** Its
00:01:08 slot was auto-paused at 01:04:22 on an *"execution unverified / gateway connection failed"* admission
([[incidents/2026-10-30-mnemosyne-health-monitor-paused]]) — but the slot was **still running** and closed
**`completed` at 10:02:48** after **10 h 01 m 40 s**, delivering normally and auto-closing incident
`ea79a2_d93c3acdc4f2`; the job is **enabled**, `last_status: ok`, streak 0. Its **12:01 slot was then lost to
the CT460 host outage** (5 h 30 m dark, [[incidents/2026-10-30-ct460-host-outage-scheduler-gap]]) and fired in
the 16:37:21 catch-up. **Check `finished_at` before believing a long-running slot failed.**
- Mnemosyne Embedding Coverage every 6h — job `b63ed5817212`, alerts to Telegram topic 102 only when working-tier coverage drops below 95%
- Mnemosyne Watchdog every 15m — script: `mnemosyne-watchdog.py`, mode: no-agent
- ⚠ **Blast-radius note (2026-10-16).** Both monitors above (`ea79a2107e36` Health every 12 h,