audit 2026-11-15: capture stall 38h46m (freeze total, counts unchanged); cron_incidents 1->3 unclosed (signature embeds elapsed-hours float); monitor's 4.64h decoded as newest-conversational-message age; watchdog lost an 11:45 slot to a 600s deps-guard timeout; ledger 168 rows 165/3 (11-14 settled 167/0)
This commit is contained in:
+36
-4
@@ -3,16 +3,48 @@ title: Current State
|
||||
type: concept
|
||||
status: active
|
||||
created: 2026-07-22
|
||||
updated: 2026-11-15
|
||||
verified_on: 2026-11-15
|
||||
review_after: 2026-11-15
|
||||
updated: 2026-11-16
|
||||
verified_on: 2026-11-16
|
||||
review_after: 2026-11-17
|
||||
confidence: high
|
||||
tags: [system]
|
||||
sources: [live-cron-list, live-sqlite-cron-executions, live-sqlite-sessions, live-probe, live-executions-db, live-cron-incidents, live-deliveries-db, live-sessions-db]
|
||||
---
|
||||
|
||||
# Current State
|
||||
Updated: 2026-11-15
|
||||
Updated: 2026-11-16
|
||||
|
||||
## Recent Changes (2026-11-15, nightly audit; live probes 2026-11-15 23:59 – 2026-11-16 00:2x AWST)
|
||||
|
||||
- ⚠ **Memory capture is still dead — 38 h 46 m — and the freeze is total, not degraded.**
|
||||
[[incidents/2026-11-14-mnemosyne-capture-stall]] re-read: `working_memory` **1130** /
|
||||
`episodic_memory` **1249**, *the same two counts as every earlier read of the stall*; newest
|
||||
`working_memory` write still the `09:32:59 AWST` (01:32:59 UTC) `[MODEL_REFRESH_PROPOSAL]` maintenance
|
||||
row, newest *user-turn* capture `2026-11-14 09:04:19 AWST`. Root cause still not established.
|
||||
- **The monitor's `≈4.64 h` figure is not a duration — decoded against the gate's own source.**
|
||||
`mnemosyne_freshness_gate.py`'s `newest_user_message()` takes the newest `role='user'` message whose
|
||||
session source is not `cron`/`subagent` and prints *its* age. On this box those are the **Pulse**
|
||||
turns on `source: desktop` (~6 h cadence), and the `0 */12` slots sit ~4.6 h after one — which is why
|
||||
all three alerts read alike. **Do not read it as the stall length.**
|
||||
- **`cron_incidents` 1 → 3 unclosed** (138 → **141** rows) — all `ea79a2107e36`, all
|
||||
`failure_type: auth`, all `alerted`, each `first_seen_at == last_seen_at`. The signature embeds the
|
||||
elapsed-hours float (`4.64157453` / `4.634034074444445` / `4.643481075555555`), so **one durable
|
||||
fault mints a fresh unclosed row every slot** and nothing escalates. **Fix proposed, not applied.**
|
||||
- **The consolidator runs and does nothing — by design.** Latest `consolidation_log` row **4696** at
|
||||
`2026-11-15T16:14:14.934306+00:00` (= 00:14:14 AWST), `items_consolidated: 0`, `summary_preview`
|
||||
`No-op consolidation cycle — timestamp updated for watchdog`; **~74 consecutive zero-item cycles**
|
||||
from `2026-11-14T02:04:42+00:00`. It bumps its own timestamp, so an age-only gate reads "fresh".
|
||||
- **Fleet: 2026-11-15 — 168 rows, 165 `completed` / 3 `failed`**, deliveries **9 / 9 `delivered`**
|
||||
(3 `for_failure`). The three: the Health Monitor at `00:00:53.928` and `12:01:24.719`, plus — **new
|
||||
failure mode** — the Watchdog `96eb95ce12f2` at `11:31:20.699`, `finished_at 11:49:10.534610` =
|
||||
**17 m 49.8 s**, `runtime deps guard … timed out after 600 seconds`; the `11:45` slot was **skipped**,
|
||||
`12:01:25` completed. **2026-11-14 settled 167 / 167 `completed` / 0 `failed`.**
|
||||
- **Fleet 29 jobs (26 enabled / 3 disabled)** — a **tenth consecutive window unchanged**; only non-clean
|
||||
row is `ea79a2107e36` (`error`, `failure_streak` **3**).
|
||||
- **No interactive work on 11-15.** All **9** sessions started that day are `source: cron` — nothing
|
||||
human-side for the wiki to have missed.
|
||||
- Freshness (03:00 stocktake, `raw/stocktake/freshness-20261115.txt`): **0 stale / 133 fresh / 3
|
||||
no-date of 136** pages.
|
||||
|
||||
## Recent Changes (2026-11-14, nightly audit; live probes 2026-11-14 23:59 - 2026-11-15 00:4x AWST)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user