audit(2026-11-12): the estate's last incident closed itself; a past-0.9.42 hq-push install was refused by the plugin scan (fix parked in PR #2)
- 429 row cbfe43_ed01845310d8 closed resolved 2026-11-12T00:25:36 on the next clean slot; 0 of 137 unclosed - 11-12: 176 rows / 175 completed / 0 failed / 1 running; 11-11: 172/172/0; deliveries 9/9 and 7/7 delivered - NEW incidents/2026-11-12-hq-push-upgrade-blocked-by-plugin-scan.md (dangerous verdict, one critical in the plugin's own tile skill; --force cannot override; no per-verdict override exists) - systems/hermes-hq-push.md corrected live (0.9.27 -> 0.9.42, tree mtime 2026-11-08 02:19, config line 13226) - current-state / scheduled-tasks / index / log updated; skills-index regenerated; freshness 2026-11-13 (0 stale)
This commit is contained in:
+44
-5
@@ -3,16 +3,55 @@ title: Current State
|
||||
type: concept
|
||||
status: active
|
||||
created: 2026-07-22
|
||||
updated: 2026-11-11
|
||||
verified_on: 2026-11-11
|
||||
review_after: 2026-11-12
|
||||
updated: 2026-11-13
|
||||
verified_on: 2026-11-13
|
||||
review_after: 2026-11-13
|
||||
confidence: high
|
||||
tags: [system]
|
||||
sources: [live-cron-list, live-sqlite-cron-executions, live-sqlite-sessions, live-probe, live-executions-db, live-cron-incidents, live-deliveries-db, live-sessions-db]
|
||||
---
|
||||
|
||||
# Current State
|
||||
Updated: 2026-11-11
|
||||
Updated: 2026-11-13
|
||||
|
||||
## Recent Changes (2026-11-12, nightly audit; live probes 2026-11-12 23:59 – 2026-11-13 00:4x AWST)
|
||||
|
||||
**Clean day. The estate is incident-clean, and the only open item is an upgrade that cannot be installed.**
|
||||
|
||||
- **The last open incident closed itself.** `cbfe43_ed01845310d8` (the 2026-11-10 audit's 429,
|
||||
[[incidents/2026-11-10-wiki-audit-429-all-targets-skipped]]) went `closed_at: 2026-11-12T00:25:36.133387+08:00`,
|
||||
`state: resolved`, when the **next slot of the same job ran clean** — `cbfe434a3b5e`
|
||||
2026-11-11T23:59:54.486572 → 2026-11-12T00:25:36.133387 = **25 m 42 s**, `completed`, delivery carrying
|
||||
**both** windows. **`cron_incidents`: 0 unclosed of 137.** No configuration produced this; the pool's
|
||||
reset at ≈ 06:36:57 on 11-11 did, and the 07:0x cohort confirmed it.
|
||||
- **State reads:** fleet **29 (26 enabled / 3 disabled)** — unchanged for a seventh window.
|
||||
Ledger — **2026-11-11: 172 rows, 172 `completed` / 0 `failed`**; **2026-11-12: 176 rows, 175 `completed`
|
||||
/ 0 `failed` / 1 `running`** (this audit); **2026-11-13 so far: 7 / 7 `completed`**. **Deliveries 11-11:
|
||||
7 / 7 `delivered`; 11-12: 9 / 9 `delivered`, 0 `for_failure`.** Executions retention floor
|
||||
`2026-11-07T00:00:42`, max `2026-11-13T00:30:55`, **1,001 rows** in the table.
|
||||
- **New open item — a refused upgrade, not a failure.** The attempt to take **`hermes-hq-push`** past its
|
||||
installed **0.9.42** was **blocked by the pre-install plugin security scan**:
|
||||
*"Blocked (dangerous verdict, 1 critical of 39 findings (echo_pipe_exec))"*, and *"--force does not
|
||||
override a dangerous verdict."* The critical is the plugin's **own** `skills/dashboard-tile/SKILL.md`
|
||||
one-liner (`echo '<json>' | python3 …` = obfuscation). Verified in source: **there is no per-verdict
|
||||
override anywhere** — `plugins.scan_on_install: false` disables scanning for *every* future install, and
|
||||
the plugin guard hardcodes `trust_level="community"` (the skills-side allowlist machinery is not read by
|
||||
it). Installed copy untouched, `enabled`, still delivering. **Fix = PR #2** on
|
||||
`mrcharlesiv/hermes-hq-plugins` (author `Tony0410`, `fix/tile-skill-heredoc`, **OPEN / MERGEABLE**,
|
||||
`mergedAt: null`, +7/−2 in one file), pushed from a fork because `gh` is **read-only** upstream.
|
||||
→ [[incidents/2026-11-12-hq-push-upgrade-blocked-by-plugin-scan]]
|
||||
- **Config untouched and consistent.** Live `config.yaml` is **byte-identical to the
|
||||
2026-11-12 18:14:52 snapshot** (565,433 B). The only drift since **11-09** is the **model catalogue
|
||||
block** (lines 1916-1941): 6 models removed, 9 added. No unrelated settings moved.
|
||||
- **The "stored hold-and-ask instruction" is not stored.** The alleged standing rule about plugin
|
||||
security-scan warnings was hunted exhaustively — a recursive sweep of `~/.hermes` (**184,716 files**,
|
||||
generated/venv/browser-profile trees excluded) found **zero matches in any editable text file**; the
|
||||
sentence exists only in `state.db` **conversation history** (58 rows). **Nothing was removed, nothing
|
||||
was reverted** — there was no persisted policy to undo. Procedure recorded as the skill
|
||||
`stored-instruction-search-and-removal`; installed skills **299 → 300**.
|
||||
- **The recurring pre-dispatch-filter signature was re-confirmed** on a *second* job and a *second* pin by
|
||||
the 2026-11-12 03:00 stocktake — still no failover for the free-tier cohort
|
||||
([[incidents/2026-10-21-omniroute-pre-dispatch-filter-skip]]).
|
||||
|
||||
## Recent Changes (2026-11-11, nightly audit; live probes 2026-11-11 23:59 – 2026-11-12 00:1x AWST)
|
||||
|
||||
@@ -24,7 +63,7 @@ Updated: 2026-11-11
|
||||
`RuntimeError: HTTP 429: Service temporarily unavailable: all targets were skipped by pre-dispatch
|
||||
filters (credits 100% conn:3021bab6) reset after 6h 24m 31s` — **6 candidates, `attempted 0`**, tenant
|
||||
`tn-5ud77abtl1` quota exceeded. Row `cbfe43_ed01845310d8` (`rate_limit`) was raised at 00:12:28 but
|
||||
**`alerted_at: NULL`, `closed_at: NULL` — it is the estate's only open incident row**. Pool reset
|
||||
**`alerted_at: NULL` — it was the estate's only open incident row; it has since closed `resolved` at 2026-11-12T00:25:36 (0 of 137 unclosed)**. Pool reset
|
||||
≈ **06:36:57**; the 07:0x cohort ran clean.
|
||||
⇒ **The 2026-11-10 window was never audited.** This audit covers two windows.
|
||||
- **State reads:** fleet **29 (26 enabled / 3 disabled)**; **non-clean `last_status` 2** (was 1) —
|
||||
|
||||
Reference in New Issue
Block a user