Maintenance script ran clean (skills-index 346 -> 347, freshness audit, Quartz rebuilt 596 files and deployed, hermes-wiki-serve.service restarted). infrastructure/tailscale.md — node table rebuilt from live `tailscale status --json`. The 2026-10-19 table had drifted: octop (100.92.163.122) and springroll (100.100.153.125) missing entirely, openmausbot / openmausbot-vm present in prose but absent from the table body, omarchymac now offline, all offline ages stale. Rebuilt keyed on DNS name rather than the JSON HostName — HostName is `ct260` for the freshrss node and BOTH OmniRoute nodes report the hostname `omniroute`, which collides silently. Now 51 non-funnel nodes. Container states cross-checked against live `pct list` on pve and m93p: CT255 stopped, CT601 stopped, CT299 running. reports/uber-eats/ — 2026-08 and 2026-09 recovered. The generator wrote only to ~/wiki/reports/uber-eats/ and never to the canonical tree, so both months were missing from the published wiki. Root cause fixed in ~/.hermes/cron/scripts/generate-uber-eats-report.py: it now targets ~/workspace/agent-estate-wiki/reports/uber-eats/ and mirrors to the legacy tree, and now emits YAML frontmatter (without it the pages landed in the audit's "no updated DATE" bucket and Quartz could not read the page date). 2026-08 previous-month column corrected from $0.00 to $264.51 / 11 orders. incidents/2026-08-15-skills-index-drift.md — re-verified live; the named regenerate-skills-index.sh no longer exists on disk (regeneration now lives in wiki-maintain.sh step 1/3). Incident prevention confirmed working: 347 skills. incidents/2026-09-02-sftpgo-outage.md — re-verified live: CT299 running, health endpoint HTTP 401 (auth required, service up), no recurrence. reports/communities-wa-social-media-audit-2026.md — left stale (54d). Its source document no longer exists on disk, so the baseline cannot be re-verified against a live source. Flagged, not edited. Freshness after this run: 1 stale, 94 fresh, 6 no-date of 101 pages.
54 lines
2.6 KiB
Markdown
54 lines
2.6 KiB
Markdown
---
|
|
title: "Skills Index Drift — 4x Undercount"
|
|
type: incident
|
|
status: resolved
|
|
created: 2026-08-15
|
|
updated: 2026-10-21
|
|
resolved_on: 2026-08-15
|
|
verified_on: 2026-10-21
|
|
confidence: high
|
|
tags: [skills, wiki, drift, auto-regeneration]
|
|
sources: [session-investigation, agent-estate-wiki]
|
|
---
|
|
|
|
# Skills Index Drift — 4x Undercount
|
|
|
|
## Summary
|
|
The `systems/skills-index.md` page in both wikis claimed **66 skills** when **330 were actually installed** — a 4x undercount. The page had been hand-written once on 2026-07-22/25 and never regenerated as the estate grew.
|
|
|
|
## Root Cause
|
|
Static documentation for a mutable inventory. The skills tree at `~/.hermes/skills/` grew from ~66 to 330 skills over three weeks, but the wiki page was never updated because there was no automation to keep it in sync.
|
|
|
|
## Impact
|
|
- Wiki page was 4x out of date
|
|
- Any inventory-based decisions (skill loading, capacity planning) would have been based on wrong numbers
|
|
- No functional impact — skills still loaded correctly via Tool Search
|
|
|
|
## Resolution
|
|
1. Regenerated `systems/skills-index.md` from the live skill tree (all 330 skills, 26 categories)
|
|
2. Created a regeneration script for automated regeneration — **superseded on 2026-10-21:** the
|
|
regeneration now lives inside `wiki-maintain.sh` (step 1/3) in the wiki repo; no standalone
|
|
`regenerate-skills-index.sh` exists on disk any more.
|
|
3. Set up cron job `1a8e90ea2271` to run daily at 03:00 AWST
|
|
4. Script auto-commits and pushes to Gitea (`Anthony/agent-estate-wiki`)
|
|
5. Quartz site at `http://100.118.5.51:9120/systems/skills-index` rebuilt and redeployed
|
|
|
|
## Lesson
|
|
Static wiki pages that reflect **mutable inventory** (skills, services, cron jobs) **MUST be auto-regenerated on a schedule**, not hand-maintained. The moment the estate grows, a hand-written page becomes stale.
|
|
|
|
## Re-verified 2026-10-21
|
|
The prevention mechanism is live and working. `wiki-maintain.sh` step 1/3 regenerated
|
|
`systems/skills-index.md` from `~/.hermes/skills/` on the 2026-10-21 03:00 scheduled run:
|
|
**347 skills across 70 categories** (the "26 categories" figure in the original write-up was
|
|
the count at the time of the incident, not the current topology — the skill tree has since
|
|
nested deeper). The daily cron job `1a8e90ea2271` is `active` with `last_status: ok`.
|
|
|
|
## Prevention
|
|
- Daily cron job regenerates skills-index.md from live tree
|
|
- Page includes "auto-regenerated, do not hand-edit" warning
|
|
- Same script pattern is reusable for other inventory pages (cron jobs, services, agents)
|
|
|
|
## Related
|
|
- [[systems/skills-index]] — The updated page
|
|
- [[systems/scheduled-tasks]] — The new cron job
|