48 lines
1.6 KiB
Markdown
48 lines
1.6 KiB
Markdown
|
# @evolv/output-manifest-verify
|
||
|
|
|
||
|
|
Enforce `.claude/rules/output-coverage.md` §3:
|
||
|
|
|
||
|
|
1. Every node ships `test/_output-manifest.md`.
|
||
|
|
2. Every key declared in the manifest is referenced by at least one test
|
||
|
|
file under `test/**/*.test.js`.
|
||
|
|
|
||
|
|
Designed to replace the manual verification checklist in the rule. The
|
||
|
|
rule itself can become a thin pointer to this tool once every node is in
|
||
|
|
compliance.
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# scan every node with a CONTRACT.md
|
||
|
|
node tools/output-manifest-verify/bin/output-manifest-verify.js
|
||
|
|
|
||
|
|
# one node
|
||
|
|
node tools/output-manifest-verify/bin/output-manifest-verify.js nodes/machineGroupControl
|
||
|
|
|
||
|
|
# fail (exit 1) when a manifest is missing, not just warn
|
||
|
|
node tools/output-manifest-verify/bin/output-manifest-verify.js --strict
|
||
|
|
|
||
|
|
# CI / JSON output (one line per node)
|
||
|
|
node tools/output-manifest-verify/bin/output-manifest-verify.js --json
|
||
|
|
```
|
||
|
|
|
||
|
|
## Severity
|
||
|
|
|
||
|
|
| Condition | Severity |
|
||
|
|
|---|---|
|
||
|
|
| `test/_output-manifest.md` missing | `warn` (escalates to `error` under `--strict`) |
|
||
|
|
| Manifest has no `##` sections / no tables | `error` |
|
||
|
|
| Declared key not referenced by any test file | `warn` |
|
||
|
|
| Manifest declares keys but `test/**/*.test.js` directory empty | `error` |
|
||
|
|
|
||
|
|
## What it does NOT check (yet)
|
||
|
|
|
||
|
|
- Whether each key has both a **populated** and **degraded** test (the
|
||
|
|
rule's §3 promise). Reaching that level of confidence requires
|
||
|
|
instrumenting the actual node runtime; tracked as a follow-up.
|
||
|
|
- The Port 1 (InfluxDB) cardinality discipline — see
|
||
|
|
`.claude/rules/telemetry.md`.
|
||
|
|
|
||
|
|
Run after touching `_output-manifest.md`, `test/**/output-*.test.js`,
|
||
|
|
or any Port 0/1/2 emission key.
|