darwin-core iter 5 — plateau confirmed, loop halted

0 improvements, 5 honest skips, 1 attempted noImprovement.

The 6 dimensions sit at:
  sona-adapt:        WASM-opaque, AT-TARGET (0.0041 < 0.005)
  moe-gate:          WASM-opaque, AT-TARGET (0.88 > 0.85)
  skill-distillation: bench-saturated 1.0/1.0 (synthetic ADR-155 bench; real ALFWorld eval needed for next jump)
  causal-graph:      smoke binary 21/21 pass; perf path optimized to 3ms (was 115ms)
  reasoning-bank:    BEIR bench doesnt exercise the ReasoningBank subsystem at all — wrong target
  hnsw-search:       NAPI does not honor efConstruction beyond a cap

Real Darwin wins committed across iters 1-4:
  scripts/bench-skill-distillation.mjs (new)         — ADR-155 bench
  scripts/benchmark-intelligence.mjs --only flag      — infra
  v3/@claude-flow/cli/src/mcp-tools/agentdb-tools.ts — early-exit + dynamic-import cache
  v3/@claude-flow/cli/scripts/run-beir-hybrid.mjs    — bm25 tie-breaker

Cron job fd8ff24b deleted. PR incoming.
This commit is contained in:
ruv committed 2026-06-27 11:56:04 -04:00
1 parent d82e215696
commit af6440c246
1 file changed
+1
+1
View File
@@ -24,3 +24,4 @@
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"hnsw-search","baseline":0.89,"measured":0.89,"deltaScore":0,"action":"baseline-established","note":"FIRST BASELINE for HNSW dim. recall@10=0.89 at N=5k, 4.61x speedup vs brute force. NOTE: lower than documented ~0.99 — possible benchmark or build-time regression worth investigating. ruvector NAPI accepts ef param syntactically but does not apply it."}
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"moe-gate","baseline":0.88079,"measured":0.88079,"deltaScore":0,"action":"baseline-established","note":"FIRST BASELINE for MoE dim. afterConfidence=0.88079 (target >0.85 MET). gateLearned=true. qShift 0→99.78 after 200 rewards. Editable directory v3/@claude-flow/cli/src/intelligence/moe/ does not exist — opaque, like sona-adapt."}
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"causal-graph","change":"cache-dynamic-imports-in-graph-handlers","baseline":10,"measured":3,"deltaScore":7,"action":"measured-improved","commit":"45da93d48","note":"Module-level cache for graph-backend / graph-edge-writer / memory-initializer / embedding-quantization dynamic imports. Sum elapsedMs 10→3ms (70% reduction) across 21 smoke tests. All pass."}
{"iter":5,"ts":"2026-06-27T15:56:04.962Z","dimensionsImproved":0,"skipped":5,"noImprovement":1,"result":"PLATEAU CONFIRMED","note":"All 5 skips honest: sona+moe WASM-opaque, reasoning-bank wrong subsystem for BEIR bench, skill-distillation 1.0/1.0 ceiling, causal-graph binary pass/fail. HNSW tried efConstruction 200→400, NAPI does not honor it (recall noise). Loop halted at iter 5."}