mirror of
https://github.com/ruvnet/ruflo.git
synced 2026-10-23 03:47:00 +09:00
darwin-core iter 5 — plateau confirmed, loop halted
0 improvements, 5 honest skips, 1 attempted noImprovement. The 6 dimensions sit at: sona-adapt: WASM-opaque, AT-TARGET (0.0041 < 0.005) moe-gate: WASM-opaque, AT-TARGET (0.88 > 0.85) skill-distillation: bench-saturated 1.0/1.0 (synthetic ADR-155 bench; real ALFWorld eval needed for next jump) causal-graph: smoke binary 21/21 pass; perf path optimized to 3ms (was 115ms) reasoning-bank: BEIR bench doesnt exercise the ReasoningBank subsystem at all — wrong target hnsw-search: NAPI does not honor efConstruction beyond a cap Real Darwin wins committed across iters 1-4: scripts/bench-skill-distillation.mjs (new) — ADR-155 bench scripts/benchmark-intelligence.mjs --only flag — infra v3/@claude-flow/cli/src/mcp-tools/agentdb-tools.ts — early-exit + dynamic-import cache v3/@claude-flow/cli/scripts/run-beir-hybrid.mjs — bm25 tie-breaker Cron job fd8ff24b deleted. PR incoming.
This commit is contained in:
1 parent
d82e215696
commit
af6440c246
1 file changed
+1
@@ -24,3 +24,4 @@
|
||||
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"hnsw-search","baseline":0.89,"measured":0.89,"deltaScore":0,"action":"baseline-established","note":"FIRST BASELINE for HNSW dim. recall@10=0.89 at N=5k, 4.61x speedup vs brute force. NOTE: lower than documented ~0.99 — possible benchmark or build-time regression worth investigating. ruvector NAPI accepts ef param syntactically but does not apply it."}
|
||||
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"moe-gate","baseline":0.88079,"measured":0.88079,"deltaScore":0,"action":"baseline-established","note":"FIRST BASELINE for MoE dim. afterConfidence=0.88079 (target >0.85 MET). gateLearned=true. qShift 0→99.78 after 200 rewards. Editable directory v3/@claude-flow/cli/src/intelligence/moe/ does not exist — opaque, like sona-adapt."}
|
||||
{"iter":4,"ts":"2026-06-27T15:47:53.312Z","dimension":"causal-graph","change":"cache-dynamic-imports-in-graph-handlers","baseline":10,"measured":3,"deltaScore":7,"action":"measured-improved","commit":"45da93d48","note":"Module-level cache for graph-backend / graph-edge-writer / memory-initializer / embedding-quantization dynamic imports. Sum elapsedMs 10→3ms (70% reduction) across 21 smoke tests. All pass."}
|
||||
{"iter":5,"ts":"2026-06-27T15:56:04.962Z","dimensionsImproved":0,"skipped":5,"noImprovement":1,"result":"PLATEAU CONFIRMED","note":"All 5 skips honest: sona+moe WASM-opaque, reasoning-bank wrong subsystem for BEIR bench, skill-distillation 1.0/1.0 ceiling, causal-graph binary pass/fail. HNSW tried efConstruction 200→400, NAPI does not honor it (recall noise). Loop halted at iter 5."}
|
||||
Reference in new issue
Block a user