mirror of
https://github.com/ruvnet/ruflo.git
synced 2026-11-09 05:35:21 +09:00
rUvandReuven
b395d12559
Full benchmark implementation to evaluate AgentDB memory system against the LongMemEval standard (ICLR 2025, 500 questions, 6 categories). Includes: - ADR-088 with competitive landscape analysis (MemPalace 96.6%, OMEGA 95.4%, Observational Memory 94.87%) - Benchmark harness with 4 modes: raw, hybrid, full, baseline - AgentDB adapter (HNSW + ONNX) and baseline adapter (cosine) - Dataset download scripts (HuggingFace) - Per-category scoring, latency percentiles, storage metrics - Honesty protocol: no test-set tuning, full category breakdown Motivated by MemPalace's claimed "perfect score" — we need a real apples-to-apples comparison to establish AgentDB's position. Co-authored-by: Reuven <cohen@ruv-mac-mini.local>