An AI agent with learning memory should get better the more you use it. That is the promise everyone in this category makes, including us.
In practice, the mechanism designed to do the heaviest lifting is almost entirely absent from production traffic. Agents read memories constantly. They almost never report back on whether those memories helped.
We measured how wide that gap is in our own production store, and the numbers were worse than I expected.
The signal that carries the most weight
In a reinforcement-aware memory engine, associations strengthen through three kinds of events.
A write creates co-occurrence evidence: storing a memory links the concepts inside it. There is no outcome yet.
A read creates weak co-activation between the query and what came back. This signal is deliberately faint, an exploration signal damped so that merely retrieving something does not entrench it.
Feedback reports outcome. It is the only channel that carries a result, and the result gates how much the association strengthens. Positive outcome amplifies, negative suppresses. This is a three-factor learning rule: co-activity alone is not enough, a third factor such as reward or surprise has to gate durable change (Frémaux and Gerstner, DOI:10.3389/fncir.2015.00085).
One property of that design made a production audit possible. Only feedback carries an outcome, and the recorded outcome polarity survives weight decay. So an edge with nonzero outcome polarity is a durable fingerprint that says: explicit feedback touched this one.
What we found in production
Our August 2026 measurement covered one engine, one production store, 359,388 concept-graph edges, and 65 tenants with at least 100 concepts each.
One of those tenants came from benchmark campaigns, where our harness calls the feedback endpoint between queries by design. The rest were live traffic. Same engine, two completely different shapes of memory.
Edges touched by feedback:
Tenant Edges touched by feedback Benchmark 94.8% Mixed account 66.1% Best live tenant 12.8% Read-heavy live tenant 0.6% Bulk-ingest tenant 0.0%And what that did to the graph:
Metric Benchmark Live tenants, n=57 Edges per concept 22.0 7.5 Share surviving after cutting weak edges 0.539 0.107Benchmark-grown memory was about three times denser and roughly five times more resistant to dissolution when weak edges were cut. On the benchmark tenant, edges touched by feedback had a p90 weight of 0.261 against 0.002 for untouched edges, more than a hundredfold difference. The benchmark median edge was reinforced ten times. The live median edge was reinforced once.
One tenant made the attribution unusually clean. It looked live, but 71.4% of its 60,872 edges were born in a single four-day benchmark window. Removing those edges dropped its density and resilience straight into the middle of the live distribution. The effect tracked the regime, not the account.
The honest limit. We measured a structural difference. We did not measure whether more feedback causally improves retrieval quality for live users. “Agents that give feedback get better memory” remains a hypothesis with a suggestive structural result behind it, not a finished quality claim. I would rather say that plainly than let the tables imply more than they show.
This is not one engine’s problem
Feedback scarcity is an old finding wearing new clothes. Hu, Koren and Volinsky framed the asymmetry for recommender systems back in 2008: implicit signals are abundant, explicit ratings are scarce (DOI:10.1109/ICDM.2008.22). Nielsen’s participation inequality describes the same 90-9-1 shape across online contribution (NN/g, 2006). The entire RLHF line exists because human feedback is expensive to collect (Christiano et al., arXiv:1706.03741).
The agent-memory category shows the same tension in product shape. Reading vendor documentation on 2026-08-12:
- Mem0 documents a per-memory feedback API and advises customers to track their own feedback completion rates, while publishing none.
- Zep assigned fact ratings automatically against developer instructions rather than by end users, and listed them in its February 2026 deprecation wave.
- Letta exposes feedback on agent steps, not on memories.
- LangMem documents no memory feedback or rating API at all.
- ChatGPT memory offers remember, forget and delete. No grading.
- Anthropic’s memory tool gives the model six file-like commands and no rating command.
Across every surface I could check, no vendor publishes data on how often their feedback channels are actually used. The pattern is not “vendors ship ratings and users ignore them.” It is that explicit memory ratings are quietly not becoming standard, and at least one vendor is walking away from them.
What silent failure looks like without a quality signal is visible in the open: a production audit filed in Mem0’s tracker reported that 97.8% of 10,134 memory entries were junk (issue #4573).
Two builders ran the same kind of check on their own systems this week, after a conversation under the previous piece. Giulio D’Erme counted his corpus and found zero of 152 memos and zero of 59 documents carrying a validity window or a supersession edge: fields the engine could read, and nothing was writing them. Ken Alger took the argument to the interface in Your Memory API Is Lying to Your Agent, which is worth reading next to this one. Availability is not usage, and it does not appear to matter much whether the unexercised thing is a schema field, a rating channel, or a relationship the response has nowhere to put.
Three ways to fix it, and two of them are traps
Force it. Gate reads on a feedback call. Your completion metric goes to 100%. But the value of explicit feedback comes precisely from someone deciding an outcome was worth reporting; coerce it and the label degrades toward noise, while every read pays a round trip. Forced completion protects a dashboard and damages the signal.
Ask for it. Thumbs up, thumbs down, “was this useful?” This helps when a real human chooses to answer, and it does nothing about participation inequality. In agentic systems it is often worse, because the agent finishes the task without ever surfacing a rating moment to a person.
Prescribe it. This is the one that fits how agents actually work today, and the industry has already converged on the pattern for a neighbouring problem. Anthropic’s memory tool auto-injects a memory protocol instruction when enabled. Claude Code loads project instructions every session. The official MCP knowledge-graph memory server ships a suggested system prompt prescribing proactive memory behaviour. AGENTS.md exists as a standing-instruction format used by tens of thousands of projects.
So the practical lever is a few lines in AGENTS.md, CLAUDE.md, or your system prompt that tell the agent when to report an outcome. Something as plain as: after acting on a recalled memory, report whether it helped.
Two caveats I owe you. No official Anthropic document prescribes rating memories, because their tool has no rating command, so this extends the documented instruction pattern rather than following an established norm. And our own MCP server prescribes exactly this in its instructions, which makes it our practice rather than independent evidence.
Why I wrote this about our own product
The uncomfortable version of these numbers is that our strongest learning mechanism is the one our users almost never trigger. We could have shipped the benchmark column and left the live column out. The benchmark column is genuinely ours and genuinely good.
But a memory engine that only performs in a feedback-rich regime, and never says so, is exactly the kind of thing this field has too much of already. So: the mechanism strengthens what it touches, the regime that exercises it is rare in production, and the cheapest thing you can do about it today has nothing to do with which vendor you pick. It is a standing instruction in a file your agent already reads.
Disclosure: I work on Mnemoverse, the engine these measurements came from. The full version, with the complete methodology note, the percolation definitions and every vendor citation, is in the Mnemoverse library.