R088 · Agent architecture › Memory and context

MemCredit: pick agent memories by decision utility, not relevance

Read the original

agent-memorycontext-economicsretrievalbenchmarks

Source: Guo, Wang, Zhu et al., "MemCredit: From Relevance to Utility for Decision-Time Memory in Long-Horizon Web Agents", arXiv 2611.15600, 11 Nov 2026. Surfaced by Elvis Saravia and DAIR.AI.

The claim

Most agent memory systems retrieve the memories most semantically similar to the current state. The paper's counterfactual analysis finds that memory utility is sparse and strongly state-dependent: most retrieved memories do not change the agent's next action, and similarity is a poor predictor of which ones do.

How it works

  1. Measure credit offline. Run controlled interventions: replay a decision with and without a given memory in context and record whether and how the action changes. That difference is the memory's credit for that state, reference context and policy.

  2. Distill an estimator. Train a lightweight model to predict a memory's credit from features of the state and the memory.

  3. Select at inference. Semantic retrieval still produces a high-recall candidate set; the utility estimator decides which candidates fit in a fixed token budget. The agent policy is unchanged and no extra environment interaction is needed.

Results (author-reported)

Why it matters

Tradeoffs and failure modes

Review checklist

  1. Do we know what fraction of retrieved memories ever changes an action?

  2. Is retrieval tuned for recall, with a separate precision step under a token budget?

  3. Can we replay decisions to ablate memories offline?

  4. Are hard constraints kept out of the utility-ranked pool so they are always loaded?

R040 (evidence-linked agent memory), R059 (the memory tax), R083 (agent memory pattern catalog), R084 (what an always-on agent should store), R002.

Connections

See R088 on the knowledge map

Part of the Research notes on nowucca.com. Figures and claims are the source's own unless the summary says otherwise.