Agent memory vs RAG
Retrieval answers “what is relevant?” Action memory answers “what may we rely on?”
RAG and vector retrieval are good at finding context. They do not, by themselves, establish source, confidence, confirmation, or permission to take a consequential action. ContextDB adds that decision layer.
Different jobs
Relevant does not mean trusted for action.
| Question | RAG or vector retrieval | Decision-safe memory |
|---|---|---|
| Primary job | Find semantically relevant context | Evaluate evidence for a specific action |
| Typical input | Query plus documents or chunks | Action query plus sourced memories and policy |
| Typical output | Ranked relevant context | Act, ask, or abstain with evidence and reason |
| Source semantics | Depends on the application | User-stated, agent-inferred, or third-party |
| Action audit | Depends on the application | Decision object with policy and evidence IDs |
The failure mode
Prompt inclusion quietly becomes permission.
A retriever finds “Friday might be easier” because it is relevant to scheduling. The model sees it near the tool call and treats it like an instruction. The retrieval step worked. The permission model was missing.
# retrieval result "Friday might be easier, maybe." similarity = high relevance ≠ authority # action decision source = "user_stated" confidence = 0.4 confirmed = false outcome = "ask" reason = "tentative preference"
When to use each
Use the smallest tool that solves the job.
Use ordinary RAG when
- The agent answers from a document corpus
- A person reviews the generated output
- Relevant context is the main requirement
- No recalled statement directly authorizes a mutation
Add ContextDB when
- The agent acts using remembered user facts
- Tentative and confirmed statements need different treatment
- Missing evidence should stop or trigger a question
- An operator needs the reason after the action
Questions
Common architecture questions.
Is ContextDB a vector database?
ContextDB is positioned as decision-safe agent memory. Retrieval can be part of that system, but the product's job is to evaluate evidence for action and record the decision.
Should I remove my existing RAG pipeline?
No. Keep it where it works. Add an action-specific memory check before consequential tool calls.
Does act mean the remembered fact is objectively true?
No. It means the evidence passed the configured policy for that action. Confirmation records attestation, not objective truth.
Keep retrieval. Add permission.
Run action recall before one consequential tool call.