passdrill
AI & LLM Engineering · AI Agents & Tool Use · Card 008/012 medium

A simulated agent needs to act consistently over many simulated days, far longer than could ever fit inside a single prompt. Its architecture keeps a running, timestamped log of everything the agent observes and does, periodically has the model synthesize higher-level 'reflections' from recent entries in that log, and retrieves only the log entries and reflections most relevant to its current situation to insert into the prompt when it needs to decide what to do next. What problem is this external memory log-and-retrieval design primarily solving?

  1. That the model's own context window cannot hold the agent's entire history, so relevant past experience has to live outside the prompt and be selectively pulled back in only when needed, rather than resent in full every time
  2. That retrieval-augmented generation and agent memory are the same mechanism, so any agent already doing RAG over documents automatically has this capability with no extra design work
  3. That language models cannot retain any information at all between two consecutive turns of the same single conversation, even when that history would otherwise fit in the prompt
  4. That reflections are required before a model is allowed to take any action, regardless of how simple that action is
Next card → Shuffle