passdrill
AI & LLM Engineering · AI Agents & Tool Use · Card 002/012 easy

A research-QA agent is prompted to alternate between writing a brief 'Thought' about what it still needs to find out, taking an 'Action' such as querying an external knowledge source, and reading an 'Observation' of that query's result, before moving to its next Thought. Compared to having the model produce one uninterrupted chain-of-thought and then answer directly, what is the main benefit of this interleaved Thought/Action/Observation pattern?

  1. It guarantees the final answer will be completely free of factual errors, since every claim is now backed by a verified action
  2. It removes the need for the model to reason at all, replacing reasoning entirely with a fixed lookup script
  3. It grounds each later reasoning step in real information retrieved from the environment, reducing the hallucination and error propagation that can accumulate when a model reasons in one unchecked pass
  4. It permanently increases the size of the model's context window, letting it process longer documents than it otherwise could
Next card → Shuffle