A research-QA agent is prompted to alternate between writing a brief 'Thought' about what it still needs to find out, taking an 'Action' such as querying an external knowledge source, and reading an 'Observation' of that query's result, before moving to its next Thought. Compared to having the model produce one uninterrupted chain-of-thought and then answer directly, what is the main benefit of this interleaved Thought/Action/Observation pattern?
- It guarantees the final answer will be completely free of factual errors, since every claim is now backed by a verified action
- It removes the need for the model to reason at all, replacing reasoning entirely with a fixed lookup script
- It grounds each later reasoning step in real information retrieved from the environment, reducing the hallucination and error propagation that can accumulate when a model reasons in one unchecked pass
- It permanently increases the size of the model's context window, letting it process longer documents than it otherwise could
Why C? And why not the others?
Correct answer: C. It grounds each later reasoning step in real information retrieved from the environment, reducing the hallucination and error propagation that can accumulate when a model reasons in one unchecked pass
This Thought/Action/Observation pattern is the ReAct approach: interleaving reasoning traces with actions lets the model's later reasoning steps update on real observations pulled from an external environment (such as a knowledge-base query), rather than continuing to build on an earlier reasoning step that may already have drifted from the facts. Yao et al. showed this measurably reduces the hallucination and error propagation that plain chain-of-thought reasoning is prone to on multi-step question-answering and fact-verification tasks, because a wrong intermediate claim gets corrected by an observation instead of being compounded further. The option claiming complete freedom from factual errors overstates the benefit -- retrieved sources can themselves be wrong or misread, so grounding reduces but does not eliminate error. The option describing reasoning as removed entirely misunderstands the pattern, since the Thought step is reasoning and remains essential to deciding what to look up next. The option about a permanently larger context window confuses a prompting pattern with a model's architecture; interleaving Thought/Action/Observation does not change how many tokens the underlying model can attend to.
Source: Yao et al., 'ReAct: Synergizing Reasoning and Acting in Language Models' (2022), arXiv:2210.03629