passdrill
AI & LLM Engineering · Fine-tuning & Model Customisation · Card 009/010 hard

A team fine-tunes a policy by optimizing it, via reinforcement learning, as hard as possible against a fixed, already-trained proxy reward model rather than against real human judgment. Gao, Schulman & Hilton studied this setup by using a much larger 'gold-standard' reward model to stand in for real human judgment, so they could measure the gap between the two as optimization pressure against the proxy increased. What did they find happens to gold-standard, true-preference performance as optimization against the fixed proxy reward model continues further and further?

  1. Gold-standard performance rises without limit for as long as optimization against the proxy reward model continues, with no observed ceiling or decline in any of the tested configurations
  2. Gold-standard performance initially rises alongside the proxy reward model's score but eventually plateaus and then declines even as the proxy score keeps climbing, an instance of Goodhart's law where the imperfect proxy is increasingly over-exploited; the relationship follows scaling patterns that shift with the reward model's size and with whether optimization is done via reinforcement learning or best-of-n sampling
  3. This decline in gold-standard performance was observed only when optimizing via best-of-n sampling and never appeared at all when optimizing via reinforcement learning, showing the two optimization methods behave in completely unrelated ways
  4. The paper found that simply increasing the proxy reward model's parameter count to be large enough eliminates the decline in gold-standard performance entirely, regardless of how much further optimization pressure is then applied
Next card → Shuffle