The Power of Test-Time Training for Approximate SamplingResearch Paper
A language model generates a sequence one token at a time, and a common way to improve it at inference time is to steer generation with a learned value function that scores partial sequences. Golowich, Moitra and Rohatgi model this as sampling: an unknown target distribution on strings of length is accessible only through an oracle that…