SEP 8, 2026 · PREPRINT
Transformers as In-Context Samplers: From Closed-Form Diffusion to Estimation-Free Sampling
arXiv
A theoretical construction proving transformers can simulate generative samplers, with empirical observations of geometric patterns in hidden states, but no direct demonstration of sampling capability or comparison to established generative methods.
Study details
DesignTheoretical analysis with post-hoc analysis…
InterventionPrompts consisting of words from common sem…