Diffusion Model’s Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold
arXiv:2602.06021v1 Announce Type: new Abstract: When a diffusion model is not memorizing the training data set, how does it generalize exactly? A quantitative understanding of the distribution it generates would be beneficial to, for example, an assessment of the model’s performance for downstream applications. We thus explicitly characterize what diffusion model generates, by proposing a log-density ridge manifold and quantifying how the generated data relate to this manifold as inference dynamics progresses. More precisely, inference undergoes a reach-align-slide […]