Configuration-to-Performance Scaling Law with Neural Ansatz
arXiv:2602.10300v1 Announce Type: new Abstract: Researchers build scaling laws to forecast the training performance of expensive large-scale runs with larger model size N and data size D. These laws assume that other training hyperparameters are optimally chosen, which can require significant effort and, in some cases, be impossible due to external hardware constraints. To improve predictability across a broader set of hyperparameters and enable simpler tuning at scale, we propose learning a textit{Configuration-to-Performance Scaling Law} (CPL): a mapping […]