Scaling Law
S
Scaling Law
Definition
Empirical relationships showing how AI model performance improves predictably as model size, dataset size, or compute budget increases. Scaling laws have guided the development of increasingly large foundation models and help predict capabilities before training.