Tag: Inference Scaling Laws

For the first decade of the modern deep learning expansion, progress followed a single primary vector: pre-training compute scaling laws. Empirical research from Kaplan and Chinchilla demonstrated that model capabilities scaled predictably as a power-law function of parameter counts, dataset volume, and training FLOPs. However, by late 2024, pre-training reached physical and economic friction points: […]