Popular GitHub Repositories for Scaling Laws

Scaling Data-Constrained Language Models

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

[NeurIPS'24 Spotlight] Observational Scaling Laws

code for Scaling Laws for Language Transfer Learning

Model Hemorrhage and the Robustness Limits of Large Language Models: A Perspective

RSRC Calculator is a practical tool designed to evaluate the efficiency of AI models in the post-scaling era: Recursive Self-Referential Compression (RSRC), this tool computes training efficiency metrics by analyzing factors such as training FLOPs, energy consumption, and model architecture details.