2025-01-07 10:17:11.AIbase.14.5k
Google Uses Small Models to Accelerate AI Training of Large Models, Improving Efficiency by 28%
In recent years, training large language models (LLMs) has become increasingly expensive and complex, with only a few major tech companies possessing the necessary computing resources. However, Google has recently introduced a new method called SALT (Small Model-Assisted Large Model Training), which could fundamentally change the landscape of AI training. Image Source Note: The image was generated by AI, and the image is authorized by service provider Midjourney based on the latest research papers from Google Research and DeepMind, 'A Little Help Goes a Long Way: Leveraging Small Language Models...'
