Meta AI researchers have introduced MobileLLM, a new approach to designing efficient language models for smartphones and other resource-constrained devices. This research was released on June 27, 2024, challenging the assumptions about the necessary scale for effective AI models.
The research team consists of members from Meta Reality Labs, PyTorch, and Meta AI Research (FAIR), focusing on optimizing models with fewer than 1 billion parameters. This is a fraction of models like GPT-4, which have