MobileLLM-350M

An efficiently optimized language model with sub-billion parameters, specifically designed for device-side applications.

CommonProductProgrammingLanguage ModelTransformer

Visit

MobileLLM-350M is an autoregressive language model developed by Meta, utilizing an optimized Transformer architecture tailored for device-side applications to meet the needs of resource-constrained environments. The model integrates key technologies such as SwiGLU activation function, deep thin architecture, embedding sharing, and grouped query attention, resulting in significant accuracy improvements in zero-shot commonsense reasoning tasks. MobileLLM-350M offers performance comparable to larger models while maintaining a small model size, making it an ideal choice for natural language processing applications on devices.

Best AI Websites & Tools

MobileLLM-350M

MobileLLM-350M Visit Over Time

MobileLLM-350M Visit Trend

MobileLLM-350M Visit Geography

MobileLLM-350M Traffic Sources

MobileLLM-350M Alternatives

Lepton Search — Lepton is an open-source language model search platform

Aya Expanse — Developed by CohereForAI in the Hugging Face Space.

MaskGCT TTS Demo — Text-to-speech demonstration based on the MaskGCT model.

Zamba2-7B — High-performance small language model

SLM_Survey — Research, Measurement, and Insights on Small Language Models

Meta Llama 3.1-405B — Large multilingual pre-trained language model

DCLM-baseline — High-performance language model benchmark dataset

DCLM-7B — 700 million parameter language model, demonstrating the effectiveness of data organization technology.

Arcee Spark — A highly efficient and compact 7B parameter language model

Multi-Token Prediction — A multi-token prediction model designed to boost the efficiency and performance of language models

MDLM — An efficient masked diffusion language model.

Samba — Official implementation of an efficient infinite context language model

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Trustworthy Language Model (TLM) Playground — Try Cleanlab's Trustworthy Language Model (TLM) in your browser

LLaVA++ — LLaVA++ extends the LLaVA model by integrating Phi-3 and LLaMA-3, enhancing the interaction capability between visual and language models.

OpenELM — OpenELM is a family of efficient language models equipped with an open-source training and inference framework.

LLM Transparency Tool — Analyzes the inner workings of Transformer-based language models.

Qwen1.5-32B — A series of Transformer-based pre-trained language models

Cappy — A lightweight scoring model that enhances the performance of large, multi-task language models.

Hugging Face Course — Official courses from Hugging Face, providing tutorials and resources on using Hugging Face products.

H2O-Danube-1.8B — A 1.8B parameter language model, open-source and free.

Baichuan 3 — A large language model with over trillion parameters

Qwen-VL — General-purpose Visual Language Model

MaLA-500 — A large language model covering 534 languages

honeybee — Multi-modal Language Model Prediction Network

Wiseses AI — Intelligent Content Creation Platform

InternLM2 — Multilingual Pretrained Language Model

TinyGPT-V — Efficient multimodal large language model

intfloat/e5-mistral-7b-instruct — A text embedding model improved by a large language model for better text representation.