TinyLlama

The TinyLlama project aims to pre-train a 1.1B Llama model on 3 trillion tokens. With some optimizations, we can achieve this in just 90 days using 16 A100-40G GPUs. Training began on 2023-09-01.

CommonProductchattingPre-trained ModelChat

Visit

The TinyLlama project aims to pre-train a 1.1B Llama model on 3 trillion tokens. With some optimizations, we can achieve this in just 90 days using 16 A100-40G GPUs. Training began on 2023-09-01. We adopt the same architecture and tokenizer as Llama 2. This means TinyLlama can be used in many open-source projects built on top of Llama. Additionally, with only 1.1B parameters, TinyLlama's compactness allows it to meet the needs of many applications with limited computational and memory resources.

Text Generation
Transformers
Safe Tensors

TinyLlama can be used for fine-tuning chat models and text generation.

https://github.com/jzhang38/TinyLlama
https://huggingface.co/docs/transformers/main/en/chat_templating
https://github.com/huggingface/transformers.git

Visit

TinyLlama Visit Over Time

Monthly Visits

19075321

Bounce Rate

45.07%

Page per Visit

5.5

Visit Duration

00:05:32

TinyLlama Visit Trend

TinyLlama Visit Geography

TinyLlama Traffic Sources

TinyLlama Alternatives

Aya Expanse 32B — A multilingual large language model supporting 23 languages

Productivity•multilingual•text generation

EXAONE-3.0-7.8B-Instruct — A bilingual generative model with 780 million parameters.

chatting•NLP•Text Generation

102

Index-1.9B-Pure — A lightweight large language model focused on text generation.

Programming•Text Generation•Natural Language Processing

126

Syncia — Browser extension that allows you to use ChatGPT from OpenAI on any website.

Productivity•Chat•Browser Extension

Qwen2.5-Coder-0.5B-Instruct-AWQ — Qwen2.5-Coder series 0.5B parameter code generation model.

Programming•Code Generation•Code Reasoning

AlphaQubit — AI-based decoder for quantum computing error correction

Programming•Quantum Computing•Artificial Intelligence

Qwen Turbo 1M Demo — The Qwen Turbo 1M Demo is a Hugging Face space provided by Qwen.

Productivity•Natural Language Processing•Machine Learning

Tide AI — Tide AI offers instant answers and creative inspiration.

chatting•Chat•Q&A

204

Qwen2.5-Coder-32B-Instruct-GGUF — Open-source code generation language model

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-0.5B-Instruct — Instruction-tuned 0.5B parameter code generation model in the Qwen2.5-Coder series

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-1.5B — 1.5B parameter code generation model in the Qwen2.5-Coder series

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-3B — The 3B parameter model in the Qwen2.5-Coder series focuses on code generation and comprehension.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-7B — A 7 billion parameter code generation model from the Qwen2.5-Coder series.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-7B-Instruct — A language model for code generation with 7B parameters.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-14B — A large language model for code generation and comprehension.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-14B-Instruct — A 14 billion parameter code generation model in the Qwen2.5-Coder series.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-32B — The open-source code generation model in the Qwen2.5-Coder series with the most parameters.

Programming•Code Generation•Code Reasoning

Qwen2.5-Coder-32B-Instruct — Open-source code generation large language model

Programming•Code Generation•Code Reasoning

Hermes 3 - Llama-3.1 70B — The latest large language model in the Hermes series.

Programming•Large Language Model•Text Generation

168

Chat.com — An interactive dialogue AI model offering Q&A and text generation services

InternationalSelection•Dialogue Generation•Natural Language Processing

222

Aquila-VL-2B-llava-qwen — A visual-language model that intelligently processes both image and text information.

Image•Visual Language Model•Multimodal

Ferret-UI-Llama8b — A multimodal large language model based on Llama-3-8B, focused on UI tasks.

Programming•Multimodal•Large Language Model

108

SmolLM2-1.7B — A lightweight language model with 1.7 billion parameters, suitable for diverse tasks.

Programming•Text Generation•Lightweight Model

Claude for Desktop — An AI companion for desktop, designed for fast and focused deep work.

InternationalSelection•Chat•Deep Work

510

Best AI Websites & Tools

TinyLlama

TinyLlama Visit Over Time

TinyLlama Visit Trend

TinyLlama Visit Geography

TinyLlama Traffic Sources

TinyLlama Alternatives

Aya Expanse 32B — A multilingual large language model supporting 23 languages

EXAONE-3.0-7.8B-Instruct — A bilingual generative model with 780 million parameters.

Index-1.9B-Pure — A lightweight large language model focused on text generation.

Tencent MX Assistant — AI companion offering diverse intelligent services

Mixtral-8x22B — A large language model based on a sparse expert framework.

Gemma-2b — An open-source pre-trained language model released by Google

Side-GPT — An extension for text generation powered by GPT-4.

AIssistify — Your AI assistant for sales, marketing, and RevOps.

Syncia — Browser extension that allows you to use ChatGPT from OpenAI on any website.

Qwen2.5-Coder-0.5B-Instruct-AWQ — Qwen2.5-Coder series 0.5B parameter code generation model.

AlphaQubit — AI-based decoder for quantum computing error correction

Qwen Turbo 1M Demo — The Qwen Turbo 1M Demo is a Hugging Face space provided by Qwen.

Tide AI — Tide AI offers instant answers and creative inspiration.

Qwen2.5-Coder-32B-Instruct-GGUF — Open-source code generation language model

Qwen2.5-Coder-0.5B-Instruct — Instruction-tuned 0.5B parameter code generation model in the Qwen2.5-Coder series

Qwen2.5-Coder-1.5B — 1.5B parameter code generation model in the Qwen2.5-Coder series

Qwen2.5-Coder-3B — The 3B parameter model in the Qwen2.5-Coder series focuses on code generation and comprehension.

Qwen2.5-Coder-7B — A 7 billion parameter code generation model from the Qwen2.5-Coder series.

Qwen2.5-Coder-7B-Instruct — A language model for code generation with 7B parameters.

Qwen2.5-Coder-14B — A large language model for code generation and comprehension.

Qwen2.5-Coder-14B-Instruct — A 14 billion parameter code generation model in the Qwen2.5-Coder series.

Qwen2.5-Coder-32B — The open-source code generation model in the Qwen2.5-Coder series with the most parameters.

Qwen2.5-Coder-32B-Instruct — Open-source code generation large language model

Hermes 3 - Llama-3.1 70B — The latest large language model in the Hermes series.

Chat.com — An interactive dialogue AI model offering Q&A and text generation services

Aquila-VL-2B-llava-qwen — A visual-language model that intelligently processes both image and text information.

Ferret-UI-Llama8b — A multimodal large language model based on Llama-3-8B, focused on UI tasks.

SmolLM2-1.7B — A lightweight language model with 1.7 billion parameters, suitable for diverse tasks.

Claude for Desktop — An AI companion for desktop, designed for fast and focused deep work.