1.5-Pints

A compact large language model pre-trained in 9 days

CommonProductProgrammingOpen SourceMachine Learning

1.5-Pints is an open-source, compact large language model (LLM) that has been pre-trained using high-quality data over a span of 9 days. It aims to serve as an AI assistant comparable to Apple OpenELM and Microsoft Phi. The model's codebase and architecture are publicly available to facilitate replication, experimentation, and further open-source development.

Model architecture design with options for different layers/dimensions/heads
Training scripts supporting custom training parameters and dataset configurations
Dataset preparation tools for processing and prepping training data
Model fine-tuning capabilities allowing additional training on pre-trained models
Model evaluation tools for testing model performance
Model conversion functionality to convert lit models to HuggingFace model format

\1.5-Pints is primarily targeted at researchers and developers in the fields of machine learning and natural language processing
especially professionals interested in developing and optimizing large language models. It provides a fast-track to pre-trained models
helping to speed up both research and product development processes.\

Researchers using 1.5-Pints for academic studies in language models
Companies developing intelligent customer service systems using this model
Developers creating personalized chatbots based on 1.5-Pints

Clone the 1.5-Pints code repository to your local environment
Create and activate a Conda environment and install the required dependencies
Download and prepare the pre-trained dataset
Configure training parameters and datasets as needed
Run the training script to initiate model training

Visit

1.5-Pints Visit Over Time

Monthly Visits

499904316

Bounce Rate

37.31%

Page per Visit

5.8

Visit Duration

00:06:52

1.5-Pints Visit Trend

1.5-Pints Visit Geography

1.5-Pints Traffic Sources

1.5-Pints Alternatives

Reflection Llama-3.1 70B — The world's leading open-source large language model

Productivity•Large Language Model•Natural Language Processing

264

OLMoE-1B-7B — An efficient open-source large language model.

Productivity•Large Language Model•Open Source

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

Productivity•Artificial Intelligence•Natural Language Processing

162

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

Programming•Natural Language Processing•Machine Learning

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Programming•Speech Recognition•Natural Language Processing

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

Programming•Open Source•Natural Language Processing

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Programming•Natural Language Processing•Open Source

414

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Programming•Code Intelligence•Machine Learning

288

Cognita — An open-source framework for constructing modular production-level applications.

Programming•Machine Learning•Natural Language Processing

192

Qwen1.5-110B — The first petabyte-scale open-source model in the Qwen1.5 series, supporting multilingual functionality and an efficient Transformer decoder architecture.

ChineseSelection•Artificial Intelligence•Machine Learning

546

Snowflake Arctic — An efficient enterprise-level AI model that achieves high-quality custom models at a low cost.

InternationalSelection•Artificial Intelligence•Machine Learning

150

OpenELM — OpenELM is a family of efficient language models equipped with an open-source training and inference framework.

InternationalSelection•Language Model•Natural Language Processing

624

Copilot in Excel — Copilot in Excel: Unlocking data-driven decision-making.

Productivity•Data Analysis•Automation

Mistral-Small-Instruct-2409 — High-performance instruct-tuned AI model

Programming•Artificial Intelligence•Natural Language Processing

Qwen2.5-LLM — An open-source high-performance language model that supports multi-platform applications.

Productivity•Natural Language Processing•Machine Learning

xAI — AI to Accelerate Human Scientific Discovery

Skywork-Reward-Llama-3.1-8B — An advanced reward model for text classification and preference assessment.

Programming•Machine Learning•Natural Language Processing

pixtral-12b-240910 — A multimodal large language model that supports understanding of both images and text.

Image•Multimodal•Image Processing

MemoRAG — A memory-based RAG framework for general-purpose applications

Programming•Natural Language Processing•Machine Learning

Qihoo-T2X — Qihoo-T2X, an efficient diffusion transformer model aimed at text-to-any-task processing.

Programming•Text Processing•Diffusion Transformer

rStar — Enhances problem-solving capabilities of small language models through self-play mutual reasoning.

Programming•Machine Learning•Natural Language Processing

RAGLAB — A modular, research-oriented unified framework for retrieval-augmented generation

Programming•Natural Language Processing•Machine Learning

DeepSeek-V2.5 — An AI model integrating general and programming capabilities.

Productivity•Artificial Intelligence•Machine Learning

126

West Lake AI Model — A multimodal model with high emotional and intellectual intelligence

ChineseSelection•Artificial Intelligence•Multimodal

120

OLMoE — An open-source expert mixture language model with 130 million active parameters.

Productivity•Natural Language Processing•Expert Mixture Model

Aixploria — AI tools directory for discovering the best AI tools

Productivity•AI tools•AI navigation

228

PR-Agent — AI assistant that streamlines the code review process

Programming•Code Review•Automation

138

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

Productivity•ChatGPT•Artificial Intelligence

C4AI Command R+ 08-2024 — A multilingual advanced dialogue generation model with 104 billion parameters.

Productivity•Artificial Intelligence•Machine Learning

Best AI Websites & Tools

1.5-Pints

1.5-Pints Visit Over Time

1.5-Pints Visit Trend

1.5-Pints Visit Geography

1.5-Pints Traffic Sources

1.5-Pints Alternatives

Reflection Llama-3.1 70B — The world's leading open-source large language model

OLMoE-1B-7B — An efficient open-source large language model.

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Cognita — An open-source framework for constructing modular production-level applications.

Qwen1.5-110B — The first petabyte-scale open-source model in the Qwen1.5 series, supporting multilingual functionality and an efficient Transformer decoder architecture.

Snowflake Arctic — An efficient enterprise-level AI model that achieves high-quality custom models at a low cost.

OpenELM — OpenELM is a family of efficient language models equipped with an open-source training and inference framework.

Copilot in Excel — Copilot in Excel: Unlocking data-driven decision-making.

Mistral-Small-Instruct-2409 — High-performance instruct-tuned AI model

Qwen2.5-LLM — An open-source high-performance language model that supports multi-platform applications.

xAI — AI to Accelerate Human Scientific Discovery

Skywork-Reward-Llama-3.1-8B — An advanced reward model for text classification and preference assessment.

pixtral-12b-240910 — A multimodal large language model that supports understanding of both images and text.

MemoRAG — A memory-based RAG framework for general-purpose applications

Qihoo-T2X — Qihoo-T2X, an efficient diffusion transformer model aimed at text-to-any-task processing.

rStar — Enhances problem-solving capabilities of small language models through self-play mutual reasoning.

RAGLAB — A modular, research-oriented unified framework for retrieval-augmented generation

DeepSeek-V2.5 — An AI model integrating general and programming capabilities.

West Lake AI Model — A multimodal model with high emotional and intellectual intelligence

OLMoE — An open-source expert mixture language model with 130 million active parameters.

Aixploria — AI tools directory for discovering the best AI tools

PR-Agent — AI assistant that streamlines the code review process

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

C4AI Command R+ 08-2024 — A multilingual advanced dialogue generation model with 104 billion parameters.