1.5-Pints

A compact large language model pre-trained in 9 days

CommonProductProgrammingOpen SourceMachine Learning

1.5-Pints is an open-source, compact large language model (LLM) that has been pre-trained using high-quality data over a span of 9 days. It aims to serve as an AI assistant comparable to Apple OpenELM and Microsoft Phi. The model's codebase and architecture are publicly available to facilitate replication, experimentation, and further open-source development.

Model architecture design with options for different layers/dimensions/heads
Training scripts supporting custom training parameters and dataset configurations
Dataset preparation tools for processing and prepping training data
Model fine-tuning capabilities allowing additional training on pre-trained models
Model evaluation tools for testing model performance
Model conversion functionality to convert lit models to HuggingFace model format

\1.5-Pints is primarily targeted at researchers and developers in the fields of machine learning and natural language processing
especially professionals interested in developing and optimizing large language models. It provides a fast-track to pre-trained models
helping to speed up both research and product development processes.\

Researchers using 1.5-Pints for academic studies in language models
Companies developing intelligent customer service systems using this model
Developers creating personalized chatbots based on 1.5-Pints

Clone the 1.5-Pints code repository to your local environment
Create and activate a Conda environment and install the required dependencies
Download and prepare the pre-trained dataset
Configure training parameters and datasets as needed
Run the training script to initiate model training

Visit

1.5-Pints Visit Over Time

Monthly Visits

494758773

Bounce Rate

37.69%

Page per Visit

5.7

Visit Duration

00:06:29

1.5-Pints Visit Trend

1.5-Pints Visit Geography

1.5-Pints Traffic Sources

1.5-Pints Alternatives

Q-RWKV-6 32B Instruct Preview — The most powerful variant of the RWKV model, breaking multiple English benchmark tests.

Programming•Machine Learning•Natural Language Processing

OLMo-2-1124-7B-SFT — High-performance English text generation model

Productivity•Text Generation•Natural Language Processing

Llama-3.1-Tulu-3-8B-DPO — An advanced text generation model that supports diverse tasks.

Programming•Text Generation•Natural Language Processing

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

Productivity•Artificial Intelligence•Natural Language Processing

234

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

Programming•Natural Language Processing•Machine Learning

102

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Programming•Speech Recognition•Natural Language Processing

102

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

Programming•Open Source•Natural Language Processing

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Programming•Natural Language Processing•Open Source

438

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Programming•Code Intelligence•Machine Learning

300

Cognita — An open-source framework for constructing modular production-level applications.

Programming•Machine Learning•Natural Language Processing

192

Qwen1.5-110B — The first petabyte-scale open-source model in the Qwen1.5 series, supporting multilingual functionality and an efficient Transformer decoder architecture.

ChineseSelection•Artificial Intelligence•Machine Learning

570

Snowflake Arctic — An efficient enterprise-level AI model that achieves high-quality custom models at a low cost.

InternationalSelection•Artificial Intelligence•Machine Learning

168

OpenELM — OpenELM is a family of efficient language models equipped with an open-source training and inference framework.

InternationalSelection•Language Model•Natural Language Processing

714

CosyVoice Speech Generation Model 2.0-0.5B — Efficient, multilingual speech synthesis model

Music•Speech Synthesis•Artificial Intelligence

114

tulu-3-sft-olmo-2-mixture — A large-scale multilingual text dataset.

Others•Multilingual•Text Dataset

OLMo-2-1124-7B-RM — A large language model for text generation and classification.

Productivity•Artificial Intelligence•Natural Language Processing

Agentless — An agentless approach to automatically resolve software development issues

Programming•Automated Repair•Software Engineering

ChatGPT Pro — Scalable access plan for cutting-edge AI models.

InternationalSelection•Machine Learning•Data Science

252

PaliGemma 2 — PaliGemma 2 is a powerful visual language model that is easy to fine-tune.

Productivity•Visual Language Model•Machine Learning

OLMo 2 1124 7B Preference Mixture — A large-scale textual dataset for preference mixture research.

Others•Natural Language Processing•Text Dataset

Supabase AI Assistant — An intelligent assistant that interacts with Postgres, generating, running, and debugging queries.

Programming•Database•Postgres

HunyuanVideo — A large-scale video generation model training framework open-sourced by Tencent.

Video•Video Generation•Artificial Intelligence

282

OLMo-2-1124-7B-DPO — An advanced text generation model supporting diverse task handling.