FineWeb

High-quality English webpage dataset

CommonProductProgrammingNatural Language ProcessingDataset

The FineWeb dataset contains over 150 billion web pages of cleaned and deduplicated English text sourced from CommonCrawl. Designed specifically for pre-training large language models, it aims to advance the development of open-source models. The dataset has been meticulously processed and filtered to ensure high quality, making it suitable for a variety of natural language processing tasks.

Best AI Websites & Tools

FineWeb

FineWeb Visit Over Time

FineWeb Visit Trend

FineWeb Visit Geography

FineWeb Traffic Sources

FineWeb Alternatives

Nemotron-CC — Transforms Common Crawl into a refined long-term pre-training dataset.

YuLan-Mini — A highly efficient lightweight language model with 240 million parameters.

OLMo 2 1124 13B Preference Mixture — Large-scale multilingual preference mixture dataset

dolmino-mix-1124 — A high-quality dataset for the second phase of OLMo2 training.

MedTrinity-25M — A large-scale multimodal medical dataset

Data-Juicer — A one-stop data processing system that provides high-quality data for large language models.

DCLM-baseline — High-performance language model benchmark dataset

Tele-FLM — An open-source multilingual large language model with 52 billion parameters

Index-1.9B-Pure — A lightweight large language model focused on text generation.

emo-visual-data — Emoji Visual Annotation Dataset

FlashRAG — Efficient Toolkit for Retrieval-Augmented Generation Research

ImageInWords — A model for generating highly detailed image descriptions, designed for training visual language models.

WildChat — A corpus composed of real-world user interactions with ChatGPT.

OpenBioLLM-Llama3-8B — An open-source large language model specifically designed for the biomedical field

LaVague — LaVague is a large language model framework for automating browser interactions.

MNBVC — MNBVC is a massive Chinese corpus comparable to the 40T data used to train ChatGPT.

Llama 3 — A new generation of open-source large language model with excellent performance.

H2O-Danube-1.8B — A 1.8B parameter language model, open-source and free.

Lepton Search — Lepton is an open-source language model search platform

Yi-VL-34B — Advanced open-source multimodal model

En3D — 3D Character Generation Model

Distil-Whisper — A collection of models and datasets.

RoleLLM — Role-playing framework for large language models

Falcon 180B — Falcon LLM - Pioneering the next generation of language models.

I2VGen-XL — AI Model Library and Dataset Platform

Inst-Inpaint — An image restoration algorithm based on natural language input

FinGPT — Open-source financial large language model

LLM Sandbox by Dioptra — An open-source data management and annotation platform

Open Voice OS — Open-source voice AI platform