FineWeb

High-quality English webpage dataset

CommonProductProgrammingNatural Language ProcessingDataset

The FineWeb dataset contains over 150 billion web pages of cleaned and deduplicated English text sourced from CommonCrawl. Designed specifically for pre-training large language models, it aims to advance the development of open-source models. The dataset has been meticulously processed and filtered to ensure high quality, making it suitable for a variety of natural language processing tasks.

Best AI Websites & Tools

FineWeb

FineWeb Visit Over Time

FineWeb Visit Trend

FineWeb Visit Geography

FineWeb Traffic Sources

FineWeb Alternatives

MedTrinity-25M — A large-scale multimodal medical dataset

Data-Juicer — A one-stop data processing system that provides high-quality data for large language models.

DCLM-baseline — High-performance language model benchmark dataset

Tele-FLM — An open-source multilingual large language model with 52 billion parameters

Index-1.9B-Pure — A lightweight large language model focused on text generation.

emo-visual-data — Emoji Visual Annotation Dataset

FlashRAG — Efficient Toolkit for Retrieval-Augmented Generation Research

ImageInWords — A model for generating highly detailed image descriptions, designed for training visual language models.

WildChat — A corpus composed of real-world user interactions with ChatGPT.

OpenBioLLM-Llama3-8B — An open-source large language model specifically designed for the biomedical field

LaVague — LaVague is a large language model framework for automating browser interactions.

MNBVC — MNBVC is a massive Chinese corpus comparable to the 40T data used to train ChatGPT.

Llama 3 — A new generation of open-source large language model with excellent performance.

H2O-Danube-1.8B — A 1.8B parameter language model, open-source and free.

Lepton Search — Lepton is an open-source language model search platform

Yi-VL-34B — Advanced open-source multimodal model

En3D — 3D Character Generation Model

Distil-Whisper — A collection of models and datasets.

RoleLLM — Role-playing framework for large language models

Falcon 180B — Falcon LLM - Pioneering the next generation of language models.

I2VGen-XL — AI Model Library and Dataset Platform

Inst-Inpaint — An image restoration algorithm based on natural language input

FinGPT — Open-source financial large language model

LLM Sandbox by Dioptra — An open-source data management and annotation platform

Open Voice OS — Open-source voice AI platform

Dokko — Conversational AI platform for knowledge sharing

DeepSeek-R1-Lite-Preview — Unlock powerful reasoning capabilities to enhance AIME & MATH benchmark performance.

Qwen Turbo 1M Demo — The Qwen Turbo 1M Demo is a Hugging Face space provided by Qwen.

WorkflowLLM — A data-driven framework that enhances the workflow orchestration capabilities of large language models.