llm.c

Utilizes simple C/CUDA for LLM training.

CommonProductProgrammingLLMC

karpathy/llm.c is a project that implements LLM training using a simple C/CUDA implementation. It aims to provide a clean and straightforward reference implementation while also including optimized versions that can approach the performance of PyTorch with drastically reduced code and dependencies. It is currently under development for a direct CUDA implementation, CPU version optimization using SIMD instructions, and support for more modern architectures such as Llama2 and Gemma.

Uses simple C/CUDA to implement LLM training
Provides a clean and simple reference implementation
Includes optimized versions with performance close to PyTorch
Supports various modern LLM architectures

Serves as a reference implementation for LLM training and a foundation for further optimization and expansion of LLM models.

Implemented a small-scale language model based on GPT-2 using karpathy/llm.c and achieved significant speed improvements through the optimized version.
Developed an LLM training tool that supports the Llama2 architecture based on karpathy/llm.c.
Referred to the code structure and implementation of karpathy/llm.c to develop a custom LLM model tailored to a specific application scenario.

Visit

llm.c Visit Over Time

Monthly Visits

515580771

Bounce Rate

37.20%

Page per Visit

5.8

Visit Duration

00:06:42

llm.c Visit Trend

llm.c Visit Geography

llm.c Traffic Sources

llm.c Alternatives

Prompt Engineering — A comprehensive resource library for Prompt Engineering techniques.

Productivity•Prompt Engineering•Machine Learning

RAG_Techniques — A revolutionary collection of Retrieval-Augmented Generation system technologies.

Programming•RAG•NLP

150

Qwen2.5-Coder-0.5B — The 0.5B parameter code generation model in the Qwen2.5-Coder series.

Programming•Code Generation•Code Reasoning

IBM Granite 3.0 Models — IBM Granite 3.0 Models, high-performance AI language models

Programming•Machine Learning•Natural Language Processing

awesome-LLM-resources — A comprehensive collection of global large language model resources.

Productivity•Large Language Models•Resource Aggregation

Zamba2-7B — High-performance small language model

Productivity•Language Model•Natural Language Processing

126

falcon-mamba-7b — A high-performance causal language model with 7 billion parameters.

Productivity•Causal Language Model•Natural Language Processing

Piao Computing Cloud Large Model API — Rapid AIGC Application Construction Platform

Productivity•API•Large Models

SLM_Survey — Research, Measurement, and Insights on Small Language Models

Education•Small Language Models•Transformer

ColPali — Efficient document retrieval tool based on visual language models

Productivity•Document Retrieval•Visual Language Models

Cheating LLM Benchmarks — A research project that explores cheating behaviors in automated language model benchmarking.

Programming•Natural Language Processing•Machine Learning

LlamaIndex.TS — A framework for building LLM applications

Programming•LLM•Natural Language Processing

Entropy-based Sampling — Entropy-based sampling technique that optimizes the diversity and accuracy of model outputs

Programming•Machine Learning•Natural Language Processing

AI Sentence Generator — An online tool that utilizes AI technology to generate high-quality sentences

Writing•AI Writing•Natural Language Processing

174

Molmo — Advanced Multimodal AI Model Family

InternationalSelection•Multimodal•Image Recognition

300

Llama-3.2-3B — Multilingual Large Language Model

Productivity•Artificial Intelligence•Machine Learning

186

YunHu Ai — An AI assistant that creates limitless possibilities.

ChineseSelection•Artificial Intelligence•Chat Assistant

SmartDialogue — Explore unlimited intelligence and build a more perfect path of aggregation.

chatting•Artificial Intelligence•Natural Language Processing

510

GRIN-MoE — High-performance, low-resource consumption hybrid expert model

Programming•Artificial Intelligence•Machine Learning

Copilot in Excel — Copilot in Excel: Unlocking data-driven decision-making.

Productivity•Data Analysis•Automation

144

Mistral-Small-Instruct-2409 — High-performance instruct-tuned AI model

Programming•Artificial Intelligence•Natural Language Processing

Best AI Websites & Tools