OLMoE

An open-source expert mixture language model with 130 million active parameters.

CommonProductProductivityNatural Language ProcessingExpert Mixture Model

OLMoE is a fully open, state-of-the-art expert mixture model with 130 million active parameters and a total of 690 million parameters. All data, code, and logs associated with the model have been released. It provides a comprehensive overview of resources related to the paper 'OLMoE: Open Mixture-of-Experts Language Models'. This model has significant applications in pre-training, fine-tuning, adaptation, and evaluation, marking a milestone in the field of natural language processing.

Best AI Websites & Tools

OLMoE

OLMoE Visit Over Time

OLMoE Visit Trend

OLMoE Visit Geography

OLMoE Traffic Sources

OLMoE Alternatives

YAYI-UIE Information Extraction Large Model — High-quality information extraction model based on massive data

Tencent-Hunyuan-Large — Industry-leading open-source large mixture-of-experts model

llmc — A local inference command-line tool that converts natural language descriptions into executable shell commands.

Knowledge Table — An open-source tool that simplifies the extraction and exploration of structured data from unstructured documents.

Zamba2-7B — High-performance small language model

TurboSeek — An open-source AI search engine powered by Together.ai.

Chat with your Database — Interact with your database using natural language to query data.

SLM_Survey — Research, Measurement, and Insights on Small Language Models

Reflection Llama-3.1 70B — The world's leading open-source large language model

OLMoE-1B-7B — An efficient open-source large language model.

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

OpenVoiceChat — Engage in natural voice conversations with large language models.

fact-finder — An intelligent question-answering system based on knowledge graphs.

1.5-Pints — A compact large language model pre-trained in 9 days

speech-to-speech — Open-source speech-to-speech conversion module

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

Meta Llama 3.1-405B — Large multilingual pre-trained language model

RWKV — The new generation of large-scale model architecture, surpassing transformer.

gemma-2-9b — Lightweight, advanced text generation model

Index-1.9B-Pure — A lightweight large language model focused on text generation.

GLM-4 Series — Open-source multilingual multimodal dialogue model

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Cognita — An open-source framework for constructing modular production-level applications.

GraphRAG — An end-to-end system that integrates text extraction, network analysis, and large language model prompting and summarization

Qwen1.5-110B — The first petabyte-scale open-source model in the Qwen1.5 series, supporting multilingual functionality and an efficient Transformer decoder architecture.