OLMoE

An open-source expert mixture language model with 130 million active parameters.

CommonProductProductivityNatural Language ProcessingExpert Mixture Model

OLMoE is a fully open, state-of-the-art expert mixture model with 130 million active parameters and a total of 690 million parameters. All data, code, and logs associated with the model have been released. It provides a comprehensive overview of resources related to the paper 'OLMoE: Open Mixture-of-Experts Language Models'. This model has significant applications in pre-training, fine-tuning, adaptation, and evaluation, marking a milestone in the field of natural language processing.

Best AI Websites & Tools

OLMoE

OLMoE Visit Over Time

OLMoE Visit Trend

OLMoE Visit Geography

OLMoE Traffic Sources

OLMoE Alternatives

YAYI-UIE Information Extraction Large Model — High-quality information extraction model based on massive data

Reflection Llama-3.1 70B — The world's leading open-source large language model

OLMoE-1B-7B — An efficient open-source large language model.

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

OpenVoiceChat — Engage in natural voice conversations with large language models.

fact-finder — An intelligent question-answering system based on knowledge graphs.

1.5-Pints — A compact large language model pre-trained in 9 days

speech-to-speech — Open-source speech-to-speech conversion module

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

Meta Llama 3.1-405B — Large multilingual pre-trained language model

RWKV — The new generation of large-scale model architecture, surpassing transformer.

gemma-2-9b — Lightweight, advanced text generation model

Index-1.9B-Pure — A lightweight large language model focused on text generation.

GLM-4 Series — Open-source multilingual multimodal dialogue model

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Cognita — An open-source framework for constructing modular production-level applications.

GraphRAG — An end-to-end system that integrates text extraction, network analysis, and large language model prompting and summarization

Qwen1.5-110B — The first petabyte-scale open-source model in the Qwen1.5 series, supporting multilingual functionality and an efficient Transformer decoder architecture.

Snowflake Arctic — An efficient enterprise-level AI model that achieves high-quality custom models at a low cost.

OpenELM — OpenELM is a family of efficient language models equipped with an open-source training and inference framework.

Meta Llama 3 — Meta's new generation of open-source large language model with excellent performance

Qwen1.5-32B — A series of Transformer-based pre-trained language models

Gemma-7B — A 70-Billion Parameter Language Model by Google

Gemma-2b — An open-source pre-trained language model released by Google

Ollama Windows Preview — Ollama enables local execution of large AI models on Windows.