OLMoE-1B-7B is a specialized mixture of experts large language model (LLM) with 100 million active parameters and a total of 700 million parameters, released in September 2024. This model outperforms similarly priced models and competes with larger models such as Llama2-13B. OLMoE is fully open-source and supports a variety of features, including text generation, model training, and deployment.