Nemotron-4 340B is a series of open models released by NVIDIA, specifically designed for generating synthetic data to train large language models (LLMs). These models are optimized to work with NVIDIA NeMo and NVIDIA TensorRT-LLM, enhancing the efficiency of training and inference. Nemotron-4 340B comprises base, instruction, and reward models, forming a pipeline for generating synthetic data to train and refine LLMs. These models are available for download on Hugging Face and will soon be available on ai.nvidia.com as part of NVIDIA NIM microservices.