Llama-3.1-Nemotron-70B-Instruct is a large language model tailored by NVIDIA, focusing on improving the helpfulness of responses generated by large language models (LLM). This model excelled in various auto-alignment benchmark tests, such as Arena Hard, AlpacaEval 2 LC, and GPT-4-Turbo MT-Bench. It is trained using RLHF (specifically, the REINFORCE algorithm), Llama-3.1-Nemotron-70B-Reward, and HelpSteer2-Preference prompts on the Llama-3.1-70B-Instruct model. This model not only showcases NVIDIA's technological advances in enhancing generative support for general domain instructions but also offers a model conversion format compatible with the Hugging Face Transformers library, with free hosted inference available through NVIDIA's build platform.