NuminaMath is a database and model designed for training the state-of-the-art math language models (SOTA math LLMs). It comprises 860k+ pairs of math competition problems and solutions, where each solution is templatized using chain of thought (CoT) reasoning. In addition, there are 70k+ math competition problems, whose solutions are generated by GPT-4 through tool integrated reasoning (TIR). NuminaMath provides a valuable resource for educators and students by offering high-quality math problems and solutions, which helps them improve their mathematical thinking and problem-solving abilities.