InternLM-Math-Plus is a cutting-edge bilingual (English and Chinese) open-source large language model (LLM) focused on mathematical reasoning. It exhibits capabilities in solving, proving, validating, and augmenting mathematical problems. It demonstrates significant performance improvements in both informal mathematical reasoning (such as reasoning chains and code interpretation) and formal mathematical reasoning (such as LEAN 4 translation and proof).