Nvidia's ChatQA2 model, optimized from Llama3, addresses key challenges in AI long-text context understanding and retrieval-augmented generation by extending the context window to 128K tokens and employing a three-phase instruction tuning process. It significantly enhances instruction adherence, RAG performance, and long-text comprehension. In the InfiniteBench evaluation, ChatQA2 demonstrated accuracy comparable to GPT-4-Turbo-2024-0409 and surp....