Llama-3 70B Instruct Gradient 1048k is an advanced language model developed by the Gradient AI team. By extending the context length to over 1048K, it demonstrates that SOTA (State of the Art) language models can learn to process long text after appropriate adjustments. The model employs NTK-aware interpolation and RingAttention technology, along with the EasyContext Blockwise RingAttention library, to efficiently train on high-performance computing clusters. It has widespread application potential in commercial and research applications, especially in scenarios requiring long text processing and generation.