Although the Transformer model is powerful, its efficiency issue during decoding has always been a headache. However, researchers from the Korea Advanced Institute of Science and Technology, LG, and DeepMind have given us a surprise this time—they have proposed a new Transformer architecture called Block Transformer, which directly boosts decoding speed by 10 to 20 times! But how did they achieve this? It turns out that they "chunked" the attention mechanism of Transformer. This completely over