2024-07-24 09:40:45.AIbase.10.5k
Apple Research Team Presents: LazyLLM for Enhanced Long Text Reasoning Efficiency
Recently, Apple's research team and Meta AI researchers have jointly introduced a new technology called LazyLLM, which aims to enhance the efficiency of large language models (LLMs) in long-text reasoning.
As everyone knows, current LLMs often face slow processing speeds when dealing with long prompts, especially during the pre-filling phase. This is primarily due to the modern transformer architecture's computational complexity, which grows quadratically with the number of tokens in the prompt
