Researchers Discover an Energy-Efficient Method for Training Large Language Models, Reducing Energy Consumption by 30%

AIbase基地

Published inAI News · 3 min read · Nov 8, 2024

122

A recent study from the University of Michigan has discovered an energy-efficient method for training large language models that can achieve the same results in the same amount of time while reducing energy consumption by 30%. This method could save enough energy to power 1.1 million American households by 2026.

Researchers have developed a software tool named Perseus, which identifies the critical path—a series of sub-tasks that take the longest to complete. Perseus then reduces the processor speed on non-critical paths so that all tasks can be completed simultaneously, eliminating unnecessary power consumption.

Robot AI

The team tested Perseus by training GPT-3, three other large language models, and a computer vision model. The results showed that Perseus can reduce the energy consumption of AI training while maintaining the same training speed.

Researchers emphasize that this energy-saving method is crucial for equitable access to artificial intelligence. If a country lacks sufficient electricity to run large models, they may need to use remote services or operate smaller, less accurate models. This gap could further exacerbate disparities between different communities.

The study demonstrates that optimizing AI training methods can reduce energy consumption while maintaining the same training speed, which is significant for energy conservation and reducing carbon footprints.

ZhiYuan and Tencent Launch Long Text Understanding Benchmark Model LongBench v2

On December 19, 2024, at a press conference, ZhiYuan Research Institute and Tencent announced the launch of LongBench v2, a benchmark designed to evaluate the deep understanding and reasoning capabilities of large language models (LLMs) in real-world long text multi-task scenarios. The platform aims to advance long text models in understanding and reasoning, addressing the current challenges faced by large language models in practical applications.

AI Unicorn Cohere Deeply Collaborates with Palantir: Enterprise-level AI Applications Emerge

As one of the most watched AI startups outside of OpenAI and Anthropic, Cohere was valued at $5.5 billion in July. One of the company's co-founders is an author of the paper 'Attention Is All You Need,' which is considered critical to sparking the revolution of large language models (LLMs). Headquartered in Toronto and San Francisco, Cohere focuses on providing AI solutions for enterprise clients, rather than pursuing a similar path as other companies.

Meta Launches 'Large Concept Models' (LCMs)! Breaking Through LLM Limitations and Leading a New Direction in AI Language Understanding

Large Language Models (LLMs) have made significant progress in the field of Natural Language Processing (NLP), shining in applications such as text generation, summarization, and question answering. However, the reliance of LLMs on token-level processing (predicting one word at a time) presents some challenges. This method contrasts with human communication, which typically operates at higher levels of abstraction, such as sentences or ideas. Token-level modeling also struggles in tasks that require understanding long contexts and may produce inconsistent outputs.

Meta AI Launches Conceptual Model: A Breakthrough Beyond Traditional Language Models

In recent years, large language models (LLMs) have made significant progress in the field of natural language processing (NLP), widely applicable in scenarios such as text generation, summarization, and question answering. However, these models rely on a token-level processing method that predicts word by word, which struggles with contextual understanding and often leads to inconsistent outputs. Moreover, when scaling LLMs to multilingual and multimodal applications, the computational costs and data requirements tend to be relatively high. To address these issues, Meta AI has proposed a novel approach.