Musk Announces Launch of World's 'Strongest' AI Training Cluster with 100,000 H100 GPUs

AIbase基地

Published inAI News · 4 min read · Jul 23, 2024

Recently, Musk announced on the social platform X (formerly known as Twitter) that his company, xAI, is conducting training on the world's most powerful AI training cluster — the "Memphis Supercluster" located in Memphis, Tennessee. This cluster will be the largest capital investment in the city's history, attracting significant media attention.

According to local news reports, this supercluster is equipped with 100,000 liquid-cooled Nvidia H100 graphics processing units (GPUs). These chips, introduced last year, have seen high demand, with even competitor OpenAI using these devices. Musk also mentioned that the entire cluster utilizes a technology called "Remote Direct Memory Access" (RDMA), which enables efficient data transmission between computing nodes, reducing the burden on central processing units (CPUs).

The goal of xAI is to train the "most powerful AI" across all metrics by December 2024 using this supercluster. Musk emphasized in his replies that the Memphis Supercluster will provide a "significant advantage" for their goal. However, considering Musk's history of delays in multiple projects, many are cautious about the fulfillment of this promise.

In fact, xAI's competitors are not idle. Companies like OpenAI, Anthropic, Google, Microsoft, and Meta are all racing to launch more powerful and affordable large language models (LLMs) and small language models (SLMs). Therefore, xAI needs to introduce innovative and practical new models to stay competitive in the AI race.

Additionally, insiders revealed that Microsoft is collaborating with OpenAI CEO Sam Altman to develop a 100-billion-dollar AI training supercomputer with the code name "Stargate". If this plan progresses smoothly, xAI's Memphis Supercluster may not remain the world's most powerful for long.

Key Points:
🌟 xAI announces the launch of the world's most powerful AI training cluster, equipped with 100,000 Nvidia H100 GPUs.
⚡ Musk plans to train the "most powerful AI" by December 2024, stating that the cluster will provide a significant advantage.
🚀 xAI faces pressure from competitors such as OpenAI and Google, requiring the introduction of innovative models to maintain competitiveness.

Japanese Supermarkets Use AI to Monitor Employees' Smiles, Netizens Say It's Unnecessary

In today's pursuit of efficient and humanized management, Aeon, a large Japanese supermarket chain, has sparked widespread controversy by using AI technology to monitor employee smiles.On July 16, Yahoo Japan reported that Aeon has rolled out an AI system called "Smile-Kun" in 240 stores since July 1. This system analyzes employees' smiles and volume, providing real-time feedback to enhance customer service skills.The Smile-Kun system requires employees to greet it daily, then scores them based

Musk's xAI to Launch Grok 2 Next Month, Grok 3 Expected in December

Elon Musk recently announced in an interview with psychologist and author Jordan Peterson that xAI will release its latest artificial intelligence model, Grok2, next month.Musk stated that Grok2's performance is expected to be on par with GPT-4, having been trained on approximately 15,000 H100 GPUs. Meanwhile, the release of Grok3 is scheduled for December, which Musk claims will be the most powerful AI model.During the interview, Musk further revealed that Grok3 is currently being trained at th

Xiaohongshu Launches First 'AI Convenience Store' to Support Quality AI Notes with Traffic Boosts of 30,000 to 500,000

Recently, Xiaohongshu officially announced the launch of an intriguing tech account named "TechPotato," introducing its entrepreneurial project: the world's first AI-powered convenience store.According to official information, the "AI Convenience Store" is a collaboration between TechPotato and top authors across the web, along with renowned tech companies, to curate the most authentic and visually appealing AI-related content, which is then offered as "limited edition products" for continuous o

Microsoft Research Introduces AI Framework E5-V: Simplifying Multimodal Learning with Text Pair Unimodal Training to Reduce Costs

Recently, a research team from Microsoft Research and Beihang University has jointly introduced a novel framework called E5-V, aimed at providing a more efficient solution for multi-modal embeddings. With the continuous advancement of artificial intelligence, multi-modal large language models (MLLMs) have become a focal point of research, as they are capable of understanding both textual and visual information simultaneously, thereby better handling complex data relationships. However, effective