Oracle has announced the launch of the world's first Zettascale cloud computing cluster. This cluster is equipped with up to 131,072 NVIDIA Blackwell GPUs, capable of delivering a peak performance of up to 2.4 ZettaFLOPS. This powerful AI infrastructure enables enterprises to process large-scale AI workloads with greater flexibility and sovereignty. Oracle Cloud Infrastructure (OCI) integrates with NVIDIA's advanced GPU architecture.

With the rapid development of the global artificial intelligence market, Graphics Processing Units (GPUs) are essential as a core driving force for applications driven by large language models. In the coming years, GPU price volatility is expected to increase significantly, affecting companies' cost management. Traditionally, energy-intensive industries such as mining and logistics have been accustomed to cost fluctuations, while sectors like finance and pharmaceuticals need to adapt quickly. Nvidia, as a key supplier, has seen a surge in GPU demand and soaring valuations. The popularity of GPUs stems from their ability to handle vast amounts of computations in parallel, making them suitable for training and deploying large.

The rapid development of AI technology has propelled GPUs to become a hot commodity worldwide, with Nvidia reporting significant growth in the second quarter, exceeding $30 billion in revenue. However, powerful GPUs require adequate data centers to support the AI demand. Nvidia, along with partners, is investing $160 million in Applied Digital to expedite the construction of data centers in North Dakota, aiming to provide data center and cloud services around Nvidia's GPUs. The construction of data centers is crucial, as GPUs are expensive.

Elon Musk's xAI has announced the launch of an artificial intelligence training system named 'Colossus', powered by 100,000 Nvidia H100 GPUs, which is considered the most powerful AI training system globally. Its performance may even surpass that of the U.S. Department of Energy's Aurora supercomputer. The power of Colossus is largely attributed to Nvidia's H100 GPU, which operates language models at a speed 30 times faster than previous GPUs, especially in transformer-based tasks.

Elon Musk showcased the internal structure of Tesla's Cortex AI supercomputer cluster being built at the Austin headquarters, which is expected to require 130 megawatts of cooling and power upon launch, growing to 500 megawatts by 2026. The cluster contains 70,000 AI servers, primarily used to solve real-world AI issues, particularly for training Tesla's full self-driving system and the AI for the Optimus robot. Cortex will rely entirely on Nvidia's hardware at launch, while Tesla's own hardware is expected.

Geekbench AI is a new cross-platform tool designed to evaluate the performance of devices under compute-intensive workloads, with a particular focus on machine learning tasks. It provides full precision, half precision, and quantized scores by measuring the performance of CPUs, GPUs, and NPUs, and includes accuracy assessments. It supports various machine learning frameworks, including ONNX, CoreML, TensorFlow Lite, and OpenVINO. This tool is available on Windows, macOS, Linux, Android, and iOS.

The Transformer architecture, a star in the field of artificial intelligence, has led a revolution in natural language processing with its self-attention mechanism at its core. However, when handling long contexts, the resource consumption of self-attention calculations becomes a bottleneck. To address this issue, researchers have proposed the Tree Attention method, which decomposes the calculation tasks through tree reduction to improve efficiency. This method not only reduces communication overhead and memory usage but is also 8 times faster than existing methods in a multi-GPU environment. The introduction of Tree Attention not only enhances performance.

Google Cloud has collaborated with Y Combinator to offer AI startups $350,000 worth of cloud computing resources, including dedicated GPU/TPU clusters, for a period of two years. This initiative aims to foster AI innovation by prioritizing access to computing resources and facilitating one-on-one discussions with AI experts, helping startups tackle technical challenges and promote their growth. The partnership seeks to nurture future tech giants, with Google aiming to establish long-term relationships through early support. This collaboration not only addresses the computing resource needs of startups.

Oracle deepens its partnership with Nvidia by integrating Nvidia L40S and H100 Tensor Core GPUs into its cloud infrastructure (OCI) to provide AI acceleration services. The L40S GPU serves as a general-purpose AI accelerator suitable for inference, small model training, and graphics-intensive applications. The addition of the H100 GPU offers more flexibility for businesses of various sizes to leverage AI capabilities. Oracle has also optimized it....

AMD's Q2 sales show strong performance in the data center market, with Instinct MI300X GPU sales exceeding $1 billion and projected to generate over $4.5 billion in FY2024. Data center revenue rose 115% year-on-year to $2.8 billion, nearly half of total revenue. However, gaming revenue fell 59% due to decreased demand for Microsoft and Sony consoles. AMD expects continued decline in gaming revenue in Q3, but growth in data center and client produ....

Meta has trained its latest AI model, Llama 3.1, using 16,384 GPUs, showcasing the astonishing speed of AI technological advancement. However, during this process, an average of one failure occurs every 3 hours, totaling 419 failures, with approximately half related to the H100 GPUs and their HBM3 memory. This data reveals the reliability challenges faced by supercomputing systems in their pursuit of performance breakthroughs. The complexity of the Llama 3.1 training cluster is comparable to a small city's neural network, with frequent failures. The Meta team has implemented strategies such as reducing...

GPU cloud computing company Lambda has launched a 1-Click Cluster Service, allowing users to access Nvidia H100 GPUs and Quantum 2 InfiniBand clusters on demand, especially suitable for companies needing GPU compute power for short-term projects. This innovative service simplifies the coordination of hardware and software, with no long-term contracts required; users simply reserve when needed, with a minimum reservation time of two weeks. Founded in 2012, Lambda recently raised $320 million, valuing the company at $1.5 billion, indicating strong market demand for its services.

Intel recently announced the beta release of its AI open-source software AI Playground for Arc graphics card users. This move marks another significant step in Intel's AI strategy, providing users with a new platform to explore and harness AI technology. AI Playground is a completely free software designed specifically for users with Intel Arc graphics cards. Whether using devices with Intel Meteor Lake Core Ultra-H processors or systems equipped with at least 8GB of memory in Intel Arc discrete

In the semiconductor industry, AMD recently announced a significant development: Victor Peng, the company's president, will retire next month. As a pivotal figure in AMD's AI strategy, Peng's departure is sure to garner widespread attention within the industry.Since joining AMD in 2022, Victor Peng has been instrumental in driving the company's growth. Prior to AMD, he served as the president and CEO of Xilinx, a programmable chip design company, leading it for four years. Earlier, he had also w

Recently, Musk announced on the social platform X (formerly known as Twitter) that his company, xAI, is conducting training on the world's most powerful AI training cluster — the "Memphis Supercluster" located in Memphis, Tennessee. This cluster will be the largest capital investment in the city's history, attracting significant media attention. According to local news reports, this supercluster is equipped with 100,000 liquid-cooled Nvidia H100 graphics processing units (GPUs). These chips, in

On July 9th, Musk announced that his artificial intelligence company xAI is building a supercomputer with 100,000 NVIDIA H100 GPUs, expected to be delivered and begin training by the end of this month. This move marks the termination of xAI's negotiations with Oracle to expand the existing agreement and rent more NVIDIA chips. Musk emphasized that this will become "the most powerful training cluster globally with a significant lead." He said that the core competitive edge of xAI lies in speed, "

Elon Musk recently announced that his artificial intelligence startup, xAI, is set to launch its revolutionary large language model, Grok-2, in August, signaling the arrival of more advanced AI capabilities. Although Grok-2 has not yet been fully unveiled, Musk is already excitedly hyping up the upcoming masterpiece, Grok-3. When discussing AI development, Musk particularly emphasized the importance of datasets and the arduous task of cleaning data for large language models (LMMs). He also did n

Meta has released two 24K H100 GPU clusters for training Llama-3. Llama-3 utilizes RoCEv2 networking and Tectonic/Hammerspace's NFS/FUSE network storage. It is expected that Llama-3 will go live by the end of April or mid-May, possibly as a multimodal model and will continue to be open-sourced. Meta plans to have 600,000 H100 computing power by the end of 2024.

Consumer GPU shipments grew 32% year-over-year, reaching 9.5 million units. AI PCs are not the primary factor driving the sales growth of GPUs. AMD saw the largest growth in the holiday quarter, while Nvidia maintains market dominance. Analysts expect the market to remain stable, with Nvidia and AMD launching new GPUs.