2024-08-28 11:29:28.AIbase.11.3k
Cerebras Launches 'World's Fastest' AI Inference Service, Challenging Nvidia's Dominance
Cerebras Systems Inc. announced the launch of what it claims to be the 'world's fastest' AI inference service, challenging Nvidia Corp. The service aims to perform AI tasks at greater speed and lower cost. It is based on the WSE-3 processor, which has over 900,000 computing cores and 44GB of memory, with a core count 52 times that of Nvidia's H100. It claims an inference speed of up to 1,000 tokens per second, which is 20 times faster than Nvidia's comparable service, and offers a price-performance ratio 100 times better. The service is offered for free.