Search AI Products and News

Meta's open-source large language model, Llama-4-Maverick, has experienced a dramatic drop in LMArena rankings, plummeting from second place to 32nd. This significant shift has sparked widespread skepticism among developers, who suspect Meta may have manipulated the benchmark by submitting a specially optimized version. The issue stems from Meta's April 6th release of its latest large language model, Llama 4, encompassing three versions: Scout, Maverick, and Behemoth.

Meta released its new flagship AI model, Maverick, on Saturday. The model ranked second in the LM Arena benchmark. LM Arena is a testing platform that relies on human raters to compare different model outputs and select their preferences. However, several AI researchers quickly discovered that the version of Maverick deployed to LM Arena appears significantly different from the version widely used by developers. Meta acknowledged in its announcement that the Maverick on LM Arena is an experimental version.

Meta, the American tech giant, has released Llama 4, its most powerful open-source AI model. The initial release includes two models: Llama4Scout and Llama4Maverick. Llama4Scout boasts 109 billion parameters, 17 billion active parameters, and 16 experts. Its key feature is support for a 10 million context window, enabling processing of over 20 hours of video, all while running on a single H100 GPU (after Int4 quantization).