2025-04-07 09:20:30.AIbase.16.9k
Meta Accused of AI Model Double Standard: Maverick's Performance Varies Widely Between Evaluation and Public Versions
Meta released its new flagship AI model, Maverick, on Saturday. The model ranked second in the LM Arena benchmark. LM Arena is a testing platform that relies on human raters to compare different model outputs and select their preferences. However, several AI researchers quickly discovered that the version of Maverick deployed to LM Arena appears significantly different from the version widely used by developers. Meta acknowledged in its announcement that the Maverick on LM Arena is an experimental version.
