Google Gemma: Over 7 Billion Parameters with Unique Design Principles

Google introduces a new series of open-source models called "Gemma," which outperforms Llama 2 and Mistral with unique design principles. Gemma utilizes the GeGLU activation function and, despite its larger parameter size, can replace other open-source models, demonstrating significant potential.