Google introduces a new series of open-source models called "Gemma," which outperforms Llama 2 and Mistral with unique design principles. Gemma utilizes the GeGLU activation function and, despite its larger parameter size, can replace other open-source models, demonstrating significant potential.
Google Gemma: Over 7 Billion Parameters with Unique Design Principles

机器之心
This article is from AIbase Daily
Welcome to the [AI Daily] column! This is your daily guide to exploring the world of artificial intelligence. Every day, we present you with hot topics in the AI field, focusing on developers, helping you understand technical trends, and learning about innovative AI product applications.