On January 15, 2025, MiniMax announced the open sourcing of its new series of models, MiniMax-01, which includes the foundational language model MiniMax-Text-01 and the visual multimodal model MiniMax-VL-01. The MiniMax-01 series features bold innovations in its architecture, implementing linear attention mechanisms on a large scale for the first time, breaking the limitations of traditional Transformer architectures. With a parameter count reaching 456 billion and 45.9 billion activations per instance, its overall performance competes with international standards.

Israeli AI company aiOla has released an open source speech recognition model named Whisper Medusa, which is based on an improved architecture design that incorporates multi-head attention mechanisms, allowing it to process speech 50% faster than OpenAI's Whisper model. Whisper Medusa makes parallel predictions of ten tokens instead of the traditional one at a time, significantly enhancing speech recognition speed while maintaining performance. Its innovative training method employs weak supervision, freezing the backbone system and utilizing...

Aishi Technology has launched PixVerse V2, an AI video generation tool designed to unleash user creativity. Utilizing a Diffusion+Transformer architecture with a spatiotemporal attention mechanism, it accurately understands and generates multimodal information, supporting efficient training and optimization. Key features include enhanced spatial and temporal perception, precise text alignment, and the ability to produce smooth, coherent video seg....