Mamba's New Architecture Challenges Transformer: Performance Surpasses All

Tencent's HunYuan InstantCharacter Open-Sourced: High Character Consistency, Customizable Poses, Styles, and Scenes

Yao Class Top Student, Shunyu Yao of OpenAI: AI Development Shifts from Model Innovation to Product Thinking

AI Video Generation Technology TTT: Generates One-Minute Complete Tom and Jerry Animations Directly, No Editing or Splicing Needed

A new research paper titled "One-Minute Video Generation with Test-Time Training" has been released, marking a significant advancement in AI video generation technology. This research successfully generates one-minute Tom and Jerry animations by introducing an innovative Test-Time Training (TTT) layer into a pre-trained Transformer model.

EasyControl: Empowering DiT Models with ControlNet-like Capabilities, Including Ghibli Style Transfer

In the field of AI art generation, diffusion models are transitioning from U-Net based architectures to Transformer-based architectures (DiT). However, the DiT ecosystem faces challenges in plugin support, efficiency, and multi-conditional control. Recently, a team led by Xiaojiu-z introduced EasyControl, an innovative framework designed to provide efficient and flexible conditional control capabilities for DiT models, effectively giving DiT models the power of ControlNet.

NVIDIA AI Researchers Introduce FFN Fusion Technology: Accelerating Large Language Model Inference

Tencent Releases the Official Version of HunYuan-T1 Large Language Model with Significantly Enhanced Reasoning Capabilities

Tencent recently released the official version of its HunYuan large language model series – HunYuan-T1. This new model, built upon the medium-scale HunYuan base model and extensively fine-tuned, demonstrates significantly improved reasoning capabilities, particularly excelling in deep thinking and complex problem-solving. Since the launch of the HunYuan T1-Preview in February, users have experienced faster and more insightful processing. The official release marks a significant upgrade to the product line. The HunYuan-T1 development team leveraged the latest Turbo...

Moore Threads Open-Sources Two Major AI Frameworks, Achieving Over 90% Training Efficiency on Domestic GPUs

Challenging Conventions: A Breakthrough Transformer Architecture Without Normalization Layers

In the field of deep learning, normalization layers are considered an indispensable component of modern neural networks. Recently, research led by Meta FAIR research scientist Zhuang Liu, titled "Transformer without Normalization Layers", has garnered significant attention. This research not only introduces a new technique called Dynamic Tanh (DyT), but also demonstrates the effectiveness of Transformer architectures even without traditional normalization layers.

Sesame Releases CSM Model: Real-time Emotion-Customized AI Speech Synthesis Reaches New Heights

On March 13th, Sesame unveiled its latest speech synthesis model, CSM, attracting significant industry attention. According to the official introduction, CSM adopts an end-to-end Transformer-based multimodal learning architecture. It understands contextual information to generate natural and emotionally rich speech with stunningly realistic sound. The model supports real-time speech generation, processing both text and audio inputs. Users can also control features such as tone, intonation, rhythm, and emotion by adjusting parameters, showcasing high flexibility. CSM is considered a breakthrough in AI speech technology.

Revolutionizing Long-Document Reasoning with APB: A 10x Speedup Over Flash Attention

Frustrated by the slow processing speed of large language models on long documents? Researchers from Tsinghua University have unveiled a groundbreaking technology – the APB parallel inference framework – that dramatically accelerates processing. Benchmark tests show this technology achieves a 10x speed improvement over Flash Attention when handling ultra-long texts. With the rise of models like ChatGPT, AI's ability to process vast amounts of text (hundreds of thousands of words) has increased significantly. However, this often comes at the cost of processing speed...