On February 14, 2025, Kunlun Wanwei Group officially launched the Matrix-Zero world model, marking an important step for China in the field of spatial intelligence. Matrix-Zero includes two sub-models: a large model for 3D scene generation and a large model for interactive video generation, aiming to reshape digital content creation through AI technology and promote innovative development in industries such as film production, game development, and embodied intelligence.
The 3D scene generation model of Matrix-Zero can transform user-input images into freely explorable real 3D scenes, supporting different styles of image input and style transfer, and has the capability to generate dynamic scenes. This model combines scene layout generation and texture generation modules, along with differentiable rendering and diffusion model technology, to ensure that the generated 3D scenes are globally consistent and dynamically reasonable, providing an efficient solution for 3D game modeling and embodied intelligence simulation. For example, inputting an image of "a corner of a castle garden" allows the model to create a 360-degree view of the scene while keeping it unchanged, enabling users to freely explore over long distances and large areas.
At the same time, the interactive video generation model of Matrix-Zero is driven by user input, combining advanced generative video models with self-developed user interaction modules to achieve precise control over the movement of perspectives within video content. Users can control the perspective and motion trajectory in the video through keyboard or mouse input, allowing for movements such as moving forward, backward, left, right, and changing perspectives. This model includes discrete motion control modules, continuous perspective control modules, 3D scene position tracking modules, and a sliding window mechanism to ensure a smooth and coherent interactive experience.
As a leading company in China's AI field, Kunlun Wanwei is committed to achieving general artificial intelligence and continuously launching innovative AI products through independent research and development. The launch of Matrix-Zero is not only a significant breakthrough for the company in the field of spatial intelligence but also an important addition to its AI business matrix. Over the past three years, Kunlun Wanwei has achieved remarkable results in key technology areas such as visual multimodal and deep learning, and has built a complete AI matrix that includes TianGong AI Search, Mureka music creation platform, SkyReels short drama platform, and more.
Matrix-Zero is expected to officially launch in April, bringing new capabilities to Kunlun Wanwei's AI game production and AI short drama production businesses, and providing users and developers with a new platform and tools.
