Recently, Roblox released a 3D intelligent foundation model called Cube, marking a significant step forward for game developers who can now leverage the power of artificial intelligence when designing game assets. Roblox has always encouraged users to create their own games, items, and clothing, and this process is now made simpler and more efficient.
Cube aims to provide developers with a powerful tool capable of generating various in-game experiences. Whether it's 3D objects, scene design, character modeling, or programming scripts, Cube can accomplish these tasks with simple instructions. For example, users can simply input a description, and Cube will generate a vivid 3D character or object. However, tests revealed that while Cube performs well with common objects, its performance is less impressive with more complex or unconventional requests.
Roblox's founder and CEO, David Baszucki, stated on social media that the model is designed as a collaborative assistant to help developers create Roblox experiences across the board. In the future, developers will not only be able to create unique 3D objects but also design complete scene layouts and interactive logic.
During the model's design, the Roblox team identified three core requirements: joint learning from sparse multimodal data, handling different input and output sizes, and the ability to collaborate with humans and other AI systems. While these goals are ambitious, their practical implementation requires a gradual approach.
Cube's core lies in the tokenization of 3D shapes. By converting geometric shapes into digital tokens, Roblox enables text-to-shape and shape-to-text conversion, leading to the generation of more complex 3D scenes. To optimize this process, the researchers also introduced a novel positional encoding technique to ensure high fidelity and reduce artifacts when generating complex shapes.
The launch of Cube is not only a significant step for Roblox towards 3D intelligent foundation models but also ushers in a new era of creation for game developers.
Project address: https://github.com/Roblox/cube