Animate3D
3D Model Animation Generation
CommonProductImage[\3D Animation\\Multi-view Rendering\
Animate3D is an innovative framework for generating animations for any static 3D model. Its core ideas include two main parts: 1) Propose a new multi-view video diffusion model (MV-VDM) based on multi-view rendering of static 3D objects and trained on our large-scale multi-view video dataset (MV-Video). 2) Introduce a framework combining reconstruction and 4D score distillation sampling (4D-SDS) that utilizes multi-view video diffusion prior to animate 3D objects. Animate3D enhances spatial and temporal consistency through the design of new spatiotemporal attention modules, and maintains the identity of static 3D models through multi-view rendering. Additionally, Animate3D proposes an effective two-stage process for generating animations for 3D models: First, it directly reconstructs motion from the generated multi-view video, and then refines appearance and motion through the introduced 4D-SDS.