MikuDance
A blended motion dynamics character art animation generation tool based on diffusion.
CommonProductImageAnimationCharacter Art
MikuDance is a diffusion-based animation generation pipeline that combines blended motion dynamics to animate stylized character art. The technology addresses the challenges of high dynamic movement and reference guide misalignment in character art animations through two key techniques: blended motion modeling and mixed control diffusion. MikuDance explicitly models dynamic camera movements in pixel-level space using scene motion tracking strategies, achieving unified character-scene motion modeling. On this foundation, mixed control diffusion implicitly aligns different character scales and body types, allowing for flexible control of localized character movements. Additionally, a motion-adaptive normalization module is incorporated to effectively inject global scene movement, paving the way for comprehensive character art animation. Through extensive experiments, MikuDance demonstrates its effectiveness and generative capabilities across various character arts and motion guides, consistently producing high-quality animations with significant motion dynamics.